Cape May Court House was laid out in 1703 by Jeremiah Hand and was first called Rumney Marsh and afterward Middleton before the adoption of its present name. The Court of Cape May County met in private homes and the First Baptist Church until 1764, when Daniel Hand set 1 acre of his own property to construct a court house and jail. It was replaced by the current structure in 1849.