Holmes first came to Tarrytown in 1833 he found no place of worship of his own Church nearer than several miles from the village ; he referred to his Bishop for authority to lay-read and procure a place in which to do it, accordingly he applied to the trustees of the Methodist church for the occasional use of the building, which was readily granted -- and here service was held in the afternoons of Sunday. The Rev. Dr. Creighton officiated in the absence of Mr. Holmes, and here they laid the foundation of their church and Sunday school. At this time there was no other church in the place except the old Dutch church in Sleepy Hollow.

In the year 1842, the name of Tarrytown as a separate charge first appears in the minutes of the Conference. In the year 1843, Pleasantville was separated from Tarrytown. In 1837, the increased prosperity of the church, demanded a new and more suitable edifice. Accordingly, a site was purchased from Dr. Josh Scribner, in Washington Street. The corner-stone was laid April 17,, 1837. The dimensions of the building were 40 x 60, and the cost $5,394. The church was dedicated, and two years after the whole church debt cancelled. And so, after an occupation of about thirty years, the old church was forsaken, ^nd has been converted into a dwelling.

A curious entry is found in the old Trustee minutes, in which it is ordered, that "hereafter, (1840) the males and females should enter the church by separate doors, and sit on the opposite sides of the aisles, and that the seats under the gallery be assigned to the colored members.'' These regulations were posted in the vestibule of the church. The parsonage was built on a lot directly north of the church in 1854, at a cost of $4,800.