The History of the Several Towns, Manors, and Patents of the County of Westchester (1881 revised edition, Vol. I)
The organ presented by the ladies of the parish in 1849, was also built by the Messrs. Holbrook & Co., and cost twelve hundred dollars. The corner stone of this edifice, which was organized under the title of St. Paul's church, in 1829, was laid by Bishop Onderdonk in 1838; and upon Saturday, June 1 6th, of that year, it was consecrated and set apart to the worship and service of Almighty God, under the title of "St, Peter's chapel, &c," by the same Prelate.
The site of this church was formerly occupied by the military magazine, destroyed by the British army in 1777. Large quantities of grape shot have been found in the immediate vicinity. Adjoining the building on the south, is situated the family vault of the late Ward B. Howard, Esq., at one time president of the village corporation, in which repose the mortal remains of himself and wife Lucia, daughter of the late Hon. Robert Johnston, who died Mar. 8th, 1834. Also the remains of their nephew, William J. Mitchell, Esq., who was unfortunately killed by the explosion of the steamer General Jackson, off Verplanck's Point, June 7th, 183 r.
The church was first incorporated 19th July, 1838, under the title of the "Wardens and Vestrymen of St. Peter's chapel, in the village of Peekskill," on which occasion Pierre Van Cortlandt and Samuel Marks, were elected wardens, and Daniel D. Smith, Samuel T. Wood, John Collett, Elihu E. Baker, Alex Fairly, Wm. B. Birdsall, Nicholas Cruger and Isaac Seymour, vestrymen.0