The History of the Several Towns, Manors, and Patents of the County of Westchester (1881 revised edition, Vol. I)
The old Brown mansion which was erected before 1750, and occupied the site of the present shed on the opposite side of the road facing the residence of Mr. Wakeman Wood, was removed sometime in November, 1836. In this house, Washington and staff took dinner on one occasion during the Revolutionary war." Tower Hill, one of the old family slaves who lived to a great age, but was at last frozen to death during the heavy Christmas snow storm of 181 1, lies buried on the spot named after him by the side of his ancient comrades Cato, Lucas and Dyar. Obediah was fond of relating stories of his master's family, and telling how deer, bear, wolves and other game once abounded in the neighborhood of Cross Pond, and especially wild geese which he had frequently shot in the marshy grounds, directly in front of the residence of Mr. Gardiner J. Kellogg. At this early period " the old cart path " leading from Ridgefield to Salem, was marked by notched trees.
Mary Brown, the sister of James, married Samuel Isaacs, Esq., of Norwalk, Conn., and died at Salem, November 26, 1801, aged seventynine, or eighty-one,d leaving two sons, Isaac Isaacs, who died at Salem, Oct. 2, 1820, and Samuel Brown Isaacs, Esq., who succeeded his uncle James Brown, Esq., in all his rights, titles and interest in Lower Salem, which is said to have amounted to five hundred acres of land. Upon the 2ist of June, 1788, we find his relatives conveying to him much of the real estate of his late uncle, besides what his mother and other near relatives had already granted, etc.