Behind the granite wall stretched Peter Smith's estate, "Forest Hill", 1848-1849 until its1948 demolition. The 1870 tax list identifies the main house, a stable, two greenhouses, a farmhouse, two barns and other buildings on 41 1/2 acres. A servant's house at #63 Shawsheen Road was re-oriented to #6 Smithshire Estates and two barns were converted to residence at #5 Smithshire Estates and #69 Shawsheen Road. A map #2807 at the Registry of Deeds, Estate of Esther W. Smith April 1953 - Oct. 1953 shows the three structures in their original locations.

Peter Smith (1802-1880) joined his brother John Smith in in Plymouth, MA in 1822 then came to Andover in 1824 to set up the John Smith Co., makers of cotton machinery in Frye Village. Family friend John Dove, also of Brechin, Scotland arrived in 1833 and they established a flax manufacturing plant across the river from the machine shop under the name Smith & Dove Co., the first flax production company in America. Its success lead to expansion up-river to Abbott Village in 1843. As the Smith's financial success increased so did their generosity to the community. The first generation contributed to the Memorial Hall Library building and more recent descendants have donated to the West Parish Church and the Andover Historical Society.

Peter Smith's new home Forest Hill was built in 1848-1849 on the former Alexander Winning farm of 26 acres with a dwelling house and barn.
Street numbers were changed after WWII and again in 1958. This former barn was number #59 when converted into a home about 1930 by Esther Ward Smith, granddaughter of Peter Smith, daughter of Peter Dove & Abby (Chandler) Smith. Esther, with her two sisters Elizabeth Miller Smith and Mary Churchill inherited Forest Hill after their mother Abby died in 1921. In 1923 Esther took control of the estate and moved into the former Gardner's Cottage at 63 Shawsheen Rd. The main house was too large to maintain and too big for a single woman. Esther lived there until her death on Oct. 15, 1952.

In the 1931 street directory Edward R. Hale, age 46, a lawyer, wife Ethel M age 43 and a maid Margaret Willis, age 46, are listed here at #59.