Over the years, Holt House has come to be associated with Presidents John Quincy Adams, Andrew Jackson, and Martin Van Buren, but no substantial evidence has been uncovered to support these claims. Since 1891, it has served as the administrative headquarters for the National Zoological Park. The Holt House is generally assumed to have been built in 1805; however, the earliest construction date that can be confirmed is 1827.
The first mention of the house in any official records is a reference to the building in the 1831 will of Roger Johnson. The Johnson family owned the property from 1809 to 1835. The tract of land upon which the house stands was originally called "Pretty Prospect," but came to be known as "Jackson Hill" by 1841.
DC Inventory: November 8, 1964 (Joint Committee on Landmarks)
National Register: April 24, 1973