William Whitley House State Historic Site is one of the first brick house west of the Allegheny Mountains. The estate, named Sportsman's Hill, was home to William and Esther Whitley and had the first circular racetrack to run counter-clockwise in the United States.
The Whitley family was one of the first families to settle in frontier Kentucky in the 1770s. William Whitley would serve with George Rogers Clark, Captain John Montgomery, and later under Kentucky's first governor, Isaac Shelby, as a major in the 6th Regiment of the Kentucky militia. Whitley also served in Kentucky's House of Representatives and volunteered in the Kentucky Mounted Infantry during the War of 1812.