The settlement of the Gabriel Mills community, later known as Mather’s Mill and Brizendine Mill, began in 1849 with early pioneers including the Mathers, Brizendines, and Bitticks. The Mount Horeb Methodist Church was constructed in 1854 on land originally provided by Williamson County pioneer Samuel Mather. German craftsman William Scheyli designed and built the church in an oak grove on a river bluff around 1860. The community thrived for decades until the railroad bypassed the area, leading to population decline. By the 1920s the town had largely disappeared, and the church relocated to nearby Mahomet around 1922.

Mount Horeb Cemetery, located along the western side of CR 236 near Liberty Hill, has long been entangled with neighboring family plots including Rhodes, Mather, and Brizendine cemeteries, causing significant historical confusion over names and boundaries.

In 1900, J.R. Brizendine deeded roughly six acres for use as a graveyard while reserving a half-acre private family plot. The current Mount Horeb Cemetery contains about 29 burials, beginning with Vina Missouri J. (Culpepper) Favors in 1889 and most recently including John T. King in 2021. It holds graves of interconnected families such as the Favors, Culpeppers, Joneses, Grizzles, Curtises, and Daytons, along with craftsman William Scheyli. The site features distinctive hand-carved sandstone folk markers alongside modern marble and granite stones, including two undated gravestones possibly linked to Hispanic individuals named Mary Loma and Mary Tomas.