Built about 1863, the cabin was the homestead of Henry Green Madison (1843-1912). Madison was a Unionist, president of the Austin chapter of the Union League, and an active participant in Reconstruction. Madison is notable for being Austin’s first African American City Council member from 1871 to 1872. He later served as a policeman and farmer. Madison and his wife Louise had eight children.
The log structure was donated to the city of Austin in 1968 by Mrs. Ninabelle Wooten, dismantled and reassembled in Rosewood Park in 1973 as an exhibit dedicated to the black heritage of the city.