The home of an African dictator and a sporting hero, and the facility that held apartheid's greatest critic are abandoned, but still have unique stories to tell