According to Department of Buildings records, Madison Realty Capital wants to tear down a 172-year-old property that was once home to Civil War generals, Oscar-winning actors, inventors, and politicians.