The late antiquarian would buy houses on a whim and sell them just as fast. But he held on to his first love on West 24th.