The land has changed hands several times, but now the new owners plan to build a retirement complex with hundreds of apartments.