St Helier House will be sold to a private developer.
Parishioners have narrowly voted through the £2.9 million pound deal for the former care home, despite opposition from the Housing Minister.
Senator Sam Mezec had urged ratepayers to block the bid amid concerns the site might be over-developed and the homes sold to foreign buy-to-let-investors.
Town Constable Simon Crowcroft called it 'paranoia'.
"People have assumed on social media that there is going to be tiny, luxury flats created on the site, and that is to completely ignore the fact that we have a planning policy, we have an application process, and I don't believe that Planning would allow something to be built on the site that would produce cramped accommodation."
Constable Crowcroft has said that some of the profit from the sale will be used to relocate Westmount Day Nursery as soon as possible.
The vote taken at last night's Parish Assembly was 48 in favour, 43 against of the offer from property firm Columbia Group.
But a late change to the proposal demands that the parish negotiates a betterment clause to restrict the new owner's future profits from the site.
St Helier House closed at the end of 2017 after it was found to have the same cladding as Grenfell Tower.

Number portability issue between Coop Mobile and JT resolved
Former teacher jailed and placed on Sex Offenders register
Opponents ask if St Mary solar plans have been 'abandoned'
Jersey takes step closer to protecting whistleblowers
Tickets on sale for women's Muratti
New 'competitiveness' plan to protect Jersey's £3bn financial sector
Fines for 'Jersey Lifts' drivers a step closer?
£225K grant given for clinical trial into heart failure