The councillor has said there has been a "bit of nonsense" surrounding the controversial Oxfordshire car park to housing scheme.