You can remove an add-on from your community at any time and add a new one by informing us at the register.  The cost to demolish a building and dismiss a worker 300 points / the level of your community.  You will see that the cost diminishes as your community grows in size.