This is not true. Only the land is owned by the sovereign. You can remove almost anything you can including your house on any piece of land before or when the government invokes its right of eminent domain. You could probably remove the topsoil as well.

TEK