Managed to remove them by placing other plants and shells on them. The remove tool worked on some after the procedure and others were replaced by the shells. Took multiple tries on some. One (The anemone to the right) Needed to be mowed over with rock. I had displaced the anemone earlier. So might be because of that.