You can remove followers on Facebook by changing your follower settings. You can also block or add followers to a restricted list.
You can easily unblock someone on Facebook Messenger in the "People" preferences section of the app. Here's how to do it.