You can soft block a user on Twitter by blocking and then unblocking them to remove them as a follower.
If you don't want people to know you're calling, you can hide caller ID by blocking your own number on both landlines and smartphones.