You can unblock someone on the Instagram app from Settings or their profile, and they won't be notified.
It's easy to follow people on Apple Music by setting up an account and searching for people on your profile page.