I was an early adopter of Jellyfin and love it - but personally prefer Navidrome for my music server. Granted, I haven't looked at the music capabilities of Jellyfin in a long while, because I've been running Navidrome.
Symphonium android client is my recommendation for that (and I believe it also works for Jellyfin) but there are others.
My pipeline is essentially as you describe though Lidarr --> nzbget --> Navidrome
Hey OP I just realized I should have linked the very tiny (so far no one but me posts there) kbin magazine I mod which is intended to more or less collect songs such as you describe. For each post I've included the lyrics.
I'm not sure how to link it that it will clickable on Lemmy, but it's:
I have been slowly dipping my toes in Brother Ali the past few months, and recently listened to this for the first time. His voice is awesome but some of the words may be a little hard to catch. It's worth looking up the lyrics.