I did this for a while, and only switched back to Jellyfin/Finamp while degoogling (needed for paid version). I thought it was definitely worth it while I was using it. I also listen to music on the TV and Jellyfin handles it better than other options I tried (including side-loading symfonium).

I currently use a separate music library manager on my server to organize my music collection, then Jellyfin just does the server work.

I think you’ll be very happy with the setup you are using.