Lidarr doesn’t need your whole library, just what you need to download. You can add your local music to Jellyfin alongside anything you get from -Arr services.
I know when I’ve used Sonarr it’s also managed to parse my local library when I’ve added a series I’ve already downloaded to look for future episodes.