I asked a similar question and I was lead to this post.
I got side tracked and eventually lost motivation to get it working. I might give it another try in the new year. Hopefully this is what you are looking for. I assume your distribution is using PipeWire, otherwise you may have to look into HRIR for PulseAudio.