Not really. It’s noticeable over Bluetooth as well, if your device supports codecs with a high enough bitrate. Obviously Bluetooth is still lossy, but listening experience is way better. The headphones I’m wearing now use aptxHD, with a bitrate of 576kbps. Spotify only offers AAC, with a bitrate of 256kbps.
As far as who can appreciate the difference, I guess? But you don’t need to be a concert pianist to appreciate audio. That said, I play many instruments, so maybe I’m biased.