Gentoo: I hated constantly compiling and configuring. It was incredibly time consuming. If I was compiling for uncommon cases it might make sense, but I am dealing with a pretty standard dev machine.
NixOS: The configuration is kind of a pain and never really got the extra features you get beyond package management working correctly.