Thanks for this feedback, it helps me feel a little bit less stupid :) With everything setup in NixOS documentation for neovim in appearance I thought really dumb to not be able to have it worked.
Using the approach proposed by @flashgnash (i.e. using lazy.vim) let me install neovim and all my plugins.