The only time I ever would’ve preferred silence to some background noise was when I was at a scout camp along the banks of a river and the cacophony of frogs and crickets at night was super fucking loud. I barely slept the whole time I was there.
Other than that, I always put on some kind of ambient sounds or yoga music.