It’s almost completely the opposite, drivers are (almost completely) a windows problem. If you’re willing and able to go the open source route, which for most people mean “I don’t have an NVIDIA card or don’t plan on getting every ounce of performance from it” you don’t need to worry about drivers at all (bar some weird cards, but they’re getting rarer and rarer, I don’t remember the last time I had to install a driver that wasn’t NVIDIA).