I'm using Linux as my desktop system (including for gaming) and drivers situation feels OK. Unless you use some really weird hardware, Linux drivers aren't usually a problem. Especially with Intel being pretty open and AMD opening things up (GPU wise), it's getting even better.