I think you discount the value of the other 99%. Those scientists were able to commute to work because some guys with shovels made a usable roadway, some other girls worked an oil rig to extract what would become fuel, yet another group of people made the street signals, and some teenage kid with very little skill at all made them a burrito for lunch so they could get back to sciencing.
Not everyone is a brilliant scientist, but every brilliant scientist relies on the rest of the collected mass of humanity to make it through their day.
Yeah absolutely you need a society. But now you're into the realm of arguing by degree of contribution to some effort. At that point there are probably more plants, bacteria and fungi by number of individual organisms or biomass I would like to thank for my accomplishments in life. But hey who the hell thinks that way? Im almost certainly more thankful to my local trees than I am road workers in Australia living in the UK.
Not everyone is a brilliant scientist, but every brilliant scientist relies on the rest of the collected mass of humanity to make it through their day.