I actually approve this argument. My personal experience also shows that usability testing can be done with very few people at a time, over many iterations.
Obviously, this is not a universal rule. It's useful for practical usability testing, but not for testing all cognitive processes.
Perhaps, if the variations are small enough, it may be sufficient.