But if you're there, you're working. You can't spend that time out at a stadium watching a ballgame, or hiking through a forest, or catching up with old friends over coffee, or fixing that stubborn door on your house, or with your family. You're at work, in work mode and your time and energy are alloted to that.
If you work for an agency, and sales is having a tough time closing a deal so there's no work for you today, but you have to be there anyway, ready to work or finding other things to do, maybe upgrading your tools, practicing/learning, then that's still work time. It's not leisure time.
Just because you don't achieve 100% uptime cranking out widgets non-stop at full productivity doesn't mean you're not working. We're people, not industrial factory machines.
You can say 'people are pretending' or 'that's not actually work', but it is. And saying that it's not is just denying reality by casting a moral judgment on it like that.