The work is the problem, or should I say, jobs - not the activities. The problem is with people being forced to spend most of their lives fighting for survival. In the past it was toiling in the fields 3/4 of the year to have anything to eat. Today it's toiling in factories and offices to have money to pay for the house, food and medical care. The less time is spent on that, for the same level of quality-of-life, the better.
While I agree in principle, I don't think many humans are capable of what you want. Without a desperate need to work, most people don't seem to bother doing much even it that would give them great satisfaction. Just look at almost every unemployed person who has a place to live and food to eat but nothing to do all day. Why aren't they spending their plentiful time on high quality of life activities?
This might be hard to imagine if you're well educated, already working, and in your 20's and the world seems full of excitement and opportunity but you're held back by the annoying need to pay your bills. If you didn't have to work, you might start a business or spend all day on your side project or whatever. But most people aren't in that position. Often, their only sense of fulfillment comes from their work no matter how unpleasant it is, and they only work because they have to to survive.
