Interesting. My experience was similar when, after years of playing competitively at club level, I decided to give up because I felt I couldn't progress further without devoting several hours a day.

For me it was more because I found chess to be such a demanding game. One can play well for hours (in a serious match) making many good moves only to have it all thrown away by one slip of concentration.