I didn't see the fun in many subjects either, and got appropriately poor grades that reflected my level of knowledge or skill.

For PE we had normatives we were supposed to meet -- so many pullups, etc (based on old soviet army normatives I think :)), and if you don't you got corresponding grade.

I would make sense to break PE course into two -- one about theory and one about skill and have two separate grades for them.