Don't let people decide if your other things are actually "better things to do", certainly not a boss, they're hardly objective. Simply state that like work, they are obligations you can't miss. I frequently have artistic obligations in the evening, and I make sure everyone knows they are unbreakable.