Yup, something like that. I also write the intent of the app and that gives them a line of attack. "Easy to use tool? This is NO WAY easy to use! I ripped out my hair to understand feature X"
In the HIT form, I give them a nice big text box to write their comments. Then I ask them some specific questions and give them radio buttons / check boxes to reply with. They've told me stuff that I would have otherwise never imagined.
