If they have evidence that a person in your position should reasonably know the answer, then you're in a bad situation. "I don't recall" doesn't fly very well unless you're HRC being interviewed by the FBI

In the general case, maybe. The objection here is specifically over providing non-public testimony. Even if your secret testimony didn't cover anything new or wasn't useful, how do other people know that?