As she should. Trust but verify. The biggest question is what will this be applied to. Without it we can't really discuss approaches towards developing that trust.
I'd consider The ability to output a rationalization in human understandable text (ie: english in my case) will determine success /failure.
I'd consider The ability to output a rationalization in human understandable text (ie: english in my case) will determine success /failure.