> Edit: Maybe what we really need to worry about is an AI developing charisma....

That is the most immediate worry, by a wide margin. It seems to be dangerously charismatic even before it got any recognizable amount of "intelligence".