It's not a bug, just an odd convention, like using Enter to rename files in Finder.

Space = focused button, Enter = default button. When a dialog is shown, the focus is never on the default button, so there are always two choices that you can make (Space/Enter) without using the mouse or the tab key at all.