Then closer the buffer. I've only opened it by accident. To use Vim I can't "disable" modes and only into modes by accident, I am forced to use them.

So no, emacs is not modal like Vim. But good try, good try...

Besides, why not use speedbar, that opens a nice directory browser and you can open files by clicking on them.