Yes, for me physical notebooks are the best solution as well. A notebook and a pen goes everywhere with me (e.g. I don't leave it in the office). It's not that inconvenient. No battery to keep charged, worrying about breaking the screen, etc.

For the rare occasions I don't happen to have it at hand, it's easy to scavenge a scrap of paper to scribble things down and then later glue into the notebook.