You can learn a lot of that kind of thing from reading app notes and data sheets carefully when you're starting out. For analog, the old applications handbooks from National, Burr-Brown, Analog, Linear, etc. are all available scanned to pdf if you look for them.
Got it. Now that you said, I did remember reading a few app notes. There was one written by TI regarding ALL their chip X (IIRC it's a RAM chip) that did speak about how to protect the Vcc by connecting a capacitor as a best practice.
Thanks! Yeah I probably should read more of those app notes. I'm mostly interested in digital though.