Surprisingly enough, for most issues (barring such situations as the wings literally falling off ;)), it's safer to get in the air to buy yourself some time for analyzing the situation and deciding (even if it's "go around for an emergency landing") than trying to decide during takeoff.
It's not too unusual for pilots to turn a minor problem into a major one by trying to fix the minor problem too aggressively. A cargo door opening would be a good example of this. It doesn't threaten the aircraft, so it should be ignored until the situation is calm enough that your attention isn't needed elsewhere. Prioritizing problems like this is a big part of pilot training.
It's a little bit like spilling your coffee while merging onto an interstate in a car. Slamming on your brakes so you can take care of your coffee will likely make things worse. Instead, merge, get stabilized, then figure out what to do with the coffee.