Yeah, phrasal verbs (verb-particle combinations) are almost entirely idiomatic. At least as a non-native learner, I've found it best to memorize them as units and not to even think about what the adposition would mean affixed to a noun, and that's how they were taught as well.