Not really. By the time Apollo came around, erasing the nation on the other side of the world was pretty much a solved problem. 400,000 people were employed on Apollo and they weren't military (well, a few were) and were not thinking about nuclear weapons.
Even Space Shuttle later was driven (and funded) heavily by military applications, a lot of Apollo funding came from wish of improving missile guidance systems as well.
You're trying to make a distinction where there is none - it's the same bag of money. Which also why the money quickly dried up when rocket guidance, indeed, became a solved problem. Before Apollo was finished.