Ancient Geeks knew about and drank milk. It's literally mentioned in Homer's The Odyssey, where Odysseus takes milk on one of his quests. Cheese is also mentioned, multiple times.