The interviews are:
"Mark Zuckerberg - Llama 3, $10B Models, Caesar Augustus, & 1 GW Datacenters": https://www.youtube.com/watch?v=bc6uFV9CJGg
"Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI | Lex Fridman Podcast #416 ": https://www.youtube.com/watch?v=5t1vTLU7s40
The total FLOPS used in training is in bunch of places, I can't find a good link at the moment.
https://www.dwarkeshpatel.com/p/mark-zuckerberg