We literally designed, planned, and engineered the environment and mechanisms which created those weights.

It’s just code. We can train models by hand too, it’d just take a lot longer.

It’s literally something we made, just from a higher order place.

To understand which exact weights correspond to what output will vary from model to model. There is research going into this subject for llama.

it’s not like we’re in the dark as to the principles that allow LLMs to make predictions.

My whole point is that to say “we don’t know how AI works” is just not true