Would anyone have an idea as to why it would drop large portions of text as pointed out in the article? Would this be a context window issue? Overall very interesting analysis, thank you!!! (I also thought the comparison to the authors bird and wanting to invent conditions to be rewarded to be both funny and intriguing).

Maybe try something like "here are the differences between v1 and v2 .mdx. Write a script to convert." Or create a script that checks the file and sends any errors to GPT-4 with instructions to write a new correct file or call editing/diff function.