> Maybe it’d be easier if we could upload our own ‘sequential program’ to a little CPU inside the GPU that would be code making calls to the real GPU.

This is effectively what Command Lists/Buffers are in Direct3D 12 or Vulkan.