I handle this by firing up a Fargate instance with a Docker container pre-configured for VSCode Remote SSH. Then once you connect to it, you can install whatever language server you want assuming it's not baked into the Docker image. An EFS mount persists my sources across runs too, and I can scale it up to whatever size Fargate instance my development of the day needs.

Would be cool to tie it into this.