More often than not, people want build artifacts in the same security profile / performance profile as their CI/CD pipelines. Think of this more as services to support your GitHub Action workflows - where inter-service bandwidth is free and highly performant.
Disclosure: I work at Azure.