There's a shell script version of GNU parallel that's great for CI/CD pipeline tasks. You just keep it in your repo and source it as needed. It's incredibly useful, we use it in one build to batch process a few thousand things in groups of 25.
Edited to add: finally got signed in to work, you create the script via:
parallel --embed > scriptname.sh
It's about 14,000 lines of awesome and works on "ash, bash, dash, ksh, sh, and zsh"
Maybe this is a silly question, but what advantage do you get from checking that huge file into VC instead of just installing parallel ahead of time on the CI images?
Edited to add: finally got signed in to work, you create the script via:
It's about 14,000 lines of awesome and works on "ash, bash, dash, ksh, sh, and zsh"