I think studying what happened to the “data engineer” role is a good indicator.
There was a brief moment in time wherein data engineers were computer scientists specialised in distributed systems and data processing algorithms on commodity hardware. You had to know a lot on average.
Then came commoditisation via the big vendors and now you really don’t need to know very much. As a result it is not uncommon to meet “senior” data engineers who mostly script Python, do SQL and configure Airflow.
I think ML ala AI has already gone that way and many vendors are strongly promoting developer participation with courses and plug-and-play resources.
So what do you need? A vendor certificate you took over a weekend, and an employer to say “yes”…
This is a "just draw the owl" kind of comment. It's hard to get hired with just a certificate for plug and play tools and it isn't the kind of job OP wants anyway.
I wasn’t commenting on how difficult it is to be hired —- that’s relative to many things. But in terms of the least you need, I think I’m unfortunately right because I have seen it many times over the least few years.
We will see over the next few years when every 2nd BI analyst has become a AI engineer :-)
There was a brief moment in time wherein data engineers were computer scientists specialised in distributed systems and data processing algorithms on commodity hardware. You had to know a lot on average.
Then came commoditisation via the big vendors and now you really don’t need to know very much. As a result it is not uncommon to meet “senior” data engineers who mostly script Python, do SQL and configure Airflow.
I think ML ala AI has already gone that way and many vendors are strongly promoting developer participation with courses and plug-and-play resources.
So what do you need? A vendor certificate you took over a weekend, and an employer to say “yes”…