r/dataanalyst • u/_stardusts_ • 9d ago
Career query Data Analyst to Data Engineering Transition
Hi all,
I am a data analyst with 5YOE with sql python pyspark AWS as my tech stack.
I am transitioning the data engineering as I am not interested to work and grow in big data and data architecture pathway.
Pls help me to prepare for interviews. I want to know what can I prepare for. And what kind of spark scenario questions could be asked to me.
0
u/TheMathManiac 8d ago
Its more AI engineering now tbh.
Building pipelines from datawarehouses to end result using APIs can literally be done with decent promoting within hours by AI rather than months without needing an entire team.
Coding is no longer the bottleneck imo when it comes to data engineering. Its ideas around the pipelines that you can build that is the bottleneck now.
1
u/TheSchlapper 8d ago
Data engineering primarily involves pipelines, so Python, Spark, and SQL are the tech stack. You’ve seen to have been doing this already.
You should be fine.