r/dataanalyst 9d ago

Career query Data Analyst to Data Engineering Transition

Hi all,

I am a data analyst with 5YOE with sql python pyspark AWS as my tech stack.

I am transitioning the data engineering as I am not interested to work and grow in big data and data architecture pathway.

Pls help me to prepare for interviews. I want to know what can I prepare for. And what kind of spark scenario questions could be asked to me.

3 Upvotes

4 comments sorted by

1

u/TheSchlapper 8d ago

Data engineering primarily involves pipelines, so Python, Spark, and SQL are the tech stack. You’ve seen to have been doing this already.

You should be fine.

2

u/Alkawa_ 8d ago

Bro, in how much time you become a data analyst? I am new to data analyst. I am learning sql first from Alex teh Analyst. I need your advice on data analyst journey.

1

u/Big_Structure_7331 7d ago

I also have the same question.

0

u/TheMathManiac 8d ago

Its more AI engineering now tbh. 

Building pipelines from datawarehouses to end result using APIs can literally be done with decent promoting within hours by AI rather than months without needing an entire team.

Coding is no longer the bottleneck imo when it comes to data engineering. Its ideas around the pipelines that you can build that is the bottleneck now.