this post was submitted on 21 Oct 2023
2 points (100.0% liked)

Data Engineering

1 readers
1 users here now

Discussion on Data Engineering topics. Data pipelines, tools and technologies, databases and DBMS, best practices:

Rules:

founded 1 year ago
MODERATORS
 

I've been a data (reporting) analyst for nearly a decade. I got my start writing complex SQL queries to develop reports and expanded into visualization (Tableau, Power BI). Lately I spent time as a data modeler designing DBs and helping create ETLs using ADF (though not putting hands on that process myself, I'm familiar enough with it to make it work).

I'm looking for my next opportunity and finding that my lack of knowledge in Python is creating a blocker. Also, other skills I don't have seem to crop up, like Spark, Hadoop, etc. It seems like the Data Engineer role has been folded into my Data Analyst role and I just can't compete any more.

Would anyone have any suggestions for paths I might take to remedy this? I can work with some online Python courses but I feel I'm not getting the full experience needed to really support the new needs being asked of those in my role. I'm hoping someone might have some suggestions for directions I might take to up-skill myself and be more prepared for the emerging needs of this changing industry.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] vynlwombat@lemmy.world 2 points 1 year ago (1 children)

I think you might have better results if you look for BI engineering positions. That would be a better fit for your skill set. At some point data engineering sorta got split up into more specialized niches and based on your experience with dashboarding and ETLing, I think youre more in line with BI Engineering.

[โ€“] starlord@lemm.ee 1 points 1 year ago

Thanks. I'll keep that in mind.