* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Monday, June 30, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Susquehanna Raises Penn Entertainment Inc. (PENN) Price Target. – Yahoo Finance

    Susquehanna Raises Price Target for Penn Entertainment Inc. (PENN)

    George Lopez is coming to Spokane – KXLY.com

    George Lopez is coming to Spokane – KXLY.com

    Netflix unveils Dallas immersive venue for fans of hit shows like ‘Squid Game,’ ‘Stranger Things’ – Houston Chronicle

    Step Inside Netflix’s New Dallas Immersive Experience Featuring Hits Like ‘Squid Game’ and ‘Stranger Things

    ‘Puttin’ on the Ritz’: Civic Players bring ‘Young Frankenstein’ to life – Yahoo

    Civic Players Deliver a Hilarious and Unforgettable Performance of ‘Young Frankenstein

    ‘Wheel of Fortune’: Amputee Wins $60,000 After Breaking Incredible ‘Curse’ – Hastings Tribune

    Wheel of Fortune’ Amputee Breaks Incredible ‘Curse’ to Win $60,000!

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    North Star Sports & Entertainment Network: Coming soon – KTTC News

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Mirrors in space and underwater curtains: can technology buy us enough time to save the Arctic ice caps? – The Guardian

    Can Technology Like Space Mirrors and Underwater Curtains Buy Us Time to Save the Arctic Ice Caps?

    Naples restaurant owner prepares for hurricane season with new flood technology – Fox4Now.com

    Naples restaurant owner prepares for hurricane season with new flood technology – Fox4Now.com

    Emerging Memory and Storage Technology Market Analysis Report 2025-2034 | AI and HPC Boom Fuels Surging Demand for Fast, Low-Power Memory Devices – Yahoo Finance

    How AI and HPC Are Driving Explosive Growth in Fast, Low-Power Memory Technologies Through 2034

    Ostin Technology (OST): Volatility’s Warning or Contrarian Opportunity? – AInvest

    Ostin Technology (OST): Navigating Market Volatility – Red Flag or Hidden Opportunity?

    St. Francis Medical Center brings advanced robotic surgery technology to Northeast Louisiana – KNOE

    St. Francis Medical Center brings advanced robotic surgery technology to Northeast Louisiana – KNOE

    Wayve Expands Engineering Leadership to Power Next-Gen Autonomous Driving Technology – Silicon Canals

    Wayve Boosts Engineering Leadership to Accelerate Next-Gen Autonomous Driving Innovation

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Susquehanna Raises Penn Entertainment Inc. (PENN) Price Target. – Yahoo Finance

    Susquehanna Raises Price Target for Penn Entertainment Inc. (PENN)

    George Lopez is coming to Spokane – KXLY.com

    George Lopez is coming to Spokane – KXLY.com

    Netflix unveils Dallas immersive venue for fans of hit shows like ‘Squid Game,’ ‘Stranger Things’ – Houston Chronicle

    Step Inside Netflix’s New Dallas Immersive Experience Featuring Hits Like ‘Squid Game’ and ‘Stranger Things

    ‘Puttin’ on the Ritz’: Civic Players bring ‘Young Frankenstein’ to life – Yahoo

    Civic Players Deliver a Hilarious and Unforgettable Performance of ‘Young Frankenstein

    ‘Wheel of Fortune’: Amputee Wins $60,000 After Breaking Incredible ‘Curse’ – Hastings Tribune

    Wheel of Fortune’ Amputee Breaks Incredible ‘Curse’ to Win $60,000!

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    North Star Sports & Entertainment Network: Coming soon – KTTC News

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Mirrors in space and underwater curtains: can technology buy us enough time to save the Arctic ice caps? – The Guardian

    Can Technology Like Space Mirrors and Underwater Curtains Buy Us Time to Save the Arctic Ice Caps?

    Naples restaurant owner prepares for hurricane season with new flood technology – Fox4Now.com

    Naples restaurant owner prepares for hurricane season with new flood technology – Fox4Now.com

    Emerging Memory and Storage Technology Market Analysis Report 2025-2034 | AI and HPC Boom Fuels Surging Demand for Fast, Low-Power Memory Devices – Yahoo Finance

    How AI and HPC Are Driving Explosive Growth in Fast, Low-Power Memory Technologies Through 2034

    Ostin Technology (OST): Volatility’s Warning or Contrarian Opportunity? – AInvest

    Ostin Technology (OST): Navigating Market Volatility – Red Flag or Hidden Opportunity?

    St. Francis Medical Center brings advanced robotic surgery technology to Northeast Louisiana – KNOE

    St. Francis Medical Center brings advanced robotic surgery technology to Northeast Louisiana – KNOE

    Wayve Expands Engineering Leadership to Power Next-Gen Autonomous Driving Technology – Silicon Canals

    Wayve Boosts Engineering Leadership to Accelerate Next-Gen Autonomous Driving Innovation

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

There is no data engineering roadmap

July 14, 2023
in Technology
There is no data engineering roadmap
Share on FacebookShare on Twitter

Between Reddit, twitter, LinkedIn and various Slack communities, I see multiple junior folk looking to break into Data Engineering and asking for advice. Every single day. Many ask for a “roadmap” or some kind of step by step lesson plan that will land them their dream job. I don’t believe that such a roadmap exists.

Newbies are welcome 👋

I have seen some say “Data Engineering is not an entry level role” and this is nothing more than toxic gatekeeping. Data Engineering is no more, and no less, complex than any other software discipline. Every discipline is open to newbies. If you want to get into data, you can do it. You don’t need to “graduate” into it from a different discipline.

Moving sideways into Data Engineering is very common, not because it’s necessary, but because Data Engineering is relatively new as a somewhat well-defined job category. Data Engineering teams haven’t been commonplace for long, in fact, there’s many industries still just starting to catch on. Many Data Analysts and Software Engineers already have at least some level of hands-on experience with data, so it makes total sense to use & develop those skills. This has happened with every single kind of engineering role in the history of engineering. But there’s only so many people who want to make the switch, and you can’t reallocate everyone from your other teams. So, Data Engineering absolutely needs entry-level engineers.

People used to say “Software Engineering is not an entry level role”. They don’t anymore, because people know it is total rubbish.

Everyone is welcome in data.

All you need is love SQL ❤️

So, how does an entry-level engineer get started in Data Engineering?

Firstly, go unfollow all those influencers on LinkedIn and Twitter. You don’t need them, in fact, they are dangerous. They’re not here to guide, help or teach you. They will take you down a path of failure so that you are more open to giving them your money for a quick win (rant).

With that out the way, understand that there is no roadmap. There is no single path, no clear linear progression of knowledge. No one can tell you that you absolutely must learn A, then B, then C and you’re guaranteed to be a successful Data Engineer.

The same applies to pretty much all engineering roles; front end, back end, embedded systems, networking, analytics. Whatever.

In all of these cases, there are basics that everyone should get familiar with, and these are usually enough to get you your first gig. Remember, there is a fundamental difference between “What do I need to get my first job?” and “How do I progress my career?“.

For Data Engineering, there is only one skill that is absolutely, non-negotiably, the first thing you should learn to get started.

SQL.

Yep, SQL. It’s not dead. It never will be. SQL is the cockroach of data and it’s not going anywhere. People have tried to displace it, and they have all failed.

SQL is the only skill that every single Data Engineer uses every single day. No other skill or tool can claim the same. Python is common, some folks are using Scala, Snowflake is popular…but there’s more data teams not using those tools than those who are. But not for SQL.

You’re an entry level engineer, you don’t need to be an expert in SQL. You need to be able to solve problems. When you write some shit SQL, and you absolutely will, one of two things will happen:

Thing 1, someone will tell you it’s shit and you’ll learn how to do it better.

Thing 2, people will thank you for solving the problem and ask you to do something else.

Win win.

How should I learn SQL?

If you’re new to SQL and databases, you should know that “SQL” is very poorly standardised. You’ll hear folks say “ANSI SQL” which many think is some kind of standard, but it’s not really. Anyway, if that topic interests you, read up on it. There is a common SQL base, but pretty much every single database in existence customises and extends SQL to do whatever it wants.

This means that SQL you write for Postgres might work in MySQL, but don’t be surprised if it doesn’t. The same is true across Microsoft’s SQL Server, Oracle Database, BigQuery, Redshift, Snowflake, ClickHouse and any other database you can think of. The different flavours of SQL used by these databases are called “dialects”.

This can make it daunting to get started, but it’s no different than getting into Software Engineering. There’s a million programming languages and most people start with one and then try a bunch of others.

So, pick any database, don’t worry about the dialect. The database is simply a vehicle for you to learn SQL.

Stuck? Start with Postgres. It’s the world’s favorite free, open source database. You can’t go wrong starting with Postgres.

Follow some simple tutorials; get it set up, load some data and start asking questions with SQL.

Google around for “SQL challenges”, there’s loads. Some are better than others, just go through them all and challenge yourself. As your knowledge improves, look for harder problems and bigger data sets.

When you’re starting to feel confident – change database. Try solving the same problems with MariaDB. Then try out Google’s BigQuery (there is a generous free-tier for BigQuery, be careful to stay under the limits and you won’t pay anything).

Pay attention to how your queries change, particularly with more complex queries. Notice that different kinds of queries are faster or slower between databases. Get used to reading the SQL reference documentation for each of these databases.

If you need something more guided, there are plenty – literally thousands – of free SQL resources on the internet. There’s nothing wrong with following a free SQL introduction course, but always challenge what you learn by applying it to a different database.

You will have time to specialise in a specific database later in your career, now is not the time.

If you’re in the UK, the UK Gov is sponsoring a whole bunch of entry-level bootcamps across loads of sectors. One of the biggest areas of funding is Data Engineering. I can’t vouch for these bootcamps, some look better than others, but they are free, so if you’re eligable, why not? https://www.gov.uk/guidance/find-a-skills-bootcamp/

What if I already know SQL?

If you’re coming from a Data Analytics background, or any other role where you’re already reasonably comfortable with SQL, then you have it easy. Anyone with this background should be able to start looking for an entry-level or junior Data Engineering role.

Now, if you’re sitting on 15 years of experience as an Analyst, going back to a junior role might not be something you’re willing to do – but that’s a different discussion.

What’s next?

What about Python? Pandas? dbt? Rust? Airflow? Spark?

Later. These are all things you can learn on the job if the job even needs them.

Go get your first data job. I’m not going to tell you it will be easy. Lots of people struggle to find the right entry-level job in all fields of engineering.

But when you land it, make it your primary goal to absorb the knowledge from your new colleagues. Learn something every single day.

When the learning stops, move on. Use what you’ve learnt to get a pay bump and find new people to learn from.

Rinse and repeat. That’s your roadmap.

Everything else comes later. Go get your hands dirty.

🌶️ A quick rant 🌶️

Unfortunately, I see a lot of bad advice handed out. Now, much of it is others just innocently sharing an opinion, but, often there is a clear financial incentive behind it. Vendors who want their tools to be the “baseline” to enter the industry. So-called “influencers” who take money from those vendors, or want to convince you to buy their Data Engineering bootcamps. Because, if data engineering is spooky and complicated, you’re more inclined to buy their “land your first job in 90 days” course, right?

Now, there’s nothing wrong with vendors advertising their tools, or individuals creating genuinely helpful content that earns themselves a living. Tools have a place in the world, as do creators. But certain bad actors target junior and entry-level engineers who don’t have the experience to identify blatant bullshit from real advice. Be wary.

Post tags

data-engineering

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : Hacker News – https://www.alasdairb.com/posts/there-is-no-data-engineering-roadmap/

Tags: engineeringtechnologyThere
Previous Post

On personal relations as a manager

Next Post

Striking Sag Actors in Disbelief over Studios’ Dystopian AI Proposal

Surprising New Study Links Daytime Napping to Hidden Health Risks – Prevention

Unexpected New Study Reveals Hidden Health Risks of Daytime Napping

June 30, 2025
The 1975’s Matty Healy Says ‘We Don’t Need More Politics’ at Glastonbury – Variety

The 1975’s Matty Healy Declares “We Don’t Need More Politics” at Glastonbury

June 30, 2025
Mirrors in space and underwater curtains: can technology buy us enough time to save the Arctic ice caps? – The Guardian

Can Technology Like Space Mirrors and Underwater Curtains Buy Us Time to Save the Arctic Ice Caps?

June 29, 2025
Guirassy latest candidate for Milan attack with 70m price tag – Yahoo Sports

Guirassy Emerges as Milan’s Top Striker Target with €70 Million Price Tag

June 29, 2025
‘Half the tree of life’: ecologists’ horror as nature reserves are emptied of insects – The Guardian

Half the Tree of Life at Risk: Ecologists Warn as Insect Populations Plummet in Nature Reserves

June 29, 2025
Health, science cuts affect future jobs – The Acorn

Health, science cuts affect future jobs – The Acorn

June 29, 2025
Why Some People Have Absolutely No Sense Of Direction, According To Science – YourTango

Why Do Some People Struggle with Direction? The Surprising Science of Getting Lost

June 29, 2025
Cardiologist shares how stress and modern lifestyle are raising heart risks in 30s and 40s: ‘Don’t wait for chest pain’ | Health – Hindustan Times – Hindustan Times

Cardiologist shares how stress and modern lifestyle are raising heart risks in 30s and 40s: ‘Don’t wait for chest pain’ | Health – Hindustan Times – Hindustan Times

June 29, 2025
79-year old man competing in his 16th World Police and Fire Games – WVTM

79-year old man competing in his 16th World Police and Fire Games – WVTM

June 29, 2025
The Economy Is So Off the Rails That They’re Trying to Figure Out How to Make Ads Specifically Targeted at AI Bots – Futurism

The Economy Is So Off the Rails That They’re Trying to Figure Out How to Make Ads Specifically Targeted at AI Bots – Futurism

June 29, 2025

Categories

Archives

June 2025
MTWTFSS
 1
2345678
9101112131415
16171819202122
23242526272829
30 
« May    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (700)
  • Economy (723)
  • Entertainment (21,613)
  • General (15,623)
  • Health (9,763)
  • Lifestyle (728)
  • News (22,149)
  • People (724)
  • Politics (730)
  • Science (15,940)
  • Sports (21,220)
  • Technology (15,708)
  • World (703)

Recent News

Surprising New Study Links Daytime Napping to Hidden Health Risks – Prevention

Unexpected New Study Reveals Hidden Health Risks of Daytime Napping

June 30, 2025
The 1975’s Matty Healy Says ‘We Don’t Need More Politics’ at Glastonbury – Variety

The 1975’s Matty Healy Declares “We Don’t Need More Politics” at Glastonbury

June 30, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version