* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Wednesday, October 22, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    AMC brings first new Dolby Experience to Gwinnett since 2017 – Wyoming News Now

    AMC Launches First New Dolby Experience in Gwinnett Since 2017

    Hetzel Design: blending architecture and entertainment – Blooloop

    Hetzel Design: Where Architecture and Entertainment Unite in Perfect Harmony

    Country music legend rushed to hospital year after heart surgery. Here’s what we know – PennLive.com

    Country Music Legend Rushed to Hospital One Year After Heart Surgery – What’s Happening Now?

    Strictly Come Dancing results: Chris Robshaw is eliminated while drag queen La Voix escapes dance-off – Yahoo

    Strictly Come Dancing results: Chris Robshaw is eliminated while drag queen La Voix escapes dance-off – Yahoo

    Placer County town of Loomis considers entertainment zone for downtown – CBS News

    Loomis Unveils Thrilling New Entertainment Zone to Revitalize Downtown

    CT Culture Corner: Robert Redford films to watch – CT Insider

    CT Culture Corner: Robert Redford films to watch – CT Insider

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Office Technology: Dealers’ Managed IT Revenue up Nearly 30% – The Cannata Report –

    Office Technology: Dealers’ Managed IT Revenue up Nearly 30% – The Cannata Report –

    3 E Network Technology Group Limited Closes $1.5 Million Convertible Promissory Note Offering – Quiver Quantitative

    3 E Network Technology Group Limited Closes $1.5 Million Convertible Promissory Note Offering – Quiver Quantitative

    3 Technology Stocks to Buy Now – Yahoo Finance

    3 Must-Buy Tech Stocks You Can’t Afford to Miss Right Now

    ‘New frontier’: Austin leaders start discussions on air taxi technology – KXAN Austin

    Austin Leaders Ignite Exciting Conversations on the Future of Air Taxi Technology

    How a Gemma model helped discover a new potential cancer therapy pathway – blog.google

    How a Gemma Model Revealed a Breakthrough Pathway for Cancer Treatment

    Italian Technology in Manufacturing: Supporting North American Industries and Keeping Production Local – Thomasnet

    How Italian Technology is Revolutionizing North American Manufacturing and Boosting Local Production

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    AMC brings first new Dolby Experience to Gwinnett since 2017 – Wyoming News Now

    AMC Launches First New Dolby Experience in Gwinnett Since 2017

    Hetzel Design: blending architecture and entertainment – Blooloop

    Hetzel Design: Where Architecture and Entertainment Unite in Perfect Harmony

    Country music legend rushed to hospital year after heart surgery. Here’s what we know – PennLive.com

    Country Music Legend Rushed to Hospital One Year After Heart Surgery – What’s Happening Now?

    Strictly Come Dancing results: Chris Robshaw is eliminated while drag queen La Voix escapes dance-off – Yahoo

    Strictly Come Dancing results: Chris Robshaw is eliminated while drag queen La Voix escapes dance-off – Yahoo

    Placer County town of Loomis considers entertainment zone for downtown – CBS News

    Loomis Unveils Thrilling New Entertainment Zone to Revitalize Downtown

    CT Culture Corner: Robert Redford films to watch – CT Insider

    CT Culture Corner: Robert Redford films to watch – CT Insider

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Office Technology: Dealers’ Managed IT Revenue up Nearly 30% – The Cannata Report –

    Office Technology: Dealers’ Managed IT Revenue up Nearly 30% – The Cannata Report –

    3 E Network Technology Group Limited Closes $1.5 Million Convertible Promissory Note Offering – Quiver Quantitative

    3 E Network Technology Group Limited Closes $1.5 Million Convertible Promissory Note Offering – Quiver Quantitative

    3 Technology Stocks to Buy Now – Yahoo Finance

    3 Must-Buy Tech Stocks You Can’t Afford to Miss Right Now

    ‘New frontier’: Austin leaders start discussions on air taxi technology – KXAN Austin

    Austin Leaders Ignite Exciting Conversations on the Future of Air Taxi Technology

    How a Gemma model helped discover a new potential cancer therapy pathway – blog.google

    How a Gemma Model Revealed a Breakthrough Pathway for Cancer Treatment

    Italian Technology in Manufacturing: Supporting North American Industries and Keeping Production Local – Thomasnet

    How Italian Technology is Revolutionizing North American Manufacturing and Boosting Local Production

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

There is no data engineering roadmap

July 14, 2023
in Technology
There is no data engineering roadmap
Share on FacebookShare on Twitter

Between Reddit, twitter, LinkedIn and various Slack communities, I see multiple junior folk looking to break into Data Engineering and asking for advice. Every single day. Many ask for a “roadmap” or some kind of step by step lesson plan that will land them their dream job. I don’t believe that such a roadmap exists.

Newbies are welcome 👋

I have seen some say “Data Engineering is not an entry level role” and this is nothing more than toxic gatekeeping. Data Engineering is no more, and no less, complex than any other software discipline. Every discipline is open to newbies. If you want to get into data, you can do it. You don’t need to “graduate” into it from a different discipline.

Moving sideways into Data Engineering is very common, not because it’s necessary, but because Data Engineering is relatively new as a somewhat well-defined job category. Data Engineering teams haven’t been commonplace for long, in fact, there’s many industries still just starting to catch on. Many Data Analysts and Software Engineers already have at least some level of hands-on experience with data, so it makes total sense to use & develop those skills. This has happened with every single kind of engineering role in the history of engineering. But there’s only so many people who want to make the switch, and you can’t reallocate everyone from your other teams. So, Data Engineering absolutely needs entry-level engineers.

People used to say “Software Engineering is not an entry level role”. They don’t anymore, because people know it is total rubbish.

Everyone is welcome in data.

All you need is love SQL ❤️

So, how does an entry-level engineer get started in Data Engineering?

Firstly, go unfollow all those influencers on LinkedIn and Twitter. You don’t need them, in fact, they are dangerous. They’re not here to guide, help or teach you. They will take you down a path of failure so that you are more open to giving them your money for a quick win (rant).

With that out the way, understand that there is no roadmap. There is no single path, no clear linear progression of knowledge. No one can tell you that you absolutely must learn A, then B, then C and you’re guaranteed to be a successful Data Engineer.

The same applies to pretty much all engineering roles; front end, back end, embedded systems, networking, analytics. Whatever.

In all of these cases, there are basics that everyone should get familiar with, and these are usually enough to get you your first gig. Remember, there is a fundamental difference between “What do I need to get my first job?” and “How do I progress my career?“.

For Data Engineering, there is only one skill that is absolutely, non-negotiably, the first thing you should learn to get started.

SQL.

Yep, SQL. It’s not dead. It never will be. SQL is the cockroach of data and it’s not going anywhere. People have tried to displace it, and they have all failed.

SQL is the only skill that every single Data Engineer uses every single day. No other skill or tool can claim the same. Python is common, some folks are using Scala, Snowflake is popular…but there’s more data teams not using those tools than those who are. But not for SQL.

You’re an entry level engineer, you don’t need to be an expert in SQL. You need to be able to solve problems. When you write some shit SQL, and you absolutely will, one of two things will happen:

Thing 1, someone will tell you it’s shit and you’ll learn how to do it better.

Thing 2, people will thank you for solving the problem and ask you to do something else.

Win win.

How should I learn SQL?

If you’re new to SQL and databases, you should know that “SQL” is very poorly standardised. You’ll hear folks say “ANSI SQL” which many think is some kind of standard, but it’s not really. Anyway, if that topic interests you, read up on it. There is a common SQL base, but pretty much every single database in existence customises and extends SQL to do whatever it wants.

This means that SQL you write for Postgres might work in MySQL, but don’t be surprised if it doesn’t. The same is true across Microsoft’s SQL Server, Oracle Database, BigQuery, Redshift, Snowflake, ClickHouse and any other database you can think of. The different flavours of SQL used by these databases are called “dialects”.

This can make it daunting to get started, but it’s no different than getting into Software Engineering. There’s a million programming languages and most people start with one and then try a bunch of others.

So, pick any database, don’t worry about the dialect. The database is simply a vehicle for you to learn SQL.

Stuck? Start with Postgres. It’s the world’s favorite free, open source database. You can’t go wrong starting with Postgres.

Follow some simple tutorials; get it set up, load some data and start asking questions with SQL.

Google around for “SQL challenges”, there’s loads. Some are better than others, just go through them all and challenge yourself. As your knowledge improves, look for harder problems and bigger data sets.

When you’re starting to feel confident – change database. Try solving the same problems with MariaDB. Then try out Google’s BigQuery (there is a generous free-tier for BigQuery, be careful to stay under the limits and you won’t pay anything).

Pay attention to how your queries change, particularly with more complex queries. Notice that different kinds of queries are faster or slower between databases. Get used to reading the SQL reference documentation for each of these databases.

If you need something more guided, there are plenty – literally thousands – of free SQL resources on the internet. There’s nothing wrong with following a free SQL introduction course, but always challenge what you learn by applying it to a different database.

You will have time to specialise in a specific database later in your career, now is not the time.

If you’re in the UK, the UK Gov is sponsoring a whole bunch of entry-level bootcamps across loads of sectors. One of the biggest areas of funding is Data Engineering. I can’t vouch for these bootcamps, some look better than others, but they are free, so if you’re eligable, why not? https://www.gov.uk/guidance/find-a-skills-bootcamp/

What if I already know SQL?

If you’re coming from a Data Analytics background, or any other role where you’re already reasonably comfortable with SQL, then you have it easy. Anyone with this background should be able to start looking for an entry-level or junior Data Engineering role.

Now, if you’re sitting on 15 years of experience as an Analyst, going back to a junior role might not be something you’re willing to do – but that’s a different discussion.

What’s next?

What about Python? Pandas? dbt? Rust? Airflow? Spark?

Later. These are all things you can learn on the job if the job even needs them.

Go get your first data job. I’m not going to tell you it will be easy. Lots of people struggle to find the right entry-level job in all fields of engineering.

But when you land it, make it your primary goal to absorb the knowledge from your new colleagues. Learn something every single day.

When the learning stops, move on. Use what you’ve learnt to get a pay bump and find new people to learn from.

Rinse and repeat. That’s your roadmap.

Everything else comes later. Go get your hands dirty.

🌶️ A quick rant 🌶️

Unfortunately, I see a lot of bad advice handed out. Now, much of it is others just innocently sharing an opinion, but, often there is a clear financial incentive behind it. Vendors who want their tools to be the “baseline” to enter the industry. So-called “influencers” who take money from those vendors, or want to convince you to buy their Data Engineering bootcamps. Because, if data engineering is spooky and complicated, you’re more inclined to buy their “land your first job in 90 days” course, right?

Now, there’s nothing wrong with vendors advertising their tools, or individuals creating genuinely helpful content that earns themselves a living. Tools have a place in the world, as do creators. But certain bad actors target junior and entry-level engineers who don’t have the experience to identify blatant bullshit from real advice. Be wary.

Post tags

data-engineering

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : Hacker News – https://www.alasdairb.com/posts/there-is-no-data-engineering-roadmap/

Tags: engineeringtechnologyThere
Previous Post

On personal relations as a manager

Next Post

Striking Sag Actors in Disbelief over Studios’ Dystopian AI Proposal

Jacobson earns program’s first medal at U23 World Championships – nmuwildcats.com

Jacobson Breaks New Ground with Program’s First Medal at U23 World Championships

October 22, 2025
AHLA: Hotels generate $7B for Denver economy – Hotel Management

Hotels Drive Denver’s Economy to Soar by $7 Billion

October 22, 2025
AMC brings first new Dolby Experience to Gwinnett since 2017 – Wyoming News Now

AMC Launches First New Dolby Experience in Gwinnett Since 2017

October 22, 2025
UCare, other carriers dropping Medicare Advantage Plans, leaving 200K Minnesota seniors without health insurance – CBS News

UCare, other carriers dropping Medicare Advantage Plans, leaving 200K Minnesota seniors without health insurance – CBS News

October 22, 2025
With Israel-Hamas Cease-Fire, Some Pro-Palestinian Protesters Look Back at Their Movement, Ruefully – The New York Times

With Israel-Hamas Cease-Fire, Some Pro-Palestinian Protesters Look Back at Their Movement, Ruefully – The New York Times

October 21, 2025
Fusobacterium nucleatum : ecology, pathogenesis and clinical implications – Nature

Unveiling Fusobacterium nucleatum: Exploring Its Ecology, Disease Connections, and Health Impact

October 21, 2025
Escherichia coli with a 57-codon genetic code – Science | AAAS

Escherichia coli Engineered with a Revolutionary 57-Codon Genetic Code

October 21, 2025
LOCALIZE IT: Over 420 anti-science bills target public health protections in statehouses across US – newspressnow.com

More Than 420 Anti-Science Bills Jeopardize Public Health Across the Nation

October 21, 2025
Halloween not your thing? Here’s when Christmas at the Newport mansions will start. – The Providence Journal

Not a Halloween Fan? Find Out When Christmas Magic Begins at the Newport Mansions!

October 21, 2025
Office Technology: Dealers’ Managed IT Revenue up Nearly 30% – The Cannata Report –

Office Technology: Dealers’ Managed IT Revenue up Nearly 30% – The Cannata Report –

October 21, 2025

Categories

Archives

October 2025
M T W T F S S
 12345
6789101112
13141516171819
20212223242526
2728293031  
« Sep    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (879)
  • Economy (901)
  • Entertainment (21,772)
  • General (17,729)
  • Health (9,942)
  • Lifestyle (913)
  • News (22,149)
  • People (901)
  • Politics (911)
  • Science (16,111)
  • Sports (21,400)
  • Technology (15,880)
  • World (884)

Recent News

Jacobson earns program’s first medal at U23 World Championships – nmuwildcats.com

Jacobson Breaks New Ground with Program’s First Medal at U23 World Championships

October 22, 2025
AHLA: Hotels generate $7B for Denver economy – Hotel Management

Hotels Drive Denver’s Economy to Soar by $7 Billion

October 22, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version