Learn Data Engineering From These GitHub Repositories
If you are looking to get into the world of data, particularly Data Engineering – then this blog can provide you with valuable resources to help your studies. Let’s first break down what the difference is between a data scientist and a data engineer in the simplest way.
A data scientist’s main focus is to explore data, build models, and implement machine learning algorithms. A data engineer’s main focus is ensuring that the algorithms built work effectively in production infrastructure and creating data pipelines.
Data engineers are responsible for everything surrounding the organization’s data infrastructure. This infrastructure will store the business’s critical information, ranging from small databases to large-scale systems. The aim is to ensure that the data’s foundation is solid and secure in order for critical analysis to be performed and reports can be produced.
If you are still keen on learning about data engineering, here are some valuable GitHub repositories to help you.
As mentioned in the name, DataTalksClub is a global online community of data enthusiasts, that talk about everything data. They have a 9-week syllabus to help you learn about data engineering. The weeks are broken down into:
You can join the next cohort, however, you can also do it in your own time. All the materials of the course are freely available, and DataTalks.Club provide you with a suggested syllabus week by week to help you.
Andreaz Kretz, the author of The Data Engineering Cookbook published the book on GitHub. His aim with this book was to provide a starting point for newbies in the data engineering world. He helps you to identify the important topics you need to learn about to become a successful Data Engineer.
The book focuses on five different types of content to help you with data engineering: articles published by the author, links to their podcast episodes (video & audio), 200+ links to helpful websites that he recommends, data engineering interview questions and case studies.
If you need guidance on the different topics you need to learn to become a Data Engineer. The Data-Engineering-HowTo provides you with a list of different resources where you can gain useful data engineering knowledge.
The repo starts with the basics of the world of data engineering, such as the hierarchy needs, beginner’s guide, and more. There are also resources for talks, algorithms & data structures, SQL, programming, databases, distributed systems, books, courses, blogs, tools, cloud platforms, and more.
