Description:In this project, I undertook a comprehensive data engineering journey focused on COVID-19 data, leveraging AWS services to create a powerful data infrastructure. My goal was to make the COVID-19 data accessible, understandable, and valuable for analysis.Key Steps:Data Collection and Storage: I started by downloading COVID-19 datasets from Registry of Open Data on AWS and... Continue Reading →
Big Data Pro Resources
#Resources Referred by me for Big data Technologies These resources are available for free in YouTube, which helped me to crack CISCO.. and for you to crack product based companies also..1.Hadoop ,sqoop and Hive concepts by Saif shaik:https://lnkd.in/ewyYweTJ2.pyspark concepts in depth by karunakar goud:https://lnkd.in/eNtFkxmd3.Another spark playlist which useful Raja's Data Engineering channel.https://lnkd.in/eqiy7dBS4. Hadoop and Kafka... Continue Reading →
Crack The Spark
🚀Data Engineer Interview Experience📢Apache Spark⌛How "Executor Out Of Memory" can be explained in step by step manner👉🏽https://lnkd.in/gPsrw9Wp How "Salting" can be explained in step by step manner👉🏽https://lnkd.in/gUQUPj8x How "Data Locality in Spark" can be explained in step by step manner👉🏽https://lnkd.in/gcQ_CJZs How "Garbage Collection (GC) Tuning" can be explained in step by step manner👉🏽https://lnkd.in/gY5CQM9c How "Predicate... Continue Reading →
Top Github Repositories
Top Github repositories which would be really helpful for job preparation, upskilling and much more 💫 - Free programming books : https://lnkd.in/gbSk9NRr- System Design : https://lnkd.in/graSZG3Phttps://lnkd.in/gykTqH6k- Project Based Learning : https://lnkd.in/gjewtywD- Coding Interview : https://lnkd.in/ge7e7gyh- Resources for Preparation of Placements : https://lnkd.in/d6zpHj4P- Data Science : https://lnkd.in/gbnGnGRD- Projects : https://lnkd.in/gNvjU9jr- For Roadmaps : https://lnkd.in/gYNSH-dc- JavaScript :... Continue Reading →
AWS Training
AWS just launched a new free training, along with a digital badge "Migrations Foundations". This means you can now earn up to 12 AWS digital badges at no cost!To secure this badge, simply enroll in the free course and score 80% or higher on the final assessment. It's a fantastic opportunity to demonstrate your cloud... Continue Reading →
Types of Dimensions in DWH
Types of Dimensions in Dimensional Data Modelling👉 There are 9 types of Dimensions/metrics when dealing with Dimensional Data Modelling. They are given below:🔹Conformed Dimension🔹Outrigger Dimension🔹Shrunken Dimension🔹Role-Playing Dimension🔹Dimension to Dimension Table🔹Junk Dimension🔹Degenerate Dimension🔹Swappable Dimension🔹Step Dimension✅ Conformed DimensionA Conformed Dimension is a type of Dimension that has the same meaning to all the Facts it relates to.... Continue Reading →
Spark & Hadoop beginner to Advanced Questions
1. What are the different cluster managers provided by Apache Spark? Three different cluster managers are available on Apache Spark. These are: Standalone Cluster Manager: The Standalone Cluster Manager is a simple cluster manager responsible for managing resources based on application requirements. The Standalone Cluster Manager is resilient in that it can handle task failures.... Continue Reading →
Big Data V’s
What is Big Data? Large amount of data which is impossible for traditional data processing and management systems to handle effectively. Examples of traditional systems could be RDBMS, On-Premises Data Centers, Traditional batch processing systems, etc. Big Data is mainly characterized by four V's as follows: (A) Volume - 2.5 Quintillion (2,500,000,000,000,000,000) Bytes of data... Continue Reading →
Azure Learning Resources
Top 9 Azure #dataengineering tools to learn for FREE.....start your Azure journey here.....1. Azure Data Factory.https://lnkd.in/gEmpbyrMProject: https://lnkd.in/gFG2aCgy2. Azure Data bricks.https://lnkd.in/gvFwKxaNproject: https://lnkd.in/gFG2aCgy3. Azure Stream Analytics.https://lnkd.in/g35VbSTv4. Azure Synapse Analytics.https://lnkd.in/gCufskNC5. Azure Data Lake Storage.https://lnkd.in/gcEKjWsc6. Azure SQL database.https://lnkd.in/gmHxqxQX7. Azure Postgres SQL database.https://lnkd.in/grHWJvWZ8. Azure MariaDB.https://lnkd.in/gYSp7MZi9. Azure Cosmos DB.https://lnkd.in/g6jPZA36This is an excellent guide to become azure data engineer. No need to... Continue Reading →
SQL Learning Resources
Learn sql for free and earn 10X salary growth. Yes it possible. Here are the 6 best free resources for learning SQL for free -- --Khan Academy -https://lnkd.in/gCZ5fS7x--SQLZoo - https://sqlzoo.net/--Codecademy - https://lnkd.in/gWyMTS-G--SQLBolt - https://sqlbolt.com/--Udacity - https://lnkd.in/gxpBMteQ--SQL for Web Nerds - https://lnkd.in/gRPT3P5X
CODEBOX 