#Databricks #SQL for Data Engineering ,Data Science and Machine Learning.✅ The whole SQL lesson for DataBricks is provided here.1️⃣ spark sql sessions as series.https://lnkd.in/g77DE36a2️⃣ How to register databricks community editionhttps://lnkd.in/ggAqRgKJ3️⃣ What is DataWarehouse? OLTP and OLAP?https://lnkd.in/gzSuJCBC4️⃣ how to create database in databricks?https://lnkd.in/gzHNFZrv5️⃣ databricks file system dbfs.https://lnkd.in/dHAHkqd36️⃣ Spark SQL Table , Difference between Managed table and... Continue Reading →
COMPLEX SQL QUERIES
Questions on SQL are based on following two tables, Employee Table and Employee Incentive Table. Table Name : Employee EMPLOYEE_ID FIRST_NAME LAST_NAME SALARY JOINING_DATE DEPARTMENT 1 John Abraham 1000000 01-JAN-13 12.00.00 AM Banking 2 Michael Clarke 800000 01-JAN-13 12.00.00 AM Insurance 3 Roy Thomas 700000 01-FEB-13 12.00.00 AM Banking 4 Tom Jose 600000 01-FEB-13 12.00.00... Continue Reading →
Big Data Learning Resources
Complete Plan to learn Big Data Step by Step (All Free resources Included) by Sumit Sir.1. Learn SQL Basics - https://lnkd.in/g9NEJMVESQL will be used at a lot of places - Hive/Spark SQL/RDBMS queriesJoins & windowing functions are very important2. Learn Programming/Python for Data Engineering - https://lnkd.in/gr6fFPdULearn Python to an extent required for Data Engineers.3. Learn... Continue Reading →
Mastering SCD Type 2: Handling Historical Changes in SQL
📊 Mastering SCD Type 2: Handling Historical Changes in SQLSlowly Changing Dimensions (SCD) are a crucial part of data warehousing and analytics. Among the different types of SCD, Type 2 is particularly interesting as it allows us to track historical changes in dimensions such as customer data, product information, and more.In a recent project, I... Continue Reading →
Data Engineering Questions – 1
if your #dataengineering experience grows more than 5 years you expect these questions in your interviews.....1. Explain me the architecture of spark?2. How does internals job execution happens?3. what will happen when you fire the Spark Job?4. How did you tune your jobs?5. Explain optimizations you have used in your project?6. How did you connected... Continue Reading →
Database Indexes
Spend 2 minutes on this post, and you'll gain a good understanding of Database Indexing, which might take much longer to learn otherwise!Imagine managing a large-scale database:Database Size: 𝟱𝟬𝟬 𝗚𝗕Average Query Search Time Without Index: 𝟱 𝘀𝗲𝗰𝗼𝗻𝗱𝘀Number of Records: 𝟱𝟬 𝗺𝗶𝗹𝗹𝗶𝗼𝗻𝗟𝗲𝘁'𝘀 𝗱𝗶𝘃𝗲 𝗶𝗻𝘁𝗼 𝘁𝗵𝗲 𝘄𝗼𝗿𝗹𝗱 𝗼𝗳 𝗗𝗮𝘁𝗮𝗯𝗮𝘀𝗲 𝗜𝗻𝗱𝗲𝘅𝗶𝗻𝗴:1️⃣ 𝗪𝗵𝗮𝘁 𝗶𝘀 𝗗𝗮𝘁𝗮𝗯𝗮𝘀𝗲 𝗜𝗻𝗱𝗲𝘅𝗶𝗻𝗴?A database index is... Continue Reading →
TOP 50 SQl queries for interview
-- Q-1. Write an SQL query to fetch “FIRST_NAME” from Worker table using the alias name as <WORKER_NAME>. select first_name AS WORKER_NAME from worker; -- Q-2. Write an SQL query to fetch “FIRST_NAME” from Worker table in upper case. select UPPER(first_name) from worker; -- Q-3. Write an SQL query to fetch unique values of DEPARTMENT... Continue Reading →
Cloud Data Engineering Road Map
🚶🏻 Cloud Data Engineering Road Map 🏃🏻✅ Basic Version Control toolhttps://lnkd.in/gEqyhzZRhttps://lnkd.in/g_t2xKnGhttps://lnkd.in/gZT7QNjS ✅ Data Warehousing Conceptshttps://lnkd.in/gq99PDcp ✅ Core Pythonhttps://lnkd.in/gQpmSnM ✅ Spark SQLhttps://lnkd.in/gDcR5bwM ✅ Databrickshttps://lnkd.in/gSpKBWbJhttps://lnkd.in/gpbMg9nU ✅ Sparkhttps://lnkd.in/gtqRtTPvhttps://lnkd.in/gs2gkqRq ✅ Pysparkhttps://lnkd.in/gmkPpmAXhttps://lnkd.in/gh-_KzjE ✅ Delta Lakehttps://lnkd.in/gt6ggER6 ✅ Cloud ETL Tool + Storagehttps://lnkd.in/gTs8y4Ai ✅ Cloud MPP Warehousehttps://lnkd.in/gMTHCrNZ ✅ Databricks Unity Cataloghttps://lnkd.in/gH6Q2a5K📕 Learn , Lead and Make Leaders 🚀. Happy Learning 📖Follow 👉... Continue Reading →
Big Data Pro Resources
#Resources Referred by me for Big data Technologies These resources are available for free in YouTube, which helped me to crack CISCO.. and for you to crack product based companies also..1.Hadoop ,sqoop and Hive concepts by Saif shaik:https://lnkd.in/ewyYweTJ2.pyspark concepts in depth by karunakar goud:https://lnkd.in/eNtFkxmd3.Another spark playlist which useful Raja's Data Engineering channel.https://lnkd.in/eqiy7dBS4. Hadoop and Kafka... Continue Reading →
SQL Learning Resources
Learn sql for free and earn 10X salary growth. Yes it possible. Here are the 6 best free resources for learning SQL for free -- --Khan Academy -https://lnkd.in/gCZ5fS7x--SQLZoo - https://sqlzoo.net/--Codecademy - https://lnkd.in/gWyMTS-G--SQLBolt - https://sqlbolt.com/--Udacity - https://lnkd.in/gxpBMteQ--SQL for Web Nerds - https://lnkd.in/gRPT3P5X
CODEBOX 