8-week journey toward becoming an AWS Solutions Architect AssociateHere's the breakdown:🚀 Week 1: AWS Fundamentals- Introduction to AWS: Discover the basics and the core services that form the backbone of AWS- AWS Free Tier Account: Learn how to set up an account to leverage AWS's free offerings.- AWS Management Console: Navigate the user interface to... Continue Reading →
Spotify Cloud Project
Spotify Stream Analytics 🎥Built a synthetic data pipeline for real-time music insights, stunning dashboards, and actionable decisions.🌟 Project Overview:Addresses limited Spotify stream data access with a synthetic pipeline. Realistic events stream to Kafka, processed by Spark, stored in Deltalake. Airflow ensures a seamless pipeline, and dbt transforms data into captivating dashboards.📌 Key Features:Streamlined Infrastructure: Scripts... Continue Reading →
Big Data Learning Resources
Complete Plan to learn Big Data Step by Step (All Free resources Included) by Sumit Sir.1. Learn SQL Basics - https://lnkd.in/g9NEJMVESQL will be used at a lot of places - Hive/Spark SQL/RDBMS queriesJoins & windowing functions are very important2. Learn Programming/Python for Data Engineering - https://lnkd.in/gr6fFPdULearn Python to an extent required for Data Engineers.3. Learn... Continue Reading →
Cloud Services in one line
If you are an aspiring Data Engineer then you must know these cloud services w.r.t AWS or AZURE or GCP 👇 Save this post for future reference ...1️⃣ Amazon Web Services (AWS)🛠 AWS Data Pipeline: For creating complex data processing workloads.📊 AWS Glue: Our favourite fully managed ETL service.💾 Amazon S3: An object storage service... Continue Reading →
Google Cloud Developer’s Cheat Sheet
All Products Compute Cloud Run: Serverless for containerized applications 🔗 📄 Cloud Functions: Event-driven serverless functions 🔗 📄 Compute Engine: VMs, GPUs, TPUs, Disks 🔗 📄 Kubernetes Engine (GKE): Managed Kubernetes/containers 🔗 📄 App Engine: Managed app platform 🔗 📄 Bare Metal Solution: Hardware for specialized workloads 🔗 Preemptible VMs: Short-lived compute instances 🔗 📄 Shielded VMs: Hardened VMs 🔗 📄 Sole-tenant nodes: Dedicated physical servers 🔗 📄 Storage Cloud Filestore: Managed... Continue Reading →
Google Cloud Platform Services Summary
The complete list of services that form Google Cloud Platform is shown below. While Google offers many other services and APIs, only the services below are covered by the Google Cloud Platform terms of service, service level agreements (if applicable), and support offerings. Offerings identified below as Software or Premium Software are not Services under... Continue Reading →
Google Cloud GCloud Commands Cheat Sheet
Google Cloud Config PURPOSECOMMANDList projectsgcloud config list, gcloud config list projectList projectsgcloud config list, gcloud config list projectShow project infogcloud compute project-info describeSwitch projectgcloud config set project <project-id>Set the active accountgcloud config set account <ACCOUNT>Set default regiongcloud config set compute/region us-westSet default zonegcloud config set compute/zone us-west1-bList configurationsgcloud config configurations listActivate configurationgcloud config configurations activate Google Cloud... Continue Reading →
Top 7 GCP tools to learn for FREE.
Top 7 GCP #dataengineering tools to learn for FREE.....1. Google Bigqueryhttps://lnkd.in/g4Pvu8aq2. Google cloud Dataprochttps://lnkd.in/gZbJV_8shttps://lnkd.in/gkDeVqtb3. Google cloud Dataprephttps://lnkd.in/gF4G3uAK4. Google Cloud composerhttps://lnkd.in/gjfnYb3whttps://lnkd.in/grGTQYtT5. Google cloud Data Fusionhttps://lnkd.in/gfmxapqP6. Google Data Studiohttps://lnkd.in/gus75kYW7. Google cloud Dataflowhttps://lnkd.in/gyxKXaGU 8. Datawarehousing with Big query https://youtu.be/ZVgt1-LfWW4?si=dPVaNH9LgU-Wfo7s complete GCP Full course for FREE....https://lnkd.in/gi48NG3zResources are short and crispy, and definitely recommended.
AWS Certification
FREE AWS Certificate by Amazon that you can't miss in 20231. Getting Started with Data Analytics on AWS🔗https://lnkd.in/dwRhRAzM2. Practical Data Science on the AWS Cloud Specialization🔗https://lnkd.in/d3-3GZbG3. Getting Started with AWS Machine Learning🔗https://lnkd.in/dhAp-Vjh4. Introduction to Machine Learning on AWS🔗https://lnkd.in/detfDCWA5. Hands-on Machine Learning with AWS and NVIDIA🔗https://lnkd.in/dgGvATq26. AWS Fundamentals Specialization🔗https://lnkd.in/dSV9jhRz7. Building Modern Python Applications on AWS🔗https://lnkd.in/dQAinFGy8. AWS... Continue Reading →
Important Services for Data Engineers provided by AWS, Microsoft Azure & GCP
AWS Lambda :AWS Lambda is a serverless compute service allowing running code without provisioning or managing servers, paying only for actual usage.Amazon Redshift :Amazon Redshift is a fully managed, petabyte-scale data warehouse service that makes it simple and cost-effective to analyze vast amounts of data using SQL and existing BI tools.AWS Glue :AWS Glue is... Continue Reading →
CODEBOX 