If you are an aspiring Data Engineer then you must know these cloud services w.r.t AWS or AZURE or GCP π Save this post for future reference …
1οΈβ£ Amazon Web Services (AWS)
π AWS Data Pipeline: For creating complex data processing workloads.
π AWS Glue: Our favourite fully managed ETL service.
πΎ Amazon S3: An object storage service offering scalability, data availability, security, and performance.
π Amazon Kinesis: Use it for real-time, streaming data.
π Amazon Redshift: A fast, fully managed, petabyte-scale data warehousing service.
π
Amazon CloudWatch Events: A service for scheduling and automation of events or functions.
π Amazon DynamoDB: A key-value and document database offering performance at scale.
2οΈβ£ Google Cloud Platform (GCP)
π½ Google Cloud Storage: A unified, scalable, and durable storage system.
π Google Cloud Dataflow: A fully managed streaming analytics service.
π Google Pub/Sub: A messaging middleware for asynchronous communication.
π Google BigQuery: Use it for super-fast SQL queries.
π Google Cloud Bigtable: A NoSQL database service for use cases where low latency reads and high-powered analytics are critical.
π
Google Cloud Scheduler: A fully managed cron job scheduler.
π Google Cloud SQL: A fully-managed relational database service for MySQL, PostgreSQL, and SQL Server.
3οΈβ£ Microsoft Azure
π½ Azure Data Lake Storage: A hyper-scale data lake for storing and analyzing petabyte-size files.
π Azure Data Factory: A hybrid data integration service.
π Azure Event Hubs: A big data streaming platform and event ingestion service.
π Azure Synapse Analytics: An analytics service uniting big data and data warehousing.
π Azure SQL Data Warehouse: An analytics service providing fast query performance for big data workloads.
π
Azure Logic Apps: A service for creating workflows that integrate apps, data, services, and systems.
π Azure Cosmos DB: A multi-model database for building globally distributed applications.
In interviews, companies don’t expect you to be proficient in all cloud platforms, if you know anyone of them thoroughly that’s good enough
Leave a comment