Code the world, byte by byte
βοΈApache Spark for data engineers is like SQL is for relational databases. Just as SQL is a standard language used to interact with and manipulate data in relational databases, Apache Spark provides a powerful framework for processing and analyzing data in a distributed computing environment. With Apache Spark, data engineers can perform complex data transformations,... Continue Reading →
Internal working of Apache Spark (don't forget to save it)ππ©πππ‘π ππ©ππ«π€ works on the principle of in-memory computation making it 100x faster and a highly performant distributed framework.Here is a detailed explanation on what happens internally when a spark job is executed using the spark-submit command - πππππ© 1 : Client application initiates the execution... Continue Reading →
