Spark Context: 🔶 Spark context is the traditional entry point to any Spark application 🔶 It represents the connection to the spark cluster and is the place where the user can configure the common properties for the entire application to create RDD 🔶 SparkContext is designed for low-level programming & fine-grained control over the Spark application 🔶 Get the current status of the spark application 🔶 Access various service 🔶 Cancel a job 🔶 Cancel a stage 🔶 Closure cleaning 🔶 Register Spark-Listener 🔶 Programmable Dynamic allocation 🔶 Access persistent RDD Common Challenges  🔶 Managing multiple contexts 🔶 Need proper context initialization 🔶 failing to manage context correctly leads to performance 🔶 Before Spark 2.0, have to create specific Spark contexts for any other interaction (Hive, SQL & Streaming Context) 🔶 In a Multiuser-Multi Application case-conflict can arise when multiple users or applications try to use the same context 🔶 Legacy code base Spark S...