I prepared Spark SQL, DataFrames and Datasets LATEST PROGAMMING GUIDE for my Clients
Here I am sharing the links that will help you.
Overview: Spark SQL is a Spark module for structured data processing. Unlike the basic Spark RDD API, the interfaces provided by Spark SQL provide Spark with more information about the structure of both the data and the computation being performed. Internally, Spark SQL uses this extra information to perform extra optimizations. There are several ways to interact with Spark SQL including SQL and the Dataset API. When computing a result, the same execution engine is used, independent of which API/language you are using to express the computation. This unification means that developers can easily switch back and forth between different APIs based on which provides the most natural way to express a given transformation.
Digital Transformation Strategic Advisor
Big Data | Artificial Intelligence and Machine Learning Consultant | 00 31 6 83952246