I have been looking at Apache Spark 2.0 and trying to use Spark SQL to process some data in text files. The data is structured as follows
How would I run SparkSQL queries on data schema such as this.
I also realize spark provides various options to read data sources.
Could anyone of these be used?
This solved the task for me