It is very rare that the usage of HIVE with JSON. But sometimes business requirements might force the developers to…
There are multiple ways to do this Spark. Here we have discussed two of the approaches to accomplish this task.…
Design choices: Language choice This impossible to answer and highly depends on your requirement. If you want to perform some…
These functions are little rarely used in Spark as they confined to be used with RDDs only and RDDs are…
Spark supports multiple programming languages. Out of them most used languages are Scala, Python and Java. But which is best…
Caching is one of the best optimization techniques available on Spark. When we cache any RDD or DataFrame, Spark will…
1). Spark jargon – Job A Spark application will have a number of sub-processes and each of them can be…
What is Minus operation? Below is a picture that shows Venn diagram of result of minus operation between two tables…
In Big Data applications we rarely get the requirement to pivot the data because making transpose of billions of rows…
EXISTS EXISTS operator will be used when we need to check if there is any row exists with a condition.…