It is very rare that the usage of HIVE with JSON. But sometimes business requirements might force the developers to…
There are multiple ways to do this Spark. Here we have discussed two of the approaches to accomplish this task.…
Design choices: Language choice This impossible to answer and highly depends on your requirement. If you want to perform some…
These functions are little rarely used in Spark as they confined to be used with RDDs only and RDDs are…
Spark supports multiple programming languages. Out of them most used languages are Scala, Python and Java. But which is best…
Caching is one of the best optimization techniques available on Spark. When we cache any RDD or DataFrame, Spark will…
1). Spark jargon – Job A Spark application will have a number of sub-processes and each of them can be…
What is Minus operation? Below is a picture that shows Venn diagram of result of minus operation between two tables…
In this I have given all miscellaneous interview questions related to UNIX. For Unix interview questions we should try to…
In Big Data applications we rarely get the requirement to pivot the data because making transpose of billions of rows…