Skip to content

Big Data Interview

The Interview Hacker and Technical guide
  • Home
  • Blogs
  • About Us
  • Contact Us
  • Privacy Policy

Blog

  1. Pages:
  2. 1
  3. 2
  4. 3
  5. 4
  6. 5
  7. 6
  8. 7
  9. 8
  10. 9
  11. »

Option, Some, None in Scala (OR) How to handle null values in Scala?

January 19, 2021 admin Leave a comment

Functional programming is like writing a series of algebraic equations, and because you don’t use null values in algebra, you…

Continue Reading →

Posted in: Scala

What is Singleton object in Scala?

January 17, 2021 admin Leave a comment

What is Singleton object? Scala doesn’t have a concept called static. Instead of static, scala has something called Singleton object.…

Continue Reading →

Posted in: Scala

How to process JSON data or file in HIVE without using JsonSerDe?

December 20, 2020 admin Leave a comment

It is very rare that the usage of HIVE with JSON. But sometimes business requirements might force the developers to…

Continue Reading →

Posted in: Big Data, Hive Filed under: HIVEJSON

How to add unique index or unique row number to reach row of a DataFrame?

December 7, 2020 admin Leave a comment

There are multiple ways to do this Spark. Here we have discussed two of the approaches to accomplish this task.…

Continue Reading →

Posted in: Big Data, Spark

Advanced performance enhancement techniques in Spark.

December 6, 2020 admin Leave a comment

Design choices: Language choice This impossible to answer and highly depends on your requirement. If you want to perform some…

Continue Reading →

Posted in: Big Data, Spark Filed under: Spark, SparkPerformanceEnhancementTechniques

zip, zipWithIndex and zipWithUniqueId in Spark

admin Leave a comment

These functions are little rarely used in Spark as they confined to be used with RDDs only and RDDs are…

Continue Reading →

Posted in: Big Data, Spark Filed under: zip, zipWithIndex, zipWithUniqueId

Which is the best programming language to use with Spark?

December 5, 2020 admin Leave a comment

Spark supports multiple programming languages. Out of them most used languages are Scala, Python and Java. But which is best…

Continue Reading →

Posted in: Big Data, Spark Filed under: JAva, Python, Scala, Spark

When do Spark spills the cached RDD or DataFrame onto disk? (or) What is the threshold to spill the cached data onto disk in Spark?

admin Leave a comment

Caching is one of the best optimization techniques available on Spark. When we cache any RDD or DataFrame, Spark will…

Continue Reading →

Posted in: Big Data, Spark

Miscellaneous Spark interview questions – Part I

admin Leave a comment

1). Spark jargon – Job A Spark application will have a number of sub-processes and each of them can be…

Continue Reading →

Posted in: Spark

How to perform minus operation in Hive using joins?

December 4, 2020 admin Leave a comment

What is Minus operation? Below is a picture that shows Venn diagram of result of minus operation between two tables…

Continue Reading →

Posted in: Big Data, Hive Filed under: MinuOperationusingjoins
  1. Pages:
  2. 1
  3. 2
  4. 3
  5. 4
  6. 5
  7. 6
  8. 7
  9. 8
  10. 9
  11. »

Post navigation

Page 1 of 9
1 2 … 9 Next →

Follow Us

Contact Us

  • Email
    sparkandbigdatainterview@gmail.com
Privacy Policy
Copyright © 2021 Big Data Interview