Skip to content
Big Data Interview
The Interview Hacker and Technical guide
  • Home
  • Blogs
  • About Us
  • Contact Us
  • Privacy Policy

Category: Scala

Lead and Lag using Spark Scala

May 13, 2021 admin Leave a comment

Sometimes while processing data we will come across some situations where we need to find the difference of price a…

Continue Reading →

Posted in: Scala, Spark Filed under: Lag, Lead

Option, Some, None in Scala (OR) How to handle null values in Scala?

January 19, 2021 admin Leave a comment

Functional programming is like writing a series of algebraic equations, and because you don’t use null values in algebra, you…

Continue Reading →

Posted in: Scala

What is Singleton object in Scala?

January 17, 2021 admin Leave a comment

What is Singleton object? Scala doesn’t have a concept called static. Instead of static, scala has something called Singleton object.…

Continue Reading →

Posted in: Scala

What is Monad in Scala?

July 21, 2019 admin 2 Comments

What is Scala Monad? Monad is neither a data type nor class/trait. Monad is a concept. There are lot ways…

Continue Reading →

Posted in: Scala, Spark Filed under: Monad in Scala, Scala Monad

map vs mapValues

June 16, 2019 admin Leave a comment

mapValues – This function works with PairRDDs only. So this function always requires an RDD of type RDD[(a,b)]. mapValues functions…

Continue Reading →

Posted in: Scala, Spark

Recent Posts

  • Save action in Spark takes too long time/Save operation spills huge data on to disk and fails with the error “No space left on device”
  • How to set configuration to start Reduce jobs after completion of certain proportion of the Map jobs in Hive or Hadoop?
  • HDFS commands

Recent Comments

  • curry 7 sour patch on Spark groupByKey vs reduceByKey vs aggregateByKey
  • jordan 4 on Hive – Order By vs Sort By vs Cluster By vs Distribute By
  • louboutin shoes on Spark RDD vs Dataframe vs Dataset

Archives

  • August 2021
  • June 2021
  • May 2021
  • January 2021
  • December 2020
  • October 2020
  • July 2020
  • May 2020
  • April 2020
  • March 2020
  • November 2019
  • July 2019
  • June 2019
  • May 2019

Follow Us

Contact Us

  • Email
    sparkandbigdatainterview@gmail.com
Privacy Policy
Copyright © 2023 Big Data Interview