class male female 1 2 1 2 0 2 3 2 0 class gender 1 m 1 f 1 m 2 f 2 f 3 m 3 m Using pyspark take the data from table1 and dump into another table in the format of table2 as given . Also please do vice-versa Question 2: dept salary 1 10 1 20 2 40 2 50 2 90 2 80 1 100 1 70 using pyspark sort the datasets as per salary and print out third highest row for each dept Question 3: How you the offset works in KAFKA , also write the syntax for it
related to SPARK and HIVE, very high level nothing in depth, can easily handled by guy working in BIg data from last 6 months
What is the flow of map side Join?
all basic java and big data questions
Basic MapReduce and Java questions. Covered other components in Hadoop eco system (Hive, Sqoop and Oozie). Few questions Spark performance and architecture.
Technical step was easy, questions about spark . In manager call only hdfs hadoop questions
All big data concept and python programming, Pyspark program
What are Spark optimisation technique’s ?
all big data questions
Write code/pseudo-code for given scenarios, design solution for given scenario and answer questions that evaluated leadership capabilities.
Viewing 1451 - 1460 interview questions