Difference between WHERE and HAVING clause in SQL Write queries to extract data using panda library functions
Data Engineer Interview Questions
Data Engineer Interview Questions
Data engineers are IT professionals who are needed in almost every industry. Data engineers monitor data trends to determine best next steps for companies. A critical part of a data engineer job is to process raw data into usable data by creating data pipelines and building data systems.
Top Data Engineer Interview Questions & How To Answer
Question #1: Can you describe in detail your level of expertise with programming languages?
Question #2: Explain data engineering in your own words.
Question #3: Can you describe your experience working with Apache Hadoop and cloud data management environments?
20,348 data engineer interview questions shared by candidates
What's the last most challenging problem you've faced. How did you face it?
1st Interview : - Make Sort class with some method then create BubbleSort class that must inherit Sort class and overwrite its method in python - Use of Lead window function(scenario based question) - Write a query to get employees who don't have any project assigned - hive partitioning vs bucketing - CI/CD - joins in spark 2nd Interview: - write data frame transformation and get the required result(scenario base question) - how to assign unique identifier to each record(Use monotonically_increasing_id()) - How to remove duplicates in dataframe(use df.dropDuplicates() function)
General interview questions follow up with some technical questions with the lead and hiring manager
Basic python programming questions and about educational qualifications
What's your experience with ETL/ ELT processes?
identify if a query has errors
What was your previous job experience? why you are leaving previous job.
What was your biggest failure?
Questions: what is data management, why would you be suited for this role, what kind technologies would you use to solve the problems that we are facing at the company.
Viewing 3181 - 3190 interview questions