Data engineers are IT professionals who are needed in almost every industry. Data engineers monitor data trends to determine best next steps for companies. A critical part of a data engineer job is to process raw data into usable data by creating data pipelines and building data systems.
SQL Data schema was provided. SQL to be written that used left joins, nulls in filter, count func., case stmt. Python create a histogram from a given list flatten a list: [1,2,[3,4. [5],[6,7,[8,[9]]]]] remove duplicates from a list count words in a sentence
5 SQL and 5 Python
Q3. What was the total value of sales and the number of unique paying customers, grouped and sorted in descending order by payment type?
Perform a merge-sort with SQL only.
Onsite Interview: Cannot give specifics as I had signed NDA, but it is a real-world case study. You have to create Dimensional model and then write queries on whiteboard based on interviewer's requirements. Knowing "Key-Operating Metrics" is highly recommended.
1) Initial one round full of leadership related questions. Didn't expect a one hour full of leadership questions. This round was unexpected as recruiter didn't tell me that it's a leadership round. I was told this is a hiring manager screen where they wanted to check the fit. There were 2 hiring managers (of the 2 teams who were looking for a lead). 2) Initial coding screening - 2 Python coding questions - same as the ones that others mentioned in the Glassdoor. 1- data modeling question (social media site) and set of SQL questions against the data model. 3) Data pipeline system design interview. Asked high-level and low-level details of high data volume real-time pipeline. 4) Behavioral questions with cross-team based questions. 5) Technical round with ETL related question with SQL coding applied. One Python coding to build a grouping based ETL using Python. The output can be easily provided using SQL script. The challenge was to build the same using Python. Should be manageable somebody who's very hands-on. Unfortunately, I wasn't. Though I could write the pseudocode and think through the solution, I couldn't write the actual code within the time. 6) Design the data model for a ridesharing app and answer a set of questions using SQL. I underestimated the complexity of a couple of SQL questions in this round.
Career Question: How did you resolve a problem?
What is the fundamental of building a data pipeline. What is the most challenge project that you have ever worked on. If you have conflicts with your manager, what would u do
Lazy evaluation in spark meaning
Why do you want to pursue a career in tech?
Viewing 2621 - 2630 interview questions