About experience in preview jobs
Data Engineer Interview Questions
Data Engineer Interview Questions
Data engineers are IT professionals who are needed in almost every industry. Data engineers monitor data trends to determine best next steps for companies. A critical part of a data engineer job is to process raw data into usable data by creating data pipelines and building data systems.
Top Data Engineer Interview Questions & How To Answer
Question #1: Can you describe in detail your level of expertise with programming languages?
Question #2: Explain data engineering in your own words.
Question #3: Can you describe your experience working with Apache Hadoop and cloud data management environments?
20,268 data engineer interview questions shared by candidates
How to setup AWS for hadoop??
1. Make an class that implements a rate-limited API. 2. Create an architecture for user analytics. 3. Debug a redshift query. 4. How do you handle conflict at work?
I was asked to build a security solution for the company and describe how it would be rolled out based on parameters provided by the interviewers.
Data Modelling: Given an input file for shoppers that should be loaded into row based DB, what is the optimized DB model (table / tables & columns) that will performs best for the following queries: 1) Get shoppers that are eligible for email & FB 2) Get shoppers that are eligible for email OR App 3) Get active shoppers (status = "A") that are NOT eligible for SMS Assumptions: there are 4 different delivery channels: e-mail, App, FB, SMS a shopper may have more than one delivery channels shopper has 2 status: A - Active or D - Disabled input data structure: +----------+-------+-------+--------+--------+--------+---------+ | id (key) | status| city | dc_1 | dc_2 | dc_3 | dc_4 | +----------+-------+--------+--------+--------+-------+---------+ |L1 | A | NY | e-mail | SMS | | | +----------+-------+--------+--------+--------+-------+---------+ |L2 | A | LA | e-mail | FB | App | | +----------+-------+--------+--------+--------+-------+---------+ |L3 | D | LA | SMS | FB | | | +----------+-------+--------+--------+--------+-------+---------+
SQL Analytical Functions (windowing functions) Analytics Methodology (insights storytelling ) Heaps of Behavioural/Situational Questions. (how you react to a stressful situation, etc.)
1. Walk through the your coding process? 2. What are the challenges faced by you and how you overcame them? 3. Interview stressed a little about the datastructures? 4. Knowledge about data pipeline is a plus.
In a composite subsea cable, which component takes the tensile load?
What python library are you familiar with?
Given live minutely data for various tickers, how would you design a system that executes a DAG of computing thousands of signals, making everything available in a relational database? How would you publish the availability of this data (not the data itself, but metadata about it)? How would you publish and facilitate tracking if one or more signals could not be computed?
Viewing 2341 - 2350 interview questions