Create a simple ETL pipeline in Airflow.
Senior Data Engineer Interview Questions
2,568 senior data engineer interview questions shared by candidates
Preguntas sobre kafka, estrategias de procesar datos en continua transformación (UPSERT) de forma distribuida en un delta lake. Otras relacionadas con el ETL y spark.
They asked me real-time scenario questions related to my work experience and how I handle production issues.
Given a list of domains, that are entered sorted, we want to minimize the output of urls by uniting sub-domains by only outputting their common ancestor. Also sibling domains should be listed as their common ancestor.
Big query optimization techniques (partitioning and clustering)
Interviewer mostly asked spark and python related questions as the position was mainly from ETL development
code test, tech discussion on data engineering tech stack and hm round
Window Functions, Python: implement decorator that calculates the time taken by a given function to execute
What data validation tool do you have experience with.
1. Explain the difference between SCD Type1, SCD Type2, SCD Type3
Viewing 701 - 710 interview questions