Описание вакансии от работодателя
Project description
We are seeking a highly experienced Senior Data Engineer to design, develop, and optimize enterprise-scale data platforms using modern cloud technologies. The role involves building robust ELT pipelines, scalable data models, and analytics-ready datasets leveraging Snowflake, Azure Data Factory (ADF), DBT, Python, and SQL. The ideal candidate will play a key role in enabling data-driven decision making by delivering high-quality, governed, and performant data solutions.
Responsibilities
Key Responsibilities
Design and develop scalable ELT pipelines using Snowflake, ADF, DBT, and Python.
Build and maintain enterprise data models including 3NF, Star Schema, and Snowflake Schema.
Optimize Snowflake performance through query tuning, clustering, micro-partitioning, and warehouse management.
Develop reusable and modular data transformation frameworks using DBT (Jinja, Macros, Testing, Documentation).
Automate data ingestion, transformation, and operational processes using Python, Pandas, and PySpark.
Implement workflow orchestration using tools such as Apache Airflow, Prefect, or Dagster.
Establish data quality, governance, monitoring, and CI/CD best practices.
Collaborate with Data Analysts, Data Scientists, Product Owners, and Business Stakeholders to deliver trusted data products.
Create and maintain technical documentation, deployment procedures, and operational runbooks.
Mandatory Skills
Snowflake Data Warehouse
Azure Data Factory (ADF)
DBT
Python
Advanced SQL
Data Modeling (3NF, Star Schema, Snowflake Schema)
Apache Airflow / Prefect / Dagster
Cloud Platforms (Azure preferred)
Git and CI/CD
Data Quality and Governance Frameworks
Agile/Scrum Methodology
Nice-to-Have Skills
PySpark
Databricks
Microsoft Fabric
SKILLS
Must have
Mandatory Skills
Snowflake Data Warehouse
Azure Data Factory (ADF)
DBT
Python
Advanced SQL
Data Modeling (3NF, Star Schema, Snowflake Schema)
Apache Airflow / Prefect / Dagster
Cloud Platforms (Azure preferred)
Git and CI/CD
Data Quality and Governance Frameworks
Agile/Scrum Methodology
Nice to have
Nice-to-Have Skills
• PySpark
• Databricks
• Microsoft Fabric