Published : Tuesday, Oct 1, 2024
Data Engineer - Egypt
Department: Digital Services
Type: Full Time
Qualifications
· Proficiency in Snowflake data platform (Snowpipe, Snowflake Streams, Tasks, etc.).
· Experience in ETL tools.
· Knowledge of data warehousing concepts, data modeling, and data lake design.
· Familiarity with a cloud platform and integrations with Snowflake.
· Strong understanding of data governance and security principles.
· Familiarity with Python, Spark, and other data processing frameworks.
· Problem-solving and critical thinking skills to handle data quality issues.
Responsibilities
· Ingest data from multiple sources into Snowflake. · Build and optimize data pipelines for data warehousing.· Implement data standardization, historical data consolidation, and data quality processes.
· Work on data transformations using SQL, Python, or other ETL tools.
· Develop and maintain master data management frameworks.
· Ensure data security and governance policies are followed in Snowflake.
· Collaborate with data architects and analysts to support data workflows.