Azure Data Engineer
IT – Analyst, Data Management
Gauteng – South Africa, Cape Town – Western Cape – South Africa
ENVIRONMENT:
AN innovative robotics and AI company seeks an Azure Data Engineer to join their team. The Azure Data Engineer is responsible for building and maintaining scalable data pipelines and solutions in Microsoft Azure. You will design, implement, and optimize data architectures and services that enable data-driven decision-making across the organization.
DUTIES:
- Develop and maintain data pipelines using Azure Data Factory, Databricks, Synapse, etc.
- Design and implement data storage solutions using Azure Data Lake, Azure SQL DB, and Cosmos DB.
- Create and maintain data models and data warehouses.
- Perform ETL/ELT development and ensure data integrity and consistency.
- Work with stakeholders to understand data requirements and translate them into technical solutions.
- Optimize data solutions for performance, cost, and scalability.
- Implement CI/CD pipelines for data workflows.
- Ensure data governance, security, and compliance standards are met.
REQUIREMENTS:
- 3+ years’ experience in data engineering or related field.
- Strong experience with Azure cloud services, especially: Azure Data Factory
- Azure Databricks
- Azure Synapse Analytics
- Azure Data Lake
- Proficiency in SQL, Python, or Scala.
- Knowledge of data modeling, data warehousing, and distributed systems.
- Experience with version control (Git), DevOps, and CI/CD pipelines.
- Familiarity with Power BI is a plus.
Qualifications:
- Bachelor’s degree in Computer Science, Information Systems, Engineering or a related field.
- Azure certifications preferred