Datafin

Mid-Level Data Engineer (Remote)

IT – Analyst, Data Management
Cape Town – Western Cape

ENVIRONMENT:
A fast-paced Tech Company providing cutting-edge Data Security Solutions seeks highly meticulous and solutions-driven Mid-Level Data Engineer who will be responsible for monitoring, maintaining and developing data-driven processes in the environment to support business objectives. You will be expected to drive a positive and supportive culture towards the Client Engagement team ensuring clients are satisfied with their service delivery. The ideal candidate must have Matric/Grade 12 with 5+ years of practical experience with large and complex data sets to implement Big Data technologies within the platform to enable innovation through data exploration. Your tech toolset should include Azure, ANSI preferably T-SQL, Kimble, ETL/ELT, OLTP and OLAP concepts, Azure Data Factory or SSIS.
 
DUTIES:
  • Monitor data processes to ensure continuity.
  • Ensure highest data quality assurance, data accuracy and data completeness through regular and in-depth review and testing of work.
  • Conduct data design, database architecture, metadata and repository creation activities and tasks as required by business stakeholders.
  • Design and maintain ETL pipelines.
  • Provide data management services to the Client Engagement team.
  • Provide input to data quality deliverables, conduct root cause analysis into anomalies and provide feedback to Data Governance Facilitator.
  • Identify and recommend data cleansing opportunities, new metrics, attributes, datasets to support business intelligence requirements.
  • Drive a data-driven approach to decisions.
  • Drive on a right-data at the right-time principle to intelligence.
  • Provide feedback to wider team to collaborate on digital strategy of data assets.
  • Gather business needs and clearly documenting expected outcomes.
 
REQUIREMENTS:
Essential –
  • Matric/Grade 12.
  • 5+ Years’ practical experience working with large and complex data sets as a SQL Developer or Data Engineer.
  • A sound understanding of data management principles including data quality assurance and data governance.
  • Experience with data pipelines and workflow management.
  • Good knowledge of data warehousing principles.
  • Practical knowledge of working within Azure cloud services. Experience with other cloud platforms is a bonus.
  • Experience in Business Intelligence.
  • Understanding of general business terminology.
  • Experience engaging with stakeholders at all levels of business.
Required Skills –
  • Solid SQL (ANSI – preferably T-SQL) experience including the ability to work with complex queries.
  • Solid Knowledge of dimensional modelling (Kimble).
  • Solid knowledge of RDBMS architecture.
  • Solid knowledge of OLTP and OLAP concepts.
  • Good knowledge of data integration concepts (ETL / ELT).
  • Good knowledge of database management especially pertaining to permissions, schemas and performance tuning and quality assurance.
  • Good experience working with Azure Data Factory or SQL Server Integration Services.
  • General Windows operating literacy.
 
Advantageous –
  • Technical Degree or Diploma (in related industry).
  • Formal Business/Technical Analysis training.
  • Relevant Data Certifications.
  • Experience with Python/Scala.
  • Experience with Databricks.
 
ATTRIBUTES:
  • Detail orientated.
  • Strong analytical and problem-solving skills.
  • Clear and concise communication skills.
  • Able to interpret and simplify information.
  • Strong ability to work to deadlines, across functions and juggle multiple projects. 
  • Ability to work independently, but also closely with team members when the need arises.