Platform Data Engineer
IT – Analyst, Data Management
Stellenbosch – Western Cape
ENVIRONMENT:
A niche company specializing in Intelligent Automation (IA), Digitization, Virtual Agents, and Low Code solutions is in search of a forward-thinking Data Platform Engineer. This individual’s primary responsibility is to play a key role in shaping and creating new applications and systems that align with the business needs of the data platform environment. This includes assessing business and system requirements, as well as the enhancement and construction of data platforms. Furthermore, the candidate will actively engage and offer insights to the Architect in the process of compiling solution design documentation for both new and established data platforms.
REQUIREMENTS:
Qualification (minimum)
- Bachelor degree or relevant experience – Information Technology | Data Analysis | Computer Science
Qualification (ideal)
- Degree in Data Engineering
- AWS Certified Cloud Solution Architect
- AWS Certified Database Speciality)
- Data Warehousing certification
Knowledge and Experience (minimum)
Minimum:
Experience:
- at least 6 years’ proven experience within management information systems (MIS) | data warehousing | data transformation information systems / systems analysis together with a relevant 3-year tertiary qualification
OR
- At least 6-8 years’ proven experience within management information systems / system analysis
- Proven experience in:
- Working in a cloud environment.
- Data storage and access technologies
- Testing methodologies
- Mentorship
- Quality assuring work of others
Knowledge:
- IT systems development processes (SDLC)
- Data pipelines
- Rational database system and / or cloud data warehousing and / or big data frameworks
- Dimensional modelling
- Standards and governance
- Testing practices
- People leadership practices and principles
- Quality assurance practices and processes
Knowledge and Experience (Ideal)
Experience:
- Experience working in an AWS environment as well as with AWS Technologies and Azure
- Orchestration technologies
- Data modelling
Knowledge:
- Data architecture (technical design and implementation processes)
- Banking systems environment
- Banking business model
- Best practices for Quality Assurance (QA)
Functional Skills:
- Expert level skill in:
- Programming concepts
- Version control
- Cloud computing
- Infrastructure as code
- Python coding
- Pyspark
- Applying Big Data frameworks
- Determining and mapping dependencies
- Data streaming concepts
- Orchestration technologies
- Data Analysis skill to understand the profile of the data
- Streaming data and near time data, data solutions
Organisational Skills:
- Analytical skills
- Communication skills
- Interpersonal & Relationship management skills
- Problem solving skills
- Decision making