Data Engineer

About the team

Join a team at the forefront of regulatory reporting transformation. The team is building a strategic Regulatory Reporting Automation Platform that automates the preparation, validation, and submission of regulatory returns required by the South African Reserve Bank (SARB). This platform replaces manual, spreadsheet-driven processes with a scalable, Python-based solution that enhances data quality, auditability, and operational efficiency. As a Data Engineer, you will contribute to a modern data platform that combines software engineering, data engineering, cloud technologies, and configurable rules engines to process large volumes of financial data and transform it into regulator-ready outputs.

Purpose Statement

You will design, build and maintain robust, scalable and efficient data platforms, applications and infrastructure that power data-driven decision-making across the organisation. You'll analyse business and system requirements, contribute to solution design documentation alongside Data Architects and build the pipelines and applications that keep data flowing reliably and efficiently.

Education (Minimum)

Education (Ideal or Preferred)

Knowledge and Experience

Knowledge:

• Advanced Python — the core technical requirement for this role
• Strong SQL — modelling principles and query optimisation
• Deep knowledge of AWS cloud data services
• Application development and API design — Django or a similar backend framework is advantageous
• Kubernetes and containerised data solutions
• Batch processing concepts and basic stream processing
• ETL pipeline design, including error handling and recovery mechanisms
• Data lake and data warehouse patterns
• Data quality and governance implementation
• CI/CD principles, version control and automated testing
• Infrastructure as code and workflow orchestration tool

Experience:

• 5 years in data engineering or a closely related field —  what counts is direct involvement in solution implementation and integration
• Experience leading or significantly contributing to data engineering projects
• Strong, hands-on Python and AWS experience
• Backend application development experience — Django or similar frameworks;
• API development experience
• Experience working with cross-functional teams — finance, IT, business analysts — to understand business needs and deliver data-driven solutions, including communicating technical progress to non-technical stakeholders
• Snowflake experience is an advantage

Additional Information