Overview

DATA ENGINEER Jobs in Bryanston, Gauteng, South Africa at Competent Candidates

Title: DATA ENGINEER

Company: Competent Candidates

Location: Bryanston, Gauteng, South Africa

Our client, a well‑established group of companies, is looking for a Data Engineer with strong analytics skills (strong problem-solving skills, understanding data characteristics, identifying patterns, and addressing data quality issues). This is the ideal position for someone who wants to build their career by working for a company with an excellent reputation.

Formal Education

  • Degree in Data Science, Information Technology, Computer Science or equivalent.

Advantageous

  • Cloud Data Certifications.
  • Exposure to regulated environments, financial services, fintech.

Experience

  • Minimum of 2 years in a data engineer role or a similar technical role.

Responsibilities

  • Build and maintain ETL pipelines supporting a multi-tenant data platform, ingesting data from APIs, databases, and event sources.
  • Build and maintain Data Platform APIs that allow teams to ingest, process, and access data easily and reliably.
  • Implemented tenant-specific logic by following existing configuration and naming conventions.
  • Apply tenant-level data isolation using schemas, partitions, or access controls.
  • Build models from existing templates used for financial and operational reporting. Develop models for analytics and reporting, maintaining consistency with shared data models.
  • Monitor scheduled pipelines, investigate failures, and resolve data quality issues and inconsistencies.
  • Maintain daily and incremental data loads into the data warehouse.
  • Assist with onboarding new clients by validating source data and testing pipeline outputs.
  • Work closely with senior data engineers to learn patterns for multi-tenant data isolation.
  • Collaborate with analytics, product, and customer facing teams to understand reporting needs
  • Support strict regulatory and audit requirements by following data handling, retention, and audit guidelines.
  • Handle financial and sensitive data (PII) according to company policies and regulatory standards (e.g. POPIA).
  • Apply least-privilege access and role-based access controls, and support data protection through masking, encryption, and established security standards.

Technical Skills

  • Programming languages – Good knowledge of programming languages such as Python, especially used for pipeline and data manipulation.
  • SQL – working experience using SQL for data cleaning, aggregation, data transformation and integration.
  • Data Warehouse – have a fundamental understanding of data warehousing solutions and platforms.
  • Databases – hands-on experience working with relational and non-relational databases.
  • Cloud computing – comfortable building data solutions using cloud-hosted services or data platforms.

Data Engineering Practice

  • Data modelling and ETL – Can communicate and translate business requirements into existing data models.
  • Data Pipeline Development– build and validate smaller-scale data pipelines independently.
  • CI/CD and Version Control – apply best practices for managing pipelines and data workflows.

Core Cloud Data Technology, CI/CD and Programming tools

  • Azure Data Lake Gen2, Blob Storage
  • Azure SQL, PostgreSQL
  • Azure Data Factory, Azure Synapse Analytics
  • Azure DevOps
  • Azure Entra, RBAC, Key Vault
  • Azure Web Apps
  • Git

Apply

Upload your CV/resume or any other relevant file. Max. file size: 800 MB.