Full-Time Data Engineer – Sandton
The incumbent will join a central team tasked with consolidating and extracting value from diverse datasets from group business units.
Your main responsibility will be building and maintaining an advanced analytics capability on 100 million transactions per month scale.
You will implement and manage a platform for distributed processing on transactional data (Hadoop + Spark).
You will take over and streamline ETL jobs that load master data into a SQL data warehouse.
You will support the use of both SQL and HDFS and productionise data flows.
You will advise on IaaS or PaaS in the cloud and optimize cloud resource utilization.
Data Engineer – Sandton
In summary; you will work with a data scientist(s) to build a data platform that
(1) scales to the transactional load,
(2) enables distributed/high-performance analytical processing and predictive modeling and
(3) serves a BI self-service layer with aggregated results.
A solid foundation of data processing techniques, as well as a drive and aptitude to identify and adopt promising new technologies, is essential. Expertise of SQL and noSQL ecosystems is required. Experience in a cloud platform (Azure, AWS, GCC) will be advantageous.
- Posted By: admin
- Locaton : Sandton, Gauteng, South Africa
- Job Categories: Information Technology.
- Job Types: Full-Time.
- Job Tags: Data Engineer - Sandton.
- Salary: 40,000 - 60,000.
Job expires in 19 days.
757 total views, 2 today
Helpdesk Support Agent Educational Requirements: Matric Completed Relevant IT Degree or Diploma or relevant certificates (Must have) Experience Requirements: Must have at least 4 years’ experience Must have good communication skills (written & verbal) Must be able to communicate effectively telephonically Must be attentive to detail, analytical & able to problem solve Must be proficient […]
Field Technician (Information Technology)
Field Technician A Field Technician is urgently needed with own car and valid driver’s license. Basic Salary R5000-00 and fuel allowance. No experience is needed but an electrical background is preferred. Field Technician – Must be computer literate. – Criminal record clear. – Be able to pass a polygraph test on a regular basis. – […]
Cyber Security Specialist (Manufacturing)
Cyber Security Specialist (Manufacturing) Location: Centurion, Pretoria, South Africa Salary: Market Related Our client in the manufacturing industry is looking for a Cyber Security Specialist to provide end-to-end security solutions for the monitoring, assessment and defense of client’s information assets. Key responsibilities • Seeking to build in security during the development stages of software systems, […]