South Africa Job Openings
CyberPro Consulting
AWS Data Engineer
Johannesburg
November 29, 2024
Job Information
Job Description
-
Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with Third Parties – Glue, Step-functions, Kafka CC, Py Spark, Dynamo DB, Delta.io, Red Shift, Lambda, Delta Lake, Python.
-
Analyze, re-architect and re-platform on-premises data warehouses to data platforms on AWS cloud using AWS or Third-Party services and Kafka CC.
-
Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Py Spark, Scala, Kafka CC.
-
Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
-
Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.
-
Design, implement and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.
-
Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, AWS big data technologies and Kafka CC.
-
Creation and support of real-time data pipelines built on AWS technologies including Glue, Lambda, Step Functions, Py Spark, Athena and Kafka CC.
-
Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency.
-
Working closely with team members to drive real-time model implementations for monitoring and alerting of risk systems.
-
Collaborate with other tech teams to implement advanced analytics algorithms that exploit Liberty’s rich datasets for statistical analysis, prediction, clustering, and machine learning.
- Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for Liberty customers.
Design data across the full range from fast/clean ETL streams through to automation. Ability to use big data technologies on AWS cloud services: Athena, Lambda, Cloud Formation Stack, EMR, Spark/Storm, Kafka/Elastic Search. Ability to work with large data sources. Advanced knowledge of SQL (Oracle, Redshift, Postgre SQL).
Requirements
Academic Field
Academic Sub-Field
NQF
Bachelor`s Degrees and Advanced Diplomas
Physical, Mathematical, Computer and Life Sciences
Information Technology and Computer Sciences
NQF Level 07
New Job Alerts
Motus Corporation
Vehicle Stock Controller Kia South Africa (Pty) Ltd - Brackenfell
Brackenfell
December 4, 2024
View Job Description
Motus Corporation
Pre-Owned Vehicle Sales Manager Kia South Africa (Pty) Ltd - Silverlakes
December 4, 2024
View Job Description
Motus Corporation
New Vehicle Sales Executive Kia South Africa (Pty) Ltd - Tygervalley
December 4, 2024
View Job Description
Motus Corporation
Junior Parts Sales Executive Kia South Africa (Pty) Ltd - Western Cape Parts Distribution Centre
December 4, 2024
View Job Description
Ampath Laboratories
Lab Assistant: NRL Autolab - Centurion (Night Shift)
FULL TIME
December 4, 2024
View Job DescriptionCindy's Swim School
Administration and Customer Service Assistant
Cape Town
FULL TIME
December 4, 2024
View Job Description
Looking for similar job?
Ampath Laboratories
Data Input Clerk - Bloemfontein Mediclinic
Bloemfontein
FULL TIME
November 29, 2024
View Job Description
MSCI Inc
Real Assets Data Operations Analyst
Stellenbosch
FULL TIME
November 28, 2024
View Job Description
Medbelle GmbH
Analytics Engineer / Data Engineer (Remote - Malaysia or South Africa Only)
Cape Town
FULL TIME
November 25, 2024
View Job DescriptionNew Job Alerts
Motus Corporation
Vehicle Stock Controller Kia South Africa (Pty) Ltd - Brackenfell
Brackenfell
December 4, 2024
View Job Description
Motus Corporation
Pre-Owned Vehicle Sales Manager Kia South Africa (Pty) Ltd - Silverlakes
December 4, 2024
View Job Description
Motus Corporation
New Vehicle Sales Executive Kia South Africa (Pty) Ltd - Tygervalley
December 4, 2024
View Job Description
Motus Corporation
Junior Parts Sales Executive Kia South Africa (Pty) Ltd - Western Cape Parts Distribution Centre
December 4, 2024
View Job Description
Ampath Laboratories
Lab Assistant: NRL Autolab - Centurion (Night Shift)
FULL TIME
December 4, 2024
View Job DescriptionCindy's Swim School
Administration and Customer Service Assistant
Cape Town
FULL TIME
December 4, 2024
View Job Description