South Africa Job Openings
CyberPro Consulting
AWS Data Engineer
Johannesburg
November 29, 2024
Job Information
Job Description
-
Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with Third Parties – Glue, Step-functions, Kafka CC, Py Spark, Dynamo DB, Delta.io, Red Shift, Lambda, Delta Lake, Python.
-
Analyze, re-architect and re-platform on-premises data warehouses to data platforms on AWS cloud using AWS or Third-Party services and Kafka CC.
-
Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Py Spark, Scala, Kafka CC.
-
Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
-
Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.
-
Design, implement and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.
-
Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, AWS big data technologies and Kafka CC.
-
Creation and support of real-time data pipelines built on AWS technologies including Glue, Lambda, Step Functions, Py Spark, Athena and Kafka CC.
-
Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency.
-
Working closely with team members to drive real-time model implementations for monitoring and alerting of risk systems.
-
Collaborate with other tech teams to implement advanced analytics algorithms that exploit Liberty’s rich datasets for statistical analysis, prediction, clustering, and machine learning.
- Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for Liberty customers.
Design data across the full range from fast/clean ETL streams through to automation. Ability to use big data technologies on AWS cloud services: Athena, Lambda, Cloud Formation Stack, EMR, Spark/Storm, Kafka/Elastic Search. Ability to work with large data sources. Advanced knowledge of SQL (Oracle, Redshift, Postgre SQL).
Requirements
Academic Field
Academic Sub-Field
NQF
Bachelor`s Degrees and Advanced Diplomas
Physical, Mathematical, Computer and Life Sciences
Information Technology and Computer Sciences
NQF Level 07
New Job Alerts
SPARK Schools
High School Natural Science & Technology (SP) - SPARK Rivonia High - 2025
Rivonia
FULL TIME
December 4, 2024
View Job DescriptionOdity Cape Town
Dutch Customer Service Brand Ambassador
Cape Town
FULL TIME
December 4, 2024
View Job Description
Novo Nordisk
Director Legal, Ethics, Compliance and Quality
Johannesburg
December 4, 2024
View Job DescriptionMomentum Insure Company Limited
Senior Java Developer
Centurion
FULL TIME
December 4, 2024
View Job Description
Jotun Group
Sales Specialist - Infrastructure
Durban
FULL TIME
December 4, 2024
View Job Description
Corporate Traveller
Customer Success Manager (CSM)- RSA
FULL TIME
December 4, 2024
View Job DescriptionLooking for similar job?
Ampath Laboratories
Data Input Clerk - Bloemfontein Mediclinic
Bloemfontein
FULL TIME
November 29, 2024
View Job Description
MSCI Inc
Real Assets Data Operations Analyst
Stellenbosch
FULL TIME
November 28, 2024
View Job Description
Medbelle GmbH
Analytics Engineer / Data Engineer (Remote - Malaysia or South Africa Only)
Cape Town
FULL TIME
November 25, 2024
View Job DescriptionNew Job Alerts
SPARK Schools
High School Natural Science & Technology (SP) - SPARK Rivonia High - 2025
Rivonia
FULL TIME
December 4, 2024
View Job DescriptionOdity Cape Town
Dutch Customer Service Brand Ambassador
Cape Town
FULL TIME
December 4, 2024
View Job Description
Novo Nordisk
Director Legal, Ethics, Compliance and Quality
Johannesburg
December 4, 2024
View Job DescriptionMomentum Insure Company Limited
Senior Java Developer
Centurion
FULL TIME
December 4, 2024
View Job Description
Jotun Group
Sales Specialist - Infrastructure
Durban
FULL TIME
December 4, 2024
View Job Description
Corporate Traveller
Customer Success Manager (CSM)- RSA
FULL TIME
December 4, 2024
View Job Description