Apply for Senior PySpark Data Engineer Role at Luxoft

Italy Job Openings

Luxoft

Senior PySpark Data Engineer

December 4, 2024

Remote Italy, Italy

ETL (Informatica, Ab Initio etc.)

BCM Industry

04/12/2024

Req. VR-108990

Project description

We are hiring for projects in the Middle East. The team comprises front-end and back-end developers, data analysts and data scientists, architects, analysts, and project managers. You will work with modern technologies and be an integral part of continuing to evolve our high-performing platforms. If you are serious about being a part of this fast-paced and exciting journey, this project should be top of the list!
This role will be primarily responsible for closely collaborating with a business SME to implement data validation rules.

Responsibilities

Collaborating with a business SME to implement data validation rules.

Understand business requirements and actively provide input from a data perspective.

Understand the underlying data and flow of data.

Understand overall platform architecture and capabilities and how to load data effectively.

Recognize and adapt to the changes in processes.

Skills

Must have

7 years + of relevant experience.

Proficient hands-on experience with Py Spark-based data platforms:

Databricks, Cloudera, Apache Spark, etc. (3y+).

Proficiency in Python and Py Spark (5y+).

Advanced knowledge in SQL (5y+).

Should be able to analyse and understand complex data.

Knowledge of Azure data/delta lake, Azure Dev Ops, CI/CD, and Git is essential.

Should clearly understand the data platform lifecycle and contribute to preparing Design documents, Unit Test plans, and Code review reports.

Knowledge of data Lake house and business intelligence architecture.

Experience working in an Agile environment (Scrum, Agile) is a plus.

Interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision.

Bachelor's degree in IT/Computer Science or related field

Nice to have

Knowledge of the financial markets, portfolio theory, and risk management is a plus

Other

Languages
English: C1 Advanced

Seniority
Senior

We regret to inform you that this job opportunity is no longer available as it has expired

New Job Alerts

Segula Technologies

Progettista Meccanico Piping

Ferrara

FULL TIME

December 4, 2024

View Job Description

Sviluppatore Front-end Three.js - URGENTE

FULL TIME

December 4, 2024

View Job Description

Cesi Spa

HVDC Senior Expert

December 4, 2024

View Job Description

Luca Ceotto

Collaboratori dinamici a tempo pieno e part-time

Spilimbergo

FULL TIME & PART TIME

December 4, 2024

View Job Description

Eaton

Technical Field Service Engineer

Napoli

December 4, 2024

View Job Description

British School Group

Teacher of English for Young Learners 5+ Yrs

Melfi

FULL TIME

December 4, 2024

View Job Description

Prometeia

Senior Front-end Developer

Bologna

November 29, 2024

View Job Description

FAO

Senior Fishery Officer (Fishery Economics)

Roma

November 29, 2024

View Job Description

Gruppo Mediobanca

Senior Equity and Derivatives Trader

December 2, 2024

View Job Description

Vodafone

RAN Analysis, Troubleshooting and Terminals Senior Engineer

Sviluppatore Front-end Three.js - URGENTE

FULL TIME

December 4, 2024

View Job Description

Cesi Spa

HVDC Senior Expert

December 4, 2024

View Job Description

Luca Ceotto

Collaboratori dinamici a tempo pieno e part-time

Spilimbergo

FULL TIME & PART TIME

December 4, 2024

View Job Description

Eaton

Technical Field Service Engineer

Napoli

December 4, 2024

View Job Description

British School Group

Teacher of English for Young Learners 5+ Yrs

Melfi

FULL TIME

December 4, 2024

View Job Description

cloudpay

Italian Payroll and Implementation Specialist

Napoli

December 4, 2024

View Job Description