Italy Job Openings

Luxoft

Senior PySpark Data Engineer

December 4, 2024

Remote Italy, Italy
ETL (Informatica, Ab Initio etc.)
BCM Industry
04/12/2024
Req. VR-108990


Project description
We are hiring for projects in the Middle East. The team comprises front-end and back-end developers, data analysts and data scientists, architects, analysts, and project managers. You will work with modern technologies and be an integral part of continuing to evolve our high-performing platforms. If you are serious about being a part of this fast-paced and exciting journey, this project should be top of the list!
This role will be primarily responsible for closely collaborating with a business SME to implement data validation rules.
Responsibilities
Collaborating with a business SME to implement data validation rules.
Understand business requirements and actively provide input from a data perspective.
Understand the underlying data and flow of data.
Understand overall platform architecture and capabilities and how to load data effectively.
Recognize and adapt to the changes in processes.
Skills
Must have
7 years + of relevant experience.
Proficient hands-on experience with Py Spark-based data platforms:
Databricks, Cloudera, Apache Spark, etc. (3y+).
Proficiency in Python and Py Spark (5y+).
Advanced knowledge in SQL (5y+).
Should be able to analyse and understand complex data.
Knowledge of Azure data/delta lake, Azure Dev Ops, CI/CD, and Git is essential.
Should clearly understand the data platform lifecycle and contribute to preparing Design documents, Unit Test plans, and Code review reports.
Knowledge of data Lake house and business intelligence architecture.
Experience working in an Agile environment (Scrum, Agile) is a plus.
Interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision.
Bachelor's degree in IT/Computer Science or related field
Nice to have
Knowledge of the financial markets, portfolio theory, and risk management is a plus
Other
Languages
English: C1 Advanced
Seniority
Senior
New Job Alerts
CBRE

Hitrac Engineering Group - HSE Specialist - Roma

Roma

FULL TIME

December 4, 2024

View Job Description
Luca Ceotto

Collaboratori dinamici a tempo pieno e part-time

Spilimbergo

FULL TIME & PART TIME

December 4, 2024

View Job Description
Cesi Spa

HVDC Senior Expert

December 4, 2024

View Job Description
Sinergidea

Sviluppatore Front-end Three.js - URGENTE

FULL TIME

December 4, 2024

View Job Description
Segula Technologies

Progettista Meccanico Piping

Ferrara

FULL TIME

December 4, 2024

View Job Description
Dematic S.r.l.

Software Project Manager

Cernusco sul Naviglio

FULL TIME

December 4, 2024

View Job Description
Looking for similar job?
eLogic Digital Company

Developer Senior Drupal / PHP

Bologna

FULL TIME

November 29, 2024

View Job Description
Turner & Townsend

(Senior) Project Manager - Real Estate

FULL TIME

December 2, 2024

View Job Description
Prometeia

Senior Front-end Developer

Bologna

November 29, 2024

View Job Description
FAO

Senior Fishery Officer (Fishery Economics)

Roma

November 29, 2024

View Job Description
Gruppo Mediobanca

Senior Equity and Derivatives Trader

December 2, 2024

View Job Description
Vodafone

RAN Analysis, Troubleshooting and Terminals Senior Engineer

November 29, 2024

View Job Description
See What’s New: Luxoft Job Opportunities
Luxoft

Autosar Software Engineer

December 3, 2024

View Job Description
Luxoft

Regular Embedded C++ Developer

December 3, 2024

View Job Description
Luxoft

Regula Android Application Developer

Cairo

December 2, 2024

View Job Description
Luxoft

Junior Autosar Software Engineer

November 30, 2024

View Job Description
Luxoft

Automotive Software Engineer

November 30, 2024

View Job Description
View More Jobs by Luxoft
New Job Alerts
CBRE

Hitrac Engineering Group - HSE Specialist - Roma

Roma

FULL TIME

December 4, 2024

View Job Description
Luca Ceotto

Collaboratori dinamici a tempo pieno e part-time

Spilimbergo

FULL TIME & PART TIME

December 4, 2024

View Job Description
Cesi Spa

HVDC Senior Expert

December 4, 2024

View Job Description
Sinergidea

Sviluppatore Front-end Three.js - URGENTE

FULL TIME

December 4, 2024

View Job Description
Segula Technologies

Progettista Meccanico Piping

Ferrara

FULL TIME

December 4, 2024

View Job Description
Dematic S.r.l.

Software Project Manager

Cernusco sul Naviglio

FULL TIME

December 4, 2024

View Job Description