Senior Data Engineer with Python and Databricks
Job Description
- Work together with data scientists and analysts to understand the needs for data and create effective data pipelines
- Solution design, implement, and maintain data pipelines for data ingestion, processing, and transformation using could services and other technologies
- Create and maintain data solutions IN Azure, using any of the following: Data Factory, Synapse, Databricks/Spark, Polars/Pandas, Fabric
- Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
- Improve the scalability, efficiency, and
- effectiveness of data pipelines. - Monitoring and resolving data pipeline problems, ensuring consistency and availability of the data.
Qualifications
- Proficient in Python and SQL
- Knowledge of good data design principles (concepts such as Kimball and Star Schema), data warehousing concepts and data modelling.
- Strong experience with Relational and ideally No
SQL databases. - Strong understanding of ETL/ELT processes.
- Exposure to data monitoring and observability tools.
- Relevant experience with Event-Driven Architecture
- Good understanding of Agile ways of working
Discover some of the global benefits that empower our people to become the best version of themselves:
- Finance: Competitive salary package, share plan, company performance bonuses,
- based recognition awards, referral bonus; - Career Development: Career coaching, global career opportunities,
- linear career paths, internal development programmes for management and technical leadership; - Learning Opportunities: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions,
-
- on sessions, workshops, conferences; - Work-Life Balance: Hybrid work and flexible working hours, employee assistance programme;
- Health: Global internal wellbeing programme, access to wellbeing apps;
- Community: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.
- tagline="">
Our diversity makes us stronger - it drives meaningful change and enables us to build innovative technology solutions. We are committed to creating an inclusive community where all of us, regardless of background, identity, or personal characteristics, feels valued, respected, and free from discrimination. As an equal opportunity employer, we welcome applications from all individuals and base hiring decisions on merit, skills, qualifications, and potential.
Fii primul, care se va înregistra la oferta de muncă respectivă!
-
De ce să cauți de muncă pe Lucrezi.ro?
În fiecare zi oferte noi de muncă Puteți alege dintr-o gamă largă de locuri de muncă: Scopul nostru este de a oferi o gamă cât mai largă de opțiuni Lasă să-ți fie trimise noile oferte prin e-mail Fii primul care răspunde la noile oferte de muncă Toate ofertele de muncă într-un singur loc (de la angajatori, agenții și alte portaluri) Toate serviciile pentru persoanele aflate în căutarea unui loc de muncă sunt gratuite Vă vom ajuta să găsiți un nou loc de muncă