Senior Data Engineer Târgu Mureș

Senior Data Engineer
Târgu Mureş
Târgu Mureș, Mureș County, Romania

Data
Brasov+9 more

What's this role about?

Our client is going through an exciting period of change and is seeking highly motivated and experienced Senior Data Engineer to join their Data Engineering team. You will work as part of an exciting greenfield tech hub covering all facets of technology within their organisation. You will be responsible for
-
- end development on the data platform, including test development, to ensure continued service delivery versus expectations. You will understand all engineering stages for a data platform by providing
-
- end,
- stack data expertise from design to build. You will be a leading member of the team, helping to develop and mentor junior members as well as input into design and architectural decisions. If you're looking for an exciting opportunity to step out of your comfort zone and make a real impact by building better software, this is the job for you! *Key Responsibilities:* * Work together with data scientists and analysts to understand the needs for data and create effective data workflows * Solution design, implement, and maintain data pipelines for data ingestion, processing, and transformation using could services and other technologies * Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage. * Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations. * Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data. * Improve the scalability, efficiency, and
- effectiveness of data pipelines. * Monitoring and resolving data pipeline problems, ensuring consistency and availability of the data. * Automate tasks and deploy production standard code (with unit testing, continuous integration, versioning

What skills and experience do you need?

*Required skills:* * Experience with *Azure services* such as *Azure Data Factory, Azure Databricks, * * Strong experience in Python/Spark/Scala. * Proficient with Relational and No
SQL databases. * Knowledge of good data design principles (concepts such as Kimball and Star Schema), data warehousing concepts and data modelling. * Strong understanding of ETL/ELT processes. * Familiarity with testing frameworks like Pytest/Unitest. * Proficiency in tools like *Data Build Tool* and Datadog. * Exposure to data monitoring and observability tools. * Relevant experience with Event-Driven Architecture * Good understanding of Agile ways of working #LI-Hybrid