Senior Data Engineer
KIT-AR
- Portugal
- Permanente
- Horário completo
- Send us an e-mail with your curriculum vitae and include "Senior Data Engineer [24411]" in the subject line (
); * If you are receiving this at a job board, please use the provided apply button.If you have technical difficulties with the application process, please do not hesitate to contact us at , but please note that applications sent to this email address will not be considered.Job requirementsKey Responsibilities:
- Maintain and evolve database design for KIT-AR platform;
- Design and implementation of data integration strategies for industrial customers;
- Design and implement data processing pipelines for heterogenous data streams coming from sensors and workflows and correlating this with static context information.
- Develop data and process analysis methods either adapted from off-the-shelf systems or develop novel ideas.
- Work with business stakeholders to evaluate the usefulness and suitability of our data and process analysis methods.
- Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements
- The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.)
- Load transformed data into storage and reporting structures in destinations including data warehouses, indexes, real-time reporting systems and analytics applications
- Keep abreast of current developments in the field.
- MSc in computer science.
- 5yr+ experience on technical roles in data engineering;
- A strong record of developing and designing systems for data processing and data analysis.
- Experience in administering PostgreSQL databases in medium-scale production environments.
- Ability to support/troubleshoot data pipelines based on common ETL techniques (preference for experience with DBT).
- Experience in structured database migration tooling and pipelines (preference for Liquibase).
- Solid development practices, stable and clean coding, software design patterns, knowledge of CI/CD techniques;
- A strong record of working with common data processing, data storage, data analysis and data visualisation systems such as, for example, Kafka, Airflow, Dagster, Spark, Flink, PostgreSQL, Timescale, Superset, PowerBI, or others.
- Preference for experience with cloud environments (Azure, AWS);
- Confident and concise communication skills, with the ability to drive alignment, collaboration, and efficiency within teams
- Goal driven, enthusiastic, creative thinker and problem solver;
- Good communication skills and ability to thrive in diverse remote-first teams;
Aceda e crie já a sua conta.ouEntrar
ITJobs