Staff Data Engineer
Hays
- Kraków, małopolskie
- Stała
- Pełny etat
- Publish well written and tested code to production
- Participate in designing and developing key features and functionality of our data platform
- Investigate production issues and fine-tune our data pipelines
- Continually improve data pipelines for high efficiency, throughput and quality of data
- Build a platform that will be the foundation for our customer facing reporting features, our machine learning initiatives, and internal product analytics
- Collaborate with team members on researching and brainstorming different solutions for technical challenges we face
- Solve sophisticated problems with passion and technical leadership. Helping to discover solutions to sophisticated problems
- Develop standard methodologies and mentor others to help make technical decisions on projects
- 7+ years of software development/data engineering experience with 3+ years of hands-on experience of building scalable data platforms and/or reliable data pipelines
- Java, Python, Scala (proficient in at least one)
- Developer skills; demonstrating a strong passion to design scalable and fault-tolerant software systems
- Experience with AWS or related cloud technologies
- Experience in developing and operating high volume, high availability environments
- Working understanding of Kubernetes’ infrastructure and security best practices
- Ability to work optimally in a multifaceted, occasionally interrupt-driven environment that includes geographically spread teams and customers
- Solid working understanding in Data Modelling
- Proven track record with cloud and data related technologies.
- Experience writing ETL jobs to help address various data engineering challenges
- Strong understanding of Build tools and Deployment tools
- Familiarity with Kafka, Flink, Spark frameworks with validated understanding of at least one job scheduling tool: Airflow, Celery, AWS Step functions