Senior Data Engineer
Adyen
- Amsterdam, Noord-Holland
- Vast
- Voltijds
- Collaborative Solution Development: Engage with a diverse range of stakeholders, including data scientists, analysts, software engineers, product managers, and customers, to understand their requirements and craft effective solutions.
- State-of-the-Art Pipelines and Architecture: Design, develop, deploy and operate high-quality production ELT pipelines and data architectures. Integrate data from various sources and formats, ensuring compatibility, consistency, and reliability. Design scalable architectures.
- Champion Data Best Practices: Proactively establish and advocate for best practices in performance, code quality, data validation, data governance, and discoverability across Adyen through mentoring, training, and knowledge sharing.
- High Quality Data and Code: Ensure data is accurate, complete, reliable, relevant, and timely. Implement rigorous testing, monitoring and validation protocols for your code and data, leveraging tools such as Pytest.
- Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and systems. Optimize query performance and resource utilization to meet SLAs and performance requirements, using technologies such as caching, indexing, partitioning, and other Spark optimizations.
- Experienced in Big Data: Over 8 years of experience working as a Data Engineer or in a similar role.
- Data & Engineering practices: You possess an expert-level understanding of both Software and Data Engineering practices.
- Technical Super Star: Highly proficient in tools and languages such as: Python, PySpark, Airflow, Hadoop, Spark, Kafka, SQL, Git.
- Clear Communicator: Skilled at articulating complex data-related concepts and outcomes to a diverse range of stakeholders.
- Self-starter: Capable of independently recognizing opportunities, devising solutions, leading, prioritizing and owning projects.
- Innovator: You have an experimental mindset with a 'launch fast and iterate' mentality.
- Data Culture Champion: Experienced in fostering a data-centric culture within large, technical organizations and setting standards for excellence and continuous improvement.