Senior Data Engineer
Sobeys
- Stellarton, NS
- Permanent
- Full-time
- Leading tools and systems within our Data Engineering team such as Snowflake and Azure.
- A data-driven culture led by a strong Enterprise Data Office.
- Strong, success-focused team of energetic and experienced data experts.
- Design, develop, and maintain robust, scalable, and secure data pipelines to efficiently process large volumes of data for Snowflake and other cloud based platforms.
- Collaborate closely with cross-functional teams to identify data requirements and implement solutions that facilitate seamless access to data across the organization.
- Lead the orchestration layer for intricate data transformations, employing the data vault methodology to refine raw data into valuable assets for consumption, ensuring governance and data integrity.
- Establish and enforce processes and systems for monitoring data quality, guaranteeing the accuracy and availability of production data for key stakeholders and business processes.
- Cultivate expertise in business domains to effectively support the data needs of product teams, analytics, data scientists, and other stakeholders.
- Develop and maintain comprehensive documentation for data pipelines and essential metrics, ensuring accessibility and usability for all stakeholders.
- Provide mentorship and guidance to junior data engineers, fostering a collaborative and growth-oriented culture within the team.
- Possess 5+ years of experience in designing and implementing operational, production-grade, large-scale data solutions.
- Demonstrate an excellent understanding of Snowflake internals and adeptness in integrating Snowflake with other data processing and reporting technologies.
- Have at least 3 years of hands-on experience in designing and integrating data within cloud environments, leveraging tools like Azure Data Factory pipelines and Azure Data Lake Storage.
- Exhibit strong proficiency in Python and SQL for development purposes.
- Possess a solid understanding of GIT methodologies for version control and collaboration.
- Ability to proactively research and evaluate new features and functionalities within a dynamic data and cloud environment.
- Adaptability to navigate ambiguous and evolving requirements effectively.
- Knowledge of SAP technology is advantageous.
- Familiarity with the Data Vault Methodology is a plus.