Big Data Engineer With Azure And Aws
Daimler Ag (Canada)
- Buenos Aires
- Permanente
- Tiempo completo
BIG Data engineer with Azure and AWS Group : Mercedes-Benz Group AG
Description
As a Data Engineer with exposure to Azure and AWS platforms, you would be responsible for designing, implementing, and maintaining data pipelines and architectures to support the organization's data needs. Your role would involve:
Data Pipeline Development: Designing and building robust, scalable data pipelines to ingest, process, and transform data from various sources into formats suitable for analysis and reporting.
Data Modeling and Warehousing: Creating and optimizing data models and data warehouses to ensure efficient storage and retrieval of data for analytical purposes.
Platform Management: Managing and maintaining cloud-based data platforms on Azure and AWS, including provisioning resources, optimizing performance, and ensuring security and compliance standards are met.
Data Integration: Integrating data from disparate sources such as databases, APIs, and streaming platforms, ensuring data quality and consistency throughout the process.
Performance Optimization: Identifying and implementing optimizations to improve the performance and efficiency of data pipelines and queries, including tuning SQL queries, optimizing ETL processes, and leveraging cloud-native services.
Monitoring and Troubleshooting: Implementing monitoring solutions to track data pipeline performance and troubleshoot issues as they arise, ensuring data integrity and reliability.
Collaboration: Working closely with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and deliver solutions that meet business needs.
Documentation and Best Practices: Documenting data pipelines, architectures, and best practices to facilitate knowledge sharing and ensure compliance with data governance standards.
With 8+ years of experience, you're expected to bring not only technical expertise but also a deep understanding of data engineering principles, cloud platforms, and best practices in the field. Your role would likely involve both hands-on development work as well as providing technical leadership and guidance to junior team members
Qualifications
As a Data Engineer with exposure to Azure and AWS platforms, you would be responsible for designing, implementing, and maintaining data pipelines and architectures to support the organization's data needs. Your role would involve:
Data Pipeline Development: Designing and building robust, scalable data pipelines to ingest, process, and transform data from various sources into formats suitable for analysis and reporting.
Data Modeling and Warehousing: Creating and optimizing data models and data warehouses to ensure efficient storage and retrieval of data for analytical purposes.
Platform Management: Managing and maintaining cloud-based data platforms on Azure and AWS, including provisioning resources, optimizing performance, and ensuring security and compliance standards are met.
Data Integration: Integrating data from disparate sources such as databases, APIs, and streaming platforms, ensuring data quality and consistency throughout the process.
Performance Optimization: Identifying and implementing optimizations to improve the performance and efficiency of data pipelines and queries, including tuning SQL queries, optimizing ETL processes, and leveraging cloud-native services.
Monitoring and Troubleshooting: Implementing monitoring solutions to track data pipeline performance and troubleshoot issues as they arise, ensuring data integrity and reliability.
Collaboration: Working closely with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and deliver solutions that meet business needs.
Documentation and Best Practices: Documenting data pipelines, architectures, and best practices to facilitate knowledge sharing and ensure compliance with data governance standards.
With 8+ years of experience, you're expected to bring not only technical expertise but also a deep understanding of data engineering principles, cloud platforms, and best practices in the field. Your role would likely involve both hands-on development work as well as providing technical leadership and guidance to junior team members.
Organization Organization Mercedes-Benz Research and Development India Private Limited Primary Location India-Karnataka-Bangalore Work Locations Mercedes-Benz Research & Development India, Embassy Crest 'Embassy Crest' Plot No 5, EPIP Zone, Phase 1, 560 066
#J-18808-Ljbffr
Buscojobs