Data Engineer, Wheat
Louis Dreyfus Company
- Villeurbanne, Rhône
- CDI
- Temps-plein
- Ensure data availability, quality, and timeliness by designing and implementing performant pipelines and proactive monitoring. Ideate meaningful tests and monitoring to be proactively informed in case of data problems and to minimize regressions.
- Create and maintain high quality, well documented code and data transformations to feed models and insights reliably.
- Act as data steward with researchers, traders and operations to help them leverage the best data sets for their use case and the most relevant best practices to ensure data is always available
- Retrieve, clean, model, transform and maintain data from many sources to better understand the factors influencing wheat global and local flows and prices
- Troubleshoot and solve data issues from data ingestion to display in dashboards and reports
- Provide technical support and guidance to data scientists and researchers
- 3-5 years of experience in technical, hands on roles
- 2+ years' experience in data manipulation in SQL: DB design, data modelling, data transformation pipelines, ETL, data management
- 2+ years’ experience with Python, including data manipulation and visualization packages (e.g., Pandas, Numpy, Plotly…)
- Experience with data visualisation tools and technologies like PowerBI, Tableau, Looker.
- Data mining principles: data collection, wrangling and quality checks using multiple data systems
- Experience working with cloud technologies like Azure, AWS or GCP
- Experience with any of the following will be considered a plus:
- Hands on experience with data storage solutions and their application: SQL, NoSQL, data lakes
- Principles of modern full stack development and exposure to Python frameworks like Dash or Flask, familiarity with APIs
- Agile development and DevOps tools: CI / CD pipelines, testing and monitoring best practices.
- Support for business-critical data transformation and applications via monitoring and alerting, and contributing to the solution of critical incidents under time pressure
- Quick learner with the ability to work independently and with little prompting
- Excellent communication, collaboration and engagement skills
- Critical thinking, inclination to make improvements, find new ideas and challenge the status quo
- Flexibility and sense of adaptability in a quick paced, constantly evolving context
- Passionate about improving data literacy and spreading best practices
- Ability to perform under pressure, prioritize and escalate
- Strong problem solving, quantitative and analytical abilities
- Fluent in English
- Experience in the commodities sector is considered as a plus
- A Bachelor or Master in Computer Science, Business/Management Information Systems, Computer/Systems/Industrial Engineering, Business Analytics, Data Science, Operations Research or Statistics. Other backgrounds will be considered with relevant work experience.
- You will be working in a very concrete line of business whose impact literally feeds the world. You will get a unique point of view on major data flows of commodities around the world, including the impact of climate change and major geo political events, the importance of sustainability and regenerative agriculture.
- You will become an expert of the latest cutting-edge technologies in Data Engineering, leveraging Microsoft Azure Platform, working in collaboration with a team of technology and data science experts and accessing high quality training and development opportunities
- You will see the impact of your role in transforming our business