Senior NLP Engineer
The Economist Group
- London
- Permanent
- Full-time
- Architecting, building and maintaining NLP processing pipelines / workflows in Python via technologies such as Spark, serverless functions, Airflow, MLflow, or other.
- Working with Data Scientists to automate experiments that bring ML and NLP research ideas to production.
- Fine Tuning and consuming Large Language Models (LLM) directly or via third party Generative AI API services.
- Setting up Retrieval Augmented Generation (RAG) architectures and Reinforcement Learning from Human Feedback (RLHF) processes.
- Implement MLOps and related DevOps focused on LLMs deployed in cloud-native environments.
- Support, optimise and transition our current processes to ensure well architected implementations and best practices.
- Work in an agile environment within a collaborative agile product team using Kanban
- Collaborate across departments and work closely with data science teams and with business (economists/data) analysts in refining their data requirements for various initiatives and data consumption requirements.
- Educate and train colleagues such as data scientists, analysts, and stakeholders in NLP pipelining and data processing techniques, which make it easier for them to integrate and consume the data they need for their own use cases.
- Participate in ensuring compliance and governance during model use, to ensure that the users and consumers use the resources provisioned to them responsibly through data governance and compliance initiatives.
- Become an NLP evangelist, and promote the available Generative AI capabilities and expertise to business unit leaders, and educate them in leveraging these.
- 6+ years of professional experience with NLP used in large scale digital applications.
- Extensive experience with programming in Python and Jupyter notebooks.
- Professional experience of designing, building and managing bespoke NLP solutions in cloud environments.
- Experience in building NLP solutions while consuming LLMs, either directly from third party APIs or directly from repositories such as Hugging Face.
- Strong, fundamental technical expertise in cloud-native technologies, such as AWS Lambda, API Gateway, SageMaker Studio, Amazon ECR, Cloud Formation, or equivalent.
- Experience in leading / mentoring NLP / ML engineering teams.
- Experience in working in teams with data scientists and data engineers, for building automated pipelines for model building, deployment and monitoring.
- An advanced degree in computer science, information science, data science, linguistics, or a related quantitative field or equivalent work experience.
- Strong verbal and written communication skills and ability to work well with a wide range of stakeholders.
- Strong ownership, scrappy and biassed for action.