Data Engineer
First Central Insurance & Technology Group
- Haywards Heath, West Sussex Manchester
- £54,000 per year
- Permanent
- Full-time
- You're an excellent PySpark and SQL developer who is keen to further your data engineering career.
- You enjoy the daily opportunity of delivering data from source to consumption using Azure best practice.
- You thrive on turning customer requests into actionable designs and delivery.
- Love working in an agile team.
- Want the opportunity to showcase your talents.
- Develop low to high complexity, secure, governed, high quality, efficient data pipelines from a variety of on and off premise, internal and external data sources.
- Ensure that data is cleansed, mapped, transformed, and optimised for storage to meet requirements for business and technical use cases.
- Build data observability and data quality by design into all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies.
- Build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications.
- Build physical data models that are appropriately designed to meet business needs and optimise storage requirements, ensuring maximum re-use.
- Carry out unit testing of own code, and peer testing of others code to ensure appropriate quality.
- Maintain effective, and appropriate documentation that brings transparency and understandability to pipelines created and code created.
- Follow coding standards, architectural principles, solution design/architecture and release management processes to ensure safe, high quality, compliant code.
- Coach and mentor Associate data engineers.
- Create low to high complexity BI solutions including data mart, semantic layer, and reporting & visualisation solutions in recognised BI tools such as PowerBI.
- Requires experience of designing and building end to end data solutions (2-5 years)
- Engineering and database skills in SQL Server and/or Azure (Datafactory, Synapse) and the associated ETL technologies.
- Experience of working with large, event based, datasets in an enterprise environment.
- Experience of testing techniques and tools.
- Proven to be an excellent communicator with an desire to build rapport with others.
- Keen and active interest in the use of data, with active external networks.
- Brings ideas on how data can drive value for businesses.
- Good understanding of the full data lifecycle.
- Experience of Continuous Integration / Continuous Delivery (CI/CD)
- Experience of working in an agile environment and self-managing teams
- An excellent creative problem solver.
- Proactive and optimistic about what can be achieved.
- Very good time management and organisation skills with the ability to prioritise multiple demands.
- Supporting and enthusiastic team player focussed on delivering shared outcomes.
- Comfortable advising and supporting less experienced engineers.
- Energetic and proactive, and someone who motivates others by their “can do, will do” attitude.
- Able to follow, and make recommendations to improve, standards and designs, ensuring their work is of high quality.