Data Engineer
Boardroom Appointments
- Pretoria, Gauteng
- Permanent
- Full-time
- BCom or Bachelors degree in Information Technology / Computer Science / Engineering (IT) or similar
- Data Engineering tools (Azure Data Engineer) certification will be an added advantage
- ITIL or COBIT certification will be an added advantage
- 2 - 4 years of working experience in an IT environment
- Experience in working on IT enterprise Azure-based data solutions
- Experience with Python and SQL
- Experience in gathering requirements and transitioning them to designs and outcomes
- Experience working in the Agri sector will be an advantage
- Ensure scalability of solutions
- Continuously improve business data environment design and efficiencies
- Deliver business benefits from advanced analytics
- Ensure the managed data (business intelligence) is fit for purpose relative to customer needs
- Design and develop end-to-end data solutions on the Data platform, ensuring optimal performance, scalability, and reliability.
- Collaborate with data architects, data analysts, and business stakeholders to understand data requirements, define data models, and implement data integration solutions.
- Implement data pipelines, data lakes, and data warehouses using.
- Develop and maintain ETL/ELT processes to extract, transform, and load data from various sources into Azure data platforms.
- Design and optimize data schemas, tables, and indexes for efficient data storage and retrieval.
- Perform data profiling, data cleansing, and data quality assessments to ensure data accuracy and consistency.
- Develop and implement data security and privacy measures, ensuring compliance with relevant regulations (e.g., POPIA).
- Monitor and troubleshoot data pipelines, identifying and resolving performance bottlenecks, data inconsistencies, and system issues.
- Collaborate with DevOps teams to implement CI/CD pipelines and ensure smooth deployment and release management of data solutions.
- Stay up to date with the latest data technologies, trends, and best practices, and provide recommendations for continuous improvement.
- Microsoft Azure Data suite
- Data and Business intelligence enablement knowledge
- Business intelligence rendering tools
- Working knowledge of Project Management Tools
- Excellent verbal and written communication skills
- IT Security would be an added advantage
- Analytical ability
- Attention to detail
- Ability to tie together technologies and architectures to address requirements
- Planning and organizing
- Strong communication skills
- Teamwork
- Change Agent
- Work under pressure
- Assertiveness
- Interpersonal skills