Data Engineer (GCP)

Boost.IT

Lisboa
Permanente
Horário completo

Há 13 dias

Boost IT is made up of people who are motivated to improve the world and who are passionate about technology. Our vision focuses on the skill to bring people together around complex problem-solving for our clients, creating sophisticated solutions.People are our most important asset and the reason for our business. We are proud of our strong culture, which challenges the status quo and always searches for the best solution for our clients. We believe technology can lead to a positive change in society, connect and inspire, and, ultimately, lead to a better future.We are currently seeking a talented Data Engineer with experience in Google Cloud Platform (GCP) to join our dynamic team and contribute to the development and optimization of our data infrastructure.Position Overview:As a Data Engineer specializing in Google Cloud Platform (GCP), you will play a key role in designing, building, and maintaining our cloud-based data solutions. You will collaborate closely with our cross-functional teams to develop data pipelines, implement data ingestion processes, and ensure the reliability and scalability of our data infrastructure on GCP. The ideal candidate will have a strong background in data engineering, experience with GCP services, and a passion for leveraging cloud technologies to solve complex data challenges.Key Responsibilities:

Design, develop, and maintain data pipelines and ETL processes on Google Cloud Platform (GCP) using services such as Cloud Dataflow, Apache Beam, or Google Cloud Composer.
Implement scalable and reliable data ingestion mechanisms to collect, process, and store large volumes of structured and unstructured data.
Optimize data storage and retrieval processes using GCP storage solutions such as BigQuery, Cloud Storage, and Cloud Bigtable.
Collaborate with data scientists and analysts to support their data needs and ensure data accessibility, accuracy, and integrity.
Monitor and troubleshoot data pipelines, identifying and resolving performance bottlenecks, data quality issues, and system failures.
Implement data security and compliance measures to protect sensitive information and ensure regulatory compliance.
Stay up-to-date with the latest developments in GCP services and cloud computing technologies, evaluating new tools and techniques to improve our data infrastructure.
Provide technical guidance and mentorship to junior data engineers, fostering a culture of continuous learning and growth.

Qualifications:

Bachelor's degree in Computer Science, Engineering, or related field.
Proven experience as a Data Engineer with a focus on Google Cloud Platform (GCP).
In-depth knowledge of GCP services and products, including BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Data Studio.
Proficiency in programming languages such as Python, Java, or Scala for developing data pipelines and ETL processes.
Strong understanding of data modeling, database design, and SQL query optimization.
Experience with version control systems such as Git and CI/CD pipelines.
Excellent problem-solving skills and attention to detail.
Ability to work effectively in a fast-paced, collaborative environment with cross-functional teams.
Google Cloud certification (e.g., Professional Data Engineer) is a plus.

Preferred Skills:

Experience with other cloud platforms such as AWS or Azure.
Knowledge of containerization technologies such as Docker and Kubernetes.
Familiarity with streaming data processing frameworks such as Apache Kafka or Apache Flink.
Understanding of machine learning concepts and frameworks.

Send your CV toweb:193.164.202.168:Mozilla/5.0 (compatible):2024-04-17 03:02:57Candidatar a este anúncioPara ter acesso aos endereços (email/site) de candidatura neste anúncio deverá estar autenticado no site.Ainda não tem conta no ITJobs ?
Aceda e crie já a sua conta.ouEntrar

ITJobs

Candidate-se