Big Data Engineer

KITRUM

Colombia
Permanente
Tiempo completo

Hace 13 días

We know peopleWho we are?KITRUM is a one-stop custom software development company headquartered in sunny Florida with development centers in Ukraine, Kazakhstan, Israel, and Poland. With a pool of 300+ top-notch engineering resources, we help CxOs of VC-backed startups and fast-growing tech companies in the US, EU and Australia to custom build software engineering teams packed with top-tier talent.We realize that one of the most crucial things for developers — adequate client and fascinating projects. So we qualify our clients to make sure that they:— have an idea that they believe will make the world a better place;— think long-term and looking for a trusted-tech partner;— want to rely on and avoid micromanaging;— are not f$%$ing jackasses :-)Follow our team on Instagram to know more about our daily life instagram.com/kitrum.team :)We adore making new friends on the board!The RoleYour responsibilities will include:

Manage data quality and integrity
Assist with building tools and technology to ensure that downstream customers can have faith in the data they’re consuming
Cross-functional work with the Data Science or Content Engineering teams to troubleshoot, process, or optimize business-critical pipelines
Work with Core Platform to implement better processing jobs for scaling the consumption of streaming data sets

Ideal Profile

5+ years of experience in data engineering creating or managing end-to-end data pipelines on large complex datasets.
Experience in developing scalable software using big data technologies (e.g. Hadoop, Spark, Hive, Flink, Samza, Storm, Elasticsearch, Druid, Cassandra, etc).
Expertise in Scala
Fluency with at least one dialect of SQL
Level of English: Upper-Intermediate
Experience with Streaming platforms, typically based around Kafka
Strong grasp of AWS data platform services and their strengths/weaknesses
Strong experience using Jira, Slack, JetBrains IDEs, Git, GitLab, GitHub, Docker, Jenkins, Terraform
Experience using DataBricks

What's on Offer?

Work within a company with a solid track record of success
Flexible working options
Great work environment
High compensation according to your technical skills
Democratic management style & friendly environment
Professional and personal growth

KITRUM

Postularse