Senior Data Engineer
Epsilon
- New York City, NY
- $140,000-150,000 per year
- Permanent
- Full-time
- Write and review code for new features. This is a Senior role, and the candidate will be expected to be involved and own several projects.
- Collaborate with the VP of Engineering to plan for new features and architect data solutions.
- Ensure data quality by implementing best practices.
- Ensure code quality by developing robust test cases.
- Think automation first!
- Find areas of optimization and implement changes to create more efficient workflows.
- Monitor and troubleshoot issues as they come up.
- Provide feedback on areas of improvement
- Specialization in data engineering development using very large data sets (10s of TBs).
- Expertise in data warehousing, data streaming, relational databases, search databases and in-memory databases.
- Strong understanding of cloud computing, distributed computing, and scalability principles.
- Strong knowledge of relational databases.
- Strong knowledge of data structures and algorithms.
- Understanding of NoSQL or columnar databases.
- Outstanding communication skills and the ability to work well within agile environment.
- Advanced Degree in computer science or electrical engineering
- 4+ years hands-on data engineering software
- Must have development expertise using Scala and Spark.
- Strong understanding of cloud services in AWS or Azure
- Expertise with relational databases using SQL and Postgres.
- Experience using software automation tools such as Jenkins, Ansible, and Git.
- Experience working with containers in Docker and Kubernetes.
- Experience in Test Driven Development Practices.
- Experience working with agile scrum practices.
- Knowledge of real time streaming and/or search databases.
- Nice to have experience working with Python.
- Our Culture: https://www.epsilon.com/us/about-us/our-culture-epsilon
- Life at Epsilon: https://www.epsilon.com/us/about-us/epic-blog
- DE&I: https://www.epsilon.com/us/about-us/diversity-equity-inclusion
- CSR: https://www.epsilon.com/us/about-us/corporate-social-responsibility