Senior Data Engineer
Jio Platforms Limited
- Mumbai, Maharashtra
- Permanent
- Full-time
- End-to-End Data Pipeline Development:Design, build, optimize, and maintain robust data pipelines across cloud, on-premises, or hybrid environments, ensuring performance, scalability, and seamless data flow.
- Reusable Components & Frameworks:Develop reusable data pipeline components and contribute to the team's data pipeline framework evolution.
- Data Architecture & Solutions:Contribute to data architecture design, applying data modelling, storage, and retrieval expertise.
- Data Governance & Automation:Champion data integrity, security, and efficiency through metadata management, automation, and data governance best practices.
- Collaborative Problem Solving:Partner with stakeholders, data teams, and engineers to define requirements, troubleshoot, optimize, and deliver data-driven insights.
- Mentorship & Knowledge Transfer:Guide and mentor junior data engineers, fostering knowledge sharing and professional growth.
- Education: Bachelor's degree or higher in Computer Science, Data Science, Engineering, or a related technical field.
- Core Programming: Excellent command of a primary data engineering language (Scala, Python, or Java) with a strong foundation in OOPS and functional programming concepts.
- Big Data Technologies: Hands-on experience with data processing frameworks (e.g., Hadoop, Spark, Apache Hive, NiFi, Ozone, Kudu), ideally including streaming technologies (Kafka, Spark Streaming, Flink, etc.).
- Database Expertise: Excellent querying skills (SQL) and strong understanding of relational databases (e.g., MySQL, PostgreSQL). Experience with NoSQL databases (e.g., MongoDB, Cassandra) is a plus.
- End-to-End Pipelines: Demonstrated experience in implementing, optimizing, and maintaining complete data pipelines, integrating varied sources and sinks including streaming real-time data.
- Cloud Expertise: Knowledge of Cloud Technologies like Azure HDInsights, Synapse, EventHub and GCP DataProc, Dataflow, BigQuery.
- CI/CD Expertise: Experience with CI/CD methodologies and tools, including strong Linux and shell scripting skills for automation.
- Problem-Solving & Troubleshooting: Proven ability to analyze and solve complex data problems, troubleshoot data pipeline issues effectively.
- Communication & Collaboration: Excellent communication skills, both written and verbal, with the ability to collaborate across teams (data scientists, engineers, stakeholders).
- Continuous Learning & Adaptability: A demonstrated passion for staying up-to-date with emerging data technologies and a willingness to adapt to new tools.
Expertia AI Technologies