Big Data Infrastructure Engineering / DevOps Intern (50-100%)
Swiss Re
Madrid
Prácticas
Tiempo completo
Hace 22 días
About The TeamWe in the Stargate Platform Engineering team, are searching for an enthusiastic students passioned for Big Data Infrastructure and DevOps Engineer. We focus on optimizing data intensive distributed systems, building and improving data pipelines while making our platform more efficient, secure and resilient. Our team members range from PhD in Mathematics to contributors to open-source Apache Big Data projects. Whether you are a fresh graduate or more experienced professional, we look forward to getting to know you.If you join us, you will be able to participate in a variety of interesting initiatives. For example, you will:· Help us improve the resilience of the world by modelling/interpreting/studying real-world data. Transforming terabyte large datasets using hundreds of cores is normal day of work.· Develop and maintain both declarative and imperative infrastructure system on a multicloud environment. From ARM templates and CloudInit on completely immutable servers to Puppet and python scripts.· Analyse Data ingestions and bottlenecks to improve the latency of data pipelines. Maximizing Network I/O throughput, improving query plans or even simply fixing connectivity issues between data sources and data ingestion systems.· Write Big Data pipelines and analyse how data-lineage is handled in a global company in a petabyte scale.· Work on a day-to-day basis with Palantir software engineers, using state-of-the-art concepts for solving technical problems.· Translate Infrastructure findings into actionable dashboards, distilling right large datasets into actionable insights for operational users.· Helping other internal customers making better use of the data platform, by providing guidance and handling Issues they may raise internally. You will advise these customers on how to efficiently ingest terabytes data from a relational database or millions of records Kafka topic to the platform.We are a diverse team and our passion to learn is what connects us. We are looking for a person who loves to learn and we will support you in this journey! We reserve time for studying and exams.About YouNobody is perfect and meets 100% of requirements. If you however meet some of the criteria below and are genuinely curious about the world of data science, we will be happy to meet you.In order to be successful in the role, you need to ideally have these technical skills and knowledge:- Studying PhD, Master or final year of Bachelors degree in Computer Science, Computer/Electronics Engineering, Applied Mathematics, Physics or related quantitative field.- Good knowledge of Python and/or Java programming languages.- Knowledge of Apache Spark.- Knowledge of computer networks.- Knowledge of database internals.The following items are a plus:- Background in DevOps / Infrastructure Engineering.- Experience in distributed computing/ databases.- Passionate about high-performance-computing, functional programming, and constant optimizations.- AWS/Azure/GCP/Palantir/Databricks Certificates.- Experience handling tickets and guiding customer in their learning process.We look forward to receiving your application!About Swiss ReSwiss Re is one of the world's leading providers of reinsurance, insurance and other forms of insurance-based risk transfer, working to make the world more resilient. We anticipate and manage a wide variety of risks, from natural catastrophes and climate change to cybercrime. Combining experience with creative thinking and cutting-edge expertise, we create new opportunities and solutions for our clients. This is possible thanks to the collaboration of more than 14,000 employees across the world.Our success depends on our ability to build an inclusive culture encouraging fresh perspectives and innovative thinking. We embrace a workplace where everyone has equal opportunities to thrive and develop professionally regardless of their age, gender, race, ethnicity, gender identity and/or expression, sexual orientation, physical or mental ability, skillset, thought or other characteristics. In our inclusive and flexible environment everyone can bring their authentic selves to work and their passion for sustainability.Keywords: Reference Code: 129669
