Job Description:Must have minimum 5+ years of experience as AWS Data EngineerNice to have AWS Certified Data Analytics Specialty certificationExperience in designing and implementing data pipelines using AWS Glue and orchestration using Airflow for batch, streaming (Kafka/Kinesis) and API ingestion patternsWork closely with DevOps engineer to support implementation of deployment of data engineering code using CI/CD pipelines such as CodePipeline and CodeDeploy and enterprise GitExperience in designing and implementing streaming data pipelines using AWS MSK, AWS SQS, Amazon KinesisExperience working on scripting language preferably Python using Cargill standard tools such as AWS Glue (Spark)Experience in designing and implementing API ingestion pipeline using AWS API GatewayWork with Solution architect to enhance the data ingestion framework using AWS native services to make it metadata driven supporting multiple ingestion patterns such as batch processing, streaming data and API integrationMandatory Skills: AWS, Python, SQL, Spark
