Description de l'emploi

Niveau d'expérience: Experienced Hire

Catégories:

  • Engineering & Technology

Emplacement(s):

  • Quay Building 8th Floor, Bagmane Tech Park, Bengaluru, IN

Skills and Competencies

  • 5+ years of hands-on experience in data engineering roles
  • Expert-level proficiency with Apache Spark (Python/PySpark and Scala)
  • Deep experience building and managing real-time data streaming pipelines using Apache Kafka
  • Strong understanding of big data technologies including HDFS, Hive, distributed computing, and file formats like Parquet/Avro
  • Demonstrated ability to work independently, manage priorities, and deliver high-quality, tested solutions
  • Strong problem-solving, debugging, and analytical skills
  • Excellent communication and interpersonal skills
  • Preferred: Experience with cloud-based platforms (AWS, Azure), orchestration tools (Airflow, Dagster), containerization (Docker/Kubernetes), data warehouses (Snowflake, Redshift), IaC tools (Terraform), CI/CD for data pipelines, and database design (SQL/NoSQL)

Education

  • Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, or a related field
  • Equivalent practical experience also considered

Responsibilities

Design and build scalable data pipelines and infrastructure to support large-scale data processing in real time and batch.

  • Design, implement, and maintain scalable data pipelines using Apache Spark (PySpark/Scala) and Apache Kafka
  • Work with large datasets across data lakes, warehouses, and distributed systems
  • Build low-latency streaming solutions to ingest, process, and serve data
  • Optimize processing jobs and storage for cost-efficiency and scalability
  • Develop comprehensive automated tests for pipeline reliability and data quality
  • Collaborate with data scientists, analysts, engineers, and product teams to deliver data solutions
  • Actively contribute in Agile ceremonies and deliver sprint commitments
  • Take ownership of tasks and drive projects to completion independently
  • Troubleshoot and resolve issues with data performance and reliability
  • Mentor junior engineers and share knowledge across the team
  • Document technical processes, architecture, and pipeline workflows
  • Contribute to ongoing improvements in data architecture and engineering practices

About the Team

Our Data Engineering team is responsible for designing and maintaining the infrastructure that powers our company’s data-driven decision-making.

By joining our team, you will:

  • Help scale real-time and batch data processing platforms
  • Support mission-critical analytics and data science initiatives
  • Influence architectural decisions that shape the future of data at Moody’s

Instructions de demande

Please click on the link below to apply for this position. A new window will open and direct you to apply at our corporate careers page. We look forward to hearing from you!

postuler en ligne