Data Engineer - #1175243

Junior Data Pipeline Engineer - Java / Scala

About the role

Help build and maintain data pipelines for batch and streaming workloads. Implement transformations and validation checks, monitor processing flows and work with senior engineers to troubleshoot data and deployment issues.

Key responsibilities

• Develop assigned ingestion, mapping and transformation components using SQL and Java or Scala.
• Implement data validation checks and scheduled processing workflows.
• Support batch or streaming pipeline development using relevant distributed-processing technologies.
• Assist container deployments and the use of Kubernetes and S3-compatible object storage.
• Monitor pipelines, investigate defects and document changes under the guidance of senior engineers.

Requirements

• 2-4 years of data engineering or backend development experience.
• Familiarity with Agile delivery and working knowledge of SQL and Java or Scala.
• Basic experience developing batch or streaming pipelines using Apache Spark, Apache Flink or Apache Kafka.
• Familiarity with containerised deployment, Kubernetes and S3-compatible object storage.
• Experience with mappings, transformations, validation checks, scheduled workflows, pipeline monitoring and defect resolution.

Good to have

• SAFe, MinIO or comparable object storage, and relational databases.
• Git, CI/CD, Docker and automated testing.
• Comparable processing frameworks and Apache Airflow or equivalent orchestration tools.

Interested candidates are encouraged to submit their resumes outlining their relevant experience and achievements to apply88(@)talentvis.com or click apply!

We regret to inform that only shortlisted candidates would be notified

EA License No: 04C3537

EA Personnel No: R22106683

EA Personnel Name: Yang Hui Shan, Sherri