AI Engineer - #1176544

NCS PTE. LTD.


Date: 1 hour ago
District: Singapore
Salary: $5,000 - $10,000 / month
Contract type: Contractor
NCS PTE. LTD.

Role Summary

You are an autonomous AI Engineer, responsible for creating the harness for designing and building the AI harness, agent framework, and reusable engineering components required to operate a modern data platform based on Apache Iceberg, Trino, and Parquet.

Your primary responsibility is not only to build data pipelines, but also to establish the agentic execution framework (AIHarness) that enables multiple specialized agents to collaborate, execute tasks, maintain state, orchestrate workflows, and deliver end-to-end data engineering capabilities.

Key Responsibilities

AI Harness Development

Design and implement the foundational agent framework that provides:

  • Agent orchestration and coordination
  • Workflow execution and state management
  • Memory and context handling
  • Tool and function calling
  • Agent-to-agent communication
  • Human approval workflows
  • Logging and audit trails
  • Error handling and recovery
  • Security and access controls
  • Observability and monitoring

The harness must support autonomous and multi-agent execution patterns.

Specialized Agents Creation

The agents will need to perform the following:

  • Discover Iceberg catalogs and schemas
  • Profile datasets
  • Generate metadata and lineage
  • Ingest data from databases, APIs, files, and streams
  • Create Parquet datasets
  • Register and maintain Iceberg tables
  • Generate Trino SQL
  • Build transformation workflows
  • Create curated and business-ready datasets
  • Validate schemas and data integrity
  • Detect anomalies
  • Generate reconciliation reports
  • Analyze Trino workloads
  • Recommend partitioning strategies
  • Optimize Iceberg tables and Parquet files
  • Classify sensitive information
  • Manage metadata and lineage
  • Apply retention and compliance policies
  • Monitor pipelines and agent activities
  • Detect failures and bottlenecks
  • Generate alerts and operational insight

Expected Deliverables

  • Iceberg table definitions and schemas
  • Trino SQL scripts and views
  • Python data pipeline code
  • Data quality validation suites
  • Metadata and lineage documentation
  • CI/CD deployment artifacts
  • Monitoring and observability configurations
  • Technical documentation and runbook

Skills and Experience

The candidate should demonstrate expertise in:

  • Experience with Generative AI, Agentic AI, or LLM-based solutions.
  • Proficiency in Python, including FastAPI, Pydantic and Pandas.
  • Experience designing and implementing AI Harness or multi-agent frameworks.
  • Hands-on experience with LangChain & LangGraph.
  • Experience with Apache Iceberg, Trino, and Parquet-based lakehouse architectures.
  • Experience building data ingestion, transformation, and orchestration pipelines.
  • Strong knowledge of meta data management, data lineage, and data governance practices.
  • Experience developing REST APIs,SDKs, and reusable engineering frameworks.
  • Experience with observability, monitoring, tracing, and operational support practices.
  • Strong understanding of distributed systems, event-driven architectures, and microservices patterns.
  • Proven ability to design, develop, and operationalize enterprise-grade AI agents for data discovery, ingestion, transformation, optimization, governance, and observability.
  • Familiar with modern data engineering technologies, including DuckDB, dbt, and related engineering tools for data transformation, modelling, and pipeline development.

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Staff Occupational Therapist [WCAN]

WECRUIT PTE. LTD., Singapore
$4,800 - $7,000 / month
24 minutes ago
Provide Occupational Therapy services to inpatient, outpatient and home-based patients. Assess patients and develop individual rehabilitation plans. Conduct regular reviews and monitor patients' rehabilitation progress. Provide treatment, follow-up care and discharge planning. Participate in case discussions and multidisciplinary team meetings....
WECRUIT PTE. LTD.

Application and Systems Engineer

EMERSON ASIA PACIFIC PRIVATE LIMITED, Singapore
$5,800 - $8,600 / month
54 minutes ago
If you are an Applications andSystems Engineer professional looking for an opportunity to grow your career,Emerson has an exciting opportunity for you. As part of the Test &Measurement business, you will collaborate with customers, sales teams, engineeringcolleagues, and technology partners...
EMERSON ASIA PACIFIC PRIVATE LIMITED

Marketing & Campaign Trainee | Mentorship | Growth Opportunities | Join Our Team

ROYAL ORG PTE. LTD., Singapore
$3,500 - $6,000 / month
3 hours ago
Looking for a Fresh Start and New Opportunities? Wondering what career path to take next? Want a role with practical, hands-on learning? Looking for opportunities to grow with a team? If you’re looking for more than a routine role, join...
ROYAL ORG PTE. LTD.