AI Engineer - #1169473

General Summary

Realtek's Ameba AIoT product line delivers Wi-Fi/BT MCU and edge-AI SoCs used in smart home, security, and connected consumer devices worldwide.

We are looking for an AI Engineer to advance AI capabilities across the Ameba software stack — from AI-assisted development tooling that lets developers build on Ameba through natural language, to vision and speech applications that run on our NPU-enabled SoCs.

You will extend our Model Context Protocol (MCP) toolchain so that AI agents can build, deploy, and validate directly on Ameba hardware; bring vision and speech models onto our edge-AI platforms; and turn the results into reference designs that customers and ecosystem partners can adopt.

This is a role for someone who works at the intersection of applied AI and real hardware — comfortable moving a model from training framework, through quantization, onto a memory-constrained device, and then proving with data that it works. You will collaborate closely with our firmware and platform software teams, who own the RTOS, drivers, and low-level platform integration.

Key Responsibilities

• AI Development Toolchain. Extend the Ameba SDK Development MCP server with new agent-facing capabilities — model deployment, inference control, camera capture, and NPU performance reporting — so that AI coding agents can drive the full development loop on Ameba hardware.

• Benchmarking and Quality Measurement. Design and run end-to-end evaluation of the AI-assisted development workflow: task success rate, iteration count, and failure-mode analysis across multiple Ameba SoCs and AI clients. Use the results to guide engineering priorities and improve developer experience.

• Edge AI Model Enablement. Port, quantize, and optimize vision and speech models for Ameba NPU platforms. Produce and maintain a benchmarked model zoo covering inference latency, memory footprint, power consumption, and post-quantization accuracy.

• Bring-Your-Own-Model Workflow. Build and document the end-to-end path for customers to bring their own trained models onto Ameba — conversion, INT8 quantization, accuracy recovery, and on-device validation — including troubleshooting guides for common failure modes.

• Vision Reference Designs. Develop application-level reference designs on Ameba NPU SoCs for scenarios such as human and object detection and commercial video surveillance, validated against real-world performance targets.

• Speech and Voice Applications. Prototype hybrid on-device / cloud voice architectures — on-device wake word and audio front-end, cloud ASR, LLM, and TTS — and characterize the end-to-end latency budget that determines user experience. Benchmark speech technology components against measured accuracy, memory, and power targets.

• Partner and Customer Enablement. Serve as the technical counterpart for international AI/ISV ecosystem partners and support customer teams in adopting Ameba AI capabilities, including reference code, documentation, and issue resolution.

Minimum Qualification

• Master's degree in Electrical Engineering, Electronic Engineering, Computer Science, or a related field, with 5+ years of relevant AI/ML engineering experience.

• Demonstrated end-to-end ownership of machine learning systems in production — from model training and fine-tuning, through optimization and quantization, to deployed inference serving live business operations with measurable outcomes. Research-only or proof-of-concept-only experience does not meet this requirement.

• Experience building and maintaining the pipelines, APIs, or internal platforms that other engineers or end users depend on — not solely notebook-based model development.

• Practical experience with model optimization and deployment toolchains such as ONNX, OpenVINO, or TensorRT, including quantization of models for inference on constrained hardware and systematic recovery of post-quantization accuracy.

• Strong proficiency in Python for model development, tooling, and service implementation.

• Hands-on experience with deep learning frameworks ( PyTorch, TensorFlow) for training and fine-tuning models.

• Experience leading technical delivery, either owning a project end to end or directing a small team through a full delivery cycle.

• Ability to read and interpret C source code well enough to understand SDK examples, trace data flow, and communicate precisely with firmware engineers. (Writing production firmware is not required for this role.)

• Professional working proficiency in English, both written and verbal.

Preferred Qualifications

• Experience building developer-facing tools or SDKs consumed by external developers.

• Experience deploying models to embedded, MCU-class, or NPU-accelerated hardware.

• Experience with computer vision model development and deployment (OpenCV, YOLO-family object detection, anomaly detection).

• Experience with speech and audio AI: ASR model fine-tuning, text-to-speech synthesis, or conversational systems.

• Experience building LLM-based applications: retrieval-augmented generation (RAG), agent frameworks, and systematic evaluation of AI system quality.

• Familiarity with the Model Context Protocol (MCP) or comparable AI agent tooling standards.

• Experience delivering technical enablement to external customers or partners.

• Track record of open-source contribution, technical publication, or competitive AI/ML achievements.