Software Engineer (Splunk APM) - #1109701

NCS is a leading technology services firm that operates across the Asia Pacific region in over 20 cities, providing consulting, digital services, technology solutions, and more. We believe in harnessing the power of technology to achieve extraordinary things, creating lasting value and impact for our communities, partners, and people. Our diverse workforce of 13,000 has delivered large-scale, mission-critical, and multi-platform projects for governments and enterprises in Singapore and the APAC region.

As a Software Engineer (Splunk APM) you will be responsible for Splunk Observability, Splunk ITSI, Application Performance Monitoring, Real User Monitoring and Synthetic Monitoring. Operationalize Use cases to meet customer requirements and improve service delivery and operation productivity

What will you do?

• Implement and enable applications for Splunk APM (Application Performance Monitoring), RUM (Real User Monitoring), and Synthetic monitoring.

• Onboard new applications and services to the Splunk monitoring platforms, APM, RUM, and Synthetic.

• Maintain Splunk Observability tools including Infrastructure Monitoring

• Continuously tune and optimize alert rules to reduce false positives/negatives and improve incident detection.

• Coordinate with the Operations team for patching and upgrading of Splunk agents across environments.

• Proactively monitor hosts, applications, and infrastructure components to detect and resolve issues early.

• Create and fine-tune dashboards to provide actionable insights and visibility into system and application health.

• Configure and manage paging and alerting duties to ensure timely responses to incidents.

• Collaborate with cross-functional teams to improve monitoring coverage and effectiveness.

• Organize and lead bi-monthly operational meetings related to Splunk and monitoring activities.

• Manage Business As Usual (BAU) tasks along with continuous enhancements to the monitoring solutions.

• Develop, maintain, and update documentation, including Standard Operating Procedures (SOPs) and knowledge base articles.

The ideal candidate should possess:

• 2+ years of hands-on experience with Splunk Observability Suite, including APM, RUM, Synthetic Monitoring, and Infrastructure Monitoring.

• Proven experience implementing and operationalizing AIOps platforms and developing monitoring-related use cases.

• Strong experience managing and supporting Splunk Enterprise, ITSI, or ELK Stack in production across medium to large-scale environments.

• Expertise in setting up and integrating Splunk or ELK Stack (Elasticsearch, Logstash, Kibana) to aggregate and process data from diverse sources.

• Proficiency in data visualization techniques and tools such as Kibana and Splunk Dashboards to generate actionable insights.

• Experience optimizing and tuning alert rules, thresholds, and detectors to reduce false positives/negatives in observability tools.

• Experience in configuring incident response mechanisms, including alert routing, paging tools, and on-call setup.

• Solid understanding of integration with ITSM platforms (e.g., ServiceNow) and automated remediation workflows.

• Familiarity with integrating observability tools with automation/configuration management tools such as Ansible, Terraform, or Chef.

• Working knowledge of SQL with the ability to optimize queries for reporting and analytics.

• Understanding of Security and Access Management in observability and monitoring platforms.

• Comfortable working across Linux/Unix/Windows environments and managing agents and services on these platforms.

• Experience collaborating with cross-functional teams and driving monitoring improvements and operational efficiency.

• Excellent documentation skills with experience creating and maintaining Standard Operating Procedures (SOPs) and knowledge base articles.

• Strong troubleshooting and analytical skills for identifying performance bottlenecks in infrastructure and applications.

We are driven by our AEIOU beliefs—Adventure, Excellence, Integrity, Ownership, and Unity—and we seek individuals who embody these values in both their professional and personal lives. We are committed to our Impact: Valuing our clients, Growing our people, and Creating our future.

Together, we make the extraordinary happen.

Learn more about us at ncs.co and visit our LinkedIn career site.