Haystack
← Back to Jobs
Engineering
SO

Splunk Observability Engineer

System OneKnoxville, TN🇺🇸United StatesPosted 11 Sept 2026

Why This Role Stands Out

This Splunk Observability Engineer role offers a fantastic opportunity to deepen your expertise in managing large-scale observability platforms within a dynamic AWS environment, fostering significant career growth. You'll thrive here if you possess strong Splunk and Python skills, enjoy complex problem-solving, and are eager to contribute to critical infrastructure. Apply now to leverage your talents and advance your career in this impactful position.

Quick Overview

Seniority
Mid Senior
Work mode
On Site
Location
Knoxville, TN, United States
Posted
19 hours ago

Job Description

For immediate consideration, please connect with me on LinkedIn at  and then email me your resume, work authorization status, current location, availability, and compensation expectations directly to  - make sure to include the exact job title and job location in your email message.

*** no C2C with 3 rd parties, no contractors - W2 salaried candidates only


*** Must be able to work on site in either of the following locations : Lafayette, LA - Knoxville, TN - Columbia, SC - Birmingham, AL


Splunk Observability Engineer :

Hands on role supporting large Splunk and observability platforms in an AWS production setting.

 

  • Run, upgrade and support Splunk Enterprise on AWS (EC2)
  • Manage the full data lifecycle: ingestion, indexing, search, dashboards, alerts, retention and recovery
  • Write and tune complex SPL queries
  • Build dashboards for monitoring and incident triage
  • Fix ingestion failures, missing data, volume spikes and outages
  • Restore and replay data after interruptions
  • Reduce noise, storage use and cost
  • Connect Splunk with CloudWatch and OpenTelemetry
  • Build and maintain OpenTelemetry agent and collector packages
  • Automate tasks with Python
  • Handle patching and security fixes
  • Lead troubleshooting calls across teams
  • Take part in on call rotation

Requirements
 
  • Strong Splunk admin experience in large production setups (forwarders, indexers, search heads)
  • Advanced SPL skills
  • Strong AWS experience: EC2, ALB, CloudWatch
  • Hands on OpenTelemetry experience, including Splunk integration
  • Python for automation
  • GitLab, GitHub, Terraform Enterprise, CI/CD, JSON
  • Strong troubleshooting and clear communication skills


 

For immediate consideration, please connect with me on LinkedIn at  and then email me your resume, work authorization status, current location, availability, and compensation expectations directly to  - make sure to include the exact job title and job location in your email message.
 

.

#M1

#LI-DP1
.

 



Ref: #404-IT Pittsburgh

Similar jobs