Quick overview
Job description
Team owns the layer between clients and backend workloads: proxy and L7 services, API Gateway, and inference gateway for AI traffic. Every request to backend services passes through this layer, so latency, availability, and correctness here directly affect everything downstream. You'll build and grow the team, set its technical direction, and own these services end to end, from design through production operations.
- Proxy and L7: request routing, TLS termination, connection management, config propagation across a large fleet, and keeping tail latency predictable under load.
- API Gateway: authentication and authorization, rate limiting and quotas, traffic policies, and giving service teams a safe, self-serve way to expose APIs.
- Inference gateway: routing AI inference traffic, which behaves differently from typical web traffic. Requests are long-running and often streamed, cost varies widely by request, and backend GPU capacity is expensive and limited. That makes routing, queuing, fairness, and capacity efficiency hard problems.
- Build and grow the team: hire engineers and tech leads, set expectations, give direct feedback, and develop people over time.
- Define the team's roadmap and priorities with leadership and partner teams.
- Stay close enough to the technical work to review designs, weigh tradeoffs, and make calls when needed.
- Own the operational health of the services: on-call, incident response, postmortems, and follow-through on reliability work.
- Work closely with networking, security, platform, and ML infrastructure teams on problems that cross team boundaries.
- Experience managing engineers who build and operate distributed systems in production.
- A solid technical background in at least one of: proxies and load balancing, API gateways, service mesh, networking, or high-throughput backend services.
- Experience running latency-sensitive services, including on-call and incident management.
- Experience building something new, such as starting a team, launching a new service, or taking a product from early design to production.
- A track record of hiring well and helping engineers grow.
- Hands-on experience with Envoy, NGINX or similar.
- Familiarity with LLM inference serving (batching, streaming, GPU utilization).
- Experience building internal platforms used by many engineering teams.
Certain U.S. based or U.S. customer or client-facing roles may be required to comply with applicable requirements, such as immunization/occupational health mandates, and/or drug testing requirements.
Range and benefit information provided in this posting are specific to the stated locations only
US: Hiring Range in USD from: $146,300 to $306,400 per annum. May be eligible for bonus, equity, and compensation deferral.
Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle's differing products, industries and lines of business.
Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.
Oracle US offers a comprehensive benefits package which includes the following:
1. Medical, dental, and vision insurance, including expert medical opinion
2. Short term disability and long term disability
3. Life insurance and AD&D
4. Supplemental life insurance (Employee/Spouse/Child)
5. Health care and dependent care Flexible Spending Accounts
6. Pre-tax commuter and parking benefits
7. 401(k) Savings and Investment Plan with company match
8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
9. 11 paid holidays
10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
11. Paid parental leave
12. Adoption assistance
13. Employee Stock Purchase Plan
14. Financial planning and group legal
15. Voluntary benefits including auto, homeowner and pet insurance
The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.
As part of Oracle's onboarding process and consistent with applicable law, US-based employees are required to complete identity verification, which involves the collection and processing of their biometric information. Accommodations to this requirement may be granted following an individualized assessment.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- VS

Manager, Spacecraft Systems Integration & TestRecently posted Auto Apply
Varda Space Industries · El Segundo · Hybrid · Posted 19 Nov 2026 🇺🇸
FiberCADC+++3Technology$170.3k - $246.0k/yr - MS

Software Engineering ManagerRecently posted Auto Apply
Momentus Space LLC · San Jose · Hybrid · Posted 19 Nov 2026 🇺🇸
RoboticsAgileProject Management+1Technology$225k - $275k/yr - AI

Engineering Manager, InfrastructureRecently posted Auto Apply
Aiwyn · Remote (US-based) · Hybrid · Posted 18 Nov 2026 🇺🇸
GCPCapacity PlanningGrafana+4Salary not listed - TB

Mechanical Engineering Manager, New ProductsRecently posted Auto Apply
Trove Brands · Lehi · Hybrid · Posted 18 Nov 2026 🇺🇸
AssemblyCADContinuous Improvement+3EngineeringSalary not listed - KO
VP, Platform EngineeringRecently posted Auto Apply
Kobie · St. Petersburg · Remote · Posted 18 Nov 2026 🇺🇸
OnboardingOracleAWS+4Salary not listed - OS

VP of EngineeringRecently posted Auto Apply
Oscilar · Remote · Remote · Posted 18 Nov 2026 🇺🇸
ComplianceSystem DesignEngineeringSalary not listed - TA

Electrical Engineering Manager, eGSERecently posted Auto Apply
True Anomaly · Long Beach · Hybrid · Posted 17 Nov 2026 🇺🇸
CADAltiumPCB Design+1Engineering$150k - $205k/yr - PE

Dimensional & Metrology Engineer IIIRecently posted Auto Apply
Peloton · Linden · Hybrid · Posted 17 Nov 2026 🇺🇸
CNCSolidWorksEngineering$139.9k/yr - MA

Engineering Manager, Enterprise Data Warehouse & AnalyticsRecently posted Auto Apply
Machinify · Remote - US · Remote · Posted 18 Nov 2026 🇺🇸
SQLApache SparkETL+11Technology$220k - $260k/yr - LI

Director, Photonics Hardware ValidationRecently posted Auto Apply
Lightmatter · Mountain View · Hybrid · Posted 18 Nov 2026 🇺🇸
C++PythonTriage+2$261k/yr - LH

Supervisor - Biomedical EngineeringRecently posted Auto Apply
Luminis Health · Annapolis · Hybrid · Posted 18 Nov 2026 🇺🇸
NursingPatient CareHealthcare$38 - $55/hr - LA

Engineering Manager, ExperimentationRecently posted Auto Apply
LaunchDarkly · Remote - US · Remote · Posted 18 Nov 2026 🇺🇸
Engineering$163k - $263.7k/yr
