Back to Jobs
Recently postedFull timeTechnology

Backend Infrastructure Engineer, Anti-Bot

True Talent Solutions PartnersSan Francisco🇺🇸United States

Quick overview

SeniorityMid Senior
Employment typeFull Time
Work modeOn Site
LocationSan Francisco, United States
TCP/IPCloudflareGrafanaHTTPPrometheusPython

Job description

About the Role

Join a team building web data-extraction infrastructure for AI applications. You will own production systems that keep high-volume extraction reliable when websites actively resist automated access.

What You'll Do

  • Architect and manage proxy rotation, IP and session management, and isolated egress nodes at scale.

  • Improve extraction success rates against websites with active anti-bot and anti-scraping defenses.

  • Build and maintain browser and TLS fingerprinting, CAPTCHA handling, and challenge-solving infrastructure.

  • Monitor the health and cost efficiency of the proxy layer.

  • Diagnose intermittent failures across the stack and deliver lasting fixes.

  • Own production systems end to end, including reliability and on-call responsibilities.

What We're Looking For

  • More than 3 years of experience in adversarial web infrastructure or proxy-layer engineering, with recent hands-on work in production web extraction.

  • Experience building proxy rotation, IP and session management, egress isolation, and proxy economics for third-party web extraction.

  • Production experience evading aggressive anti-bot defenses, including platforms such as Akamai, DataDome, Cloudflare, or Kasada, and ownership of success-rate metrics.

  • Experience with browser and TLS fingerprinting and CAPTCHA or challenge handling at production scale.

  • Proficiency in Go and/or Python, with strong networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.

  • Experience operating end-to-end production systems and implementing observability and on-call tooling such as Prometheus and Grafana.

Compensation & Benefits

Base salary: $235,000 to $260,000 annually. Visa sponsorship is available.

Location

Hybrid, San Francisco, California, United States.

Similar jobs