Why This Role Stands Out
As an ML Infrastructure Engineer at Graphon.AI, you'll be at the forefront of building the next generation of AI by developing innovative solutions for large-scale data reasoning. This role is ideal for a mid-senior engineer passionate about shaping cutting-edge ML infrastructure and contributing to a company revolutionizing AI capabilities. You will thrive here if you are eager to make a significant impact on foundational AI technology and grow your skills in a dynamic, forward-thinking environment.
Quick Overview
Job Description
About Graphon
Graphon AI is building the pre-model intelligence layer for the next generation of AI. We are developing the context engine layer that solves a fundamental challenge: “What if I could just dump all my data and GPT/Claude/Gemini could smartly reason across it?” Today, this is incredibly difficult due to the limitations of LLM context windows and the fundamental squared scaling inherent to attention mechanisms. While sparse attention and RAG systems attempt to address this, they haven't proven to be robust general solutions.
Our Approach
Pre-model intelligence is our answer. We believe a graph-based approach that analyzes relationships across data on a topological level provides the correct inductive bias for long-context multimodal reasoning.
Just as CNNs provided the bias for spatial invariance in vision, and Transformers established the standard for sequential dependencies in language, our framework provides the structural foundation needed for complex, interconnected data.
We believe the next wave of AI progress will come from better infrastructure around models:
-
Better Memory & Context: Creating truly persistent, scalable state.
-
Better Representations: Moving beyond simple embeddings to relational world models.
-
Universal Infrastructure: A way to stop rebuilding the same context layer for every agent, dataset, and application.
The Team
We are a lean, experienced team that values ownership, pragmatism, and technical excellence. We have raised a significant seed round from top-tier VCs and strategic foundation model providers to scale this new paradigm.
-
Arbaaz Khan, CEO: ex-Amazon; PhD in Robotics and ML.
-
Clark Zhang, CTO: ex-Meta; PhD in Robotics and ML.
-
Deepak Mishra, COO: ex-VC; 10+ years of Enterprise Technology experience.
About You
Required
-
Bachelor’s, Master’s, or PhD in Computer Science, Machine Learning, Robotics, or a related technical field (or equivalent practical experience).
-
Strong software engineering fundamentals with experience building production systems (Python required; experience with C++/Go a plus).
-
Experience working with machine learning infrastructure, such as training pipelines, inference/serving systems, data pipelines, or model deployment.
-
Familiarity with modern ML stacks (e.g., PyTorch/JAX, GPUs, distributed training or inference).
-
Solid understanding of core systems concepts (version control, Linux, basic networking, CI/CD).
-
High agency and ownership mindset—you identify problems, propose solutions, and drive execution.
-
Pragmatic, “right tool for the job” thinker who enjoys collaborating and iterating quickly.
Nice to Have
-
Experience scaling ML systems in production environments.
-
Experience with distributed systems, large-scale data processing, or GPU optimization.
-
Exposure to multimodal ML, retrieval systems, or graph-based representations.
- Prior startup experience or comfort operating in ambiguous, fast-moving environments.
Compensation & Benefits
- Base salary range: $180,000 – $250,000 (depending on experience and level)
- Meaningful equity with the opportunity to own a real stake in a category-defining company
- Comprehensive benefits, including health, dental, vision, and competitive paid time off
Similar jobs
- PD
AI/ML Engineer (Azure)
NewPurple Drive Technologies LLC
Bellevue, WA🇺🇸Hybrid22 hours agoMLOpsMachine LearningAzure+2Technology - CO
Lead Machine Learning Engineer (Manager IC)
NewCapital One
Mc Lean, Virginia🇺🇸$197.3k - $225.1k/yrHybrid2 hours agoScalaAWSMachine Learning+8Technology - CO
Lead Machine Learning Engineer (Manager IC)
NewCapital One
Richmond, Virginia🇺🇸$197.3k - $225.1k/yrHybrid4 hours agoScalaAWSMachine Learning+8Technology - CO
Senior Lead Machine Learning Engineer
NewCapital One
New York🇺🇸$229.9k - $262.4k/yrHybrid4 hours agoScalaAWSMachine Learning+8Technology - CO
Senior Lead Machine Learning Engineer
NewCapital One
Richmond, Virginia🇺🇸$229.9k - $262.4k/yrHybrid4 hours agoScalaAWSMachine Learning+8Technology - CO
Senior Lead Machine Learning Engineer
NewCapital One
Mc Lean, Virginia🇺🇸$229.9k - $262.4k/yrHybrid4 hours agoScalaAWSMachine Learning+8Technology