Why This Role Stands Out
This hybrid AI Engineer role at Bank of America offers a fantastic opportunity to drive innovation in Generative AI, influencing scalable and resilient architectures while developing cutting-edge solutions. You'll thrive here if you're a mid-senior engineer passionate about defining technology stacks, enabling CI/CD, and crafting best practices for high-performance code. Apply to shape the future of AI within a reputable financial institution.
Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
New York, NY, United States
Posted
19 hours ago
AgileStakeholder Management
Job Description
Responsibilities:
- Ensures that the design and engineering approach for complex features are consistent with the larger portfolio solution
- Define the technology tool stack for the solution and evaluate and adapt new testing tool/framework/practices for team(s)
- Enables team(s)/applications with Continuous Integration/Continuous Development (CI/CD) capabilities and engages with other technical stakeholders pertaining to efficient functioning of CI-CD pipeline
- Guides and influences team(s) on design and best practices for high code performance e.g. pairing, code reviews
- Provides end-to-end delivery of complex features, including automation, for either a single team or multiple teams, at the program level
- Conducts research, design prototyping and other exploration activities such as evaluating new toolsets and components for release management, CI/CD, and features
- Works with stakeholders to establish high-level solution needs and with architects for technical requirements
- Define the reference architecture for GenAI use cases across model access, orchestration, retrieval, tool calling, agent patterns, and runtime controls, ensuring designs are scalable, reusable, and aligned to enterprise standards.
- Produce architecture standards covering identity, data boundaries, guardrails, observability, resiliency, and human-oversight patterns, with explicit guidance on designing for high availability, fault tolerance, and production-grade performance
- Establish capacity and scaling strategies for the platform
- Define resiliency architecture and service tiering models
- Partner with platform engineering, security, and use-case owners to ensure new solutions align to approved GenAI patterns and business outcomes, with clear separation of responsibilities across Developer, Use Case Owner, and End User personas
Required Qualifications
- 10+ years in enterprise architecture, platform architecture, or distributed systems design
- Deep experience designing platforms operating at scale, not just single-use applications
- Strong experience with GenAI/agentic architecture:
- model gateways, RAG, vector retrieval, orchestration, tool calling, guardrails, evaluation
- Proven experience designing for:
- high availability, scalability, and performance optimization
- capacity planning and workload distribution across distributed systems
- Experience defining standards for:
- identity, access control, and secure service integration
- data scope, governance, and controlled access in regulated environments
- Familiarity with:
- observability, auditability, and resilience patterns
- telemetry, real-time monitoring/alerts, and traceability across distributed workflows
Desired Qualifications:
- Banking or other highly regulated enterprise environment experience
- Experience designing enterprise AI platforms supporting multiple teams and products at scale
- Experience with:
- AI model registries, lineage, and compliance metadata
- Performance benchmarking and scaling strategies for AI workloads
- Agentic RAG and complex multi-hop retrieval patterns distributed, multi-agent systems operating under governance and control frameworks
Skills:
- Automation
- Influence
- Result Orientation
- Stakeholder Management
- Technical Strategy Development
- Application Development
- Architecture
- Business Acumen
- Risk Management
- Solution Design
- Agile Practices
- Analytical Thinking
- Collaboration
- Data Management
- Solution Delivery Process
Minimum Education Requirements: Bachelore degree or equivalent professional experience
Similar jobs
- K&
AI Infrastructure Director
NewKirkland & Ellis LLP
Chicago, IL🇺🇸$302k - $335k/yrHybrid2 days agoDockerMLOpsMachine Learning+11 - NS
Engineering Lead, AI Email Applications, Artificial Intelligence (AI) Required - Work From Home
NewNext Step Systems
San Francisco, CA🇺🇸$170k - $190k/yrRemote10 hours agoMachine LearningLLMTechnology - CO
Staff AI Engineer
NewCapital One
New York🇺🇸$269.1k - $307.2k/yrHybrid4 hours agoScalaAWSMachine Learning+9Technology - CO
Distinguished AI Engineer
NewCapital One
Mc Lean, Virginia🇺🇸$269.1k - $307.2k/yrHybrid4 hours agoScalaAWSMachine Learning+10Technology - CO
Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)
NewCapital One
New York🇺🇸$225.4k - $257.2k/yrHybrid4 hours agoScalaAWSMachine Learning+9Technology - CO
Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)
NewCapital One
Mc Lean, Virginia🇺🇸$229.9k - $262.4k/yrHybrid4 hours agoScalaAWSMachine Learning+9Technology