Haystack
← Back to Jobs
Technology
SA

AI Engineer - Full Time Position - New York - Bank of America -

SANSNew York, NY🇺🇸United StatesPosted 7 Sept 2026

Why This Role Stands Out

This hybrid AI Engineer role at Bank of America offers a fantastic opportunity to drive innovation in Generative AI, influencing scalable and resilient architectures while developing cutting-edge solutions. You'll thrive here if you're a mid-senior engineer passionate about defining technology stacks, enabling CI/CD, and crafting best practices for high-performance code. Apply to shape the future of AI within a reputable financial institution.

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
New York, NY, United States
Posted
19 hours ago
AgileStakeholder Management

Job Description

Responsibilities:

  • Ensures that the design and engineering approach for complex features are consistent with the larger portfolio solution
  • Define the technology tool stack for the solution and evaluate and adapt new testing tool/framework/practices for team(s)
  • Enables team(s)/applications with Continuous Integration/Continuous Development (CI/CD) capabilities and engages with other technical stakeholders pertaining to efficient functioning of CI-CD pipeline
  • Guides and influences team(s) on design and best practices for high code performance e.g. pairing, code reviews
  • Provides end-to-end delivery of complex features, including automation, for either a single team or multiple teams, at the program level
  • Conducts research, design prototyping and other exploration activities such as evaluating new toolsets and components for release management, CI/CD, and features
  • Works with stakeholders to establish high-level solution needs and with architects for technical requirements
  • Define the reference architecture for GenAI use cases across model access, orchestration, retrieval, tool calling, agent patterns, and runtime controls, ensuring designs are scalable, reusable, and aligned to enterprise standards.
  • Produce architecture standards covering identity, data boundaries, guardrails, observability, resiliency, and human-oversight patterns, with explicit guidance on designing for high availability, fault tolerance, and production-grade performance
  • Establish capacity and scaling strategies for the platform
  • Define resiliency architecture and service tiering models
  • Partner with platform engineering, security, and use-case owners to ensure new solutions align to approved GenAI patterns and business outcomes, with clear separation of responsibilities across Developer, Use Case Owner, and End User personas

Required Qualifications

  • 10+ years in enterprise architecture, platform architecture, or distributed systems design
  • Deep experience designing platforms operating at scale, not just single-use applications
  • Strong experience with GenAI/agentic architecture:
    • model gateways, RAG, vector retrieval, orchestration, tool calling, guardrails, evaluation
  • Proven experience designing for:
    • high availability, scalability, and performance optimization
    • capacity planning and workload distribution across distributed systems
  • Experience defining standards for:
    • identity, access control, and secure service integration
    • data scope, governance, and controlled access in regulated environments
  • Familiarity with:
    • observability, auditability, and resilience patterns
    • telemetry, real-time monitoring/alerts, and traceability across distributed workflows

Desired Qualifications:

  • Banking or other highly regulated enterprise environment experience
  • Experience designing enterprise AI platforms supporting multiple teams and products at scale
  • Experience with:
    • AI model registries, lineage, and compliance metadata
    • Performance benchmarking and scaling strategies for AI workloads
    • Agentic RAG and complex multi-hop retrieval patterns distributed, multi-agent systems operating under governance and control frameworks

Skills:

  • Automation
  • Influence
  • Result Orientation
  • Stakeholder Management
  • Technical Strategy Development
  • Application Development
  • Architecture
  • Business Acumen
  • Risk Management
  • Solution Design
  • Agile Practices
  • Analytical Thinking
  • Collaboration
  • Data Management
  • Solution Delivery Process

Minimum Education Requirements: Bachelore degree or equivalent professional experience

Similar jobs