Site Reliability Engineer III

Job Title: Site Reliability Engineer III

Location: Jersey City, NJ

Duration: Contract - 12 months

Pay Range: $73.66/hr (W2)

Job ID: 409165

About BCforward

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Job Description

We are seeking a Generative AI Software Engineer to join our dynamic team supporting Bank of America Global Markets AI initiatives. The ideal candidate will have strong experience in Python, MLOps, RAG architecture, and full-stack/API development and a proven ability to design, build, and operationalize secure, scalable, and compliant GenAI platforms and reusable tooling.

Responsibilities:

• Design, build, and maintain reusable tools and frameworks for Generative AI and Retrieval-Augmented Generation.


• Develop secure, scalable, and high-performance services that meet functional, non-functional, and compliance requirements.


• Implement RAG pipelines including chunking, embeddings, retrieval, reranking, and summarization.


• Build API-based applications with FastAPI, JWT integration, and API Gateway patterns.


• Engineer inference platforms using open-source toolsets, including AI gateway, policy store, and observability for RAG and related use cases.


• Develop utilities, automation frameworks, and shared data science platforms for AI/ML and GenAI teams.


• Collaborate in large teams using multi-repo workflows, IDE-based development, CI/CD, and continuous testing.


• Drive process adherence, quality, and experimentation across the development lifecycle.


• Troubleshoot and resolve complex infrastructure and platform issues with root-cause analysis.

Required Skills & Qualifications:

• 3+ years of object-oriented Python development with strong software engineering practices.


• Hands-on experience across the AI/ML and GenAI lifecycle, including MLOps, fine-tuning, and inference frameworks.


• Proficiency with RAG architectures and components such as chunking, embeddings, retrieval, reranking, and summarization.


• Application development expertise in MongoDB, Redis, and modern front-end frameworks (Angular or React).


• Experience building API services with FastAPI, JWT, and API Gateway patterns, with containerization practices.


• Strong DevOps skills with Git/Bitbucket, Jenkins, SonarQube, pytest, Artifactory, and Ansible.


• Demonstrated ability to work in multi-repo environments with CI/CD and continuous testing using IDEs such as VS Code.


• Strong automation and scripting capabilities with Python.


• Excellent analytical, problem solving, interpersonal, presentation, and communication skills.

Preferred Skills:

• Experience deploying GenAI inference platforms with observability, policy enforcement, and gateway services.


• Background in building shared AI/ML platforms supporting multiple data science teams.

Why BCforward?

At BCforward, we believe in advancing lives and careers. When you join our team, you gain access to:

• Competitive compensation and benefits


• Opportunities for growth with global clients


• A supportive, inclusive culture that values innovation and people


• Exposure to cutting-edge technologies and projects

About Our Commitment

BCforward is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.

Interested? Apply Now!

If this sounds like the right opportunity for you, please apply with your most recent resume.