Sr. AI & Data Engineer - Databricks

hackajob is collaborating with Accenture to connect them with exceptional professionals for this role. We are:
The Advanced Technology Centers (ATCs) are the engine for reinvention in our clients' transformation journey. Powered by more than 255,000 people across 24 countries, ATCs provide our clients with seamless access to industry insights and innovative technology solutions. Stronger together! The Advanced Technology Centers (ATCs) make a tremendous impact in solving our clients' business problems by leveraging innovation, intelligence, industry insights, new IT, and new technology skills.

With the global environment changing at a faster pace, our clients are facing unprecedented challenges, and they need us more than ever before. As a Network, ATCs are positioned to unlock greater opportunities and exponential value for our clients. The value for our clients and our people:
For our clients, the Network provides the strength of our geographic diversity, greater resilience, and seamless access to the deepest industry knowledge, the latest in Gen AI solutions, and tech expertise from around the world.

For our people, it brings an opportunity to shape truly boundaryless career paths in a highly collaborative team of experts where they can learn from each other and solve the world's most complex client challenges. You are:
An experienced, hands-on Data & AI Engineer with deep hands-on expertise in Databricks and Azure data services to design, build, and optimize scalable data pipelines. You design and implement autonomous agents using Databricks Mosaic AI Agent Framework and frameworks like LangChain or AutoGen.

You'll work closely with analytics, data science, and cloud teams to ensure reliable, high-performance data delivery for the clients we serve.

The Work

There will never be a typical day and that's why people love it here. The opportunities to make a difference within exciting client initiatives are unlimited in the ever-changing technology landscape. You will be part of a highly collaborative and growing network of technology and data experts, who are taking on today's biggest, most complex business challenges using the latest data and analytics technologies. We will nurture your talent in an inclusive culture that values diversity. You will have an opportunity to work in a variety of roles covering all aspects of Data Engineering including Data Modelling, Data Integration, Data Analytics, Pipeline Development, Agentic AI, RAG, Cloud and Infrastructure integration, Data Quality, Observability & Governance.

Key Responsibilities

• Architect, develop, and maintain scalable, low-latency data pipelines to ingest and transform diverse datasets leveraging Azure Databricks workflows and Spark technologies.
• Design and optimize Lakehouse architecture using Delta Lake tables following Bronze, Silver, and Gold layers to ensure efficient, reliable, and governed data storage.
• Partner closely with data scientists and business analysts to deliver clean, validated, and well-modeled datasets that support advanced analytics and AI initiatives.
• Design and implement autonomous agents using Databricks Mosaic AI Agent Framework and frameworks like LangChain or AutoGen.
• Build and optimize vector search indexes using Databricks Vector Search for accurate context retrieval.
• Process large-scale distributed datasets on the Databricks Intelligence Platform with Apache Spark.
• Design and implement data models that meet business requirements and enhance data usability.
• Continuously evaluate and improve data architecture processes to enhance efficiency and effectiveness.
• Design AI agents with retrieval, orchestration, tool invocation, evaluation harnesses, and lifecycle observability.
• Continuously monitor pipeline health and performance; implement automated alerting and observability frameworks to facilitate rapid troubleshooting and proactive optimization.

This is a hybrid role and will require three days per week in the office. Hiring locations: Dallas, TX; Houston, TX; Columbus, OH; or Tampa, FL.
What you need

• A minimum of three years of professional experience as a Data & AI Engineer or in a related role.
• A minimum of three years of experience working with Microsoft Azure cloud data services.
• A minimum of two years experience with Databricks (PySpark, SQL, Delta Lake, workflows).
• Bachelor's degree or equivalent (minimum 12 years) work experience. (If Associate Degree, must have minimum 6 years work experience)

Preferred:

• Advanced Python (PySpark) and SQL for data transformation and pipeline development.
• Experience with Azure Databricks: Spark, Delta Lake, Auto Loader, Lakehouse Medallion Architecture (Bronze, Silver, Gold).
• Experience with Git-based version control and CI/CD pipelines (Azure DevOps or GitHub Actions).
• Experience in agent development using Mosaic AI Agent Framework.
• Strong problem-solving and performance optimization skills.
• Experience in MLOps / LLMOps (CI/CD for ML and LLM lifecycle).
• Genie product family.
• Databricks Certified Data Engineer Professional (2025).
• Microsoft Certified: Azure Data Engineer Associate.

Compensation at Accenture varies depending on a wide array of factors, which may include but are not limited to the specific office location, role, skill set, and level of experience. As required by local law, Accenture provides a reasonable range of compensation for roles that may be hired as set forth below.
We anticipate this job posting will be posted until 11/21/2026.
Accenture offers a market competitive suite of benefits including medical, dental, vision, life, and long-term disability coverage, a 401(k) plan, bonus opportunities, paid holidays, and paid time off. See more information on our benefits here:
U.S. Employee Benefits Accenture
Role Location Annual Salary Range
California $70,350 to $205,800
Colorado $63,800 to $177,800
Connecticut $63,800 to $177,800
District of Columbia $68,000 to $189,300
Illinois $59,100 to $177,800
Maine $54,400 to $151,400
Maryland $63,800 to $177,800
Massachusetts $63,800 to $189,300
Minnesota $63,800 to $177,800
New York $66,300 to $205,800
New Jersey $68,000 to $205,800
Ohio $59,100 to $164,600
Virginia $59,100 to $189,300
Washington $80,200 to $189,300
About Accenture
Accenture is a leading global professional services company that helps the world's leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services-creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world's leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360 value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360 value we create for our clients, each other, our shareholders, partners and communities.
Visit us at
What We Believe
We have an unwavering commitment to diversity with the aim that every one of our people has a full sense of belonging within our organization. As a business imperative, every person at Accenture has the responsibility to create and sustain an inclusive environment.
Inclusion and diversity are fundamental to our culture and core values. Our rich diversity makes us more innovative and more creative, which helps us better serve our clients and our communities. Read more here
Requesting An Accommodation
Accenture is committed to providing equal employment opportunities for persons with disabilities or religious observances, including reasonable accommodation when needed. If you are hired by Accenture and require accommodation to perform the essential functions of your role, you will be asked to participate in our reasonable accommodation process.

Accommodations made to facilitate the recruiting process are not a guarantee of future or continued accommodations once hired. If you would like to be considered for employment opportunities with Accenture and have accommodation needs such as for a disability or religious observance, please call us toll free at 1 or send us an email or speak with your recruiter. Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences.

All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities. For details, view a copy of the Accenture Equal Opportunity Statement
. click apply for full job details