Why this role stands out
Step into this influential leadership role at Promantis Inc, where you will architect cutting-edge data solutions and drive high-impact AI initiatives within a collaborative, fast-paced enterprise environment. This position is perfect for a seasoned data engineering expert who thrives on mentoring teams and setting technical standards, so apply today to accelerate your career and shape the future of large-scale data platforms.
Quick overview
Job description
Job Title: Technology Engineering Lead
Location: NY/NJ/PA - Onsite
Type: Fulltime
Job Description:
We are seeking an experienced Technology Lead to own the design and delivery of an enterprise batch feature store. The ideal candidate is a hands-on data engineering leader who can make sound architecture decisions, guide developers, and take complex data pipelines through to production.
Experience requirements
- 8+ years of experience in data engineering, data platforms, or enterprise application development.
- 5+ years of hands-on experience with PySpark, large-scale ETL/ELT development, and advanced SQL.
- 3+ years leading technical design and delivery for data engineering teams.
- Experience in banking or financial services is a plus.
Key responsibilities
- Lead the architecture, development, and production rollout of a batch feature store supporting analytics and AI use cases.
- Design scalable PySpark and Impala SQL pipelines that transform data from Hive and Oracle into consistent, reusable features.
- Define technical standards for feature logic, data quality, reconciliation, performance, monitoring, and failure recovery.
- Own batch scheduling and dependencies using CA7 or an equivalent platform.
- Provide hands-on technical direction through design reviews, code reviews, troubleshooting, and mentoring.
- Establish effective Git/Bitbucket, CI/CD, testing, and AI-assisted development practices.
- Coordinate production releases and change management in line with SDLC requirements.
- Work closely with business, analytics, and technology stakeholders to resolve requirements, communicate trade-offs, and deliver against milestones.
- Plan and track work in an Agile environment using Jira.
Required skills
- Advanced PySpark and Impala SQL, including query and pipeline performance tuning.
- Proven experience designing enterprise-scale ETL/ELT pipelines.
- Strong expertise with Hive and Oracle data platforms.
- Experience with CA7 or equivalent batch scheduling.
- Proficiency in Linux scripting, Git/Bitbucket, and CI/CD.
- Working knowledge of Agile delivery, Jira, SDLC, production release, and change management.
- Practical experience with AI-assisted development tools.
- Strong communication skills and a track record of leading delivery across multiple stakeholder groups.
Similar jobs
- DS
Senior Systems Engineer with Security ClearanceRecently posted
Data Systems Analysts, Inc (DSA) · Fort Detrick, MD · Hybrid · Posted 17 Nov 2026 🇺🇸
Generative AILinuxNetwork AdministrationTechnology$130k - $140k/yr - CM
Software EngineerRecently posted
Computer Merchant, Ltd., The · Burlington, MA · Hybrid · Posted 17 Nov 2026 🇺🇸
DockerMongoDBSpring+11Technology$80 - $87/hr - BO
Test and Inspection Embedded Software Engineer (Experienced or Senior) - BoeingRecently posted
Boeing · Berkeley, CA · On-site · Posted 17 Nov 2026 🇺🇸
GitEmbedded SystemsRobotics+6Technology$126.7k - $171.3k/yr - BO
Software Engineer - BoeingRecently posted
Boeing · Maryland Heights, MO · Hybrid · Posted 17 Nov 2026 🇺🇸
SAFeMicroservicesGit+13Technology$105k - $128.1k/yr - BO
Senior Software Engineer - Vehicle Health Management - BoeingRecently posted
Boeing · Berkeley, CA · On-site · Posted 17 Nov 2026 🇺🇸
DockerGitEmbedded Systems+8Technology$160.7k - $217.3k/yr - LO

Peoplesoft Application Developer (Onsite Interview)Recently posted
LOGICEXCELL LLC · Okemos, MI · Hybrid · Posted 17 Nov 2026 🇺🇸
OracleSQLREST+1TechnologySalary not listed - CS
.NET Software DeveloperRecently posted
Crossword Staffing Solutions LLC · Austin, TX · Hybrid · Posted 17 Nov 2026 🇺🇸
DockerMySQLOracle+12TechnologySalary not listed - ZB

Software Engineer - Payments TechnologyRecently posted
Zions Bancorporation, N.A. · Midvale, UT · On-site · Posted 17 Nov 2026 🇺🇸
MicroservicesOracleSQL+8TechnologySalary not listed - LB

Lead Software Engineer - AWS and TerraformRecently posted
Learn Beyond Consulting LLC · Irvine, CA · Hybrid · Posted 16 Nov 2026 🇺🇸
DynamoDBAWSBash+8TechnologySalary not listed - W&
System Engineer 1 with Security ClearanceRecently posted
Weeghman & Briggs · Annapolis Junction, MD · On-site · Posted 17 Nov 2026 🇺🇸
AWSAgileSystem DesignTechnology$155k/yr - BO
Software Engineer, Missile Defense National Team, C2BMC (Associa with Security ClearanceRecently posted
Boeing · Colorado Springs, CO · On-site · Posted 17 Nov 2026 🇺🇸
MicroservicesOracleSQL+5Technology$99.5k - $134.6k/yr - BO
Senior Systems Engineer - Seeker Testing - Patriot Advanced Capa with Security ClearanceRecently posted
Boeing · Huntsville, AL · Hybrid · Posted 17 Nov 2026 🇺🇸
Technology$136.8k - $185.2k/yr
