Why This Role Stands Out
Leverage your data engineering expertise within a highly respected firm, contributing to impactful data solutions and collaborating with a talented team in a flexible hybrid environment. This role is ideal for ambitious mid-senior professionals eager to enhance their skills in Big Data, AI/ML, and data lifecycle management while working on critical projects.
Quick Overview
Job Description
You will join a top tier team that will leverage their development skills and experience, to support the successful designing, ingesting, cleansing, transformation, loading, and display of significant amounts of data. Duties, Tasks and Responsibilities - Designing, implementing, and optimizing data extraction, cleansing, transformation, loading, replication/distribution, and large-scale ingest systems in a Big Data environment
- Optimizing all stages of the data lifecycle, from initial planning, to ingest, through final display and beyond
- Developing custom solutions/code to ingest and exploit new and existing data sources
- Developing data profiling, deduping logic, and matching logic for analysis
- Organizing and maintaining Data Layer documentation, so others are able to understand and use it. Also, work closely with data scientists to craft data pipelines which serve the development of modern AI/ML workflows
- Collaborating with teammates, other service providers, vendors, and users to develop new and more efficient methods
- Effectively articulating the risks and constraints associated with software solutions, based on environment Required Experience, Skills, & Technologies - High School Diploma/GED with 2+ years of relevant software development/programming experience
- Demonstrated data analysis, parsing, and programming language experience (e.g. Python, Java) coupled with significant SQL/database experience
- Experience with the full data lifecycle, from ingest through display, in a Big Data environment
- Hands-on experience with Java-related technologies, such as JDK, J2EE, EJB, JDBC, and/or Spring, and experience with RESTful APIs
- Experience with data pipelining systems (e.g. Apache Airflow) and developing/performing ETL tasks in a Linux environment Desired Experience, Skills & Technologies - Experience deploying systems that leverage AI/ML technology
- Experience publishing results in BI dashboards Clearance Required - Due to the sensitivity of customer-related requirements, U.S. Citizenship is required
- TS/SCI with Full Scope Polygraph required
Similar jobs
- TA
Job Title: Senior / Lead Data Engineer – Snowflake Cortex & AWS Bedrock
NewTexnere Americas Inc
United States🇺🇸$50/hrHybrid20 hours agoShellAPI GatewayAWS+6Technology - NI
Senior Data Engineer (SAS to Databricks Migration)
NewNimbusAITech LLC
United States🇺🇸Remote20 hours agoSQLApacheApache Spark+4Technology - SS
Lead Azure Data Engineer || Only Locals || F2F Interview
NewSolveIT Services Inc
Chicago, IL🇺🇸On-site20 hours agoSQLSQL ServerT-SQL+5Technology - SB
Data Engineer Remote Location
NewSierra Business Solution LLC
United States🇺🇸Remote20 hours agoSQLAzureDatabricksTechnology - HP
Healthcare Data Engineer
NewHR Pundits
United States🇺🇸Hybrid20 hours agoSQLAWSETL+3Technology - SU
Senior Data Engineer (P&C Exp)(Visa Independent Candidate Only/W2)
NewSumasEdge Corporation
Charlotte, NC🇺🇸Hybrid20 hours agoSQLScalaMLOps+5Technology - SS
Lead Azure Data Engineer || Only Locals || F2F Interview
NewSolveIT Services Inc
Irving, TX🇺🇸$70/hrOn-site20 hours agoSQLSQL ServerT-SQL+5Technology - DM
Full Time: Lead Data Engineer
NewDigital Minds Global Technologies Inc.
Cary, NC🇺🇸$140k - $145k/yrOn-site20 hours agoSQLScalaAzure+8Technology - AI
Lead Data Engineer
NewAcunor Infotech
Jersey City, NJ🇺🇸On-site20 hours agoOracleSQLETL+5Technology - MC
AWS Data Engineer
NewMaven Companies
Beverly Hills, CA🇺🇸Hybrid20 hours agoSQLAWSAirflow+7Technology - BA
BI Data Engineer
NewBoston Associate Software Systems
Queens, NY🇺🇸Hybrid20 hours agoSQLSQL ServerTableau+1Technology - DS
Sr. Data Engineer
NewDolphin Solutions Inc
Newark, NJ🇺🇸On-site20 hours agoSQLShellAWS+5Technology