Back to Jobs
Recently postedTechnology

Sr. Data Engineer - SDE 26-17080

Compu-Vision Consulting, Inc.United States🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeHybrid
LocationUnited States
MySQLOracleSQLSpringSpring BootGitAWSETLSnowflakeData PipelineJavaPerlPythonRESTSOAPAzurePostgreSQLSQL ServerAgile

Job description

Job Title: Sr. Data Engineer

Duration: 12 months - CONTRACT [NO BENEFITS]

Location: Remote

Job Summary

The Data Strategy team uses agency data to serve the public more equitably and effectively. Its work has focused on analyzing data to optimize agency operations and making Open Data more accessible to the public. The team is now expanding to drive the strategy for non-public data-sharing infrastructure across agencies. This includes automating data feeds, implementing robust quality assurance, and improving the user experience of data-sharing platforms.

The resource will support the team in implementing its data management strategy. This includes strategic input on delivery, development and integration of the Master Data Management (MDM) platform, as well as building analytic products and data integration platforms.

Scope of Services

The team works with agencies and their data in three main ways: analyzing data to improve agency operations, making Open Data more accessible to all, and advancing data infrastructure, integration and sharing. The Senior Data Engineer will ensure the efficient and successful implementation and support of complex data engineering solutions. The resource should have a solid understanding of industry-standard implementation methodologies using data integration engineering technologies, tools and processes.

Key Responsibilities

  • Support implementation of the MDM Person and Business domains, integrating multiple data sources with accompanying web services and APIs.
  • Develop and support architectural blueprints that use the MDM as a foundational service, including unified profiles for linking business transactions relevant to a business owner.
  • With guidance from Technical Leads, coordinate the work of senior-level data engineers building pipelines to the MDM and other data platforms.
  • Support development of analytics tools that use the data pipeline to provide actionable insights into customer engagement and experience, operational efficiency, and other key business performance metrics.
  • Review Extraction, Transformation, Load (ETL) strategies for data from a wide variety of sources using SQL, cloud and big data technologies.
  • Manage development of APIs for data access or for landing data as output to the appropriate downstream target data store.
  • Develop custom code and services that allow seamless integration between systems.
  • Contribute to new technology projects as assigned and provide operations and maintenance support for existing applications.
  • Unit test newly developed code and support system testing efforts.
  • Troubleshoot errors, defects and other system issues.
  • Create, update and maintain system documentation, including data dictionaries, source-to-target maps, database policies and guidelines, and source code repositories.
  • Coordinate security scan accreditations and work with the Cyber Command/security team to complete the application security accreditation process.
  • Perform special projects and initiatives as assigned.

Mandatory Skills/Experience (candidates without these will not be considered)

  • At least 8 years of experience managing the development and implementation of large technology projects, with at least 3 years involving an MDM implementation.
  • At least 8 years of experience writing SQL.
  • At least 8 years of experience copying, transferring, manipulating and automating data operations that were manual processes.
  • Experience with data architecture tools and components such as Informatica PowerCenter, IICS, SSIS or similar ETL tools.
  • Experience with the Amazon Web Services or Microsoft Azure cloud computing platform and services.
  • In-depth knowledge of SQL and other database solutions.
  • Knowledge of modeling database schemas for large datasets.
  • Experience developing cloud-ready applications.
  • Experience with programming languages such as Python, Java and Perl.

Desirable Skills/Experience

  • 5+ years of hands-on development experience with the Informatica PowerCenter suite and B2B Data Transformation.
  • Experience with Oracle 10g/11g, SQL Server and/or a database appliance.
  • Knowledge of metadata-driven enterprise reporting platforms.
  • Experience with application development using the Java Spring Boot Framework.
  • Extensive knowledge of service-oriented architecture using SOAP and RESTful web services.
  • Experience with 3-tier architecture.
  • Experience with Oracle, Microsoft SQL Server, MySQL, RDS and PostgreSQL.
  • Hands-on experience with cloud-based platforms such as AWS, Microsoft Azure and Snowflake is a plus.
  • Experience with an agile, iterative development process and version control tools such as Git, GitHub and Subversion.

Will your resume get past this employer's screening? Check your resume against this job, free

Similar jobs