Azure Data Engineer

A financial services firm in North Carolina is seeking a new Azure Data Engineer to join their team in Charlotte, supporting the onboarding, validation, and maintenance of security data pipelines across cloud and on-premises environments.

About the Opportunity:

• 
  

  Shift: Day

  
  


• 
  

  Schedule: Monday to Friday

  
  


• 
  

  Hours: Standard business

  
  


• 
  

  Setting: Hybrid (at least 2 days a week onsite)

  
  

Responsibilities:

• 
  

  Design, build, and maintain scalable data ingestion pipelines for security log sources across cloud and on-premises environments

  
  


• 
  

  Parse, normalize, transform, and enrich structured and unstructured telemetry using regex, JSON parsing, schema mapping, and data validation techniques

  
  


• 
  

  Partner with application, infrastructure, cloud, vendor, and security teams to onboard new log sources and confirm end-to-end data flow

  
  


• 
  

  Validate log integrity, completeness, timeliness, and quality to support monitoring, detection, response, and reporting use cases

  
  


• 
  

  Troubleshoot ingestion, parsing, transformation, and pipeline issues while improving reliability, scalability, and operational efficiency

  
  

Qualifications:

• 
  

  Minimum of 3 years of relevant experience in cybersecurity, data engineering, log management, security operations, or a related technology discipline

  
  


• 
  

  Hands-on experience onboarding, managing, and validating log sources in SIEM, cloud data platforms, or security analytics environments

  
  


• 
  

  Strong understanding of data parsing, normalization, transformation, and validation techniques, including regex, JSON, XML, CSV, and structured and unstructured data handling

  
  


• 
  

  Familiarity with common security telemetry sources, including network, endpoint, identity, application, cloud, and infrastructure logs

  
  


• 
  

  Experience with cloud platforms and associated logging, monitoring, and analytics services

  
  


• 
  

  Strong troubleshooting and problem-solving skills related to data pipelines, ingestion flows, schema issues, and data quality defects

  
  


• 
  

  Understanding of compliance and regulatory expectations related to logging, retention, auditability, and data integrity

  
  


• 
  

  Ability to plan, coordinate, and execute onboarding efforts across multiple internal teams, vendors, and stakeholders

  
  


• 
  

  Ability to balance operational support responsibilities with project-based delivery and continuous improvement efforts

  
  


• 
  

  Strong attention to detail, commitment to data quality, and ownership of outcomes

  
  


• 
  

  Ability to work effectively and collaboratively in a global team environment

  
  


• 
  

  Strong communication skills, sound judgment, and a high degree of accountability

  
  

Desired Skills:

• 
  

  Experience with scripting or automation tools such as Python, PowerShell, or similar technologies

  
  


• 
  

  Familiarity with query languages used to validate, investigate, and analyze ingested data

  
  


• 
  

  Experience in broader cybersecurity disciplines, including threat detection, incident response, vulnerability management, or cloud security