Senior Data Software Engineer with AWS, LLM, PySpark

We are seeking a highly motivated Senior Data Software Engineer to design, build, and maintain modern cloud-based data platforms while enabling the next generation of AI and Copilot solutions. The ideal candidate will have strong expertise in AWS data ecosystems, PySpark, and experience developing AI-powered solutions using large language models and Generative AI applications.

Responsibilities Design and implement scalable ETL/ELT pipelines Build and optimize data ingestion frameworks from APIs, databases, SaaS applications, and streaming sources Develop data models to support analytics, reporting, AI, and machine learning workloads Implement data quality monitoring, lineage, and governance controls Support enterprise lakehouse and data warehouse initiatives Build serverless and event-driven data processing solutions using AWS Glue, S3, Athena, Redshift, Lambda, EventBridge, and IAM Optimize cloud infrastructure costs and performance Integrate Generative AI and LLM-based capabilities into enterprise data workflows Support Agentic AI and workflow orchestration initiatives Implement CI/CD pipelines and automate deployments using Azure DevOps and GitHub Actions Support Infrastructure as Code using Terraform or Bicep Monitor solution health and performance Requirements 3+ years of working experience with AWS data technologies 1+ year of working experience with Generative AI, LLMs, or Copilot Studio Experience in Agile product delivery teams Proficiency in Python, SQL, PySpark, and Spark SQL Expertise in AWS Glue, S3, Athena, Redshift, Lambda, and IAM Familiarity with Bedrock Knowledge of prompt engineering, RAG (Retrieval-Augmented Generation), and LLM integration Background in working with SQL Server and PostgreSQL English proficiency at B2 level or higher Nice to have Familiarity with Azure Data Factory, Azure Synapse, and Azure Databricks Knowledge of Azure SQL, Azure Data Lake Gen2, and Microsoft Fabric Familiarity with Azure OpenAI and Azure Functions Skills in Snowflake and Cosmos DB Background in Healthcare, Life Sciences, MedTech, or Pharmaceutical industries Experience integrating enterprise applications such as SAP, Salesforce, or ServiceNow Exposure to Microsoft Fabric and Azure AI Foundry