Lead Software Engineer

 Lead Software Engineer
New York, New York, United States

Job Description :

Hands On programming experience and build scalable pipelines using Java, Python, Spark, PySpark.

Design and optimize enterprise data warehouses within AWS and Snowflake.

Good hands-on design and programming skills building reusable tools and products

Expertise in Data Governance and Data Security Implementation.

Deploy, manage, and monitor cloud-native data architectures on AWS.

Write clean, maintainable backend code for high-throughput data processing.

Optimize slow-running Spark jobs and complex SQL queries for performance.

Create robust data models, schemas, and automated orchestration workflows.

Implement strict data quality checks, governance, and security controls.

Translate business needs into efficient and cost-effective data solutions.

Experience developing in AWS or similar cloud platforms.

Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).

Experience and build scalable pipelines using Java, Python, Spark, PySpark. Experience in programming in AWS and Python.

Should have expertise in performing data analysis (NOT DATA SCIENCE) on AWS platforms Experience in Big Data technologies (Spark, Redshift, Kafka, etc.)