AWS Data Engineer (Only on W2)

Desired Experience 

• 6–10 years of experience in Data Engineering.  

• Bachelor’s degree in computer science, computer engineering, or a related technical field. 

• Experience building cloud-native data platforms on AWS.  2+ years of experience with AWS cloud or other cloud Big Data computing design, provisioning, and tuning. 

• Related AWS certification, preferred. 

• Experience handling large-scale structured and semi-structured datasets.  

• Strong understanding of distributed data processing and performance optimization.  

• Experience working in enterprise production environments with high availability requirements. 

• Expertise in database concepts, object and data modeling techniques and design principles. 

• Expertise in database architectures, software, and facilities 

• Expertise with programming languages - Python (required), Scala, Ruby, R Database technologies - SQL, performance tuning concepts, AWS RDS, RedShift, MySQL 

• Expertise with big data batch processing tools: Hadoop MapReduce, ElasticSearch, PIG, Hive, Cascading/Scalding, Apache Spark, AWS EMR 

• Expertise with stream-processing systems: Kinesis, Kafka, MQTT 

• Expertise with relational NoSQL databases including DyanamoDB 

• Expertise in writing JSON, XML, YAML and other data definition schemas 

• Excellent verbal and written communication skills necessary to effectively collaborate in a team environment and present and explain technical information and provide advice to management. 

• Ability to work on advanced complex technical projects or business issues requiring state of the art technical knowledge or industry. 

• Ability to work on significant and unique issues where analysis of situations or data requires an evaluation of intangibles. Exercises independent judgment in methods, techniques and evaluation criteria for obtaining results.