Hatchyard logo
Be the first to apply!

Associate Technical Lead- Data Engineering

Hatchyard    Colombo • Full-time

Job Description

Associate Technical Lead- Data Engineering

Key Requirements

  • A Bachelor's Degree in Computer Science or equivalent, and 4+ years of experience in developing enterprise grade data processing applications.
  • A strong programming background in data ops (Python, Shell, SQL).
  • Experience in working with streaming data (Kafka).
  • Strong hands-on experience with AWS data services including Redshift, RDS (PostgreSQL), DMS, Lambda, EC2 and S3.
  • Experience in processing large volumes of data.
  • Hands-on experience in working with relational/NoSQL databases and distributed storage engines (HDFS, S3, Redshift).
  • Hands-on experience in ETL design and development using ETL tools (Preferably Informatica and cloud tools such as AWS Data Pipelines, Glue, Lambda, EMR, Spark, Hive).
  • Experience in API development and user interfaces and related tools (NodeJS, AngularJS, HTML) will be an added advantage.
  • Working in a Scrum Agile delivery environment and DevOps practices.
  • Experience in code management and CICD tools such as Github, Gitlab, Jenkins.