Data Engineer

Job Description

Join our dynamic team and help us deliver high-quality data solutions that make an impact.

Job Role

• The design and development of data solutions for one of the world's largest corporations involved in the marketing and distribution of food products.
• Implement distributed and highly available data processing applications that scale for enterprise demands.
• Adhere to Continuous Integration and Continuous Delivery of solutions.
• Ensure high code quality by following software engineering best practices.
• Work collaboratively in a cross functional team in an Agile delivery environment.
• Adhere to DevOps principles and be involved in projects throughout their full software lifecycle: from development, QA, and deployment, to post-production support.

Qualifications

• A Bachelor's Degree in Computer Science or equivalent, and 1-2 years of experience in developing enterprise grade data processing applications.
• A strong programming background in data ops (Python, Shell, SQL).
• Experience in processing large volume of data.
• Hands on experience in working with relational/NoSQL databases and distributed storage engines (HDFS, S3, Redshift) 
• Hands on experience in ETL design and development using ETL tools (Preferably Informatica and cloud tools such as AWS Data Pipelines, Glue, Lambda, EMR, Spark, Hive).
• Experience in working with streaming data (using tools such as Kenisis, Kafka, Storm, Spark) will be an added advantage
• Experience in API development and user interfaces and related tools (NodeJS, AngularJS, HTML) will be an added advantage
• Working in a Scrum Agile delivery environment and DevOps practices.
• Experience in code management and CICD tools such as Github, Gitlab, Jenkins.
• Experience in an agile environment and aligning Pod members on technical vision and path to implementation.
• A strong desire to continue to grow your skillset. 
• Strong communication skills that is influential and convincing.