itpro.lk

• IT and General
• Software Development
• Quality Assurance
• Mobile Development
• Design and Creative
• Management and Business
• AI and Data
• Digital Marketing
• Web Development
• Hardware and Networking
• Academic
• Internship

• Companies
• About Us
• Subscribe
• Contact

applicants

We are Hiring a DATA ENGINEER (AZURE DATA FACTORY/SNOWFLAKE)

A Data Engineer is a data professional who leverages their expertise in data engineering and programming to build systems that collect, manage, and transform raw data into actionable insights for business analysts. We are looking for an experienced Data Engineer to join our team. In this role, you will utilize various methods to convert raw data into effective data systems, including creating algorithms and conducting statistical analyses. Your efforts will focus on optimizing data systems to align with business goals.

To succeed in this position, you should possess strong analytical skills and the ability to integrate data from diverse sources. Familiarity with multiple programming languages and knowledge of machine learning techniques are also essential.

POSITION RESPONSIBILITIES

• Develop and parameterize Azure Data Factory (ADF) pipelines to enable dynamic and reusable workflows for data extraction, transformation, and loading (ETL).
• Design and implement data loading processes into Snowflake based on ADF pipeline parameters, ensuring efficiency and accuracy.
• Create and optimize stored procedures in Snowflake to handle complex transformations and implement business logic.
• Optimize the performance of ADF pipelines and Snowflake queries, ensuring scalability and minimal latency.
• Design and maintain Snowflake data models and perform advanced transformations to support analytics and reporting needs.
• Monitor ADF pipeline executions and Snowflake workflows, troubleshoot issues, and ensure seamless data flow.
• Work closely with data architects, analysts, and stakeholders to gather requirements and deliver scalable data solutions.
• Implement data security, governance best practices, and maintain detailed documentation for pipelines and Snowflake processes.

POSITION QUALIFICATIONS

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• A Master’s degree is highly desirable and considered a strong advantage.
• Minimum of 2 years of proven experience in a Data Engineering role, with a preference for expertise in Azure Data Factory (ADF) and Snowflake.
• Strong understanding of cloud data warehousing concepts and architecture, especially Snowflake.
• Proficient in SQL, with hands-on experience in database design and data modeling.
• Familiarity with data mining, data models, and segmentation techniques.
• Programming skills in Python, Java, or Scala are a valuable asset.
• Data Engineering certifications such as IBM Certified Data Engineer or Snowflake SnowPro Core are highly regarded.
• Experience with ETL tools and cloud platforms (e.g., AWS, Azure, GCP).
• Knowledge of data visualization tools, including Tableau or Power BI.
• Strong analytical and numerical abilities to solve complex data problems.
• Familiarity with machine learning concepts and workflows is a significant plus.