
1
applicant
applicant
Senior Engineer – Databricks
Softvil Technologies
Colombo •
Full-time
Job Description
Are you an experienced Data Engineer with strong hands-on expertise in Azure Databricks?
We’re looking for a Senior Engineer – Databricks to join our team and build scalable, secure, and high-performing enterprise data platforms.
What You'll Work With
- Azure Databricks
- Apache Spark & PySpark
- Python & SQL
- Delta Lake & Lakehouse Architecture
- Batch & Streaming Data Pipelines
- Unity Catalog & Data Governance
- Azure Data Factory & ADLS
- Azure DevOps & CI/CD
What We're Looking For
- 5+ years of experience in Data Engineering or related fields
- 2+ years of hands-on experience with Databricks in production environments
- Strong knowledge of Spark, PySpark, Python, and SQL
- Experience building and optimizing ETL/ELT pipelines
- Knowledge of data modelling, data warehousing, and Medallion Architecture
- Experience with batch and streaming workloads
- Strong understanding of performance tuning and cost optimisation
- Experience with Unity Catalog, security, and data governance
- Experience with Git, Azure DevOps, and CI/CD pipelines
- Experience with MLflow, MLOps, Generative AI, Microsoft Fabric, Databricks Asset Bundles, or Infrastructure as Code will be an added advantage.
Databricks certifications are highly desirable.
If you're passionate about building modern data platforms and working with cutting-edge cloud technologies, we'd love to hear from you!