06 Oct 2023 - 07 Jul 2024 9 Months
system limted . Contract
Description: Designed data orchestration pipelines with Azure Data Factory and utilized Azure Data Lake for storage. Engineered Databricks Lakehouse solutions, including: ETL processing with Databricks (Python, Spark, SQL, Scala) Orchestration via Databricks Workflows Real-time streaming using Structured Streaming & Delta Live Tables Change Data Capture & incremental processing with Auto Loaders BI dashboards via Databricks SQL Endpoints Data governance with Databricks Unity Catalog Optimized big data analytics & warehousing using Azure Synapse (Star Schema, Round Robin, Dedicated SQL Pool) Implemented CI/CD pipelines with Azure DevOps Managed security & access using Azure AD & Key Vault Experienced in Git for version control.
Informatics & Information Sciences
University of Gujrat, Gujrat