Devika Eaga

Milton,ON

Summary

Data Engineer with 5+ years of experience designing, building, and supporting scalable ETL/ELT pipelines on Azure. Strong hands-on expertise in Azure Data Factory, Azure Databricks, and Microsoft Fabric, with solid programming skills in SQL, Python, and PySpark. Experienced in data integration, schema design, data quality validation, and governance to deliver reliable, analytics-ready datasets, including preparing curated data for Power BI reporting. Proven ability to optimize performance, support production systems, and collaborate effectively with data scientists, analysts, and business teams.

Overview

years of professional experience

Work History

Senior Data Engineer

Lucid Data Hub

Milton, Ontario

05.2023 - Current

Designed and developed ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and Microsoft Fabric for batch and incremental processing.
Implemented data transformations and business logic using SQL, PySpark, and Python to produce analytics-ready datasets.
Designed and managed data lakes and lakehouse architectures, including schema design, and Delta Lake tables for large-scale data storage.
Integrated structured and semi-structured data from multiple source systems into unified data platforms.
Applied data quality checks, validation rules, and governance standards to ensure data accuracy, consistency, and security.
Optimized Spark jobs, SQL queries, and pipeline execution to improve performance and system efficiency.
Prepared curated datasets and semantic-ready tables to support Power BI reporting and analytics.
Collaborated with data scientists, analysts, and business stakeholders to translate data requirements into scalable solutions.
Provided production support, troubleshooting pipeline failures, resolving data issues, and ensuring SLA compliance.

Associate Projects – SQL Developer

Cognizant Technology Solutions

Coimbatore, India

12.2018 - 11.2021

Designed, developed, and optimized complex SQL queries, stored procedures, views, and functions to support application features, enterprise reporting, and data analytics.
Assisted in writing and reviewing SQL queries used for data retrieval, validation, and reporting tasks.
Analyzed business and data requirements, and translated them into scalable SQL-based data solutions.
Performed data validation, data quality checks, and reconciliation to ensure accuracy and consistency across reporting datasets.
Tuned SQL queries and database objects to improve performance and reduce execution time in production environments.
Supported ETL processes by preparing source data, validating transformations, and assisting with post-deployment data checks.
Collaborated with cross-functional teams, including business analysts, QA, and application teams, demonstrating a working knowledge of project tracking tools such as JIRA.
Participated in Agile Scrum ceremonies, sprint planning, and release activities.
Contributed to technical documentation outlining database processes, workflow logic, and client-specific data handling procedures, along with maintaining SQL standards.
Gained exposure to Azure and DevOps practices to support deployment workflows and cloud integration initiatives.

Education

Bachelor of Science - Electronics And Communication Engineering

Jawaharlal Nehru Technological University

Hyderabad, India

09-2017

Skills

Programming and querying: Python, SQL, PySpark, SparkSQL
Data engineering and integration: Azure Data Factory, Azure Databricks, Microsoft Fabric (Lakehouse, Pipelines), ETL/ELT pipelines
Databases and storage: Microsoft SQL Server, PostgreSQL, Azure Cosmos DB, Azure Data Lake Storage, Azure Blob Storage
Analytics and reporting: Power BI, Microsoft Excel
Data architecture and governance: Data lakes, lakehouse architecture, medallion architecture (Bronze/Silver/Gold), schema design, data dictionaries, data quality and governance
Performance and operations: Pipeline monitoring, performance optimization, production support, SLA management
DevOps and version control: Git, Bitbucket, CI/CD pipelines

Timeline