ABHISHEK SRIVASTAVA
Bedford,Nova Scotia
Summary
Senior Data Engineer with over 11 years of experience specializing in Azure, Databricks, and Fabric. Skilled in developing end-to-end data solutions in cloud and hybrid environments. Proficient in creating scalable data architectures using Azure Data Factory, Databricks, Synapse, and Power BI. Demonstrated expertise in cloud migrations, Medallion architecture design, and high-performance pipeline development utilizing Spark and distributed systems. Experienced in batch and streaming data integration with a strong emphasis on automation, cost optimization, and operational efficiency to enable AI and advanced analytics on modern enterprise-grade data platforms.
Overview
11
11
years of professional experience
1
1
Certification
Work History
Data Engineer
Greenfield Global
05.2022 - Current
- Designed and developed end-to-end data pipelines using Azure Data Factory (ADF) to ingest and orchestrate data from on-premises servers, flat files, REST APIs, and Dynamics 365 F&O (via Synapse Link).
- Built scalable, distributed data processing workflows with Azure Databricks and Apache Spark, leveraging Medallion Architecture (Bronze, Silver, Gold) for modular, high-performance lakehouse design.
- Implemented Azure Synapse Analytics for enterprise-grade reporting and fast querying across structured and semi-structured data sources.
- Delivered self-service analytics through Power BI, designing dynamic dashboards and KPIs to support leadership and operational decision-making.
- Spearheading the integration of LLM and Retrieval-Augmented Generation (RAG) frameworks into enterprise data workflows, enabling natural language querying over curated datasets.
- Prototyping GenAI-powered agents to translate business questions into SQL using Databricks Genie and Azure OpenAI models, improving analytics accessibility for non-technical users.
- Leading the development of a structured knowledge base containing table schemas and business logic to enhance the accuracy of AI-generated queries.
- Driving performance tuning and cost optimization initiatives, including auto-scaling, partitioning, and cache strategies for Spark and SQL-based workloads.
- Collaborating with analytics, BI, and engineering teams to modernize legacy pipelines and deliver scalable, AI-ready data infrastructure.
Senior Associate - Projects
Cognizant Technology Solutions
12.2021 - 05.2022
- Engineered data integration pipelines using Azure Data Factory to automate the flow of data between on-premise sources and cloud-based systems with minimal latency.
- Developed robust data processing frameworks within Azure Databricks and Azure Data Lake to handle large datasets, ensuring scalability and data reliability.
- Streamlined data onboarding processes by designing automated data ingestion routines through Azure Logic Apps and ADF, minimizing manual intervention and increasing throughput.
- Delivered intuitive and dynamic Power BI reports that translated raw data into actionable insights for business stakeholders.
- Employed Azure Data Lake for efficient storage management and fine-tuned complex SQL stored procedures to enhance processing performance and reduce resource consumption.
Senior Associate - Projects
Cognizant Technology Solutions
05.2021 - 10.2021
- Delivered robust data pipelines using Azure Data Factory (ADF) to enable automated, reliable data movement between on-premises systems and cloud storage.
- Built scalable data transformation workflows in Azure Databricks and Azure Data Lake, improving processing speed and supporting high-volume datasets.
- Automated end-to-end data ingestion and integration using ADF and Azure Logic Apps, reducing manual tasks and enhancing pipeline efficiency.
- Utilized SSIS for ETL processes involving legacy systems, ensuring consistency and smooth migration to the Azure ecosystem.
- Created interactive dashboards and visual reports using Power BI to support business decision-making and performance monitoring.
- Optimized SQL stored procedures for complex data transformations, improving query performance and reducing compute costs.
- Leveraged Azure Data Lake for cost-effective storage and structured organization of raw and curated data layers.
Lead Engineer - Database Administration
FIS Solutions
04.2017 - 05.2021
- Designed and fine-tuned SSIS data flows to support robust and scalable ETL operations across multiple environments.
- Developed and maintained SQL Server maintenance plans to ensure consistent performance, uptime, and data integrity.
- Implemented strategic backup and recovery policies aligned with RTO/RPO targets to safeguard business-critical data.
- Configured and managed Always On High Availability Groups to deliver seamless failover and maximize system availability.
- Automated key database administration tasks using PowerShell, improving operational efficiency and reducing manual overhead.
- Analyzed and optimized complex, long-running queries to improve response times and reduce overall server load.
Senior Systems Engineer
Infosys Ltd
06.2014 - 04.2017
- Developed and optimized SSIS packages and SQL Server stored procedures for efficient data processing.
- Enhanced performance of large fact tables by designing and implementing partitioned tables.
- Streamlined complex data workflows through performance tuning of SSIS packages and stored procedures.
Education
Bachelor of Technology - Computer Science
Kalinga University
Odisha, India06-2014
Skills
- Azure Data Factory
- Azure Databricks
- Apache Spark
- Microsoft Power BI
- Azure Synapse
- Python programming
- Azure Logic Apps
- Transact-SQL
- Azure Data Lake
- SQL Server Integration Services
- Microsoft SQL Server
- Windows PowerShell
Certification
- Databricks Certified Data Engineer Professional
- Databricks Certified Data Engineer Associate
- Microsoft Certified: Azure Data Engineer Associate
- Microsoft Certified: Azure Fundamentals
- Academy Accreditation - Databricks Lakehouse Fundamentals
Languages
English
Hindi
Social Links - Linkedin
https://www.linkedin.com/in/abhishek-srivastava-5343a679/
Details
Bedford, Nova Scotia, 9029895654, abhishek_srivastava13@outlook.com
Timeline
Data Engineer
Greenfield Global
05.2022 - Current
Senior Associate - Projects
Cognizant Technology Solutions
12.2021 - 05.2022
Senior Associate - Projects
Cognizant Technology Solutions
05.2021 - 10.2021
Lead Engineer - Database Administration
FIS Solutions
04.2017 - 05.2021
Senior Systems Engineer
Infosys Ltd
06.2014 - 04.2017
Bachelor of Technology - Computer Science
Kalinga University
Similar Profiles
Barnabas EgbuonuBarnabas Egbuonu
Production Operator at Greenfield GlobalProduction Operator at Greenfield Global
Andrew WrightAndrew Wright
Export Logistics Assistant at GREENFIELD GLOBALExport Logistics Assistant at GREENFIELD GLOBAL
Krista SnookKrista Snook
Customer Success Representative at Greenfield GlobalCustomer Success Representative at Greenfield Global
Eric OgdenEric Ogden
Maintenance and Pick Up/Delivery Driver, Shipping at Nova Automotive Machine CompanyMaintenance and Pick Up/Delivery Driver, Shipping at Nova Automotive Machine Company
Sneha PremSneha Prem
Mobility Controller & Intelligent Applications Dev at Fujitsu Network CommunicationsMobility Controller & Intelligent Applications Dev at Fujitsu Network Communications