LepakshiBasavayyahKumar ArvindReddy Narra
Ottawa,Ontario
Summary
Results-oriented Data Engineer with 4+ years of experience architecting and scaling enterprise-grade data platforms across Azure and hybrid cloud ecosystems. Proven expertise in building resilient ETL/ELT pipelines using Azure Data Factory, Databricks, and Apache Spark, with hands-on experience in both real-time (Kafka, PySpark) and batch processing. Adept at designing high-performance data lakes and dimensional warehouses using Azure SQL, Snowflake, and Redshift, while ensuring data integrity, lineage, and governance via Azure Key Vault, DBT, and RBAC policies.
Versatile in developing CI/CD automation using Terraform, Azure DevOps, and Docker to streamline pipeline deployment lifecycles. Known for blending deep technical knowledge with business acumen to deliver insights through advanced Power BI and Tableau dashboards. Recognized for translating complex domain rules into scalable data products across finance, compliance, and operational intelligence. Currently expanding cloud-native expertise in Microsoft Fabric with focus on unified Lakehouse architectures. Strong advocate for Agile delivery, cross-team collaboration, and mentoring junior developers in fast-paced environments.
Overview
4
4
years of professional experience
3
3
Certification
Work History
Software Engineer
Deloitte
Hyderabad, India
06.2022 - 11.2022
- Developed and deployed end-to-end ETL pipelines using Azure Data Factory, Python, and SQL, integrating data from on-prem and cloud sources into Azure-based reporting environments.
- Contributed to the design and deployment of cloud-based data warehouses to support domain-specific analytics for finance and healthcare use cases.
- Collaborated closely with cross-functional teams (data analysts, testers, architects) to translate business rules into production-grade data logic.
- Standardized CI/CD practices using Git and Azure Pipelines to accelerate delivery and reduce deployment downtime.
- Introduced serverless automation with Azure Functions to handle transformation logic and reduce manual overhead in cleansing tasks.
- Designed monitoring dashboards and integrated logging tools to enable early detection and resolution of pipeline issues.
- Built reusable ETL components using parameterized datasets and dynamic linked services in ADF.
- Participated in agile ceremonies using JIRA and Confluence to ensure delivery alignment with sprint objectives.
Associate Software Engineer
Deloitte
Hyderabad, India
06.2020 - 05.2022
- Worked on ingestion workflows using Apache Spark, ADF, and Databricks to support timely availability of structured and semi-structured data.
- Developed DAGs using Apache Airflow to manage job dependencies and orchestrate workflows across cloud and on-prem environments.
- Built and maintained dimensional data marts using Azure SQL and Power BI, supporting cross-functional reporting needs.
- Implemented test-driven validation of data pipelines using PyTest and automated test cases within CI workflows.
- Conducted code reviews and root cause analysis of failed Spark jobs to improve stability of Databricks notebooks.
- Tuned SQL queries and optimized index strategies in Azure SQL to improve dashboard refresh performance.
- Created custom transformation logic using Python and DBT to support evolving schema requirements.
- Authored ETL architecture documentation, deployment runbooks, and process lineage diagrams for audit and compliance.
- Participated in security assessments and applied Azure Key Vault to encrypt and manage sensitive secrets.
- Collaborated with SMEs to define SLA metrics and data quality thresholds in Power BI reports.
- Migrated legacy SSIS workflows to modern cloud-based ADF pipelines.
- Established Git branching models and implemented Azure Repos integration for team collaboration.
Solution Delivery Analyst
Deloitte
Hyderabad, India
06.2019 - 05.2020
- Assisted in building ETL pipelines using SSIS and SQL Server for regulatory compliance reporting in banking projects.
- Developed dashboards using Power BI and SQL queries to provide real-time visibility into operational KPIs.
- Supported migration projects from on-prem SQL Server to Azure SQL Database, contributing to modernization efforts.
- Wrote unit tests and performed data validation using SQL to ensure data quality throughout pipeline stages.
- Contributed to internal documentation of data sources, business logic, and report generation flows.
- Automated data ingestion workflows using Python scripts for CSV, Excel, and XML files.
- Acted as L1 support for nightly ETL failures and collaborated with DevOps to improve monitoring via log alerts.
- Maintained role-based access configurations and audit logs for internal data access systems.
- Assisted in schema design discussions and contributed suggestions for transformation logic in compliance projects.
Education
Master of Science - Software Engineering
Carleton University
Ottawa, ON06-2024
Skills
- Languages: Python (Pandas, NumPy, PySpark), SQL (T-SQL, PostgreSQL), Bash, Scala
- Cloud platforms: Microsoft Azure (Data Factory, Databricks, Data Lake Storage Gen2, Synapse Analytics, Azure SQL Database), Microsoft Fabric, AWS (S3, Redshift, Glue, Lambda, IAM)
- ETL & Orchestration Tools: Azure Data Factory, Apache Spark, Apache Airflow, Databricks, DBT, SSIS
- Data Warehousing & Modeling: Azure SQL, Snowflake, Redshift; Star Schema, Snowflake Schema; Dimensional Modeling, OLAP/OLTP Design
- Monitoring, Deployment & DevOps: Azure Monitor, Azure Key Vault, Git, Azure DevOps, Terraform, Docker, CI/CD Pipelines, Logging & Alerting Systems
- Reporting & BI Tools: Power BI, Tableau, SSRS, Excel Analytics
- Soft Skills: Communication, Analytical Thinking, Problem Solving, Team Collaboration, Initiative, Time Management, Attention to Detail, Stakeholder Engagement, Adaptability, Agile Methodology, Technical Documentation
Certification
- Microsoft Certified: Fabric Data Engineer Associate (DP700)
- Microsoft Certified: Azure Data Fundamentals (DP900)
Training
Pluralsight:
- Apache Spark 3
- Querying Data with Snowflake
- Databricks Administration and Integrations
- Exploratory Data Analysis in Python
- Managing Infrastructure with Terraform
Databricks Course Certifications:
- Deploy workflow with Lakeflow Jobs
- Data Ingestion with Lakeflow Connect
- Build Datapipelines with DLT
- Data Management and Governance with Unity Catalog
Deloitte (Internal):
- Unstructured Data Digitization
- Talking Tech: Data & Analytics, AI/ML, RPA
- Cloud Fundamentals, AML 101 & 102
- Agile Scrum Essentials
Projects
AML Transaction Monitoring Platform:
· Built end-to-end pipeline using Azure Data Factory, Spark, and SQL Server to ingest transactional datasets into Data Lake Gen2.
· Automated fraud detection logic using Pandas and NumPy to flag anomalous transactions and enhance fraud detection accuracy.
· Orchestrated workflows with Apache Airflow and Kafka for batch and stream scheduling.
· Developed Power BI dashboards to visualize suspicious activity and share compliance insights.
EDA on Netflix Content & User Behavior:
· Ingested content metadata and user behavior data using Azure Data Factory and stored it in ADLS Gen2 and referenced it via a shortcut in Microsoft Fabric Lakehouse.
· Performed exploratory data analysis and statistical modeling of user engagement trends using Apache Spark Notebooks in Microsoft Fabric.
· Created interactive dashboards in Tableau to present trends and time-based visualizations.
Languages
English
Native/ Bilingual
Telugu
Native/ Bilingual
Hindi
Native/ Bilingual
References
References available upon request.
Timeline
Software Engineer
Deloitte
06.2022 - 11.2022
Associate Software Engineer
Deloitte
06.2020 - 05.2022
Solution Delivery Analyst
Deloitte
06.2019 - 05.2020
Master of Science - Software Engineering
Carleton University
Similar Profiles
SRI HARSHA PAMULAPATISRI HARSHA PAMULAPATI
Senior Consultant at DeloitteSenior Consultant at Deloitte
Sandalee ShrivastavaSandalee Shrivastava
Level 2 Analyst at DeloitteLevel 2 Analyst at Deloitte
Ganji Sai Venkata BhimeshGanji Sai Venkata Bhimesh
Senior Software Engineer at DeloitteSenior Software Engineer at Deloitte
Vikram LNUVikram LNU
Solution Delivery Analyst at DeloitteSolution Delivery Analyst at Deloitte
NIRANJAN VASUDEVAN PRADEEPNIRANJAN VASUDEVAN PRADEEP
LINE COOK at LEVY RESTAURANTLINE COOK at LEVY RESTAURANT