Summary
Overview
Work History
Education
Skills
Websites
Certification
Languages
Timeline
Generic

CHARAN UPPALA

Kitchener,ON

Summary

Sr. Data Engineer with 12+ years of experience in full lifecycle development, including requirement gathering, data pipeline design, ingestion frameworks, building data marts, and KPI implementation. Proven track record across domains like insurance, automobile, stocks, media, and e-commerce. Over 8 years of experience in leading and supporting agile teams with Big Data technologies, including Spark and Hadoop (on-premise and cloud). Skilled in AWS (EMR, EC2, S3, Redshift) and GCP (BigQuery, Dataproc, Composer/Airflow, GCS, Cloud Functions). Expertise in NoSQL databases (MongoDB) and DWH applications. Developed CSV Ingestion Framework using PySpark. Experienced with MS Azure: ADLS, ADF, BLOB, DATABRICKS, Delta Lake, CI/CD using Azure DevOps. Strong focus on performance tuning for long-running queries. Hands-on experience in Informatica, batch & real-time ETL processes.

Overview

13
13
years of professional experience
1
1
Certification

Work History

Senior Data Engineer

Loblaw companies
04.2024 - Current
  • Developed automated file ingestion pipeline in GCP that listens to GCS events, processes raw files from landing zone, optionally decrypts them, validates schema, loads data into BigQuery, and logs metadata, errors, and flow control into Datastore and Firestore.

Senior Data Engineer

Walmart Luminate
09.2022 - 04.2024
  • Walmart Luminate serves as data analytics platform providing suppliers and merchants insights into customer behavior and trends within Walmart's ecosystem.

Specialist

Definity
07.2022 - 09.2022
  • Created ingestion framework incorporating Databricks alongside Airflow.

Senior Data Engineer

Walmart Global Tech
04.2021 - 07.2022
  • A Batch process ETL which generates data in the cateogry level. It helps Walmart to negotiate with suppliers,by keeping competitors in
    mind so that both the parties make profits.

Senior Technical Lead

Mercedes Benz R&D
03.2019 - 04.2021
  • Implemented Enterprise Data Lake and Integrated Analytics platform in Azure to support various analytics applications.
    Transformed Matlab system into Azure/Spark Data as a Service using cloud capabilities.
    Leveraged Azure Databricks and Spark for efficient ETL processing, optimizing data workflows.

Consultant

Deloitte Consulting
07.2017 - 01.2019
  • The Dow Jones Industrial Average (DJIA) is second-oldest U.S. market index that shows how 30 large publicly owned companies based in the United States have traded during a standard trading session in the stock market. The project aimed to enable new and existing revenue streams, reduce operational cost, promote more informed decision-making and improve customer experience through targeted communications.

Senior Member Technical

Broadridge Financial Solutions
01.2016 - 07.2017
  • BR Composer enables customers to communicate regulatory and business letters to their clients either via self-service or service provider model. This solution is a composition workflow solution built upon the Informatica & Elixir Tango Plus software platform.

Senior Systems Engineer

Infosys
01.2015 - 01.2016
  • Dataplex is a project for BOA which provides data for the reporting purpose that enables consistent and stable 24x7 accesses to data across all channels.

Programmer Analyst

Cognizant
10.2012 - 01.2015
  • The information factory is an existing cigna assed used to integrate business data from different sources of truth and consistent information from a common platform.

Education

Master of Technology (M.Tech.) - Information Technology

Vellore Institute of Technology (VIT)
Vellore, India
01.2012

Bachelor of Technology (B.Tech.) - Information Technology

Hasvita Institute of Technology
Hyderabad, India
01.2010

Skills

  • Team leader
  • Multi-cloud exposure
  • Problem solving
  • Process optimization
  • Collaboration skills
  • Data warehousing

Certification

Databricks Certified Associate Developer for Apache Spark 3.0

Languages

  • English
  • Telugu
  • Hindi

Timeline

Senior Data Engineer

Loblaw companies
04.2024 - Current

Senior Data Engineer

Walmart Luminate
09.2022 - 04.2024

Specialist

Definity
07.2022 - 09.2022

Senior Data Engineer

Walmart Global Tech
04.2021 - 07.2022

Senior Technical Lead

Mercedes Benz R&D
03.2019 - 04.2021

Consultant

Deloitte Consulting
07.2017 - 01.2019

Senior Member Technical

Broadridge Financial Solutions
01.2016 - 07.2017

Senior Systems Engineer

Infosys
01.2015 - 01.2016

Programmer Analyst

Cognizant
10.2012 - 01.2015

Master of Technology (M.Tech.) - Information Technology

Vellore Institute of Technology (VIT)

Bachelor of Technology (B.Tech.) - Information Technology

Hasvita Institute of Technology

Similar Profiles

CREATE PROFILE
CHARAN UPPALA