Summary
Overview
Work History
Education
Skills
LANGUAGES
Timeline
Generic

SACHIN KHURANA

Fremont,CA

Summary


Data engineering professional with deep expertise in data architecture, pipeline development, and big data technologies. Proven track record in optimizing data workflows, enhancing system efficiency, and driving business intelligence initiatives. Strong collaborator, adaptable to evolving project demands, with focus on delivering impactful results through teamwork and innovation. Skilled in SQL, Python, Spark, and cloud platforms, with strategic approach to data management and problem-solving.

Overview

11
11
years of professional experience

Work History

Senior Manager Data Engineering

Databricks
10.2021 - Current
  • Led development of data pipelines with Python, Spark, and Airflow for scalable analytics.
  • Provided strong leadership to enhance team productivity and morale.
  • Established strong relationships with clients and stakeholders, ensuring long-term partnerships and repeat business.
  • Improved team performance by providing comprehensive training and fostering a collaborative work environment.
  • Collaborated closely with peers from other departments to drive organizational success jointly as one cohesive unit.
  • Mentored junior staff members for skill development and career progression within the organization.
  • Collaborated with cross-functional teams to optimize data architecture for performance and efficiency.

Senior Manager Data Engineering

01.2019 - 10.2021
  • Led cross-functional team to integrate data sources, optimizing performance and scalability.
  • Implemented data governance policies to ensure data accuracy and compliance.
  • Developed data architecture strategy for seamless data flow across systems.
  • Managed team of data engineers to deliver high-quality data solutions on time.

Staff Data Engineer

Walmart Labs
03.2014 - 01.2019
  • Roles and responsibilities: Gather Business requirements and Analyze the data & reporting needs.
  • Developed Logical and Physical data models for new Business requirements.
  • Managed end to end lifecycle including ingestion processing aggregation, storage visualization for returns data sets using Kafka streaming's and ThoughtSpot reporting.
  • JSON returns data processing into Teradata EDW using HDFS, Hive and Spark.
  • Developed and maintained automated data pipelines to assemble, cleanse and transform large Complex datasets and load results in data warehouse and Hadoop Data lake.
  • Worked closely with stakeholders, data infrastructure teams to build dashboards and support effective data driven decision making.
  • Build visualizations in Tableau and thought pot and developed queries for Adhoc reporting.
  • Responsible for tunings SQL and Hadoop pipelines.
  • Provide guidance to development team in ETL development/support activities.
  • Also migrated the Teradata compute to Hadoop/Hive.
  • Utilized machine learning techniques to enhance data processing and drive data-driven decision-making.
  • Collaborated with cross-functional teams to optimize data architecture for performance and efficiency.
  • Designed and maintained data models in PostgreSQL and Redshift to support business reporting.
  • Led development of data pipelines with Python, Spark, and Airflow for scalable analytics.

Senior Data Engineer

Cisco
  • Responsible for gathering business requirements by interacting with business users and perform detailed requirement analysis.
  • Responsible for providing functional & technical design documents.
  • Design the data architecture for reporting requirements and socialize with development and reporting teams.
  • Designed the architecture for data replication into Teradata replication using Golden Gate.
  • Work with Logical and Physical data modelers for data modeling and responsible for providing the ETL architecture of the Project.
  • Performance Tuning, monitoring and Teradata queries.
  • Involved in designing Order & case metrics.
  • Developed Informatica workflows using various transformations and Pushdown Optimization.
  • Performed Technical Project manager role, provided leadership and guidance to the team in High level & Low-Design, end to end development activities and during QA Support, UAT Support.
  • Developed scripts to load data into Teradata using FastLoad, BTEQ, Fast Export, MultiLoad.

ETL Engineer

Best Buy
  • Involved in the Functional & Technical Design of this release.
  • Programming the business logic as per the business requirements.
  • Database administration activities.

Education

Bachelor of Technology -

Kurukshetra University

Skills

  • Databricks
  • Big Data/Kafka
  • Teradata/Oracle
  • SQL Performance Tuning
  • Python
  • Tableau/Thoughtspot
  • SQL Tuning Expert
  • ETL processes
  • SQL querying
  • ETL Architecture
  • Data modeling
  • ETL development
  • Big data processing

LANGUAGES

Hindi | Advanced

Timeline

Senior Manager Data Engineering

Databricks
10.2021 - Current

Senior Manager Data Engineering

01.2019 - 10.2021

Staff Data Engineer

Walmart Labs
03.2014 - 01.2019

Senior Data Engineer

Cisco

ETL Engineer

Best Buy

Bachelor of Technology -

Kurukshetra University

Similar Profiles

CREATE PROFILE
SACHIN KHURANA