Summary
Overview
Work History
Education
Skills
Timeline
Generic

NITIN CHOUDHRY

Vancouver,BC

Summary

Results-driven Big Data Engineer with expertise in distributed processing, Python, and Scala. Proven success in designing and implementing large-scale data solutions using Apache Spark and Apache Kafka. Adept at optimizing data processing workflows and improving overall system efficiency.

Overview

10
10
years of professional experience

Work History

Data Engineering Consultant

Independent Consultant
06.2022 - Current
  • Architected robust big data solutions for clients, handling over 1 billion daily clickstream events.
  • Implemented scalable data processing pipelines, contributing to 30% improvement in data processing efficiency.
  • Provided consultation on big data architecture, resulting in 20% reduction in infrastructure costs.

Senior Big Data Engineer

Expedia
12.2020 - 06.2022
  • Led the design and implementation of large-scale, real-time data-driven products using Apache Spark and Scala.
  • Optimized ETL processes with a generic Scala SDK, reducing processing time by 25%.
  • Engineered a comprehensive data pipeline, measuring the impact of Expedia users on lodging properties.

Senior Data Engineer

HT Media Limited
12.2018 - 12.2020
  • Built and managed a large-scale big data platform processing 3 billion daily events and handling 100 TBs of data.
  • Led the development of the world's first fully personalized news publication platform, delivering responses in less than 50 ms.
  • Launched a propensity-based subscription program, increasing user engagement by 20%.

Senior Software Developer

Dunnhumby India
03.2017 - 12.2018
  • Developed Spark Streaming-based SDKs for ingesting clickstream data from various retail markets.
  • Implemented real-time data processing for customer basket generation, contributing to a 15% improvement in personalized recommendations.
  • Managed and improved the overall data quality across products.

Co-Founder and Data Platform Consultant

ICTHRU Analytics
05.2016 - 03.2017
  • Developed an event-driven Python library for efficient microservices development, reducing development time by 80%.
  • Engineered a scalable big data platform to handle millions of simultaneous user interactions.
  • Implemented real-time fetching modules for Fixed Instrument Rates from various financial institutions.

Software Developer

Guavus Network Systems (A Thales Company)
01.2014 - 08.2016
  • Worked on tethering anomaly detection using neural engines, contributing to a 10% improvement in anomaly detection accuracy.
  • Created high-throughput adaptors using Python and Scala for production-like data, facilitating efficient product development and testing.
  • Contributed to the implementation of CI/CD pipelines, reducing deployment time by 30%.

Education

B.E (I.T) - Computer Science

Guru Gobind Singh Indraprastha Univerity
New Delhi

Skills

  • Programming Languages :Python,Scala,Java
  • Databases: Hive, Elastic, MySQL,Mongo ,Cassandra,Redshift,Snowflake,Athena
  • Distributed Systems: Hadoop Yarn, Apache Kafka,Apache Spark
  • Cloud: AWS ,GCP
  • Queuing Systems: Kafka, Rabbit MQ
  • Operating Systems : Linux, MAC OS
  • VCS : GIT
  • Scripting Language: Python,Bash
  • Cloud : AWS,GCP

Timeline

Data Engineering Consultant

Independent Consultant
06.2022 - Current

Senior Big Data Engineer

Expedia
12.2020 - 06.2022

Senior Data Engineer

HT Media Limited
12.2018 - 12.2020

Senior Software Developer

Dunnhumby India
03.2017 - 12.2018

Co-Founder and Data Platform Consultant

ICTHRU Analytics
05.2016 - 03.2017

Software Developer

Guavus Network Systems (A Thales Company)
01.2014 - 08.2016

B.E (I.T) - Computer Science

Guru Gobind Singh Indraprastha Univerity

Similar Profiles

CREATE PROFILE
NITIN CHOUDHRY