Subhro 'RAJ' Chowdhury

Spearheaded the development of a cutting-edge Big Data Solution aimed at enhancing the efficiency of marketing expenditure.. This product effectively manages sensitive data within AWS and secure Clean Rooms.
The architecture leveraged advanced technologies such as AWS Glue, PySpark, Redshift, and proprietary internal tools. As the project leader, I oversaw every aspect of its design and implementation.

Working in the Payments Team of GoFundMe. Following are the major contributions:

• Designed and implemented data-pipeline for the revenue reporting system using spark and python on AWS.
• Build ledger application on all payment related transactions, This required integration with different Payment Processors like Stripe and Adyen. Several APIs and webhooks were implemented as part of the ledger system using Kotlin and Spring Boot.

I have built a real-time reporting application called NRT using spark streaming and Google Cloud technologies like Pub/Sub.

I have also been involved in the cost optimization projects for Google Cloud expenditures. As part of my contribution to that, I have re-designed and implemented the data pipeline.

Primary technologies I have been working on are Java, Scala, Spark, Google Cloud (mainly Kubernetes, Dataproc, PubSub, CloudSQL and GCS) and Terraform

Built several Big Data applications and setup required application infrastructures. Projects included development of ETL pipeline and building Real Time Data Analysis Tools. Designing, Coding, Mentoring, Production Support and Deployments were main day to day activities. Java 8, Spark, Cassandra, HBase, Kafka, Google Cloud etc. are the core technologies involved. Below are the summaries of a few projects:

• Front Page : Real-time tool used by 200+ publishers for Audience Development and to manage the Homepage
• Migration Project : Migration of application infrastructures and applications from Google Cloud to Data Centers
• Web Crawler : Built a scalable and robust web crawler currently being used in several products of the company
• Full Page Personalization : Publishers are using this product to personalize the site based on the user segment

Architected and developed new ETL pipeline for the iCloud reporting. Setup Kafka cluster, developed data consumers and processors for the downstream applications. Apart from setting up the infrastructure, designing, coding and testing were the daily responsibilities. Kafka, Java, HDFS, Pig, HBase were few core technologies.

Designed and implemented new platform services for the Ticketmaster.com. Wrote scalable REST APIs and underlying business logic that can handle concurrent and heavy load. Design, development, Testing and Production Support were primary responsibilities. Core technologies involved were Java, String Boot, Hibernate, Oracle etc.

Developed and managed several distributed enterprise applications related to Loan Processing. Also played role of Project Lead for two development projects. Requirement Analysis, Project Planning and Execution, Designing, Coding, Testing were core responsibilities. Few technologies involved were Java, Spring, REST, Oracle SOA etc

Developed a Loan Optimization product which is currently used by leading investment companies. Singlehandedly developed the visualization framework of the product. Other than designing and development, was also responsible for training and co-ordinating the deployments.