Data engineering focus on analytics and visualization for various projects subscription of various line of businesses mainly Music, Video, FitnessPlus etc.
Work closely with business and product teams to provide analytics and dashboards for key product metrics like user engagement, penetration and retention to drive product and business growth.
Release ETL pipelines that comply with data governance of different regions like US, EU & rest of the world.
Senior Site Reliability Engineer
Apple
07.2018 - 09.2022
Leveraged Kafka for AWS Voldemort migration to get through Apple Internal ACLS to AWS Voldemort Cluster for data store copy. This involved AWS, Kafka, Spark, Scala, HDFS frameworks
Implemented SRE Customer facing tool for reporting by querying HDFS core data for users usage , activity, quota etc and store in mongo with Java libraries.
Implementation of spark jobs to migrate data from NoSQL databases to various sources of big data systems for Apple Video plus streaming
Automating deployments of cluster spin up process for bare metals and cloud native clusters
Developed Framework for build data in HDFS for data transfers from bare metals Hadoop clusters to AWS NoSQL databases(AWS EC2) which involves data hop on cloud storages(AWS S3)
Automated CI/CD Deployments using Jenkins’s integration with GitHub
Deployed NoSQL database cluster in parallel with bare metal and all cloud regions for faster data distribution to customer based on edge computing patterns.
Disaster recovery solutions for cloud deployment clusters using Apple cloud Infrastructure pipelines mechanism
Automated domain migration of live cluster infrastructure to new domain and its networking ACL
NoSQL backup solution implementation to store in cloud by hourly, daily, weekly based on data criticality
Involved and helped database consumers to scale Voldemort database with Hashing technique for nodes to avoid data lookup during instance failures
Experience with data analysis using Splunk , enriching logging with log4J and JSON frameworks
Senior Software Developer
Nisum Technologies Inc.
11.2010 - 06.2018
Gap is retail company needs software for inventory management in Warehouse, implemented product manage items or SKU inventory in each self and making auto updates as SKU used for fulfilling or return back to shelf during returns.
Its barcode managed product for each item, when each item is moving on conveyer belt while receiving inventory to warehouse or using SKU for customer order fulfilled, for both cases implemented factory patter to optimize code to manage multiple functional using single API.
Also make it scalable API for holiday peak support with front-end load balancer for REST API to route requests to across servers based on round robin technique, which help to manage 2 million requests per day