SANDEEP MALIK

Led a team of data engineers in designing and implementing a new data platform resulting in a 30% increase in efficiency (accuracy and recency) of data pipelines.

• Spearheaded development of GPT solution for strategic sales products, enhancing customer engagement and sales strategies.
• Designed and implemented semantic index, improving data retrieval and analysis capabilities.
• Streamlined data flow by integrating various data sources into unified system for seamless access and analysis. Implemented data quality checks to ensure data accuracy and integrity.
• Developed LLM-Ops solutions to streamline deployment and monitoring of machine learning models.
• Collaborated with cross-functional teams to ensure alignment with business requirements.
• Provided technical guidance to team members, resulting in 40% improvement in their technical skills

Designed and implemented a scalable Data Lake and Data Warehouse architecture for a global retailer resulting in a 50% reduction in data storage costs.

• Led core product team to enhance AI-backed search capabilities and personalization features.
• Developed and maintained data mart in Snowflake for analytics dashboard.
• Designed and implemented automated monitoring and alerting system to detect and resolve data processing errors.
• Conducted POCs on new tools and technologies to improve product offerings.
• Troubleshooted and diagnosed performance issues to ensure SLAs were met.

• Helped customers onboard Cloudera Data Platform (CDP) on Public, Private, and Hybrid cloud.
• Built solution architecture documentation and provided training to customers.
• Optimized performance and reduced operational costs in cloud environment.
• Collaborated with customers to recommend and implement right tools for their use cases

Led a team of developers to successfully deliver high-quality software projects on time and within budget constraints.

• Building strategies for historical data migration from On-Premise to AWS Cloud.
• Refactoring existing pipelines so that it can be run on Databricks.
• Building processes to monitor security events such as multiple login attempts, suspicious queries etc. for Snowflake and Databricks which will be monitored by 3rd party systems.
• Writing user guide or cookbook for best practices while working on Snowflake, Databricks, and AWS for Intact.
• Building Solution Architecture for various internal projects.
• Collaborating with other team members to provide consultation to them on various technologies Such as Spark, CI/CD, Snowflake, and so on.
• Working closely with Architects in order to come up with strategy to reduce cost and effort.