JAY PATEL
Los Angeles
Summary
Results-oriented Data Engineer specializing in Azure Databricks and PySpark, formerly at ZS Associates. Expertly designed a financial data platform, improving data governance and minimizing cloud expenses. Demonstrated capability to convert intricate requirements into practical solutions, showcasing exceptional collaboration and technical expertise to achieve significant business results.
Overview
5
5
years of professional experience
3
3
Certifications
Work History
Business Technology Solutions Associate (Data Engineer)
ZS ASSOCIATES
Los Angeles
03.2024 - Current
- Architected a "Single Source of Truth" financial data platform by consolidating SAP, Oracle, and NetSuite data, ensuring audit-ready reporting for executive leadership and enhancing data governance.
- Optimized PySpark and Spark SQL jobs using partitioning and Z-ORDER indexing, eliminating small-file churn and significantly reducing cloud compute costs through improved resource utilization.
- Engineered robust batch and Structured Streaming ELT pipelines using Azure Data Factory and Databricks to ingest multi-ERP GL data into a multi-layered Delta Lake, ensuring data reliability.
- Implemented Change Data Capture (CDC) with MERGE INTO logic and enforced Azure AD RBAC to secure sensitive financial data across Bronze, Silver, and Gold layers, contributing to ethical data handling.
- Defined a comprehensive GenAI roadmap for clinical and commercial executives, conducting technical feasibility assessments to guide strategic AI infrastructure investment and solution development.
- Translated complex business requirements from non-technical stakeholders into strict technical specifications and governance protocols, bridging the gap between strategy and engineering through effective collaboration.
Business Technology Solutions Intern
ZS ASSOCIATES
Los Angeles
06.2023 - 08.2023
- Automated manual workflows using Python, saving over 100 hours of effort and enabling client teams to reallocate capacity toward high-priority strategic initiatives, demonstrating self-starter capabilities.
- Enhanced the tracking of large-scale business transformation initiatives by integrating JIRA with Tableau dashboards, providing real-time visibility into project KPIs and identifying opportunities for process improvement.
Analytics Consultant
CAPGEMINI
Pune
08.2020 - 12.2021
- Designed and deployed executive dashboards for 4,200+ employees, directly translating HR and training data into actionable business metrics and driving continuous improvement.
- Implemented KPI tracking systems that visualized trends and drove a 12-18% improvement in training engagement and outcomes over 12 months.
- Influenced organizational skills development strategy by presenting data-driven recommendations to senior leadership, fostering knowledge sharing.
Education
Master of Science (MS) - Business Analytics
The University of Texas at Dallas
Richardson, TX01.2024
Post Graduate Diploma in Management (PGDM) - Marketing & Finance
FORE School of Management
New Delhi, India01.2020
Skills
- Azure Databricks and ADF expertise
- ADLS Gen2 storage solutions
- AWS cloud technologies
- Proficient in PySpark and Spark SQL
- Delta Lake utilization
- Structured streaming methods
- Z-ORDER optimization techniques
- Spark medallion architecture knowledge
- Star schema modeling skills
- SCD Type 1 & 2 strategies
- Python development skills
- SQL proficiency
- R language capabilities
- Git for version control
- Azure DevOps methodologies
- RBAC with Azure Active Directory access management
- Power BI and Tableau for data visualization
- Engineering ELT pipelines effectively
- Implementing change data capture processes
- Optimizing PySpark workflows efficiently
- Expertise in SQL programming practices
- NoSQL database solutions knowledge
- Data modeling frameworks understanding
- Metadata management systems knowledge
- Real-time processing capabilities
Certification
AWS Data Engineer Certification
Timeline
Business Technology Solutions Associate (Data Engineer)
ZS ASSOCIATES
03.2024 - Current
Business Technology Solutions Intern
ZS ASSOCIATES
06.2023 - 08.2023
Analytics Consultant
CAPGEMINI
08.2020 - 12.2021
Master of Science (MS) - Business Analytics
The University of Texas at Dallas
Post Graduate Diploma in Management (PGDM) - Marketing & Finance
FORE School of Management