Pratiksh Nakiya
Toronto,Canada
Summary
Senior Data Engineer with 7+ years of experience managing the complete data lifecycle, including extraction, cleansing, warehousing, modeling, analysis, and testing. Demonstrated ability to excel in various roles such as Data Analyst, Backend Engineer, Team Leader, Architect, and Infrastructure specialist. Strong knowledge of business operations and proficiency in analytics tools and financial applications.
Overview
10
10
years of professional experience
Work History
Senior Data Engineer
Octane Lending
New York City, NY
07.2021 - Current
- Designed data models for new sources to fulfill business requirements.
- Migrated pipelines from legacy orchestration to MWAA (Airflow).
- Architected CI/CD processes, ensuring deterministic builds for EMR and EC2 pipelines.
- Developed FastAPI microservices for loan boarding in LoanPro from company's lender website.
- Created microservices to optimize service architecture by centralizing third-party logic
- Collaborated with stakeholders and data scientists to ensure data coverage meets expectations.
- Provided technical mentorship to junior team members and facilitated scrum ceremonies.
- Integrated third-party pipeline solutions (Fivetran) into internal systems.
Data Engineer II
Octane Lending
08.2019 - 06.2021
- Developed scalable ETL pipelines using Spark (PySpark) and Python, deployed on AWS EMR, EC2, Glue, and Mesos.
- Utilized Airflow, Lambda, SQS, and SNS for efficient pipeline orchestration.
- Integrated data from MySQL, Postgres, Salesforce, API, and S3 into centralized data lake and warehouses.
- Enhanced legacy pipeline execution time by over 60% through optimizations.
- Created SQL queries and developed reports and dashboards for internal teams including Finance and Sales.
- Reviewed code changes and enforced coding standards to maintain high-quality output.
- Debugged pipeline issues promptly during on-call duty to ensure compliance with SLAs.
Data Engineer Intern
New York State Department of Environmental Conservation
Albany, NY
08.2018 - 05.2019
- Designed and developed geodatabase for forest health and related projects.
- Created configuration-driven ETL scripts for data migration and transformation to target databases.
- Automated analysis and data validation by developing ArcGIS toolboxes using Python and ArcPy.
- Developed scripts for loading Google Maps data into GIS tables and mailing updates for online services.
- Resolved issues with ArcGIS hosted layers, surveys, and Survey123 forms.
Test Engineer
Infosys Ltd
Pune, IN
05.2015 - 04.2017
- Conducted testing for Big Data ETL processes in AML system for HSBC, enabling transaction flagging.
- Developed test scenarios and cases based on business requirements to ensure comprehensive coverage.
- Created Hive queries for data validation, documenting defects in JIRA, and assigning issues to relevant teams.
- Automated test case execution by developing shell and VB scripts, enhancing efficiency.
- Evaluated defect metrics and communicated findings to management for informed decision-making.
- Performed regression testing and escalated unresolved issues while mentoring junior testers.
Education
Master of Science - Computer Science
University At Albany, SUNY
Albany, NY05.2019
Bachelor of Technology - Information Technology
Dharmsinh Desai University
Nadiad, IN05.2015
Skills
- Python
- Spark
- SQL
- Airflow
- AWS
- Docker
- Shell programming
- Terraform
- Hive
- Scala
- Django
- FastAPI
- Jenkins
- Redshift
- Athena
- MySQL
- PostgreSQL
- Geodatabase
- Github
- Zeppelin
- Mesos
- Marathon
- JIRA
- ArcGIS Pro
- AWS quicksight
Timeline
Senior Data Engineer
Octane Lending
07.2021 - Current
Data Engineer II
Octane Lending
08.2019 - 06.2021
Data Engineer Intern
New York State Department of Environmental Conservation
08.2018 - 05.2019
Test Engineer
Infosys Ltd
05.2015 - 04.2017
Master of Science - Computer Science
University At Albany, SUNY
Bachelor of Technology - Information Technology
Dharmsinh Desai University