Nidhi Kumar
Brampton
Summary
Experienced Sr. Data Engineer and Azure Cloud Developer with 9+ years of expertise in building scalable data solutions and cloud infrastructure. Currently working for TD Bank through Wipro Technologies, I design and optimize data pipelines using Azure Data Services (Data Factory, Databricks, SQL Database) to drive business intelligence and advanced analytics. Skilled in cloud architecture, data integration, SQL, Python, Spark and automation with strategic approach to data management and problem-solving. I focus on delivering secure, high-performance solutions that meet complex business requirements. Committed to continuous improvement and innovation in the data and cloud space. Managing offshore resources to get the project delivered on time.
Overview
10
10
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
Wipro Technologies
10.2024 - Current
- I am working on Azure Cloud based technology to design, build, and optimize data pipelines and data processing workflows.
- My role involves collaborating with cross-functional teams to ensure the seamless ingestion, transformation, and storage of large volumes of data across multiple systems, with a focus on Azure Data Services (e.g., Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks).
- Mentorship and Knowledge Sharing: Provide technical leadership to junior developers, helping them understand cloud architecture, Azure services, and best practices. Conduct knowledge-sharing sessions, workshops, and training for internal teams on the latest Azure features and cloud technologies.
- Collaboration and Agile Methodologies: Work closely with product owners, architects, and business analysts to gather and refine requirements for new cloud-based solutions. Participate in Agile ceremonies (e.g., sprint planning, retrospectives, standups) and deliver continuous improvements based on feedback.
- Client Interaction and Reporting: Communicate with business and provide progress updates, risks, and mitigation plans related to cloud projects.
- Prepare documentation and technical reports on cloud architecture, configurations, and performance metrics to ensure transparency and accountability.
- Re engineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.
- Delivered exceptional results under tight deadlines, consistently prioritizing tasks effectively to meet project timelines without compromising quality or accuracy.
- Managing 10 offshore resources to get the project delivered on time.
Training and Support Associate
SURGE LEARNING INC
07.2020 - 10.2024
- Working with a team in creating and managing the company's proprietary tool(s) used by the clients in the healthcare sector like Hospitals, Long term care etc and gathering their requirements
- Successfully contributed to two major projects, significantly benefiting both the organization and the clients
- Acquired proficiency in Databricks, Pyspark, SparkSQL, ADF, and other tools through comprehensive training program
- Actively engaged in internal team tasks and presentations, fostering collaboration and knowledge sharing
- Played a key role in mentoring and guiding new hires in Databricks and Pyspark
- Collaborated with other team data engineers, exploring new use cases and adopting best practices for data pipeline development
- Worked closely with cross-functional teams and with the clients to grasp data requirements and deliver tailored solutions that meet client needs
Operations Data Analyst
OEC Groups
09.2019 - 03.2020
- Application support: Responsible for functionality support to the application, cluster, technical and functional knowledge sharing to the application clients
- Provided training to clients and application users on our Tools/application usage
- Client communication: Working with the China team as well as Canadian clients on a daily basis for planning newly coming projects' roadmap and project quality improvement
- Application maintenance: Maintaining and delivering data to clients with upcoming shipments
- It involved extensive work on client's interaction and issue troubleshooting with them
Business Analyst
EXL Services
05.2018 - 11.2018
- Application support: Responsible for functionality support to the client's application for their technical and functional issues
- Client communication: Working with onsite team as well as clients on daily basis for planning newly coming projects' road map and project quality improvement
- Value Adds: Developed shell script-based automation for process improvement
- Testing: Used to Perform regression testing on UAT before the project goes live on Production
- Requirement gathering: Designing the solutions and documenting new requirement/ functionalities of new user cases as per business requirement
Free Lancer (Hadoop Developer)
TM Networks
10.2017 - 04.2018
- Development: Responsible for java and hive-based functionality development for business requirements
- Documentation for existing functionalities and the enhancement required
- Involved in analyzing the impact of the requirement on the existing jobs /processes considering the End-to-End flow of it
- Responsible for code review and validation of data during the development phase and highlighting risks and impacts if any
Project Engineer
Wipro Technologies Ltd
08.2015 - 09.2017
- Application maintenance: Maintaining and delivering data to 50+ applications/LOBs which are live on Production
- It involved extensive work on user's interactions and issue troubleshooting with them
- Client communication: Working with onsite team as well as clients on daily basis for planning newly coming projects' road map and project quality improvement
- Provided Training to other team members and Clients on our tools and its usage
- Cluster Admin: Maintaining all the clients cluster along with respective services to provide infrastructure to the client's applications
- Handled daily issues of service hung-up, disk space, user account's locks, messaging queue cleanup, cluster load balancing
- Requirement gathering: Understand/finalizing and documenting new requirement/ functionalities of application to make a prod map for future
- To provide support while the code is being tested by testers for requirement fulfillment and solving defects raised
- Team building activities: I was taking care of responsibilities to keep team motivated and help the entire team member in their personal and professional growth
Education
Bachelor of Technology - Computer Science and Engineering
Graphic Era University
Dehradun, India01.2015
Intermediate School -
Seven Oaks School
Dehradun, India01.2011
High School -
Seven Oaks School
Dehradun, India01.2009
Skills
Skills & Technologies:
- Azure Services: Azure Data Factory (ADF), Azure Databricks, Virtual Machines, Azure Functions, Azure App Services, Azure SQL Database
- ETL Tool: Informatica
- DevOps: Git, Jenkins, CI/CD pipelines,
- Programming Languages: Python, Pyspark, Hadoop Ecosystem, Java
- Security: Key Vault, Azure Active Directory (AAD)
- Database: Azure SQL, MySQL, Hive
- Collaboration & Agile: Jira, Confluence, Scrum, Service now
Certification
Microsoft Certified: Azure Data Fundamentals
Completed a certification course provided by Microsoft.
Certification
Microsoft Certified: Azure Data Fundamentals, Completed a certification course provided by Microsoft.
Languages
English
Full Professional
Hindi
Full Professional
Timeline
Senior Data Engineer
Wipro Technologies
10.2024 - Current
Training and Support Associate
SURGE LEARNING INC
07.2020 - 10.2024
Operations Data Analyst
OEC Groups
09.2019 - 03.2020
Business Analyst
EXL Services
05.2018 - 11.2018
Free Lancer (Hadoop Developer)
TM Networks
10.2017 - 04.2018
Project Engineer
Wipro Technologies Ltd
08.2015 - 09.2017
Bachelor of Technology - Computer Science and Engineering
Graphic Era University
Intermediate School -
Seven Oaks School
High School -
Seven Oaks School
Similar Profiles
Raghunandan M CRaghunandan M C
Program Manager Consultant at Wipro TechnologiesProgram Manager Consultant at Wipro Technologies
Abhishek PawarAbhishek Pawar
Financial Analyst at Wipro TechnologiesFinancial Analyst at Wipro Technologies
Ujjwal KCMUjjwal KCM
Delivery Manager at Wipro TechnologiesDelivery Manager at Wipro Technologies
PRIYANKA GOPUPRIYANKA GOPU
Manual QA Engineer at Wipro TechnologiesManual QA Engineer at Wipro Technologies
Manpreet KaurManpreet Kaur
RPN at Schlegel VillagesRPN at Schlegel Villages