UDAY KUMAR VEERA
Brampton,ON
Summary
Azure Data Engineer Associate with 12+ years of IT experience specializing in the design, development, and architecture of data warehouse applications. Proven expertise in big data technologies (Apache Spark, Hadoop, Databricks) and cloud ecosystems (Azure Data Factory, Synapse Analytics). Strong data integration background with 7+ years of experience in Oracle Data Integrator (ODI) and 5+ years in Azure Data Factory. Proficient in data modeling (dimensional, star schema, snowflake) and ETL development.
Overview
16
16
years of professional experience
1
1
Certification
Work History
Data Engineer
Royal Bank of Canada
07.2022 - Current
- Developed CHATBOT using RASA framework that extracted data from tables based on user's requests.
- Worked on POC to generate code using Langchain framework using chatgpt-3.5-turbo LLM.
- Built data pipelines using Pyspark and Spark SQL to generate datasets
- Developed data pipelines using existing data ingestion framework based on clients FRB 14Q reporting requirements for Schedule H1, H2, A9 and K using Pyspark and Apache Airflow.
- Collaborated with cross-functional teams to define requirements and develop end-to-end solutions for complex data engineering projects.
Azure Data Engineer
The Northern Trust Bank
02.2018 - 05.2022
- Built data lake in Hadoop/Azure and provided aggregated reports/insights related to customers and policies to all downstream teams for their analysis and to improve the market strategies
- Imported customers info from various systems to ADLS using ADF and masking PII Data before exposing for development activities
- Implemented Synapse workspace for Dev/Test and Prod with components like SQL pool, spark pool, Lake Database, synapse pipelines and triggers
- Created synapse pipeline for data ingestion to live tables as well as daily, weekly and quarterly snapshot tables in data lake
- Worked closely with the business analysts to convert the Business Requirements into Technical Requirements and prepared low and high-level documentation.
Big Data Developer
Reinhart Food Service
02.2017 - 01.2018
- Built pipelines for integration processes between Channel Revenue and Sales Management System and Legacy in-house ERP application
- Imported customers data from multiples systems to HDFS using Sqoop Hive UDFs to encrypt/clean the data and convert unstructured data to structured data before exporting the data to RDBMS for visualization which helps analysts to get more insights about the programs
- Used SQL server/Toad to connect with source for the analysis and imported tables from Oracle using Sqoop
- Integrated forecast data provided by data science team with aggregated data to provide future requirements information on weekly basis.
ODI Lead Developer
Scientific Games Inc.
11.2015 - 02.2017
- Designed and supervised customization of Out of the box ODI integration processes required for report customization and new reports development
- Maintained a custom reporting solution to handle procurement and spend analytics data
- Come up with ODI standards for Out of the Box code customizations and new implementation
- Stabilized the existing environments by optimizing ODI architecture from ETL failures by understanding the physical environment and network configurations.
ODI Lead Developer
Cheniere Energy
03.2015 - 10.2015
- Interacted with business power users to document requirements for reporting
- Created batch scripts to extract data from Hyperion DRM, Hyperion Financial Management and Hyperion Planning applications
- Came up with a design for Data model to efficiently integrate various data sources such as Enterprise Resource Planning application such Oracle EBS and Financial applications such as Oracle HFM, HPM
- Performed category 1 and category 3 customizations to OBAW to bring in Hyperion data
- Design, document, develop, unit test, and support complex data integration workflows for fault tolerant systems.
ETL Developer (ODI)
Constellation Brands
06.2014 - 02.2015
- Migrated data associated to Winerack, a subsidiary of CBI a retail chain in Canada, which sells in house produced wines
- Integrated daily sales and inventory data generated by Winerack into Oracle Data Warehouse in daily or for a period
- Involved in understanding Wirerack sales model using the legacy warehouse SQL Server procedures and tables and re-modeling data to meet standards in current system using Agile Scrum methodology
- Used SAP adapter to retrieve data from iDocs to an XML file
- Generated interfaces to load data from Magstar database to Oracle staging repository
- Created interfaces and procedures to transform and load data based on period-based partitions in target Data Store.
Programmer Analyst
NESS Technologies
11.2011 - 08.2012
- Developed UI using Richfaces for tracking examination paper evaluation performed for teachers in K-12 schools
- Developed Persistence Layer implementation and front-end controllers, UI design using JSF components to make rapid application development
- Supported JSF components using Richfaces and Primefaces to enable AJAX functionality and Facelets for templates
- Used Spring MVC pattern for front-end modules and made use of Spring DAOs effectively
- Implemented Spring factory pattern using Spring Bean Factory.
Research Assistant
Rochester Institute of Technology
09.2010 - 02.2011
- Developed a web portal and a standalone application for a Sandbox administrator to view and log various Virtual Machines deployed and running in the Sandbox
- Used Java and spring to develop web portal to view and log statistics of various Virtual machines in the sun’s sandbox
- Developed a standalone application using Swing package for administrator to actively monitor sever usage statistics and interact with the backend sandboxes.
Software Engineer (ODI and PL/SQL Engineer)
Free Systems Technology Labs Pvt Ltd
08.2008 - 08.2010
- Worked on FLPIDS ODS - Farm Loan Program Information Delivery System Operational Data Store for the replication of OLTP system
- Upgraded from ODI 10G to ODI 11G environment
- Resolved Upgrade issues to make sure daily loads run efficiently
- Experience in configuring ODI Agent on UNIX server and creating new agents and test them in ODI 11G
- Experience in Dimensional Modeling such as star schema, snow flake schema, creating Facts, Dimensions and Measures
- Created Topology which includes creating Master/Work repositories, Physical/Logical schemas, Agents, and Context
- Experience in running RCC (Repository consistency check) to see if master and work repositories are consistence
- Worked in importing data from different sources like database, flat file, XML files, excel.
Education
Masters in computer science -
Rochester Institute of Technology
Rochester, NY12.2013
Bachelor of Technology -
Jawaharlal Technological University
Hyderebad05.2008
Skills
- Big Data: Apache Spark, Hadoop, Databricks, Hive, Python
- Cloud: Azure Data Factory, Azure Synapse Analytics, Azure HDInsight, Azure Data Lake, Data Bricks, Delta Lake
- Data Integration: Oracle Data Integrator (ODI), ETL Development
- Data Modeling: Dimensional, Star Schema, Snowflake
- Databases: SQL, PL/SQL
Certification
Azure Data Engineer Associate
Timeline
Data Engineer
Royal Bank of Canada
07.2022 - Current
Azure Data Engineer
The Northern Trust Bank
02.2018 - 05.2022
Big Data Developer
Reinhart Food Service
02.2017 - 01.2018
ODI Lead Developer
Scientific Games Inc.
11.2015 - 02.2017
ODI Lead Developer
Cheniere Energy
03.2015 - 10.2015
ETL Developer (ODI)
Constellation Brands
06.2014 - 02.2015
Programmer Analyst
NESS Technologies
11.2011 - 08.2012
Research Assistant
Rochester Institute of Technology
09.2010 - 02.2011
Software Engineer (ODI and PL/SQL Engineer)
Free Systems Technology Labs Pvt Ltd
08.2008 - 08.2010
Masters in computer science -
Rochester Institute of Technology
Bachelor of Technology -
Jawaharlal Technological University
Similar Profiles
ANIRBAN BASUANIRBAN BASU
QA Manager at TCS CANADA (Client - Royal Bank Of Canada)QA Manager at TCS CANADA (Client - Royal Bank Of Canada)
Ashok Kumar PeddinaAshok Kumar Peddina
Senior Consultant at Capgemini, Canada, Royal Bank of CanadaSenior Consultant at Capgemini, Canada, Royal Bank of Canada
PARMEET KAURPARMEET KAUR
Collections Officer at Royal Bank of Canada, RBCCollections Officer at Royal Bank of Canada, RBC