Manoj Reddy
Toronto,ON
Summary
I worked on complex IT projects in multi-stakeholder matrix organizations for IT Services and Consulting organizations. Having educational background being in Computer Science and experience in Consulting helps liaise effectively between business stakeholders and technical teams. Offering highly analytical mindset and passion for leveraging data to solve complex problems, eager to learn and grow within dynamic team. Brings foundational understanding of data systems and database design that can be quickly developed through hands-on experience. Ready to use and develop skills in SQL and Python in Data Engineer role.
Overview
9
9
years of professional experience
1
1
Certification
Work History
Data Engineer
ProjectX
01.2021 - Current
- As of critical resource of the team, responsible for delivering the cloud migration project to the client
- Part of the 3 member team which is responsible for the development of over 400 Azure Synapse SCD1, SCD2, Header/Detail and Transactional Pipelines for data acquisition, integration, and presentation across 28 business systems
- Responsible for designing & developing various azure Synapse pipeline patterns includes accessing data from various different sources like API's, JDE, SQL server, SFT and Excel...etc
- Responsible for develop data framework for generating Year-End IFRS Financial Reports, Leasing with Supporting Accounting Notes, Leasing reports, Budgeting and Operations Reporting Leveraging Azure Synapse & Power BI
- Responsible in the development of a centralized Azure synapse data mart/data access layer with over SQL 80 complex views, 20 user defined functions, 50+ stored procedures to cater for over 96 Power BI reports & datasets
- Develop DataOps Event & Sensor Based Airflow DAGs to Orchestrate 400+ Azure Synapse & ADF Pipelines, Manage data dependencies, Audit & Error Logging, Alerts & Notifications, Rollbacks & Conditional Power BI dataset Refresh
- Developing 15 Custom UDFs, 65 data quality validation functions, 18 background data cleansing, data deduplication, PII data obfuscation Python packages using SnowPark distributed dataframes
- Developed Power Shell scripts which automated and highly optimized the process of access VTS source and storing them on Data Lake as Json files, takes less than 60mins to complete, which used to take 4hrs with synapse pipelines
- Created Power BI dashboard and generated reports using the synapse data warehouse as the source
- Lock objects on the reports and reports on Power BI Desktop and published on Power BI Report Server
- Developed complex calculations, measures, and functions using the Data Analysis Expression Language (DAX)
- Built secure Power BI reports, dashboards, and paginated reports
Data Analyst
ProjectX
01.2021 - Current
- Worked as Microstartegy developer, responsible for developing ad-hoc reports, dossiers, scorecards and dashboards using MSTR online and Desktop
- Generated key performance indicators (KPI) metrics, attributes, filters, objects, prompts, metrics, facts, consolidation and custom groups
- Developed several interactive dashboards to different iPhone and iPad models
- Worked as Teradata db developer and performance tuning expert
- Showcase experience in developing complex SQL queries and stored procedures
- Gained working knowledge in Data modelling, creating a star and snowflake schemas in DW
- Contributed to the design, development, and testing of the ETL strategy using SQL Server Integration Services (SSIS) for data population from diverse source systems
- Skilled in working with large and complex T-SQL stored procedures, leveraging concepts like Common Table Expressions (CTEs), temporary tables, and complex joins across multiple tables
Senior Systems Engineer (SQL/ETL Developer) – Retail Project (Adidas)
Infosys
01.2017 - 09.2019
- Responsible for creating and maintaining Data warehouse packages, troubleshooting issues with SSIS Packages
- Involved in building and maintaining infrastructure in azure
- Migrate SSIS Packages to import and export data from various data sources using Azure ADF and SSIS Azure IR
- Wrote complex T-SQL queries, stored procedures and used them to build SSIS packages, SSRS reports and in Tableau
- Created user interface reports using Tableau sheet objects like List Box, Input Box, Buttons, Text Input, Slider, Bookmarks, Charts (Pivot/Straight tables, Pie, Bar, Line etc.)
- Created data dictionary, Data mapping for ETL and application support, DFD, ERD, mapping documents, metadata, DDL and DML as required
- Extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL and U-SQL Azure Data Lake Analytics
- Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in In Azure Databricks
- Created new data constraints and or leveraged existing constraints for reuse
- Proficient in working with both live and imported data in Power BI, harnessing its capabilities to create insightful reports and visualizations
- Utilized Power Query in Power BI for data cleansing and manipulation, employing techniques like pivoting and unpivoting to optimize the data model
- Responsible for building comprehensive and visually appealing Power BI reports from scratch, leveraging the full potential of the tool
Systems Engineer (SQL/ETL developer) – Retail Project (Adidas)
Infosys
01.2016 - 01.2017
- Responsible for working with business analysts to gather the business requirements repairs and maintenance
- Implemented the complex business logic using T SQL, Written Stored Procedures, Triggers, Cursors and Functions to implement the business logic
- SSIS packages created with various sources like SQL Server 2016/2014/2012, Oracle, CSV, Excel,Exasol and Text files from Client servers and through FTP
- Created SSIS Packages using Pivot Transformation, Fuzzy Lookup, Derived Columns, Aggregate, Execute SQL Task, Data Flow Task, and Execute Package Task etc
- To generate underlying data for the reports and to export cleaned data from Excel Spreadsheets
- Performing daily health checks, monitoring and support of existing application, patching for database and application, preparing root cause analysis documents (RCA)
- Performing integrity checks
- Methods include configuring the database maintenance plan wizard and DBCC utilities
- Using Performance Monitor, Exasol Profiler optimizing the queries, tracing long running queries and deadlocks
- Responsible for developing ad-hoc reports using cognos according to client requirments
- Developed and deployed SSIS packages for ETL from OLTP and various sources to staging and staging
- Using SQL server reporting services (SSRS) delivering enterprise, Web-enabled reporting to create reports that draw content from a variety of data sources
- Involved in Performance Tuning of Code using execution plan and SQL profiler and added Indexes to improve performance on tables
Education
PGD - Cloud computing on big data
Lambton College
Toronto, ON01.2021
Bachelor of Science - Electrical and Electronics Engineering
SRM University
Chennai01.2016
Skills
- Business Analysis
- Stakeholder Management
- Git
- CI/CD
- Unit testing
- Data migration
- Scripting languages
- Performance tuning
- Data governance
- NoSQL databases
- Data integration
- SQL programming
- RDBMS
- Storage virtualization
Certification
- Exasol Developer, 2019
- Exasol Performance Tuning Expert, 2019
- Azure Data Fundamentals, 2023
- Azure Data Engineer Associate, 2024
Technology
Azure, AWS, SSIS, Informatica, Azure ADF, SSRS, Power BI, Cognos, Tableau, SQL Server, MySQL, EXASOL, Oracle, Teradata, Python, Power shell
Industries
- IT Consulting
- IT Services
Timeline
Data Engineer
ProjectX
01.2021 - Current
Data Analyst
ProjectX
01.2021 - Current
Senior Systems Engineer (SQL/ETL Developer) – Retail Project (Adidas)
Infosys
01.2017 - 09.2019
Systems Engineer (SQL/ETL developer) – Retail Project (Adidas)
Infosys
01.2016 - 01.2017
PGD - Cloud computing on big data
Lambton College
Bachelor of Science - Electrical and Electronics Engineering
SRM University
Similar Profiles
Sinthuja VijayarajSinthuja Vijayaraj
Intern Waitress at Cibo Wine BarIntern Waitress at Cibo Wine Bar
Salman ValimohamedSalman Valimohamed
Project Manager / Social Media Manager at Waveform Entertainment IncProject Manager / Social Media Manager at Waveform Entertainment Inc
Tamara MustafaTamara Mustafa
Care Coordinator (Care Access Representative) at CBI Home HealthCare Coordinator (Care Access Representative) at CBI Home Health
Renjana KrishnanRenjana Krishnan
Home Care Provider at Osprey Angels Home Care ServicesHome Care Provider at Osprey Angels Home Care Services
JEEVAN KUMAR PERIKALAJEEVAN KUMAR PERIKALA
Data Engineer at Suncorp InsuranceData Engineer at Suncorp Insurance