Summary
Overview
Work History
Education
Skills
Timeline
Generic

SANTHOSH MASIREDDY

Toronto,ON

Summary

Certified Azure data engineer with great exposure to Data Analysis, Data Engineering on azure and Backend development using Python and C# with Microsoft Dynamics 365 CRM and power apps. Key strengths: Expertise in Azure Data Factory, Databricks, Synapse Analytics, Microsoft Dynamics 365 CRM, Power Automate. Very strong understanding in Data processing, Relational Database Management system (RDBMS) concepts, SDLC, OLAP/OLTP environments and NOSQL (MongoDB and Elastic search).

Overview

9
9
years of professional experience

Work History

Lead Data Engineer

CAP Financial Partners LLC
Raleigh, USA
03.2019 - Current
  • Working and supporting several CAPTRUST financial projects related to Investment Industry
  • Designed, Developed, and maintained data processes/pipelines (ETL/ELT) using Azure Data Factory with managed Apache airflow orchestration which retrieves the data from various sources and applied complex business transformations to convert the data into Parquet Delta files load them into enterprise data lake/lake house for visualizations/reports and used power Query and power BI to generate reports and dashboards
  • Designed Kafka streaming pipelines (Publish-subscribe mechanism) for the real time data processing and Analytics
  • Developed canvas apps using Power Apps to address specific business needs, such as data entry, approvals, and reporting
  • Designed and developed snowflake materialized views for reporting needs and have used Failsafe and time travel when needed for restoring the data
  • Created a snow pipe in snowflake to continuously ingest the data from external data stages from various file formats
  • Migrated data from on-premises databases or other cloud platforms to the Snowflake cloud data platform which includes designing and implementing data migration strategies, ensuring data integrity, and optimizing performance
  • Migrated data from on premise SQL server to Azure SQL Database and SQL Managed Instance (SQL MI) using data migration assistant
  • Used Azure SQL MI to schedule SQL Server Agent jobs and handle some data replication mechanism from Microsoft Dynamics 365
  • Designed a data replica framework using azure synapse analytics and Python panda’s framework which replicates the data from Dynamics CRM onto the Azure SQL database to use the data for various internal reports/applications
  • Designed and configured model-driven apps, leveraging the Common Data Service (CDS) for building robust and scalable solutions
  • Maintained data warehouse solutions using snowflake, allowing for faster data access and improved reporting capabilities
  • Implemented a Data replication system to refresh the data from the Dynamics 365 into Backend Azure SQL for reporting purposes as Microsoft has deprecated DES (Data Export Service)
  • Familiarity with integrating Power Apps and Power Automate with Power BI for data visualization
  • Designed and automated business processes using Power Automate (formerly Flow) and created flows triggered by events
  • Developed Spark notebooks in Databricks to support medallion architecture to reduce infrastructure costs by up to 80% with Azure Databricks and Delta Lake mechanism to support ACID transactions
  • Written azure HTTP, Blob and Time trigger functions and azure Logic Apps call them using data factory to achieve custom functionality that is not readily available in azure data factory
  • Designed and Developed an Azure web app which Integrates with external APIs like Morningstar Calculation Engine, Black Diamond, Concur and Dynamics 365 F&O
  • Designed a Data scrambling(masking) framework which masks the customers PII data to meet the compliance
  • Lead a project to move all the .dts packages from TIBCO Scribe to azure data factory ETL pipelines with proper notification farmwork and triggers to save revenue.

Azure Data Engineer

AIM Specialty Health
Chicago, USA
10.2017 - 03.2019
  • Redesign of Client’s preauthorization application with Event-driven Micro service architecture using Rabbit MQ, Elastic search and MongoDB/ Building Data warehouse which supports this application
  • Worked on data migration from client’s legacy application system into MongoDB and Elastic Search by creating SSIS Packages related to Client’s Providers, Members, users, Case and Service by strictly following HIPAA guidelines
  • Creating SQL Server Agent jobs with the developed packages to pull the data in incremental loads by pulling the files from client’s FTP based on the schedules and have created a notification framework which alerts the user’s, developers, and DBAs on the Job failures
  • Performed CRUD operations on MongoDB using Java script syntax to update, delete and update the data in application
  • Created Azure webapp to parse the data from the RabbitMQ exchanges and split the data into different data sets which are used for the application using python
  • Created Azure web application to convert the relational data into JSON Data and will be trigger the data in to exchanges and queues based on the requirement
  • Good understanding of IIS Configuration and Web Deployment methodologies
  • Developed UI using jQuery and Java script for interactive cross browser functionality and complex user interface
  • Improved the performance of SSIS Packages by using transformations like Balanced Data distributor and running the data in batches
  • Participating in meetings with Application developers
  • Product owners to get an understanding of business requirements and implement them
  • Worked on Git Lab for version control, Jenkins, Urban Code for CI/CD (Continuous Integration and Delivery).

Data Engineer (T-SQL, SSIS, SSRS)

Quantum Health
Columbus, USA
05.2017 - 09.2017
  • Design and Development of Clients Claims matching and Member matching / Troubleshooting Job failures/ Triage and resolving Issues for existing applications
  • Worked on Jira Tickets related to Client's Enrollment, Eligibility, Pharmacy Claims, Medical Claims, Authorizations, and Accumulators by following HIPAA regulations developed on SSIS, C# and VB
  • Net
  • Developed workflows using C# which will be triggered on the selected actions like create a task, send an email task, new field update
  • Used SSDT plugin for the visual studio which will be used for several data processes and have used C# to validate the connection managers before running the application
  • Created a C# application in combination with the SSIS to check for the member matching every day after the job runs are complete and will send out a report if any issues are found which saved 80% of the HIPAA violation issues
  • Worked on SQL Server production jobs failure's and troubleshooted them by finding the Issues through the SQL Server agent
  • Created a C# application with reporting capabilities which will give a list of all the Job failures on that day as parameter
  • Developed Custom entities, Web resources, Java Scripts, and Sitemap modification
  • Designed, and deployed the Custom objects, Custom tabs, Entity-Relationship data model, validation rules, Workflow Rules, Auto-Response Rules, Page layouts, Components, Visual Force Pages to suit the needs of the application
  • Administrated and monitored the company's Salesforce CRM applications
  • Worked on different file formats like PGP, x12 as data source and extracting and transforming those sources and loading them into their respective production databases.

SSIS ETL Developer

Quidel Corporation
San Diego, USA
10.2016 - 05.2017
  • Design for Clients Sales Automation and Integration with Customer relationship management and Enterprise resource planning applications / Building Data warehouse for reporting needs
  • Worked with the Business Analysts in designing and understanding the business requirements for robust design
  • Project involves Inbound, Internal and outbound process which involves importing the data from Salesforce (CRM), ERP and Excel, CSV files and exporting the data to the distributors through SFTP utility
  • Developed a C# utility to Integrate the SQL Server with Salesforce
  • Created custom ASP.NET pages and configured forms and views for new modules to be added to ERP and CRM Systems
  • Worked on creating various workflows, triggers, profiles, validations in Salesforce to support customer’s business application
  • Configured ETL Audit framework for all the which helps in logging the Last record processed date, Package start and End date with number of records processed, and number of records flown into the exception table which will help in getting the records from the Last Record processed date
  • Worked on database performance by creating temporary tables, stored procedures, Creating Indexes and Keys and normalization forms.

Programmer Analyst

Strategic IT Experts LLC
Ballwin, USA
11.2015 - 07.2016
  • Redesign of Clients application for Claims submission, Member Appeal and Provider Appeal
  • Used client-side scripts like JavaScript & J Query extensively to maintain appropriate balance between server side and client browser capabilities
  • Hands on experience of claims/enrollment data files in X12 format received through EDI
  • Knowledge of health care data including, ICD-9 and ICD-10, HIPPA 4010 and 5010
  • Optimized the performance of queries with modifications in T-SQL queries and eliminated redundant and inconsistent data used clustered index, non-cluster index and CTE
  • Strong knowledge in writing Stored Procedures and Functions for different tasks and created Triggers to maintain the data referential integrity
  • Worked on various salesforce.com standard objects like Accounts, Contacts, Cases, Opportunities, Products, Opportunity Line Items, Leads, Campaigns, Reports and Dashboards
  • Designed different types of reports including Tabular forms, Matrix (cross Tab report) form, Conditional, List items, Charts and Sub reports using SSRS
  • Created a utility using C# and Java Script which will take the ICD9 code as input and will convert that to ICD10 as a part of HIPAA upgrade which is crucial.

Education

M.S. in Engineering -

Wright State University
Dayton, Ohio, United States of America
07.2015

B. Tech. in Electronics & Communication Engineering -

JNTU
Hyderabad, India
05.2013

Skills

  • Azure Data Factory
  • Databricks
  • Scala
  • Synapse Analytics
  • Microsoft Dynamics 365 CRM
  • Power Automate
  • Python
  • SQL
  • C#
  • JavaScript
  • Java
  • Azure
  • GCP
  • Snowflake
  • MSSQL
  • MongoDB
  • Elastic Search
  • Blob storage
  • Amazon S3
  • Scrum
  • Git Lab
  • SVN
  • TFS/VSTS

Timeline

Lead Data Engineer

CAP Financial Partners LLC
03.2019 - Current

Azure Data Engineer

AIM Specialty Health
10.2017 - 03.2019

Data Engineer (T-SQL, SSIS, SSRS)

Quantum Health
05.2017 - 09.2017

SSIS ETL Developer

Quidel Corporation
10.2016 - 05.2017

Programmer Analyst

Strategic IT Experts LLC
11.2015 - 07.2016

M.S. in Engineering -

Wright State University

B. Tech. in Electronics & Communication Engineering -

JNTU

Similar Profiles

CREATE PROFILE
SANTHOSH MASIREDDY