Bhuvaneshwari Maturi

Developed and refined the Spark process for ODS (Operations Data Store) by making changes and enhanced the performance of the data ingestion from raw and refined to publishing Postgres data to the core script using Python and PySpark.
Developed complex SQL queries for querying data against different data bases for data verification process.
Prepared the Test Plan and Testing Strategies for Data Warehousing Application
Developed ETL test scripts based on technical specifications/Data design documents and Sources to Target mappings.
Extensively interacted with developers, business& management teams to understand the OPM project business requirements and ETL design document specifications.
Participated in regular project status meetings and QA status meetings.
Extensively used and developed SQL scripts/queries in backend testing of Databases.

Validating data fields from the refined zone to ensure the integrity of the published table.
Converting ingested data (csv, XML, Json) to parquet le format in compressed form.
Created business models from business cases and enterprise architecture requirements for process
monitoring, improvement, and reporting and led the team in business intelligence solutions development
Experience in performing transformations and actions on RDD, Data frames, Data sets using Apache spark.
Good Knowledge of Spark and Hadoop Architecture and experience in using PySpark for data processing.
Applied advanced DW techniques and Informatica best practices to load a Financial, HR & Supply Management Data Warehouse, Data Marts, and Downstream Systems.
Developed several complex Informatica mappings, Mapplets, stored procedures, and reusable objects
to implement the business logic and to load the data incrementally.
Design, develop, and test Informatica mappings, workflows, work lets, reusable objects, SQL queries,
and Shell scripts to implement complex business rules.
Developed Gsutil scripts for compression with Gzip, backup, and transfer to edge node with all necessary file operational requirements for BQ load jobs.
Worked on data that was a combination of unstructured and structured data from multiple sources and automated the cleaning using Python scripts.
Congregated data from multiple sources and performed resampling to handle the issue of imbalanced data.
Coded in PostgreSQL to publish 10 million records from more than 90 tables to ensure the integrity of data ow in real-time.
Providing a single environment for data integration and data federation with role-based tools that share common metadata using Informatica data virtualization.
Understanding ETL requirement specifications to develop HLD & LLD for type-1, SCD Type-II, and Type-III mappings and was involved in testing for various data/reports.
Experienced as Senior ETL Developer (Hadoop ETL/ Teradata /Vertica / Informatica / DataStage/Mainframe), Subject Matter Expertise (SME), Production Support Analyst, QA Test.
Extensively worked on TFS (Microsoft) as a tool to deploy production-level code in part with Git.
Constructed robust, high-volume data pipelines and architecture to prepare data for analysis by the client.
Architected complete, scalable data warehouse and ETL pipelines to ingest and process millions of rows daily from 30+ data sources, allowing powerful insights and driving daily business decisions.
Implemented optimization techniques for data retrieval, storage, and data transfer.
Creating test cases for ETL mappings and design documents for production support Setting up, monitoring, and using a Job Control System in Development/QA/Prod
Extensively worked with flat files and Excel sheets of data sources. Wrote scripts to test the flat flies data in the databases,Scheduling and automating jobs to be run in a batch process.

Environment: Informatica Power Center 10.4, Snowflake, Spark 2.4, H Base 1.2, Tableau 10, Power BI, Python 2.7 and 3.4, Scala, PySpark, HDFS, Flume 1.6, Hive, Zeppelin, PostgreSQL, MySQL, TFS, Linux, Spark SQL,Kafka, NIFI, Sqoop 1.46, AWS (S3).

Business Requirements review with the client, worked with the Business Analysts to iron out the gaps in the business requirements, and provided advice on any application improvements or caveats. Wrote SnowSQL, Stored Procedures, and designed snowflake tables (Temporary, Transient, Permanent)
Working with Snowflake objects- Warehouses, Roles, Databases, Schemas, Tables, Views, Constraints and Snowflake Table Clustering Keys.
Work with Snowpipe to enable automatic loading of data from les including semi-structured data types such as JSON, Avro, and Parquet.
Work with Snowflake-Streams, Time Travel, Copy statements, Validate and validate pipe load statements.
Requirement Analysis: Analyzed the requirements, to validate the assumptions about the application architecture against the actual application architecture based on Code and Data Analysis, and update business of any discrepancies. Identify the re-usability of the existing application modules that might satisfy the requirements and suggest any alternative approaches to reduce work effort.
Design - Technical Design Creation: Created comprehensive TDD (Technical Design Documents), clearly documented assumptions, with technical ow and physical Data modeling - designed table structures, indexes, sequences, constraints, triggers, other database objects, Modularized design with technical functionality with Package/Procedure design with parameters, designed application-level exception handling strategy which is followed as a standard, clearly defined the functionality of the Unix scripting,ETL functionality, Autosys Scheduler.
Development - Developed and lead end-to-end solutions in integrating various technologies into the application for the respective project using ETL DataStage jobs, sequencers, mappings, transformations,

UDFs, re-usable components, command tasks, Oracle PL/SQL Programming and writing Stored procedures in Microsoft SQL Server DB.
Migrated DataStage 8.5 Jobs to DataStage 11.5 as part of ITA App project.
Migrated DataStage 11.5 Jobs to DataStage 11.7as part of ETL Migration project.
Migrate on-premise databases (MySQL, SQL Server, Oracle, Netezza) to Staging schemas of Snowflake.
Developed DataStage Jobs, Unix Scripts (including sed, awk), PL/SQL, and SQL Performance Tuning.
Created Code Review Standards for UNIX Scripting, SQL, and PL/SQL.
Performed Code reviews - to identify missed requirements, check on coding standards, exception
handling, cover all scenarios, scheduling, performance issues, and other application impacts.
QA Support & Production Support - Root Cause Analysis on the issues reported, code changes/fixes,
impact analysis, work around until code changes.
Environment: ETL- IBM Infosphere DataStage V 8.5, 11.5, 11.7, Oracle 12C (SQL, PLSQL), Unix Shell Scripting,Snowflake Cloud DB 5.8.2, SnowSQL, MS SQL Server 2012, IICS Cloud ETL, AWS Cloud- SQS, EC2, S3,Redshift, RDS, Autosys, Microsoft Azure