PRIYADHARSHINI CHINNASAMY

• Involved in the high-level design of the Hadoop architecture for the existing data structure and Problem statement and setup the 64-node cluster and configuration of Hadoop platform
• Developed PySpark & Sqoop jobs to import data into HDFS from Oracle & other data sources
• Created Partitioned and Bucketed Hive tables in Parquet File Formats with Snappy compression and then loaded data into Parquet hive tables from Avro hive tables
• Developed Spark core and Spark SQL scripts using Python for faster data processing
• Used Sqoop to efficiently transfer data between databases and HDFS
• Involved in designing and developing tables in HBase and storing aggregated data from Hive Table
• Developed shell scripts for running Hive scripts
• Used Jira for bug tracking and GitHub to check-in and checkout code changes
• Worked on the core and Spark SQL modules of Spark extensively using Python
• Clean data as per business requirements by using user defined functions (UDF's) in Spark
• Experienced in collecting, aggregating, and moving large amounts of streaming data into HDFS using Kafka Orchestrated number of Sqoop and Hive scripts using control -M workflow and scheduled using Control-MOwn report development and modification for reports/dashboards considered of moderate complexity Conducted comprehensive performance testing to ensure system responsiveness and stability
• Summarized complex research results in clear and concise formats for easy understanding and decision making
• Environment: Hadoop, PySpark, Sqoop, Hive, Spark SQL, HBase, Jira, GitHub, Shell script, Python

• Performed import of data from RDBMS to Amazon S3 using Microsoft Azure and then importing to HDFS to process the huge amounts of Data
• Worked on Data Lake and Staging Area where data will be staged into AVRO file formats
• Worked on Scheduling the Jobs through Control -M scheduler
• Design, development, testing, troubleshooting and debugging of the application
• Assisting in integration testing, system testing, User Acceptance Test & implementation activities
• Implementing project plans within deadlines
• Involved in working on the Data Analysis, Data quality and Data Profiling for handling the business that helped the business team
• JSON Parsing integration Developed the modules and changes based on Client's requirements and production support
• Partner with stakeholders on the design, testing, implementation, and evaluation of business process change to improve business outcomes
• Environment: Hadoop, HDFS, Spark, Python, Hive, Sqoop, AWS S3, Control-M, Impala, CLOUDERA CDH.

Client: Adidas

• Collaborated in the BI HANA Migration, where the entire Data warehousing and reporting solution is being redeveloped using MicroStrategy to provide the users with a better performance
• Involved in gathering and documenting business requirements from end clients and translating them into report specifications for the MicroStrategy platform
• Worked closely with data modeling and ETL teams to develop the data model
• Created and established KPI’s based on BRD and logical data model
• Conceived and implemented MicroStrategy objects in reports and documents using MicroStrategy Desktop
• Used Advanced Prompts, Conditional, Transformation metrics and Level Metrics for creating complex reports
• Designed MicroStrategy Reports and dashboards of various complexities to enable sound decisions making
• Developed SQL Queries for Back-end testing/Database testing and performed end-to-end testing for MicroStrategy
• Environment: SAP HANA, MicroStrategy

CLIENT: CATALINA MARKETING CORPORATION:

• Interacted with the Database experts to understand the Source System and efficient translation of technical data to Business terms through self-developed design templates. Demonstrated expertise in customizing SQL query by setting VLDB properties at different levels of Database Instance, Report, and Metric.
• Created insightful reports and dashboards for users to slice the Data across various Hierarchies, facilitating complex decisions.
• Collaborated closely with ETL/DBA teams to troubleshoot data issues and enhance database performance; trained users on efficiently developing simple reports and visual insights through MicroStrategy Web.
• Worked with Business analysts to understand High Level/System requirements to transform business requirements into functional specifications in MicroStrategy and SAS.