Kamala Venkat Rathnam
Kitchener,ON
Summary
Cloudera and AWS certified Senior Big Data/Java Solution Architect/Engineer with 15+ years of experience in the design, development, and delivery of large systems involving petabytes of storage and terabytes of RAM.
Hands-on experience in Java, Spark, Big Data, Java, SQL, performance tuning, containers, Kafka, and Airflow.
Hands-on experience in building clusters using various platforms.
Demonstrated ability in building reusable components while achieving business objectives within restrictive timelines to drive more value to the enterprise.
Enabled and empowered application teams through innovative, hands-on labs to accelerate the use of products/services we built, or to onboard technical initiatives.
Skilled in developing custom software and managing migrations, consistently ensuring compliance with security policies and achieving project milestones within SLA limits.
Results-driven Solutions Architect, known for productivity and efficiency in task completion. Possess deep knowledge in business analysis, strategic planning, and customer relationship management. Excel in communication, problem-solving, and adaptability, ensuring seamless integration of solutions into client operations. Dynamic professional with extensive experience in big data solutions and customer collaboration. Skilled in developing custom software and managing migrations, consistently ensuring compliance with security policies and achieving project milestones within SLA limits.
Overview
15
15
years of professional experience
2
2
Certifications
Work History
Senior Solutions Consultant
Cloudera Inc. Canada
Kitchener, Ontario
02.2022 - Current
- Collaborated with customers to understand their requirements, and recommended solutions leveraging various Cloudera platform features.
- Developed and maintained the trust of the customers to extend projects across multiple platforms.
- Collaborated with critical application teams on the customer side to ensure a safe migration and upgrade process within the SLA limits.
- Developed custom software solutions to meet customer requirements.
- Provided clear and fast communication to the customers when a product bug is encountered, by collaborating with the respective engineering teams.
- Demonstrated strong post-implementation support activities with customers.
- Configured components according to customer requirements, while ensuring compliance with security policies.
- Developed requirements new system installations.
- Resolved customer issues by establishing workarounds and solutions to debug and create defect fixes.
Senior Data Engineer
Cognizant Technology Solutions
12.2015 - 01.2022
- Built engineering pipelines to assist , migrate Teradata queries to Enterprise Data Lake based on business requirements using Spark framework. The pipeline was scheduled using Airflow.
- Built an Ingestion Framework to to ingest data from heterogeneous sources into Enterprise Data Lake. The framework was scheduled using Oozie.
- Built Apache Spark based pipeline for implementation of use cases that helped business to maintain and enhance customer portfolio.
- Collaborated with business analysts to gather business requirements and designed functional
and technical requirements documentation - Managed performance monitoring and tuning while identifying and repairing issues within Enterprise Data Lake.
- Developed multiple POCs to prove products' viability within the organization
- Administered Client's 200+ node cluster from setting up development cluster to perform major upgrades to the production cluster
- Implemented the clusters' security framework - Kerberos along with Knox and Ranger policies.
- Helped build strategy and execute migration of Client's application to the new Hadoop cluster.
Data Engineer
Cognizant Technology Solutions
Chennai, Tamil Nadu
06.2014 - 12.2015
- Administered client's 40+ node cluster
- Integrated AppDynamics with the Enterprise Data Lake to generate reports on cluster's health.
- Implementation of Ranger policies on the UAT environment.
- Developed extensions on the AppDynamics based on the Client's requirement.
- Assisted business team in the research phase of tools before being deployed to the clusters
Data Engineer
Infosys Limited
Chennai, Tamil Nadu
11.2010 - 06.2014
- Built a data backup framework in Java to move data from Amazon S3 to Glacier.
- The framework was scheduled using Oozie.
- Built cluster in AWS and managed the clusters by adding nodes as per the client's requirement.
- Troubleshoot and identify current issues and provide effective solutions.
Education
Master Of Technology (MTech) - Information Technology
Sathyabama University
Chennai, India05-2015
Bachelor Of Technology (BTech) - Information Technology
Anna University
Chennai, India05-2010
Skills
- Java 8/11, Scala, Shell Scripting
- Hadoop stack - Hadoop, YARN, Hive, Sqoop, Spark,MapReduce, Knox, Apache Ranger,Nifi, Kerberos
- Schedulers - Oozie, Airflow
- Build Tool - Maven
- Version Control - Git
- Jupyter Notebook
- Cloud - AWS, Azure
- Deployment tool - Jenkins
- Performance Tuning, Query Tuning
- Customer engagement
- Problem solving
- Effective communication
- Team collaboration
- Requirements gathering
- Sales support
- Enterprise architecture design
- ETL (extract, transform, load) design
- Big data solutions
- Evaluate user requirements
- Decision-making
- Continuous improvement
- Analytical skills
- Software customizations
- Solution architecture
Certification
Cloudera Certified Developer for Apache Hadoop (CCDH)
Accomplishments
- Published an IEEE paper on Big Data - https://ieeexplore.ieee.org/abstract/document/7259464
Timeline
Senior Solutions Consultant
Cloudera Inc. Canada
02.2022 - Current
Senior Data Engineer
Cognizant Technology Solutions
12.2015 - 01.2022
Data Engineer
Cognizant Technology Solutions
06.2014 - 12.2015
Data Engineer
Infosys Limited
11.2010 - 06.2014
Master Of Technology (MTech) - Information Technology
Sathyabama University
Bachelor Of Technology (BTech) - Information Technology
Anna University