Summary
Overview
Work History
Education
Skills
Certification
Accomplishments
Work Preference
Timeline
Hi, I’m

Naveen Puttalingaiah

Halifax,NS
Naveen Puttalingaiah

Summary

With over 15 years of expertise in Data Engineering and diverse Java technologies, an accomplished, self-motivated, and results-oriented cloud data engineer brings energy and proficiency in Big Data technologies, specializing in Python, Spark, Scala, Java, AWS, and Azure Cloud implementations. Substantial hands-on experience includes constructing scalable data infrastructure using Big Data platforms, navigating the Hadoop ecosystem, engaging in Java/J2EE web development frameworks, and handling various software engineering tasks. Skill set spans multiple niches.

Overview

15
years of professional experience
4

Certifications

Work History

Syntel Canada Inc
Halifax, NS

Senior Data Engineer
10.2022 - 02.2024

Job overview

  • Collaborated with cross-functional teams to define requirements and develop end-to-end solutions for complex data engineering projects.
  • Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.
  • Evaluated emerging technologies and tools to identify opportunities for enhancing existing systems or creating new ones.
  • Mentored junior team members in best practices for software development, code optimization, and troubleshooting techniques.
  • Participated in strategic planning sessions with stakeholders to assess business needs related to data engineering initiatives.
  • Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
  • Leveraged Azure services to conduct ad-hoc analyses on diverse capabilities within the Azure platform. I collaborated closely with both the Microsoft support and Humana CloudOps teams.
  • Enhance Data Ingestion and transformation efficiency while minimizing costs by transitioning from conventional data file processing to implementing CDC with Databricks and PySpark. This approach not only boosts performance but also streamlines the process of capturing incremental changes in data, leading to optimized resource
    utilization and reduced expenses.
  • Client: Humana

NTT Data Canada Inc

Senior Data Engineer
10.2016 - 10.2022

Job overview

  • Created a data ingestion framework in AWS, Hadoop Ecosystem, employing Spark, Python, Scala, HBase, Hive, HDFS, Airflow, SCDF and Big Data Technologies. This framework is designed to handle substantial data volumes (ranging from 10 GB to 50 GB , manage PHI and PII, accommodate Schema Evolution, Data Lineage, and perform Data Cleansing using Amazon Deequ. Notably, it is platform-agnostic and features an automated deployment process through Git Actions. The framework supports both batch data and streaming data pipeline development.
  • Crafted multiple solutions for managing prevalent file systems, including JSON, AVRO, Parquet, CSV, and Mainframe data, utilizing Hadoop Ecosystem, Azure Cloud Services such as Azure Data Factory and Azure Databricks
  • Infrastructure: Established and upheld HDInsight clusters through Ambari, managed SFTP, and set up Azure Databricks clusters using ARM templates Oversaw the entire process of creation and maintenance, including customization of Dremio open-source code.
  • Enabled Infrastructure as a Service IAAS , Platform as a Service PAAS , and Software as a Service SAAS Managed and Monitor the cloud ecosystem using Ambari.
  • Engaged in the development of the NTT Data Nucleus Intelligent Enterprise platform for Healthcare, contributing to the creation of a smart automation engine that powers analytics and processes crucial for operational efficiency This involvement supports the advancement of an intelligent enterprise
  • Developed an automation script/program designed to read the Data Mapping Document and transform it into an HiveQL script, resulting in a remarkable 90% reduction in effort
  • Worked on projects involving the migration from on-premises to cloud
  • Performed and presented Proof of Concepts POCs) on demand
  • Engaged in the development of APIs using Java to consume service bus messages and process data using PySpark
  • Collaborated with Architects, Directors, and Clients on documentation, including the preparation of work estimations
  • We engage in Data Analytics Practice, collaborating with numerous clients on an on- demand basis
  • Consumed data from Quandl, YouTube, Facebook..
  • Thru API's
  • Clients: BCBS, CSMI, HYG
  • In-House: SQA, Global Insurance Digital platform (GIDP), IDS, NTT Nucleus, Panorama.

NTT Data GDS Pvt Ltd

Senior Software Engineer
03.2010 - 10.2016

Job overview

  • Contributed to numerous software development and API projects utilizing Java, the Spring Framework, and Groovy/Grails, working with various RDMS and NoSQL databases.
  • Software Quality Assurance (SQA): is a practice that functions as an initial customer, participating in all project activities to ensure the deliverables meet a standard of quality suitable for customer delivery
  • Mentored junior developers, fostering professional growth and enhancing team productivity.
  • Championed best coding practices within the team to improve overall code quality and maintainability.
  • Developed scalable applications using agile methodologies for timely project delivery.
  • Managed multiple projects simultaneously while maintaining strict deadlines and high-quality standards.
  • Identifying, analyzing, and resolving infrastructure vulnerabilities and application deployment issues
  • Led the team and provided guidance for the successful completion of tasks within an
  • Onshore-Offshore model
  • Clients: Wells Fargo, Kiln Insurance, Choice Hotels, TIAA.

Celestial V Solutions

Software Engineer
04.2008 - 02.2010

Job overview

  • Consistently met project deadlines by effectively managing time and prioritizing tasks according to importance.
  • Analyzed proposed technical solutions based on customer requirements.
  • Engaged in resolving bugs and maintaining applications.
  • Delivered high-quality applications by leveraging a static code analysis tool (SONAR)

NbitOn Solutions Pvt Ltd

Software Engineer
08.2007 - 04.2008

Job overview

  • Participated in the development of a Bulletin Board application with senior team members, designed to facilitate communication among employees within the company as part of a training program
  • Analyzed code defects and failures and presented code refactors and design fixes.
  • Delivered completed products within project deadline.
  • Participated in the testing of applications.

Indian Institute of Science (IISc)

Intern
02.2006 - 09.2006

Job overview

  • During my internship in the SERC division, I focused on the IEEE 802.16 MAC protocol
  • My task included analyzing how the system's performance is influenced by collisions of bandwidth request messages during uplink transmission
  • This directly affects uplink access delay, uplink throughput, and the size of the contention period in the uplink sub-frame
  • Supported staff members in their daily tasks, reducing workload burden and allowing for increased focus on higher-priority assignments.
  • Submitted our observations both pre and post-implementation, employing the C language for this task.
  • Gained valuable experience working within a specific industry, applying learned concepts directly into relevant work situations.

Education

Visvesvaraya Technological University
Karnataka, India

Master from Computer Application
06.2006

Skills

  • ETL/ELT development
  • Git Version Control
  • Spark Development
  • Big Data Processing
  • Python Programming
  • PySpark Programming
  • Scala Programming
  • SQL Programming
  • Java programming
  • Batch and Stream Processing
  • Data Lake Management
  • Delta Lake
  • Data Warehousing
  • RDBMS/NoSQL Databases
  • Data Pipeline Design and Development
  • API Development
  • Hadoop Ecosystem
  • Spring Framework
  • Object-Oriented Programming
  • Microservices Architecture
  • Performance Tuning
  • Data Quality Assurance
  • Data Migration
  • Technology leadership work streams
  • Backup and recovery
  • Large dataset management
  • Multitasking Abilities
  • Teamwork and Collaboration
  • Problem-Solving
  • Time Management
  • Adaptability and Flexibility
  • Apache Airflow
  • Code reviews
  • Agile Methodology
  • Amazon Web Services (AWS)
  • Docker Containers and Kubernetes
  • Test-driven development (TDD)
  • ETL/ELT processes
  • Cluster Management (Ambari)
  • Azure HDInsight
  • Azure Databricks
  • Linux Operating System

Certification

  • Microsoft Certified Azure Data Fundamentals
  • Microsoft Certified Azure Fundamentals
  • Skillsoft Certified ITIL 4 Foundation: Introduction
  • LinkedIn Certified Python Programming

Accomplishments

  • I was acknowledged for effectively delivering the application to a new client within the scope of a pilot project, thereby gaining their trust throughout the process.
  • I was honored with this award for developing an automated application that impressed the client by effectively overseeing defects, extracting all issues, and presenting them in an Excel sheet for easy accessibility.

Work Preference

Work Type

Full TimeContract Work

Location Preference

RemoteHybridOn-Site

Important To Me

Work-life balanceCareer advancement

Timeline

Senior Data Engineer

Syntel Canada Inc
10.2022 - 02.2024

Senior Data Engineer

NTT Data Canada Inc
10.2016 - 10.2022

Senior Software Engineer

NTT Data GDS Pvt Ltd
03.2010 - 10.2016

Software Engineer

Celestial V Solutions
04.2008 - 02.2010

Software Engineer

NbitOn Solutions Pvt Ltd
08.2007 - 04.2008

Intern

Indian Institute of Science (IISc)
02.2006 - 09.2006

Visvesvaraya Technological University

Master from Computer Application

Similar Profiles

CREATE PROFILE
Naveen Puttalingaiah