Karthik Thirukonda
Toronto,Canada
Summary
Accomplished Staff Data Engineer at Lookout Inc, adept in Spark, Scala, Python & SQL, with a proven track record of developing high-performance data pipelines and enhancing user experiences. Demonstrated leadership in migrating complex systems and optimizing data processing, showcasing both technical expertise and collaborative skills in fast-paced environments.
Overview
21
21
years of professional experience
1
1
Certification
Work History
Staff Data Engineer
Lookout Inc
03.2022 - Current
- Developed various high-performance data pipelines that enhanced processing efficiency and replaced legacy processes and pipelines, enabling the company's product dashboard to deliver real-time insights and improved user experience.
- Spearheaded the development of a cutting-edge AI assistant backend service, enhancing our company's product with advanced capabilities and seamless user interactions
- Built and deployed data pipelines for Android Apps & Signer Popularity backend service in a multi-cloud environment, with data pipelines running on AWS and the backend service on GCP, seamlessly integrating data into a MySQL table for optimized performance.
Senior Data Engineer
Scribd Inc
10.2020 - 03.2022
- Designed and implemented data pipelines to analyze millions of PDF documents for spam detection in Slideshare, enhancing the company's ability to efficiently remove spam content and improve Google indexing.
- Architected the migration of SlideShare's data analytics pipelines from AWS EMR to Scribd's Databricks platform, streamlining operations by consolidating technologies into a single, unified platform.
Senior Data Engineering Consultant
Bank Of Montreal
03.2014 - 10.2020
- Developed a new AML/Fraud Detection platform on AWS EMR Cluster using Spark, Scala, Hive, and Kafka to modernize and upgrade the bank's aging fraud detection system, improving performance and scalability.
- Implemented parallel processing techniques and developed wrapper scripts to optimize data processing efficiency. Led the end-to-end software lifecycle, including system and user acceptance testing (UAT), and conducted client inspections to ensure seamless deployment and functionality.
Senior Associate
Cognizant Technology Solutions
03.2013 - 03.2014
- Led and managed a team of 12 supporting Pharmacy Contracts Data Migration
Software Engineer
Tata Consultancy Services
09.2004 - 03.2013
- Application developer – Handled requirement analysis, design, development, testing and implementation.
Education
Bachelor of Technology - Electronics Engineering
Madras Institute of Technology
Chennai, India04.2004
Skills
- Spark
- Scala
- Python
- SQL
- DBT
- Kafka
- Databricks
- Airflow
- Terraform
- AWS (EMR, Kinesis, Athena, Glue, DynamoDB),
- GCP (Dataproc, BigQuery, GKE, Cloud SQL)
Certification
AWS Certified Analytics Specialty, Amazon
Timeline
Staff Data Engineer
Lookout Inc
03.2022 - Current
Senior Data Engineer
Scribd Inc
10.2020 - 03.2022
Senior Data Engineering Consultant
Bank Of Montreal
03.2014 - 10.2020
Senior Associate
Cognizant Technology Solutions
03.2013 - 03.2014
Software Engineer
Tata Consultancy Services
09.2004 - 03.2013
Bachelor of Technology - Electronics Engineering
Madras Institute of Technology
Similar Profiles
Priyadarshini GurunathPriyadarshini Gurunath
Senior IT Systems Engineer at LOOKOUT INCSenior IT Systems Engineer at LOOKOUT INC
Narendranath AleNarendranath Ale
Sr Technical Account Manager at Lookout IncSr Technical Account Manager at Lookout Inc
PRADEEP VASUPRADEEP VASU
Director of Product Management at Lookout IncDirector of Product Management at Lookout Inc