TILAK BALLANI
Montreal,Canada
Summary
Big data professional with proven track record in developing and implementing high-performance data solutions. Expertise in creating scalable data pipelines and enhancing data processing frameworks. During my tenure at a Fortune 500 company, I consistently delivered innovative solutions that bridge the gap between business objectives and technological capabilities. Highly focused on team collaboration and delivering impactful results, showcasing adaptability and reliability in dynamic environments.
Overview
5
5
years of professional experience
Work History
Big Data Developer
National Bank of Canada
08.2024 - Current
- Engineered scalable batch data pipelines in Python, SQL, and Spark (PySpark/Scala) to process 3TB+ of daily financial and operational data, boosting reporting accuracy and reducing latency in business insights.
- Optimized distributed data workflows using advanced algorithms and data structures, cutting runtime by 30% and enabling more efficient large-scale data processing.
- Accelerated Spark-based pipelines from 8 hours to 2 hours by tuning partitioning, caching, and execution strategies, supporting near real-time analytics for high-volume datasets.
- Designed and optimized complex SQL schemas and queries for datasets with 100M+ rows, achieving 40% faster query performance and enhancing analytical capabilities.
- Containerized and deployed data applications on Kubernetes, improving deployment reliability and reducing environment setup by 60%, while supporting scalable execution.
- Integrated heterogeneous data sources (RDBMS, APIs, logs) into unified pipelines, cutting reconciliation efforts by 25% and strengthening data consistency across systems.
- Collaborated with cross-functional teams (frontend, backend, QA, DevOps) in agile delivery cycles, performing code reviews, knowledge sharing, and open-source library exploration to ensure production-grade solutions.
- Delivered multiple concurrent big data projects ahead of deadlines, balancing independence with collaboration, while maintaining high-quality, production-ready code.
Data Analyst
Wipro Technologies
01.2021 - 01.2023
- Designed and maintained ETL pipelines in Python, dbt, and SQL to integrate high-volume transactional data from multiple banking systems into scalable data platforms.
- Built real-time ingestion pipelines with Apache Kafka, streaming financial transactions into compliance and risk monitoring models.
- Streamlined data workflows with Python and PySpark, automating large-scale reporting processes and improving operational efficiency.
- Developed Spark batch jobs in Scala to process hundreds of millions of rows of historical financial data, ensuring reliability and scalability of analytics workloads.
- Implemented data validation frameworks in Python to detect anomalies in payroll, accounts receivable/payable, and general ledger entries before posting.
- Orchestrated batch pipelines on Kubernetes, combining Spark and dbt transformations to support finance month-end closing processes.
- Established a centralized data catalog for metadata management across Azure services (Cosmos DB, Data Lake), strengthening governance and data discoverability.
- Automated daily ingestion of data from legacy systems into cloud data lakes, modernizing storage and access for downstream analytics.
- Leveraged Azure Databricks for real-time analytics, enabling streaming data processing from IoT devices and web applications.
- Built ETL workflows with SSIS and Databricks, integrating diverse data sources into SQL Server while improving processing consistency and speed.
Education
Master of Engineering - Information System Security
Concordia University
Bachelor of Engineering - Computer Science
JNTU University
Skills
- Cloud Stack: Azure Data Bricks, Spark, Apache Kafka, Azure Data Factory, DBT, AWS EMR, AWS S3
- Programming languages: Python, Scala, SQL, PySpark, Terraform
- Databases: Azure SQL Database, MySQL, MSSQL, PostgreSQL
- Reporting tools: Informatica, Power BI, MS Excel
- Scripting Languages: Unix Shell Scripting
- CI/CD Tools: Docker, Kubernetes, Jenkins, Jira, GitHub
- Source control: Git, GitHub Actions
Languages
English
Full Professional
French
Elementary
Timeline
Big Data Developer
National Bank of Canada
08.2024 - Current
Data Analyst
Wipro Technologies
01.2021 - 01.2023
Bachelor of Engineering - Computer Science
JNTU University
Master of Engineering - Information System Security
Concordia University
Similar Profiles
Fei PeiFei Pei
Senior Banking Advisor at National Bank of CanadaSenior Banking Advisor at National Bank of Canada
Deffo Yves-DenisDeffo Yves-Denis
Senior Solution Designer at National Bank of CanadaSenior Solution Designer at National Bank of Canada
Cheikh Abdou Khadir SeyeCheikh Abdou Khadir Seye
Senior Manager, Advanced Analytics at National Bank of CanadaSenior Manager, Advanced Analytics at National Bank of Canada
Joelle LetourneauJoelle Letourneau
Key Account Manager, Healthcare Institutions at AbbottKey Account Manager, Healthcare Institutions at Abbott
Paul AkinwunmiPaul Akinwunmi
Founder & Business Lead at ShammaFounder & Business Lead at Shamma