SAI KRISHNA BITLING
Toronto,Canada
Summary
Detail-oriented Data Engineer designs, develops, and maintains highly scalable, secure, and reliable data structures. Accustomed to working closely with Data architects, software architects, and data analysts to understand business or industry requirements to develop comprehensive data models. Proficient at developing database architectural strategies, data analysis, data warehousing, business intelligence, and data visualization at the modeling, design, and implementation stages.
Overview
3
3
years of professional experience
Work History
Data Engineer
EA Sports Inc.
Toronto
12.2022 - 12.2023
- Designed and implemented a couple of aggregate tables called GDS tables which contain an aggregate of all the purchase data related to their customer behavior on the platform
- Implemented end-to-end data solutions using Snowflake, DBT, and Apache Airflow, ensuring efficient data processing, transformation, and scheduling
- Designed and maintained DBT models for dimensional modeling, enabling a streamlined analytics workflow and faster time-to-insight
- Automated data flow between the software systems using Apache Airflow by adding Configuration, and Dependencies in DAG based on project requirements
- Maintained ETL workflows using Apache Airflow, orchestrating data pipelines, and ensuring timely and reliable data delivery
- Implemented Sqitch operations (Deploy, Verify, Revert) to backfill the data into Snowflake
- Written Deploy script to backfill the data and Verify script to inspect the data for nulls, unique values, etc… Created and Integrated Airflow DAGs (Directed Acyclic Graphs) with DBT runs for seamless execution of data transformation jobs
- Conducted code reviews, provided mentorship to junior team members, and facilitated training sessions on best practices for PyCharm, SQL, DBT, Snowflake, and Airflow
- Implemented and maintained version control processes using Git, ensuring traceability and collaboration among team members
- Automated repetitive tasks using DBT Macros and JINJAs and improved development efficiency by creating custom scripts in SQL and workflows within PyCharm and Airflow
- Developed BI reports which include various drill-throughs, crosstabs, dashboards, master-detail, and summary reports using Tableau.
Associate Analyst
Global Logic Private Ltd
Hyderabad, India
01.2019 - 12.2020
- Collaborated with the data team to analyze and interpret raw data, contributing to actionable insights for business decision-making
- Conducted data cleaning, preprocessing, and validation tasks to ensure the accuracy and reliability of datasets
- Utilized SQL for querying databases and extracting relevant information for analysis
- Utilized Python and libraries like NumPy, pandas, matplotlib, and sci-kit-learn for data analysis and model development
- Created and maintained tables, views, complex PL/SQL procedures, functions, and packages and performed DML operations using insert, update, and delete statements
- Assisted in the development and maintenance of data visualizations and reports using tools such as Excel, Tableau, or Power BI
- Supported the implementation of data quality checks and data governance processes to maintain data integrity
- Presented findings and recommendations to the team, demonstrating the ability to communicate technical concepts to non-technical stakeholders
- Coordination with the QA team to develop testing strategy and test processes as per design specifications and the project's non-functional requirements.
- Developed strong communication and organizational skills through working on group projects.
Education
Post Graduate Diploma in Cloud Computing for Big Data - Data Management Technology
Lambton College
North York, CA09.2022
Skills
- Programming Languages: SQL, PL/SQL, Python
- ETL Tools/ Scheduling: DBT(Jinja’s, Macros, CLI cloud, Tests, seed), Airflow, Snowflake, Sqitch, Spark, AWS Glue, Azure Data Factory
- Visualization Tools: Tableau, Power BI
- Cloud Technologies: AZURE, AWS (EC2, S3, Lambda, Redshift, Glue, EMR)
- Automation/Scheduling: Jenkins, Docker, Kubernetes, Airflow
- IDE: Pycharm, Visual Studio, Eclipse, Jupyter
- DBMS: SnowSQL, Oracle, DB2, Teradata, SQL Server, PostgreSQL, CSV, JSON
- Version Controlling: BitBucket, Git, GitHub
- Agile: Jira, Rally
- Web Technologies: HTML, CSS, XML
Websites
Timeline
Data Engineer
EA Sports Inc.
12.2022 - 12.2023
Associate Analyst
Global Logic Private Ltd
01.2019 - 12.2020
Post Graduate Diploma in Cloud Computing for Big Data - Data Management Technology
Lambton College