Ramakrishna
Edmonton,AB
Summary
5 Years Experienced BI Engineer proficient in Azure cloud services, specializing in data engineering and analytics, with a strong track record of developing scalable BI solutions. Writing complex Data Analysis Expressions (DAX) formulas to create custom calculations, measures, and Key Performance Indicators (KPIs) in Power BI. Creating and maintaining SSIS packages to extract, transform, and load data from various sources into target systems, ensuring data integrity and accuracy. Implementing and managing attribute relationships and hierarchies in SSAS dimensions, defining the relationships and hierarchies between attributes for accurate data analysis. Implement data masking and anonymization techniques in Snowflake to protect sensitive data while maintaining data usability for analysis and reporting. Leveraged data transformation and enrichment techniques for enhanced data analysis and reporting. Developing and maintaining documentation for Power BI solutions, including data source mappings, report specifications, and user guides. Collaborating with data scientists to develop cross-selling and upselling models. Collaborated with stakeholders to define data quality requirements and standards aligned with business objectives. Articulating a deep understanding of Azure Data Factory's integration with Azure Data Lake Storage and Azure SQL Database, enabling seamless data movement and storage. Integrating Databricks with other Azure services such as Azure Storage, Azure Event Hubs, Azure SQL Database, and Azure Synapse Analytics to build end-to-end data processing and analytics pipelines. Implement Redshift audit logging feature to track user activity and changes to database objects. Automating data engineering workflows using Azure Data Factory or other automation tools, streamlining processes and boosting productivity. Utilized ensemble learning techniques such as stacking and blending to combine predictions from multiple base learners, improving overall model performance during data analysis. Diligently monitoring SSRS report usage and performance metrics, adeptly identifying opportunities for enhancing reporting efficiency and effectiveness. Integrate BigQuery with other Google Cloud services like Cloud Storage and Data Studio. Evaluate and recommend new features and enhancements for AWS Glue, staying abreast of the latest developments and best practices in data engineering to optimize data processing workflows. Implemented SQL server change data capture for capturing and tracking data changes in real-time.
Overview
5
5
years of professional experience
1
1
Certification
Work History
Azure and BI Engineer
Dye Durham
05.2023 - Current
- Create and maintain stored procedures, triggers, and functions for streamlined and reliable database operations
- Conducting user training and providing support to help users effectively navigate and utilize Power BI reports and dashboards
- Collaborated with data governance teams to establish and enforce data quality standards and data governance policies
- Experience with time series forecasting techniques for predicting future trends and patterns in temporal data, enabling proactive decision-making during data analysis
- Utilizing Azure Data Bricks MLflow for tracking and managing machine learning experiments
- Employed Git stash to temporarily save changes that are not ready for a commit
- Implement data replication and synchronization processes in Redshift
- Configuring key rotation coordination with cloud hardware security modules (HSMs) to enhance the security of cryptographic keys in Azure Synapse
- Implemented Blob Storage versioning with time-based retention for data governance
- Implement data lineage and impact analysis features in QlikView, enabling users to trace the origins of data and understand its impact on business processes
- Utilized Python's os and shutil modules for file and directory operations
- Implement BigQuery support for JSON and nested data structures for handling semi-structured data, enabling flexible data processing
- Design and implement data streaming solutions on AWS Glue, enabling real-time processing and analysis of streaming data
- Designing and implementing custom stored procedures and UDFs (User-Defined Functions) in Azure Cosmos DB for complex data processing
- Monitoring and troubleshooting data integration processes to identify and resolve issues that may impact Power BI data availability or accuracy
- Expertly managing key import and export operations within Azure Key Vault, enabling seamless key migration and secure data backups, crucial for maintaining data integrity and availability
- Developed and maintained BI system backup and recovery procedures to safeguard against data loss
- Applying agile methodologies like Scrum or Kanban within Azure DevOps to manage work items effectively
- Instituting and ensuring compliance with data privacy and data protection regulations within Azure Data Lake, maintaining data security and privacy standards
- Implementing Power BI's integration with Azure DevOps for version control and collaborative development
- Building custom data prediction models for Plotly visualizations involves creating models to predict future values based on historical data and visualize the predictions
- Collaborating seamlessly with end-users to deliver comprehensive training and exceptional support on report generation and usage in Azure Data Factory
- Utilizing Azure Purview's AI-powered recommendations to streamline data asset approval and certification processes
- Implement Snowflake data lineage documentation for tracking the flow of data
- Collaborated with developers to optimize SQL queries within application code and improve overall system performance
- Developed and maintained scalable data ingestion pipelines using tools like Apache Nifi or StreamSets.
BI Reporting Engineer
Brightlight Pictures
02.2022 - 05.2023
- Configuring and managing data lake integration with Azure Logic Apps, automating workflows and seamless data integration
- Configured Git hooks with the no-edit option to skip the interactive editor when editing hook scripts
- Developed data tokenization tools, safeguarding sensitive data by replacing it with unique tokens for secure data handling
- Conducting performance testing and optimization of OLAP and OLTP systems to ensure they meet scalability and responsiveness goals
- Knowledge of optimization algorithms such as gradient descent, stochastic gradient descent, and Adam optimization for training machine learning models, optimizing model parameters in data analysis
- Utilizing Power BI's composite models to combine direct query and imported data sources for enhanced performance
- Creating and managing data connections in QlikView involves setting up and managing connections to various data sources to ensure data is available for analysis
- Implementing and meticulously managing data replication and synchronization processes, harmonizing data consistency across various data sources in Azure Data Factory
- Implemented SQL server database security auditing to monitor user access
- Configuring and managing data retention policies for compliance with data retention regulations
- Designing and implementing deployment strategies for serverless applications and functions using Azure DevOps, enabling efficient serverless deployments
- Configured Blob Storage CORS rules to enable cross-origin requests from specific domains
- Develop and maintain Redshift external tables for querying data stored in Amazon S3
- Optimizing Plotly visualizations for mobile devices involves designing visualizations that are responsive and user-friendly on mobile devices, ensuring that users can interact with the data effectively
- Creating interactive Power BI dashboards and reports that provide real-time data visualization
- Manage AWS Glue job dependencies and sequencing for complex data processing workflows, ensuring jobs are executed in the correct order to meet business requirements
- Developing data visualizations and dashboards with Python-based tools such as Matplotlib, Seaborn, and Bokeh
- Implementing advanced splitting and recombination techniques for encryption keys in Azure Synapse to further safeguard sensitive information
- Configuring and managing Azure Databricks integration with data visualization and reporting tools, presenting data insights effectively
- Implement Snowflake data validation checks to ensure data integrity and quality
- Skillfully configuring and managing package parameters and expressions to instill SSIS packages with unmatched adaptability and configurability during execution
- Developing and maintaining data lineage tracking and documentation systems
- Develop and maintain data governance policies and procedures for BigQuery datasets
- Collaborating with Azure Purview's data stewards to verify and validate the accuracy of metadata annotations
- Devising and executing exemplary package control flow structures, employing expertly crafted loops and conditional branching to masterfully steer package execution
- Developed and maintained data governance governance frameworks to ensure data governance governance frameworks sustainability and scalability
- Meticulously curating comprehensive SSIS package documentation, encompassing intricate design specifications and meticulous data mappings for unmatched clarity
- Developing custom connectors and data connectors in Power BI to connect to unique data sources.
BI Developer
Canara Bank
05.2020 - 01.2022
- Performance tuning and optimization of database queries and procedures to improve overall system performance
- Implemented data caching and data compression techniques for efficient data processing
- Utilizing Power BI's integration with Microsoft Planner for task and project tracking
- Utilizing Azure Cosmos DB, Microsoft's globally distributed NoSQL database service, to achieve low-latency data access and seamless scalability
- This facilitates global application deployment and high-performance data retrieval
- Implemented data access logging and monitoring mechanisms to track data usage and access patterns
- Conducted data analysis on streaming data using real-time processing frameworks like Apache Kafka or Flink, enabling timely insights and responses during data analysis
- Experience with predictive modeling techniques such as decision trees, random forests, and gradient boosting for building and deploying predictive models during data analysis
- Utilized Python's concurrent.futures.ProcessPoolExecutor for multiprocessing
- Designed and implemented data governance governance frameworks to establish data governance governance frameworks accountability and transparency
- Conducted database schema evolution to accommodate changing business needs and application requirements as a DBA
- Utilizing Azure Event Grid, a fully managed event routing service, to enable real-time event processing and event-driven architectures within Azure applications
- Managing and maintaining database servers and infrastructure components to ensure a stable data environment
- Designing and implementing parent-child hierarchies and ragged hierarchies in SSAS dimensions, defining hierarchical structures for flexible and recursive analysis
- Developing and maintaining SSIS package templates or frameworks to promote standardized practices across projects or teams
- Conducting data validation and reconciliation activities to ensure the accuracy and consistency of data between different data sources and Power BI reports
- Ensure data security by implementing encryption measures within SSIS packages to protect sensitive data
- Develop custom visuals and extensions for Power BI reports and dashboards
- Designed and executed SQL scripts for database backup and recovery testing to verify data integrity and restore procedures
- Skillfully managing report subscriptions with dynamic report parameters in SSRS, dynamically adjusting parameters based on specified conditions for personalized report delivery
- Designed and developed data visualization solutions for executive-level dashboards and scorecards.
Database and BI Engineer
Bajaj Group
04.2019 - 05.2020
- Enabling dynamic data filtering by designing and implementing report filters and data-driven filtering in SSRS, empowering users to filter report data based on specific criteria or dynamic conditions
- Developed and maintained SQL scripts for database data quality checks and data validation
- Staying informed about new releases and updates in SSIS and leveraging new features and functionalities for enhanced ETL processes
- Creating and managing data governance frameworks and data quality control processes to ensure data consistency and reliability within Power BI and MSBI solutions
- Implemented data profiling and data standardization processes to ensure data consistency in the DWH
- Implemented data aggregation and summarization systems to support efficient analysis and decision-making
- Troubleshooting and resolving performance issues and errors in SSAS models and queries, identifying and resolving performance bottlenecks and errors to ensure optimal performance of SSAS solutions
- Ensuring data confidentiality and access control by developing and maintaining report security roles and permissions in SSRS, managing user access and safeguarding data integrity
- Implementing error handling and logging mechanisms in SSIS packages, proficiently addressing and managing errors throughout the ETL process
- Designing and implementing scheduled data refreshes to keep Power BI reports and dashboards up to date with the latest data
- Developing and maintaining metadata repositories for OLAP cubes and data models to enhance data discovery and understanding
- Developed custom data governance frameworks and policies to ensure compliance with data privacy regulations such as GDPR and CCPA during data analysis
- Developed data quality rules and business rules to validate data accuracy and consistency
- Utilizing Power BI's integration with Microsoft Teams for sharing reports and dashboards within the organization
- Designing and developing visually appealing and insightful reports and dashboards using Power BI.
Education
Bachelor of Commerce -
Sunrise University
Alwar, RajasthanSkills
- Azure Data Factory
- Databricks
- Azure Data Lake Storage
- SQL Database
- Azure Analysis Services
- Azure Storage Account
- Blob Storage
- AWSGlue
- Snowflake
- Redshift
- BigQuery
- Qlikview
- Plotly
- Power BI
- SSRS
- SQL Server Management Studio
- Visual Studio
- Enterprise Manager
- SQL Profiler
- SQL Server Data Tools
- DTS
- Report Builder
- SQL Server
- MySQL
- MS Access
- MongoDB
- SQL
- Python basics
- Power Shell
- TSQL
- Team Foundation Server (TFS)
- Git
- Windows Server 2012
- MS DOS
- UNIX
- Linux
- SSIS
- ADF
- Matplotlib
- Seaborn
- Bokeh
Certification
Analyzing and visualizing Data with PowerBI
Timeline
Azure and BI Engineer
Dye Durham
05.2023 - Current
BI Reporting Engineer
Brightlight Pictures
02.2022 - 05.2023
BI Developer
Canara Bank
05.2020 - 01.2022
Database and BI Engineer
Bajaj Group
04.2019 - 05.2020
Bachelor of Commerce -
Sunrise University
Similar Profiles
Desley OsborneDesley Osborne
Settlement Officer at Dye & DurhamSettlement Officer at Dye & Durham
Kamal Narayan SharmaKamal Narayan Sharma
Management Accountant at Dye & DurhamManagement Accountant at Dye & Durham
Justin YuenJustin Yuen
Account Manager at Dye & DurhamAccount Manager at Dye & Durham