Jagan Babu Kothapalli

• Work closely with business stakeholders to understand the manual processes and convert them into automated data analytics solutions at scale using big data technologies (such as Snowflake and Microsoft Fabric), gathering requirements, and developing conceptual Data Warehouse solutions by using industry best practices.
• Develop and follow a data governance framework. Data governance is at the core, and policies are applied when the data is first ingested into the analytics platform.
• Worked on many use cases that involve data profiling from various sources, such as SAP, Salesforce, Shopify, Kantar, Klaviyo, and file-based systems.
• Developed ADF pipelines to orchestrate the data from several sources to a central Observatory Data Store.
• Design and develop a Data Mart for use cases using Kimball methodologies. Developed SCD Type 0, Type 1, and Type 2 dimension tables. Developed full, partial, and incremental loads of transaction records from source systems into the data warehouse.
• Migration of large-scale data from Snowflake to Microsoft Fabric.
• Development of Airflow DAGs for the orchestration of different jobs.
• Design and develop ELT framework for ingesting large-scale datasets into data warehouses.
• Automated tasks by creating Power Automate workflows.
• Maintenance of Data science projects that predicts the numbers based on historical data using Azure ML ops and Databricks workflows.
• Creation of DataModels in Microsoft fabric lakehouses using notebooks in PySpark / SparkSQL.
• Maintenance of GIT repository using both command line Git Bash and Git GUI. Performing code merge and resolving conficts, deployments and troubleshooting CI/CD pipelines for deployment failures.
• Created several Power BI reports which involve complex DAG logics and interactive visuals. Extensively used external tools such as DAX Studio, Tabular Editor.
• Created datasets in Microstrategy which is developed on Snowflake or Databricks and further developed Power BI reports and datasets using MSTR Power BI connectors.

Stakeholder engagement

Worked with Business users to convert requirements to Data Models in Data Warehouse and further Datasets used by stakeholders for reporting purposes.

Source System

Extensively worked in popular ERP tool by Microsoft Dynamics 365 for Finance & Operations and good understanding on the modules such as General Ledger (GL), Accounts Payable, Accounts Receivable, Warehouse, Production, Sales, Products and others.

Responsible for identifying and creation of entities in D365 FO for data exports by configuring full push or incremental push into BYOD database.

Data orchestration (ETL/ELT)

Responsible for maintaining and creation of Azure Data Factory pipelines from BYOD db and other sources to Azure Blob Storage for data exploration.

Data Warehouse (Azure Synapse)

Designing and implementation of Fact and Dimension tables for Star schema based on business processes like sales data, inventory data etc.

Reporting in Power BI / Azure Analysis Services

Created various Power BI datasets which is used by different Business Stakeholders for reporting. Good experience in DAX and tabular models.

Project Methodology

Project uses agile methodology and runs on bi weekly sprints and daily scrum meetings. Have been using tools like Azure Devops, Jira, Confluence for tracking project work and lifecycles.

Repository and CI/CD

Have been using Azure Repos, Bitbucket & Git Repos. Well versed with all git commands and process of Continuous Integration / Continuous Deployment to various environments like development, testing, staging and production.

Department of Education, Victoria

Have played a key role in building some enterprise level cubes or products such as Training Activity Cube, Completions cube, Aspects of Training / Episodes of Training cubes by following VET statistical guidelines and requirements.

Worked closely with stakeholders to ensure monthly reporting of commencement numbers, FreeTAFE & JobTrainer numbers.

Worked closely with business users who do analysis for labor market and give them completion numbers that are submitted to Department by Providers.

Good understanding of National VET Register and developed models based on courses being split or merged together called superseding logic.

· Gather and analyze business requirements and translate business needs into long-term business intelligence solutions leveraging the Microsoft SQL Server platform (SQL Server, SSIS, SSAS, and SSRS)

· Followed high standards in ETL process by writing SSIS Packages with Logging, Error Handling by using Event Handler and Custom Logging.

· Scheduled ETL processes in Windows task scheduler using DTS Exec utilities for legacy transport systems.

· Good knowledge of Data Marts, Dimensional Data Modeling, Star Schema Modeling for Fact and Dimension tables.

· Created knowledge base on Data Quality Services for large scale Data Migration from Legacy Transport systems like Sapphire, Pronto to latest MS Dynamics AX 2012 ERP solutions called CAP Cargo.

· Extensively worked on Data Mining, Predictive, Forecasting activities in Ware house management systems like Accellos, Paperless systems.

· Very good understanding on EDI Concepts of Warehouse management systems running in Accellos.

· Expert in creating various reports in SQL Server Reporting Services (SSRS) such as daily operational reports for compliance, performance of the transport systems.

· Created Profit & Loss Power BI report on Financials of CAPCargo Transport Management System and got very good feedback from key stake holders.

· Created high standardised documents on ETL process and SSRS/Power BI Reports for the organization.

· Created Ad-hoc reports such as Customer Rate Card, Dispatch Report and Vendor Contracts which are data driven subscription reports by using Report Builder in SSRS.

· Creating and managing schema objects such as tables, views, indexes, stored procedures, and triggers & maintaining Referential Integrity.

· Created various visualization reports using Power BI Desktop for the proposals created and are not commenced.

· Good exposure on creating and publising reports using Power BI.

· Development of T-SQL code and SSIS packages as part of ETL process.

· Worked with installing, designing and managing MS SQL Server 2012.

· Responsible for creating technical design document, Unit/integration testing document and deployment and UAT support.

· Used SSIS components such as lookup, derived column, data conversion, aggregate, conditional split, SQL task, and send mail task extensively.

· Build efficient SSIS packages for processing fact and dimension tables with complex transforms and type 1 and type 2 slowly changing dimensions

· Responsible for creating all data mappings for migrated jobs using SSIS.

· Developed Complex database objects like Stored Procedures, Functions, Packages and Triggers using PL/SQL and T-SQL.

· Built ad-hoc reports using SQL Server Reporting Services (SSRS).

· Gathering requirements according to business requirements and responsible for creating various database objects such as tables, views, synonyms, stored procedures and triggers.

· Created different types of User-defined functions.

· Used data profiling task in SSIS 2008 to identify poor data and repair it

· Responsible for creating various shell scripts for transfering data to various environments using FTP, SCP utilities.

· Responsible for creating various scheduling tasks using SQL Server Agent.

· Worked with various tasks of SSIS include Transform Data Task, Execute SQL Task, Active Script Task etc

· Created various shell scripts for data transfer from unix environments.

· Coordination with onsite counter part for bug fixes and status calls.

Responsible for preparing Unit/SIT documents.

· Creating various shell scripts and ESQL/C code according to the client requirement.

· Troubleshoot issues in production environment and develop permanent solution for recurring issues.

· Coordination with onsite counter parts about resolutions to bugs before final deployment.

· Responsible for creating Unit test case document.

· Responsible for training new joiners in the team.

· Developed Informix 4GL program code which is specific to Postgresql.

· Developed ECPG (Embedded SQL in C) specific to Postgresql.

· Written make files for the libraries and associated executables.

Creation of shared libraries