Summary
Overview
Work History
Education
Skills
Personal Information
Timeline
Generic

AJAY B

VIC Australia

Summary

Dedicated and proficient Azure Data Engineer with over 4 years of IT experience specialized in Azure and Hadoop ecosystems, leveraging a deep understanding of data ingestion, modelling, querying, processing, storage, analysis, and integration to implement robust, enterprise-level systems. Demonstrates a comprehensive grasp of Azure Data Services, including Azure Data Lake, Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Blob Storage. Experience in Migrating SQL database to Azure data Lake, Azure SQL Database, Data Bricks and Azure SQL Data warehouse and controlling and granting database access and migrating on-premises databases to Azure Data Lake store using Azure Data Factory. Good experience on Azure Data bricks clusters, notebooks, jobs, and auto scaling. Designed and Developed ETL Processes in Azure data factory to migrate data from external sources like S3 and text Files into Azure synapse. Proficient in applying Kimball methodologies for the design and implementation of effective data models, with a focus on star schemas to enhance reporting and analytics capabilities. Hands on Experience interacting in Python, PL/SǪL, T-SǪL, and REST APIs, enabling the design, development, and execution of comprehensive data pipelines. Hands-on experience on Databricks Workspace UI, Managing Databricks notebooks, Azure Delta Lake with PySpark, and Spark SQL. Experienced in utilizing Azure DevOps tools for CI/CD pipelines, along with version control using Git and SVN. Gained experience on designing and implementing complete end-to-end Hadoop infrastructure using HDFS, MapReduce, Hive, HBase, Kafka, Sqoop, Spark, and No SǪL databases. Possesses strong SǪL capabilities across multiple dialects, including MySQL, PostgreSQL, Redshift, SǪL Server, Oracle, and Snowflake. Implemented complex business logic through T-SQL stored procedures, Functions, views, and advanced query optimizations. Experience in designing Cassandra tables and optimizing schemas for efficient data retrieval and storage. Familiar with a wide array of Azure technologies such as Cosmos DB, Virtual Machines, Kubernetes Services, Event Hubs, Logic Apps, HDInsight, etc. Collaborative team player, adept at coordinating with team members to meet project deadlines and updating Jira tickets to ensure project tracking and management. Versatile in the software development life cycle (SDLC), employing both waterfall and agile (Scrum) methodologies to drive project success.

Overview

4
4
years of professional experience

Work History

Azure Data Engineer

Idle Brain Technologies
12.2021 - Current
  • This corporation is responsible of building, operating, and maintaining Australia's largest electricity network in delivering essential network services
  • Customers Data is in cloud and on premises
  • Created and tested Data pipelines for ETL procedures
  • Collaborate with stakeholders to provide technical solutions.

Data Engineer

Fidel Technology Solutions
08.2020 - 12.2021
  • UDH is the central repository for DeVry University located in the cloud, contains the data from various source systems
  • Designed and executed data processing workflows in Azure Databricks, harnessing the power of Spark to handle large-scale data transformations and analytics tasks
  • Ability to visualize daily data, weekly data and monthly data on demand.

Education

Master of Information Technology (Networking) -

Melbourne Institute of Technology
01.2021

Bachelor of Computer Science -

Sri Indu Institute of Technology
01.2018

Skills

  • Cassandra HBase Oracle Snowflake MS Access MySQL MongoDB PostgreSQL Microsoft SQL Server GitHub
  • Power BI
  • MS Azure

Personal Information

Title: Azure Data Engineer

Timeline

Azure Data Engineer

Idle Brain Technologies
12.2021 - Current

Data Engineer

Fidel Technology Solutions
08.2020 - 12.2021

Master of Information Technology (Networking) -

Melbourne Institute of Technology

Bachelor of Computer Science -

Sri Indu Institute of Technology
AJAY B