Summary
Overview
Work History
Education
Skills
Certification
Awards
Timeline
Hi, I’m

Aniruddha I.

Melbourne,VIC

Summary

Data Engineer and a Developer with strong math background and 5+ years of experience enabling data-driven decision making for multiple companies.

Results-driven data engineering professional with solid foundation in designing and maintaining scalable data systems. Expertise in developing efficient ETL processes and ensuring data accuracy, contributing to impactful business insights. Known for strong collaborative skills and ability to adapt to dynamic project requirements, delivering reliable and timely solutions.

Overview

9
years of professional experience
1
Certification

Work History

Specsavers

Data Engineer
06.2023 - Current

Job overview

  • Data Pipelines: Building and maintaining data pipelines using Azure Data Factory to support internal and external stakeholders
  • Socrates Data Lake: Handling ingestion and developing optimized report pipelines using medallion architecture
  • During my tenure, I have developed 15 pipelines to cater to 5 key projects that helped the business with their needs
  • Unity Catalog: Involved in the implementation and testing of Unity Catalog
  • DevOps: Managing the deployments using Azure DevOps
  • Maintaining database integrity of multiple databases
  • Key project that I worked on during the time was the upgrading of the Databricks runtime from 13.3 to 14.3
  • Major achievement: Being a key element of the Data engineering team, we handled all the BI reports and reduced the ingestion time for pipelines by 80%
  • Deployment of Unity Catalog in Azure DataBricks Runtime upgrade 14.3

Macqaurie Group

Data Engineer (Contractor)
01.2023 - 06.2023

Job overview

  • Architected advanced data models, improving data retrieval for PropertyIQ
  • Built resilient data pipelines with Alteryx, ensuring seamless data flow for analytics.
  • Engineered optimized ETL pipelines, streamlining data ingestion processes for business insights.
  • Collaborated with cross-functional teams to define requirements and develop end-to-end solutions for complex data engineering projects.

Curtin University

Data Engineer
01.2022 - 06.2023

Job overview


  • Data Engineering Pipelines: Building pipelines to ingest data into Digital Analytics Platform
  • Focus on data governance and delivering actionable insights for the team with the help of AWS Quicksight
  • Working with CDK to avoid ClickOps and ensuring a streamlined process across different deployment environments
  • Data Modelling: Providing recommendations of data models to the ingested data via Oracle API, RDS across different regions
  • Data Wrangling: Manipulation of the ingested data via the Lambda functions or AWS Glue (PySpark)
  • Automation of the wrangling process to ingest the required data with the help of EventBridge .Deploying the wrangled data via CI/CD pipelines

AIA Pty Ltd (Correlate Resources)

Data Engineer (Contractor)
01.2022 - 07.2022

Job overview

  • Working on the data industrialization of CMLA data and leveraging the knowledge of Artificial Intelligence pipelines to Automate Data Engineering process
  • Data Engineering Pipelines: Wrangling the data in R and using the MySQL database to feed the data to machine learning algorithms
  • Migration: Recommending possible migration solutions to Microsoft Azure

Urbanise

BI Analytics Developer
10.2019 - 01.2022

Job overview


  • Providing Data Warehousing services to customers by creating and exposing the analytics data
  • Pipelines and Data Migrations: Managed the Data Migration from AWS PostgreSQL to Microsoft Azure for Analytical requirements using AWS DMS
  • Database Development: Managed to optimize 50+ Stored procedures from Legacy solutions to improve the reporting and product integration of the queries. Improving the performance of the queries of the legacy solution with Redshift MPP
  • Analytics Data Warehousing: Managed Data warehouse creation for one of main clients with the necessary ETL requirements and exposing the warehouse via Pentaho Data Integration
  • Carefully analyzed the business requirements and communicated with the stakeholders to provide the requirements in 10+ release
  • Reporting: Migration of 100+ key financial reports such as INE, Balance Sheets and understanding the financial business logic to cater to the needs of the product

Fractal.ai

Data Analyst (Business Intelligence Consultant)
06.2016 - 04.2018

Job overview


  • Helped the company to create better BI processes enabling the company to make hard and soft savings
  • The role also involved work on the forecasting algorithm for Promotional and Point of Sales Data
  • Automation for Hard Savings
  • Automation of reports – Handled the automation of data intensive inventory reports in Alteryx and saving ~ 40 hours
  • Customer Business Analytics
  • Consulting/ Support and Customer Setup

Education

Monash University
Melbourne Victoria Caulfield

Master of Science from Data Science
07-2020

University Overview

  • Successfully completed the minor thesis titled 'Machine Learning for next generation alloys'. The research involved using machine learning methods on empirical data to aid the discovery of novel alloys.
  • Gather data from different websites; cleaning and integration using Python. Creating dashboards in Tableau and D3.js for visualizations.
  • Statistical modelling for predicting superconductivity temperature using KNN algorithm in Python, R and SQL for data collection and integration.
  • Recipient of FIT MERIT SCHOLARSHIP
  • Member of Monash Data Science Society
  • Peer Mentor for Upcoming students

Skills

  • Python, R , SQL
  • NET , Vuejs, C# MVC
  • Basic Shell script
  • Apache PySpark
  • Pentaho, Alteryx, KNIME
  • AWS (S3, EC2, Glue, DMS, CDK, Athena, Quicksight, KMS, Lambda)
  • Git
  • Google, Amazon Web Services
  • Azure Data Factory, Azure Databricks (Certified), Azure DevOps
  • Data Warehousing, Data Analytics using Power BI
  • Descriptive Analysis, Predictive Modeling, Machine Learning
  • ETL development, Data warehousing, Data modeling, Data migration

Certification

Microsoft Certified Azure Data Engineering Associate

Microsoft Certified AZ-900 Data Fundamentals

Databricks Certified Data Engineering Associate

Awards

Awards

Granted Merit scholarship for pursuing master’s degree at Monash University

Awarded the Merit scholarship for excellence in the field of Mathematics

Timeline

Data Engineer
Specsavers
06.2023 - Current
Data Engineer (Contractor)
Macqaurie Group
01.2023 - 06.2023
Data Engineer
Curtin University
01.2022 - 06.2023
Data Engineer (Contractor)
AIA Pty Ltd (Correlate Resources)
01.2022 - 07.2022
BI Analytics Developer
Urbanise
10.2019 - 01.2022
Data Analyst (Business Intelligence Consultant)
Fractal.ai
06.2016 - 04.2018

Microsoft Certified Azure Data Engineering Associate

Microsoft Certified AZ-900 Data Fundamentals

Databricks Certified Data Engineering Associate

Monash University
Master of Science from Data Science
Aniruddha I.