Summary
Overview
Work History
Education
Skills
Timeline
Generic

Varun Dath Jain

Westmead,Australia

Summary

Highly experienced IT professional with around 13 years in the industry, including roles as a GCP Data Engineer, SQL/SSIS Developer, and DevOps. Seeking an Azure Cloud Engineer position to leverage extensive experience in designing, building, and managing infrastructure solutions. Proficient in cloud platforms (GCP and AWS basics), CI/CD pipelines, automation, and problem-solving, including Terraform for Infrastructure as Code (IaC). Proven ability to deliver cutting-edge infrastructure solutions and collaborate effectively with engineering and operations teams.

Overview

13
13
years of professional experience

Work History

GCP Data Engineer

Woolworths (TCS)
Sydney, Australia
05.2022 - Current
  • Work on sensitive data in BigQuery and apply security modeling for restricting data access.
  • Designed and built new frameworks to process large-scale PII and Non-PII data from various sources, loading into BigQuery using Cloud Functions, Pub/Sub, Dataflow, and Composer/Airflow.
  • Performed data modeling and object designing in GCP BigQuery after analyzing upstream data.
  • Executed query tuning and other techniques to improve efficiency and reduce cost.
  • Developed data reconciliation and data observability frameworks.
  • Implemented data lineage solutions for GCP and BigQuery objects, and data orchestration frameworks for data onboarding and unit testing automation.
  • Contributed to CI/CD and GitHub, automating component promotion. (Leveraged Infrastructure as Code principles, including concepts transferable to Terraform for environment provisioning.)

GCP Data Engineer

Woolworths (TCS)
Kochi, India
12.2019 - 05.2022
  • Designed frameworks to extract data from various systems and Teradata via Hadoop to GCP BigQuery.
  • Developed views in BigQuery used in business dashboards.
  • Designed and developed Airflow DAGs, Dataflow jobs, and Google Cloud Functions for processing secured PII Data.
  • Developed scripts for data transformation and extraction.
  • Involved in design and development of people data security modeling using Google encryption keys for access management in BigQuery views.
  • Proposed and built reconciliation frameworks for daily file reconciliation, handshake emails, and automating cleanup of data flow error logging.
  • Designed and developed frameworks for outbound extracts with PGP encryption.
  • Utilized Dataflow templates and Pub/Sub for real-time processing. (Applied automation and infrastructure provisioning concepts, laying groundwork for efficient use of tools like Terraform.)

Developer, Data Analyst, DevOps and Release Management

Commonwealth Bank (TCS)
Sydney, Australia
08.2016 - 12.2019
  • Attended business queries from Credit Risk and Market System end users and Business Support.
  • Identified data and code issues causing errors in breach reporting for APRA, performing configuration and code fixes following change management processes.
  • Automated deployment processes from development to production using an in-house application and Octopus Deploy.
  • Built data pipelines using SSIS to extract data from various databases and flat files for feeding data into data warehouses and for daily risk reporting.
  • Developed and managed risk reports for Country Risk and Market Risk reporting using SSRS.
  • Set up alerting and monitoring in various risk system jobs to alert operations and business teams in case of failures or data issues.

ETL (SQL/SSIS) Developer

Commonwealth Bank (TCS)
Kochi, India
03.2012 - 08.2016
  • Built data pipelines using SSIS to extract data from various databases and flat files for feeding data into data warehouses and for daily risk reporting.
  • Developed and managed risk reports for Country Risk and Market Risk reporting using SSRS.

Education

Bachelor of Technology - Electronics and Communication Engg

Government College of Engineering
Kannur, India
07.2011

Skills

  • Azure
  • GCP
  • AWS
  • Azure DevOps
  • Terraform
  • Apache Airflow
  • Dataflow
  • Cloud Build
  • CI/CD
  • GitHub
  • Git
  • Python
  • SQL
  • PowerShell
  • Hive
  • Oracle
  • SQL Server
  • SSIS
  • SSRS
  • SSAS
  • Cloud Pub/Sub
  • Cloud Run
  • Composer/Airflow
  • GCP Vertex AI
  • GCP FHIR
  • JIRA
  • MyService
  • ServiceNow
  • Agile
  • Data modeling
  • Query Tuning
  • Data Reconciliation
  • Data Observability
  • Data Lineage
  • Security Modeling
  • PGP Encryption
  • Troubleshooting
  • BigQuery
  • Data ingestion
  • Data pipeline
  • Cloud Functions
  • Data orchestration
  • Data security
  • Query optimization
  • Data reconciliation
  • CI/CD practices
  • Data quality assurance
  • Performance tuning
  • Data pipeline design
  • ETL development
  • Data integration
  • Data warehousing
  • Data migration
  • RDBMS
  • Business intelligence
  • Risk analysis
  • Database security
  • SQL programming
  • Relational databases

Timeline

GCP Data Engineer

Woolworths (TCS)
05.2022 - Current

GCP Data Engineer

Woolworths (TCS)
12.2019 - 05.2022

Developer, Data Analyst, DevOps and Release Management

Commonwealth Bank (TCS)
08.2016 - 12.2019

ETL (SQL/SSIS) Developer

Commonwealth Bank (TCS)
03.2012 - 08.2016

Bachelor of Technology - Electronics and Communication Engg

Government College of Engineering

Similar Profiles

CREATE PROFILE
Varun Dath Jain