Summary
Overview
Work History
Education
Skills
Websites
Accomplishments
Certification
Languages
References
Timeline
Generic
SMITA NAIK

SMITA NAIK

Greystanes,NSW

Summary

Results-oriented Senior Data Engineer with over six years of experience in data architecture and engineering. Demonstrated expertise in designing and implementing scalable, high-quality data solutions using industry-standard tools and platforms. Proven track record in leading teams, strategic planning, and delivering data-driven insights to support business objectives. Strong proficiency in cloud platforms, big data technologies, and data governance.

Overview

8
8
years of professional experience
1
1
Certification

Work History

Sr. Data Engineer

AC3
04.2023 - Current
  • Developed predictive models for churn prediction and content recommendation using LLM models.
  • Defined and designed initial data architecture and strategy in SOW, aligning with business objectives and technology direction.
  • Spearheaded implementation of end-to-end automated data pipelines using Azure and Databricks.
  • Collaborated with senior stakeholders to create and communicate business intelligence strategies and roadmaps.
  • Optimized data warehouse solutions using advanced SQL techniques for analytics and reporting use cases.
  • Worked closely with project managers for planning, dependency identification, and estimation, ensuring project alignment with business needs.
  • Providing technical guidance and fostering collaborative work environment.
  • Supported functional and cross-functional projects and implemented process improvements.

Sr.Data Engineer

Tech mahindra
09.2022 - 04.2023
  • Designed complex data engineering solutions using GCP and Airflow, supporting both strategic and tactical information management initiatives
  • Implemented data streaming solutions with Kafka and managed orchestration using Airflow.
  • Developed and maintained data warehouses using ETL, enhancing data processing efficiency. Conducted POC using Dataform and DBT to evaluate and enhance ETL processes.
  • Established and configured DAGs in Apache Airflow to efficiently schedule data loads across various layers of data pipeline
  • Collaborated with business stakeholders to deliver high-quality data solutions and insights.
  • Utilized Data Studio and Tableau for advanced data visualization and reporting.
  • Supported sprint planning and dependency management, ensuring alignment with business needs and timelines. Delivered comprehensive data technology roadmap aligning with evolving business needs. Enhanced data streaming capabilities.

Data Engineer

Kasna
01.2022 - 09.2022
  • Implemented data platform on GCP using Terraform, Cloud Functions, and BigQuery, automating data pipelines and processes.
  • Designed and managed ELT data pipelines, leveraging Airflow for efficient orchestration and monitoring.
  • Provided consulting services to optimize data solutions and architectures for clients, focusing on performance and scalability.
  • Developed guidelines and best practices for data engineering processes and technology integration.
  • Utilized BigQuery and Databricks for data analysis and transformation, supporting business analytics initiatives.
  • Conducted data profiling and source-target mappings to ensure data quality and integrity.

Data Engineer

Tata Consultancy Services
01.2017 - 01.2022
  • Built scalable data pipelines on GCP using Dataflow and Pub/Sub, processing high-volume data for predictive analytics.
  • Optimized data warehouse performance using partitioning, clustering, and advanced SQL techniques.
  • Implemented data ingestion and integration solutions using Python and Big Data platforms.
  • Collaborated with cross-functional teams to troubleshoot and resolve data pipeline issues.
  • Supported data governance initiatives, ensuring compliance with industry regulations and data privacy standards.
  • Documented workflows and best practices, facilitating knowledge sharing and team collaboration.

Education

Master of Information technology: Data Analytics and Business Information system -

University of Technology Sydney (UTS)
Sydney, Australia
12.2020

Bachelor's: computer science & Engineering - Computer Science And Engineering

Dr. Ambedkar Institute of Technology (Dr. AIT)
Bengaluru
06.2016

Skills

  • GitHub
  • Code commit
  • Python
  • Kafka Streaming
  • Data Governance
  • Problem-Solving
  • Data Pipeline Design
  • Data Warehousing
  • Metadata Management
  • Data Modeling
  • Machine Learning

Accomplishments

    Won DeepRacer competition at AC3 for building ML models and training on diverse tracks.

Certification

  • GCP (Google Cloud Platform)-Professional data engineering
  • DP – 203 – Microsoft Certified Azure Data Engineer Associate
  • AZ-204 – Microsoft Certified Azure Developer Associate
  • AI – 102 Microsoft Certified Azure AI Engineer Associate
  • DP -100 Microsoft Certified Azure Data Scientist Associate

Languages

English
Hindi
Kannada

References

Available upon request

Timeline

Sr. Data Engineer

AC3
04.2023 - Current

Sr.Data Engineer

Tech mahindra
09.2022 - 04.2023

Data Engineer

Kasna
01.2022 - 09.2022

Data Engineer

Tata Consultancy Services
01.2017 - 01.2022

Master of Information technology: Data Analytics and Business Information system -

University of Technology Sydney (UTS)

Bachelor's: computer science & Engineering - Computer Science And Engineering

Dr. Ambedkar Institute of Technology (Dr. AIT)

Similar Profiles

CREATE PROFILE
SMITA NAIK