Summary
Overview
Work History
Education
Skills
Hobbies and Interests
Clearance
Personal Information
Accomplishments
Timeline
Generic

Krishna Shah

Melbourne,Australia

Summary

Adept at driving transformative solutions, I led pivotal training sessions at Elastic and engineered scalable data systems at Capgemini, showcasing expertise in Elasticsearch and stakeholder relations. My work has consistently delivered beyond expectations, leveraging technical architecture design and team direction to achieve remarkable results.

Overview

10
10
years of professional experience

Work History

Consulting Architect

Elastic
Melbourne, Australia
03.2019 - 09.2024
  • Led training sessions on Elasticsearch, Kibana, and Observability for various customers throughout the Asia-Pacific area.
  • Contributed to improving Elastic solutions in Azure and AWS, private and hybrid clouds, through consultative support and project participation.
  • Expertly diagnosed use cases to enhance problem-solving efficiency.
  • Organized technical workshops to highlight Elastic solutions.

Big Data Consultant

Capgemini
Pune, India
08.2018 - 02.2019
  • Delivered client requirements through proof-of-concept (POC) development using Apache EMR, Spark jobs in IntelliJ, and AWS services.
  • Engineered data processing modules through AWS Glue, RDS, Redshift, and Talend.
  • Led a team of junior data engineers to ensure successful module delivery.
  • Streamlined critical pipeline to efficiently handle volumes exceeding 300 TB of data.
  • Deployed the Elasticsearch cluster with Ansible for enhanced performance.
  • Implemented best practices for scalable data systems.
  • Engaged with clients to offer tailored recommendations.

Data Engineer

FigMD, Inc.
Pune, India
01.2018 - 08.2018
  • Developed a scalable data processing pipeline using Spark (Scala) on AWS for transforming United States healthcare data and delivering it to CMS (Centers for Medicare & Medicaid Services), leveraging EMR and EC2 instances.
  • Designed a big data solution utilizing open-source tools to perform data migration for data marts and data transformation, thereby making more than 800 GB of data available and searchable.
  • Developed APIs in Elasticsearch (ELK Stack) to enable free text search functionality for the U.S. registry client, and implemented data visualization dashboards using Kibana.
  • Designed and implemented various ETL pipelines for data migration from RDBMS to the ELK Stack, including an Elasticsearch-Hive integration module, followed by documenting it all.

Senior Systems Engineer

Infosys Ltd.
Pune, India
10.2014 - 08.2018
  • Processed credit and debit card transactions using advanced data lake solutions.
  • Optimized utilization of available data to aid clients effectively.
  • Engineered data pipelines using Apache Hadoop within Cloudera distribution.
  • Documented the entire process of developing data pipelines to ensure seamless knowledge transfer.
  • Partnered with clients to comprehend needs.
  • Championed the adoption of open-source platforms: Developed proof-of-concepts demonstrating the value of Apache Hadoop for enterprise data management.
  • Utilized Spark API on Cloudera Hadoop YARN to perform advanced analytics on banking data within the Cloudera distribution, enabling deeper insights
  • Diagnosed bottlenecks in data retrieval processes, working closely with application teams.
  • Showcased robust work ethic and adaptability.

Education

Bachelor of Engineering -

Parul University
Gujarat, India
01.2014

Skills

  • Stakeholder relations
  • Training and mentoring
  • Solution design
  • Requirements gathering
  • Technical architecture design
  • Apache Spark
  • Elasticsearch
  • Apache Pig
  • Apache Hive
  • Apache Sqoop
  • Apache Flume
  • Hadoop Yarn
  • AWS Glue
  • AWS RDS
  • AWS Elasticsearch
  • AWS EC2
  • AWS S3
  • API gateway
  • Logstash
  • Beats
  • AWS Landing Zone
  • Azure Data Factory
  • Azure Synapse Analytics
  • IntelliJ IDE
  • Eclipse IDE
  • MS SQL
  • Kibana
  • Tableau
  • JIRA
  • Apache Hadoop
  • HDFS
  • Team direction

Hobbies and Interests

  • Books
  • Weight Lifting
  • American Board Certified NLP Coach

Clearance

NV1 federal clearance

Personal Information

Citizenship: Australian

Accomplishments

  • https://www.amazon.com.au/Kibana-8-x-exploration-visualization-dashboard/dp/1803232161

Timeline

Consulting Architect

Elastic
03.2019 - 09.2024

Big Data Consultant

Capgemini
08.2018 - 02.2019

Data Engineer

FigMD, Inc.
01.2018 - 08.2018

Senior Systems Engineer

Infosys Ltd.
10.2014 - 08.2018

Bachelor of Engineering -

Parul University

Similar Profiles

CREATE PROFILE
Krishna Shah