Teja Krishna Jampala
Melbourne,Australia
Summary
Results-driven Data Engineer with over 18 years of experience in designing, building, and operating production-grade data platforms utilizing Databricks, GCP, and webMethods. Expertise in Spark and advanced SQL facilitates the transformation of large-scale datasets, supported by extensive knowledge of CDC patterns and incremental data processing. Proven ability to lead the design of layered, analytics-ready data models while adhering to best practices in analytics engineering. Committed to ensuring high reliability and data quality through ownership of end-to-end data ingestion pipelines, CI/CD workflows, and production monitoring, along with providing technical leadership through design reviews and mentoring in dynamic environments.
Overview
18
18
years of professional experience
6
6
Certification
Work History
Consultant Data Engineer
National Australia Bank
03.2022 - Current
- Designed and delivered NDH data pipelines and currently developing Ada Serve (VIN, Commission Reports etc) and Ada Gold initiatives, focusing on NDH Exit, ML data enablement, and Edge migration for downstream analytics and marketing campaigns.
- Analysis, design, data mapping, and SQL development in Databricks, leveraging built-in ingestion frameworks and Spark to process data and calculate business metrics efficiently.
- Participated in design and architecture reviews to validate data models, pipeline design, performance considerations, and alignment with platform standards before implementation.
- Performed code reviews, ensuring adherence to best practices and optimized queries. Also, mentored junior team members.
- Created unit test cases and supporting documentation to validate data quality, transformations, and metric calculations.
- Supported SIT testing, SHO walkthroughs, run-sheet preparation, and production deployments, ensuring smooth releases and operational readiness.
- Performed Root Cause Analysis (RCA) for defects and production issues, implementing preventive and corrective actions to improve pipeline stability and spark job performance.
- Provided technical inputs to the platform team for designing and enhancing the SharePoint serve framework, ensuring seamless downstream data consumption.
Data Engineer III
Walmart
Reston, VA, USA
10.2018 - 03.2022
- Ingesting pharmacy data assets from internal and external sources into the Health and Wellness data lake by developing data pipelines and performing ETL for business consumption, and to build dashboards.
- Analysis, design, development, migration and unit testing of data pipelines, ETL using big data technology components such as Hadoop, HDFS, Sqoop, Spark, Hive and Yarn.
- Developed Spark Jobs using Scala & Python for distributed processing of the data.
- Created data pipelines for ingesting data to Google Cloud Storage, ETL transformation using Google Cloud Dataproc and analytics using BigQuery.
- Developed shell scripts, created Hive tables, partitions and wrote HQL queries and user defined functions for distributed data processing and analysis.
- Developed Continuous Integration and Continuous Delivery pipelines using Looper and Concord with Ansible Playbook.
- Creating design documents for the flows.
- Troubleshooting and performing root cause analysis, developing solutions and an action plan to resolve issues, and performance improvement.
Technology Specialist
Cognizant Technology Solutions US Corp
La Crosse, WI, USA
05.2013 - 10.2018
- Developed and supported various technology driven applications involving data collection, monitoring, analysis and reporting of defined performance parameters using Hadoop ecosystem components and middleware product webMethods.
- Requirement and Impact Analysis.
- Created high level and detail level design documents.
- Developed batch and streaming applications using Big Data ecosystem components such as HDFS, Hive, Spark, Sqoop, Kafka, HBase, Oozie and Hue.
- Development of Spark batch and streaming Jobs in Scala, created Hive tables, partitions and written HQL queries and user defined functions for data processing and analysis.
- Development of Flow Services, Java Services, Web Service Providers and Connectors, JDBC Adapter Services using webMethods Developer, Software AG designer on webMethods Integration Server.
- Writing SQL queries and PL/SQL blocks in oracle.
- Performed Unit, Functional Testing and supported Integration and System Testing.
- Performed Root Cause Analysis, preventive and corrective actions for the defects.
Technology Analyst
Infosys Limited
Atlanta, GA, USA
06.2007 - 05.2013
- Developed Notification, Tracking Systems and Project Tracking applications using Software AG middleware products such as webMethods Integration server and My webMethods server.
- Performed Requirement Analysis, impact analysis and providing estimates for the requirements.
- Developed Flow Services, Java Services, Web Service Providers and Connectors, JDBC Adapter Services using webMethods Developer/ Software AG designer on webMethods Integration Server.
- Developed of User-Interfaces using Composite Application Framework, Business Process Monitoring workflows in Software AG webMethods Designer and My webMethods Server.
- Development of Oracle Stored procedures to perform the Create, retrieve, update and delete operations on data and writing SQL queries.
- Performed Unit Testing, Functional, Integration and System Testing.
- Performed RCA, preventive and corrective actions for the defects.
Education
Bachelors in Technology -
Jawaharlal Nehru Technological University
01.2007
Skills
- Big Data Analytics
- Databricks
- HDFS
- Map Reduce
- Sqoop
- Hive
- PySpark
- HBase
- Kafka
- Yarn
- Hue
- Data pipeline development
- Cloud
- Analysis & evaluation
- Business analysis
- Data Warehousing
- Data Modelling
- ETL
- Shell scripting
- Writing SQL queries
Certification
- Certified as AWS Data Engineer
- Certified as Databricks Data Engineer Associate and Professional
- Certified as Azure Data Engineer
- Certified as Fabric Analytics Engineer Associate
- Certified as Azure AI Engineer Associate
- Certified as Cloudera CCA Spark and Hadoop developer
Awards
- Bravo Award
- Raise Award
- Spot Award
Timeline
Consultant Data Engineer
National Australia Bank
03.2022 - Current
Data Engineer III
Walmart
10.2018 - 03.2022
Technology Specialist
Cognizant Technology Solutions US Corp
05.2013 - 10.2018
Technology Analyst
Infosys Limited
06.2007 - 05.2013
Bachelors in Technology -
Jawaharlal Nehru Technological University