Ben Liu
Adelaide,SA
Summary
Certified and driven IT professional with real-world expertise in AWS Cloud Services and Data Engineering. Proficient in identifying stakeholder requirements, understanding business goals and developing data-centric solutions using Software Development Life Cycle (SDLC). Dedicated to pursuit Data Engineering opportunities with a continual improvement mindset.
Overview
1
1
year of professional experience
1
1
Certification
Work History
Associate Data Engineer
Australian Taxation Office
09.2023 - 02.2024
- Maintained AWS Cloud technologies including S3, RDS, EKS, EFS, Aurora, and CloudWatch. Prioritising problem diagnosis, configuration optimisation, and implementation of agreed procedures to enhance infrastructure resilience, resulting in improved system stability and minimised downtime.
- Addressed administration gaps on Advanced Analytics Platform GitLab instance by identifying issues and proposing multiple remediation strategies. This initiative reduced rejection rates of triage requests by 90%. Resulting in elevated relationship with data science stakeholders, and continual improvements to business systems.
- Enhanced workflow proficiency by resolving instances of misplaced data in EFS and documented technical procedures within Confluence. Facilitating knowledge sharing among engineers whilst ensuring data quality assurance and business reputation.
- Streamlined endorsed security patches on Airflow servers using Infrastructure-as-Code technology such as Terraform. Identified vulnerabilities through research spikes and actioned approved remediation strategies, ensuring uninterrupted system availability and analytical applications are compliant with professional standards.
- Fostered expertise among data graduates by advocating for utilisation of cloud services billing frameworks, raising cost awareness and delivering constructive feedback. These initiatives cultivated enhanced capability and ongoing improvement, driving continuous team growth and proficiency.
Application Developer Intern
Services Australia
07.2023 - 11.2023
- Architected automation solutions using Python whilst adhering to Software Development Life Cycle (SDLC). Leveraged Apache Nifi and Qlik Replicate RESTFUL APIs to develop automation scripts, enabling engineering teams to promptly manage 100+ streaming data pipelines, resulting in 30% increase in team productivity and mitigating possibility of human errors.
- Enforced DevOps principles by regularly seeking code review and promoting automation scripts using GitLab's continuous integration and continuous delivery (CICD) technology, resulting in reliable and successful deployment in both production and non-production environments.
- Communicated to various stakeholders using a range of media types including corporate documentations, technical wiki, real-time application demonstration. These efforts contributed to positive client experiences and comprehensive application guides.
- Collaborated with business stakeholders continuously to identify impacted functions and acquire application requirements to establish acceptance criteria, ensuring delivery of an agile solution in addition to building professional relationships.
- Applied project management principles through milestone tracking using TFS/Azure DevOps, facilitating project plan, and hosting discussion forums using Microsoft Teams, resulting in 20+ resolved blockers and 100% milestone completion.
Education
Bachelor Of Information Technology - Network And Cybersecurity Systems
Flinders University (GPA: 6.4)
Bedford Park, SA12.2023
Skills
- Agile Development
- Amazon Web Services (AWS)
- TFS/Azure DevOps
- Confluence
- Data Quality Assurance
- Microsoft SQL Server, PostgreSQL, MySQL
- Git/GitLab
- HTML/CSS
- Python
- RESTFUL APIs
- Software Development Life Cycle (SDLC)
- SQL
Projects
AWS Data Lake Implementation | AWS Relational Database Service (RDS), Identity and Access Management (IAM), AWS Glue, AWS S3, AWS LakeFormation, AWS Athena, AWS CloudWatch | Analytical Deployment Platform
- Designed a secure, scalable, and cost-effective data lake architecture using AWS microservices, while also implementing data ingestion pipelines to automate Extract, Transform, and Load (ETL) process from relational databases (Microsoft SQL Server, MySQL, PostgreSQL).
- Configured storage and partitioning strategies to optimise costs, enhance query performance, and derive efficient analytical insights in managing large data volumes.
- Documented project architecture, design decisions, and implementation steps to provide valuable reference material and facilitate knowledge sharing among stakeholders.
Certification
- AWS Certified Cloud Practitioner 2024, Amazon Web Services (AWS) - 02/2024
Timeline
Associate Data Engineer
Australian Taxation Office
09.2023 - 02.2024
Application Developer Intern
Services Australia
07.2023 - 11.2023
Bachelor Of Information Technology - Network And Cybersecurity Systems
Flinders University (GPA: 6.4)
Similar Profiles
Paul BakerPaul Baker
Asst. Commissioner - IT Infrastructure Services at Australian Government – Australian Taxation OfficeAsst. Commissioner - IT Infrastructure Services at Australian Government – Australian Taxation Office
LORNA DE LOS ANGELESLORNA DE LOS ANGELES
APS3 Service Delivery Officer Pro Tem at Australian Taxation Office, Traralgon OfficeAPS3 Service Delivery Officer Pro Tem at Australian Taxation Office, Traralgon Office
Greg ReedGreg Reed
Regional Director at Australian Taxation OfficeRegional Director at Australian Taxation Office
Krish PatelKrish Patel
Frontline Operations at Australian Taxation OfficeFrontline Operations at Australian Taxation Office
SANDEEP SAHNISANDEEP SAHNI
Truck Driver at ADELAIDE TRUCK & VANSTruck Driver at ADELAIDE TRUCK & VANS