Pinaki Basu
Franklin,ACT
Summary
As a dedicated Data Engineer with a proven track record of delivering robust data migration solutions and effective ETL strategies, I seek a dynamic role in a progressive organisation that values innovative data warehousing techniques and clear code documentation. My expertise in SQL scripting, problem-solving, and project management, complemented by my capacity to adapt and communicate effectively, positions me well to meet and exceed my employer's technical and strategic objectives. I am committed to continuous improvement and a strong foundation in team collaboration and leadership, aiming to leverage my skills to drive data quality enhancement and support informed business decision-making.
Overview
10
10
years of professional experience
Work History
DATA ENGINEER
AUSTRALIAN FISHERIES MANAGEMENT AUTHORITY (AFMA)
Canberra, ACT
08.2023 - 11.2023
- SSIS Development and Process Automation: Developed, deployed, and automated ETL processes using SSIS packages, significantly improving data processing and integration efficiency
- Database Management and Data Quality Assurance: Managed Oracle databases, ran queries for data investigation, and implemented stringent data validation and cleansing processes in SQL Server and Oracle to maintain high data quality standards
- Data Migration and Warehousing: Successfully led data migration to data warehouses, ensuring accurate and efficient transfer of large datasets from various sources using SSIS and Oracle SQL Developer
- Collaboration and Reporting: Worked collaboratively with cross-functional teams to support data needs, resolve technical issues, and develop reports, aiding in strategic decision-making
- Technical Documentation and Problem-Solving: Documented data architectures and ETL processes and adeptly solved complex data issues in SQL Server, SSIS, and Oracle environments while continually updating skills in data engineering technologies like Azure, SQL Server, SSIS, and Oracle.
DATA MANAGER
LEIDOS AUSTRALIA
Canberra, ACT
08.2022 - 07.2023
- Strategy and Planning: Develop comprehensive data migration strategies that align with organisational goals and client needs and create detailed project plans, including risk assessment and impact analysis
- Client Interaction and Assessment: Engage with clients to understand their specific data migration requirements and conduct thorough audits of existing data to identify quality and integrity issues
- Implementation and Quality Assurance: Execute data cleansing processes to ensure data quality and accuracy, maintain detailed documentation of migration processes, and collaborate with teams to verify and validate the migration
- Team Management and Skill Development: Effectively manage and allocate tasks within projects and mentor junior team members in SQL Server and data migration techniques to enhance team capabilities.
DATA TEST ENGINEER
DEPARTMENT OF HEALTH
Canberra, ACT
01.2022 - 08.2022
- Data Investigation Focus: Conduct thorough data investigations to understand underlying data structures and patterns
- Utilise advanced data analysis techniques to uncover insights and anomalies
- Emphasis on Data Mining: Implement data mining methodologies to extract valuable information from large datasets
- Apply statistical models and machine learning algorithms for predictive analysis
- Complex Oracle Query Development: Developed and optimised complex SQL queries in Oracle for data extraction and manipulation
- Utilise Oracle-specific features like PL/SQL for advanced querying
- Exposure to Snowflake Schema in Oracle Data Warehouse: Gained practical experience with the Snowflake schema, understanding its multidimensional data modelling
- Applied knowledge in designing and querying data warehouses using the Snowflake schema for enhanced data analysis and reporting.
DATA MIGRATION LEAD
National Health and Medical Research Council
Canberra, ACT
06.2019 - 12.2021
- Data Migration Strategy Development: Worked with the data team to devise a comprehensive Data Migration Strategy, aligning team efforts with project goals and managing the creation of migration flows for effective data transfer
- Leadership in Migration Projects: Led a team of migration analysts, overseeing the creation of migration designs and system field mappings and guiding complex migration processes
- Project Management and Stakeholder Collaboration: Supported project management with cut-over plans and impact analysis while collaborating with management to align migration activities with business objectives
- Process Improvement and Technical Support: Identified new process improvement opportunities in data migration and management and provided technical support through GAP analysis and adopting new technical processes
- Utilization of ETL Tools and Data Loading Execution: Employed ETL tools like Azure Data Factory for cloud-based migrations and managed data loading processes to maintain data integrity and adhere to migration plans.
DATA TEST ENGINEER
DEPARTMENT OF JOBS
Canberra, ACT
01.2019 - 06.2019
- Data Analysis and SQL Query Design: Focus on understanding data structures in source and target systems, write and optimise SQL queries for data extraction and comparison, ensuring a solid grasp of data types, relationships, and constraints
- Query-Centric Test Planning and Execution: Develop a test plan centred on SQL queries and scripts, including detailed test cases for data validation, integrity checks, and performance analysis
- Execute these tests to ensure data accuracy and completeness during migration
- Data Quality Assurance and Reporting: Conduct pre- and post-migration data quality checks using SQL scripts, focusing on completeness, accuracy, and consistency
- Document testing activities, collaborate with data teams for query optimisation, and provide effective communication on data issues and solutions
- Post-Migration Activities and Process Improvement: Perform final data validation using advanced queries, provide post-migration support for data adjustments and query optimisation, and analyse the migration process to enhance future query strategies and data-handling techniques
- Acquire knowledge of Star Schema in SQL Server Data Warehouses for efficient data organisation.
DATA ENGINEER
LION NATHAN
Sydney, NSW
05.2014 - 04.2016
- Data Migration Rule Translation: Expertly interpreted business requirements and converted them into effective data migration rules, aligning data processes with organisational goals
- Workflow/Dataflow Design & Improvement: Designed workflows and dataflows for data extraction from legacy systems to MS SQL Server, optimising data transfer processes and enhancing data quality through address cleansing tools
- ETL Job Recovery & Automated Development: Implemented a robust ETL job recovery mechanism and automated ETL processes using SSIS packages, improving data reliability and adherence to coding standards
- SSIS Package Development & Maintenance: Developed high-quality SSIS packages in Visual Studio and maintained multiple ETL packages, resolving issues during testing
- Business Collaboration & Data Management: Collaborated with business groups in developing Reference Data and manipulated data using various techniques for accurate processing, including complex transformations
- Data Optimization & Quality Assurance: Optimized data collation and sorting processes and contributed to developing quality assurance plans and initiatives to maintain high data standards
- Leadership & Mentoring: Mentored junior team members in data management practices, promoting a culture of learning and professional growth
- Self-Directed Learning & Business Support: Demonstrated self-guided mastery in SQL Server-based ETL processes and supported business units, ensuring data strategies align with business objectives.
Education
Skills
- Formal & informal communication
- Problem / Conflict Resolution
- Analytical & logical reasoning
- Effective communication
- Self-direction
- Highly adaptive and flexible
Accomplishments
- Successfully delivered a data migration solution for Lion Nathan using SQL scripting language, showcasing adaptability and skill in SQL.
- Developed an SQL cursor program for a Tolling project deployed to millions of fuel stations in NSW, demonstrating project management and technical proficiency.
- Played a vital role at the Australian Fisheries Management Authority in ETL processes, data migration, quality assurance, and reporting, highlighting data management and collaboration skills.
- As a Data Manager at Leidos Australia, formulated data migration strategies, conducted data audits, and led data cleansing and documentation efforts, emphasising strategic planning and attention to detail.
- Led a team at NHMRC, focusing on data migration strategy and project management, showcasing leadership and strategic thinking.
- At Lion Nathan, excelled in translating business requirements to data migration rules and enhanced data quality, demonstrating a solid understanding of business needs and technical expertise.
- As a Data Test Engineer at the Department of Health, engaged in data investigation, data mining, and complex query development, highlighting analytical skills and proficiency in data analysis.
Database Related Skill
- Extract, Transform, Load (ETL)
- Data Modelling
- Structured Query Language (SQL)
- Data Warehousing
- AZURE Cloud
- ORACLE
- SQL SERVER
- Building Azure Data Factory (ADF)
- Windows Azure Blob Storage (WABS)
- SQL Server Management Console (SSMS)
- SQL Server Integration Services (SSIS)
- Visual Studio
- SQL Developer for ORACLE
- Microsoft Visio
- TOAD for ORACLE
- JIRA
- PowerShell (exposure)
- XML (exposure)
Timeline
DATA ENGINEER
AUSTRALIAN FISHERIES MANAGEMENT AUTHORITY (AFMA)
08.2023 - 11.2023
DATA MANAGER
LEIDOS AUSTRALIA
08.2022 - 07.2023
DATA TEST ENGINEER
DEPARTMENT OF HEALTH
01.2022 - 08.2022
DATA MIGRATION LEAD
National Health and Medical Research Council
06.2019 - 12.2021
DATA TEST ENGINEER
DEPARTMENT OF JOBS
01.2019 - 06.2019
DATA ENGINEER
LION NATHAN
05.2014 - 04.2016
Similar Profiles
Katrina ViccarsKatrina Viccars
Admin Support Officer (VPS3) at Victorian Fisheries AuthorityAdmin Support Officer (VPS3) at Victorian Fisheries Authority
Wytasie WalkerWytasie Walker
Digital Artist at Victorian Fisheries AuthorityDigital Artist at Victorian Fisheries Authority
Orane WintOrane Wint
Manager at National Fisheries AuthorityManager at National Fisheries Authority
Asad BabarAsad Babar
Solar Sales Representative at Urban Solar LifeSolar Sales Representative at Urban Solar Life
Yutong LiuYutong Liu
Exam Coordinator at Australian Medical Council LimitedExam Coordinator at Australian Medical Council Limited