Yang Guo

Work items: Participate in the complete data governance system design, development, testing and maintenance process.
• Work content: Use Java language to develop user-defined functions (UDF), user-defined aggregation functions (UDAF) and user-defined table generation functions (UDTF), and integrate them into the Hue platform. This move aims to provide strong technical support for data cleaning work and ensure data accuracy, consistency and timeliness.
• Use Hue (based on Hive SQL) tools to support data-driven application development and cross-departmental business needs. By providing technical solutions for data acquisition, cleaning and processing, help business departments to efficiently use data resources.
• Work with the team to optimize and improve the existing data processing process. Use Python and Java technology to automate the data cleaning process, greatly improving work efficiency and data processing quality.
• Actively research and evaluate the latest data technologies and tools, and based on a deep understanding of project requirements, propose practical data engineering solutions and suggestions to promote the continuous improvement of data management capabilities.

Project Overview: I developed a Python application that helps college freshmen easily choose courses through an interactive interface. The core of the project is a Python-based web crawler that uses BeautifulSoup to automatically extract course data from the university's official website. The data includes course names, credits, prerequisites, and prohibitions, which are then stored in a structured database.
Technical Details:
• Data Scraping: Use BeautifulSoup to crawl course information from the university handbook and save the data in JSON format for subsequent processing.
• Data Processing and Storage: Write a script to parse the JSON file, organize and store the data in a SQLite database to improve query efficiency.
• User Interface: Use Tkinter to develop a graphical user interface that displays the course tree structure. Students can choose courses based on whether they meet the prerequisites, and the selected courses will dynamically update the display color.

• Assisted with special events and programs.
• Maintained clean, neat, and operational facilities to serve program needs..
• Used strong interpersonal communication skills to convey information to others.
• Supported underprivileged families with the distribution of essential supplies, improving their living conditions.

Work project: Construct and analyze branch loan customer database and explore potential customer groups.
• Initial analysis: Use Excel to conduct in-depth analysis of more than 100,000 bank customer loan behavior data, initially determine the database table structure to be established, and reveal the significant relationship between loan frequency and customer characteristics.
• Database design optimization: Through discussions with team members, the impact of objective and subjective factors on customer loan behavior was analyzed. Based on the discussion results, the preliminary designed database table structure was optimized, increasing the database query speed by 25%.
• Database model construction: Used SQL language to work with the team to build a database model, creating 7 main tables and more than 20 related tables to ensure the rationality and effectiveness of the data structure. The optimized database structure improves query performance by 30%.
• Data visualization: Combined with Python programming skills, we developed axis graphics for displaying loan customer data, showing the distribution and key trends of customer data, and helping the business team identify 20% of high-potential customer groups.
• Business report writing: Wrote a loan business analysis report based on the database analysis results, and proposed 3 targeted strategies, helping the branch successfully attract and serve more than 15% of new potential loan customers.