Alibaba Web Scraper

My partner and I decided to go for the first track which is use e-commerce companies to webscrape and to give GTM insights using the information provided from their website. For this project, we used Alibaba as the company. For the two sites of Alibaba, we usedaThe system focuses on Alibaba as the target company. It collects real-time web data from Alibaba’s public pages, including the homepage and investor relations pages. The data pipeline first scrapes the web content using Bright Data Web Unlocker, then falls back to direct scraping if Bright Data access is restricted. After collecting the raw web content, the parser converts it into structured fields such as page topics, report titles, fiscal year, document links, and summary text. The parsed data is then passed to the analysis layer, which generates GTM insights such as market positioning, strategic priorities, sales recommendations, and high-priority business signals. A desktop UI was also added so users can run the homepage pipeline, investor pipeline, combined analysis, or formatted report without using the terminal. their homepage and their investor site. For our technology, we used bright data's web unlocker API for the web scraper, and for the AI we used Hugging Face API.