Google Scholar is an important tool for academic researchers around the world to find and obtain literature, covering papers, monographs and conference papers in various fields. However, due to its strict anti-crawler mechanism, it is not easy to directly crawl Google Scholar data, especially for users who need large-scale data collection. In this article, we will introduce two methods for crawling Google Scholar data: manual crawling (Scrapy/Selenium) and Scrapeless API.
