Common use cases

Scraping each page from a list of URLs

To scrape sites like blogs and directories, you can scrape each page from a list of URLs:

1. Scrape the list of URLs
   • Download as CSV
2. Add URLs
   • Select “Scrape Details” from the select menu on the top right corner
   • Upload CSV of the list of URLs
   • Select column with the URLs to scrape
3. Select elements
   • Create a new scraper for the page
   • On the page, select the elements you want to scrape
   • Verify that the scraper captures all the data you want
4. Start scraping
   • Start scraping to automatically scrape each page

Troubleshooting

Scraping Lists

Scraping ends too early

If scraping ends while there are still more items, change your settings to give the site more time to load.

• Increase minimum wait time: If Easy Scraper tries to scrape before the site is ready, it may think that there are no more items left to scrape.
• Increase maximum wait time: If you’re scraping a super slow website, increase the maximum wait time to wait for more items to load.
• Try focusing the tab being scraped: Some sites don’t load properly unless the tab is in the foreground. You can create a separate window for scraping so that the tab can stay on top while you continue browsing.

How do I scrape faster?

Easy Scraper uses default settings that work well for most sites, but you might want to extract data more quickly. Please use caution and your best judgment to avoid overwhelming sites or having your account flagged for suspicious activity.

• Disable Autoscroll: If the website you’re scraping doesn’t load new items upon scrolling, you can disable autoscroll to speed up scraping.
• Decrease minimum wait time: Decrease waiting before scraping the page. If the wait time is too short, data may not be captured correctly on websites that take longer to load.