Product Image

Java Web Scraping Handbook

$29.00 USD

Web scraping or crawling is the art of fetching data from a third party website by downloading and parsing the HTML code to extract the data you want. It can be hard. From bad HTML code to heavy Javascript use and anti-bot techniques, it is often tricky.

Lots of companies use it to obtain knowledge concerning competitor prices, news aggregation, lead generation...

This book will teach you how to extract data from any website, how to deal with AJAX / Javascript-heavy websites, break captchas, deploy your scrapers in the cloud and many other advanced techniques.

With this package you'll get:

  • 130 pages Ebook in PDF / EPUB / MOBI
  • Full source code
  • Access to a sandbox website
  • Free Updates

Table of Content:

1-Introduction to Web Scraping In this chapter, you will learn what Web Scraping is. Who uses it, for what purpose, and the legal side.

2-Web fundamentals You can't scrape the web before really understanding it, we will go through each important foundation of the web: HTTP protocol, and the DOM.

3-Extracting the data you want In this chapter, you will learn how to parse simple HTML, through lots of different examples

4- Handling forms Dealing with forms can be complicated, in this chapter I will show you how to pass through login forms, or post any forms

5-Dealing with JavaScript JavaScript-heavy website can be quite complicated to deal with. In this chapter, we will see how to use Chrome in headless mode to handle this task.

6-Captchas, Images Keypads and other beautiful things Learn how to deal with captchas, sign in "Images Keypad" protected login forms and other annoying things

7-Stay under cover In this chapter, we will see how to stay undetected, how to use proxies and make our scraping bots look like Humans

8- Cloudy Scraping Learn how to run your scrapers in the cloud, to perform large-scale web scraping tasks.

About Me

Hi there, I'm Kevin Sahin, the author of Java Web Scraping Handbook. I have a personal blog where I write about Web scraping and software development. I'm the co-founder of ScrapingBee, a leading web-scraping API.

Previously I spent more than four years building large scale web scrapers in the fintech industry, we're talking about millions of web pages scraped each day. I got my BS in computer science at Paul Sabatier University, in Toulouse, France. I wish I had a book like this when I started my job, to answer all the questions I had. Unfortunately, there wasn't a lot of good resources about web scraping back then. But now there is :)

You can find me on Twitter or on my blog: [