Skip to main content
Version: current

Manage your crawls

DocSearch comes with the Algolia Crawler web interface that allows you to configure how and when your Algolia index will be populated.

Trigger a new crawl

Head over to the Overview section to start, restart or pause your crawls and view a real-time summary.

Algolia Crawler creation page

Monitor your crawls

The monitoring section helps you find crawl errors or improve your search results.

Algolia Crawler creation page

Update your config

The live editor allows you to update your config file and test your URLs (URL tester).

Algolia Crawler creation page

Search preview

From the editor, you have access to a Search preview tab to browse search results with DocSearch v3.

Algolia Crawler creation page

URL tester

From the editor, your can use the URL tester to debug selectors or how we crawl your website.

Algolia Crawler URL tester