DOCSEARCHbyAlgolia
Submit Docs

WP Content Crawler Documentation

website·Indexed 33 days ago

https://docs.wpcontentcrawler.com/

Documentation for the WP Content Crawler plugin, covering general settings, site-specific configurations, and common options. Includes guides on SEO tabs, scheduling, translation API options (such as Yandex Translate), file operations, and a comprehensive FAQ section for troubleshooting and licensing.

Tokens
550.1K
Snippets
776
Records
4.8K
Agent score
54%

What's inside WP Content Crawler

  1. Overview of WordPress Content Crawler

    WordPress Content Crawler is a WordPress plugin designed to scrape, grab, and retrieve content from external websites. It primarily uses CSS selectors to locate and extract specific data from a target page's source code. To assist users in finding these selectors, the plugin includes a Visual Inspector tool that allows users to click on an element to identify its CSS selector or find similar elements (e.g., all URLs in a category page).

  2. Overview of WP Content Crawler Filter Command Structure

    Filters in WP Content Crawler are constructed using a specific syntax consisting of a subject, a property, and options. The command structure is divided into four primary categories:

    1. Command Subjects: The entity being targeted (e.g., Post, WooCommerce, Special, or Error).
    2. Subject Properties: The specific attribute of the subject being evaluated (e.g., Value, Character length, HTML, Text, or HTTP status code).
    3. Condition Commands: The logical operator used to test the property (e.g., Equal to, Contains, Matches regex, or Is newer than).
    4. Action Commands: The operation executed based on the filter's result (e.g., Assign, Find and replace, Make slug, or Remove).

  3. Overview of Filter Settings for conditional logic

    Filter settings allow you to implement conditional "if-then" logic within the application. A filter consists of two primary components: the if part (condition) and the then part (action). If the conditions in the if part are met (evaluate to true), the actions in the then part are executed. If no condition is defined in the if part, the action commands are executed by default. Multiple filters can be configured within a single filter setting.

  4. Overview of Filter Settings conditional logic

    Filter settings allow you to execute actions conditionally based on specific criteria. A filter consists of two primary components: the if part (condition) and the then part (action). If the conditions in the if part are met (evaluate to true), the actions in the then part are executed. If no condition is defined in the if part, the action commands are always executed.

  5. Overview of WordPress Content Crawler

    WordPress Content Crawler is a plugin designed to scrape, grab, and retrieve content from almost any website on the internet. It uses CSS selectors to locate specific data within a target page's source code. To assist users in finding these selectors, the plugin includes a Visual Inspector tool that allows users to click an element to identify its CSS selector or find similar items (e.g., all URLs in a category page).

  6. Overview of WordPress Content Crawler

    WordPress Content Crawler is a WordPress plugin designed to scrape, grab, and retrieve content from almost any website on the internet. It primarily uses CSS selectors to locate and extract specific data from a target page's source code. To assist users in finding these selectors, the plugin includes a Visual Inspector tool that allows users to click on an element to identify its CSS selector or find similar elements (e.g., all URLs in a category page).

  7. Overview of WordPress Content Crawler

    WordPress Content Crawler is a WordPress plugin designed to scrape, grab, and retrieve content from almost any website on the internet. It primarily uses CSS selectors to locate and extract specific data from a target page's source code. To assist users in finding these selectors, the plugin includes a Visual Inspector tool that allows users to click an element to identify its CSS selector or find similar items (e.g., all URLs in a category page).

  8. Overview of Post Meta (Custom Fields) in WP Content Crawler

    The Post Meta section allows you to save values into the WordPress wp_postmeta table. In WordPress, post meta is commonly referred to as 'Custom Fields'. These values are often used by themes and plugins to store specific post information.

    Key technical details:

    • Values are stored in the wp_postmeta table under the meta_key and meta_value columns.
    • If a meta key starts with an underscore (_), it is treated as private and hidden from the standard Custom Fields section in the WordPress post editor.
    • The plugin automatically assigns the post_id when saving meta values.

  9. Overview of WordPress Content Crawler

    WordPress Content Crawler is a plugin designed to scrape, retrieve, and save content from external websites into a WordPress installation. It primarily uses CSS selectors to locate specific data within a target page's source code. To assist users in finding these selectors, the plugin includes a Visual Inspector tool that allows users to click on page elements to identify their corresponding CSS selectors.

  10. Overview of WordPress Content Crawler

    WordPress Content Crawler is a plugin used to scrape, grab, and retrieve content from external websites. It utilizes CSS selectors to locate specific data within a target page's source code. To assist users in finding these selectors, the plugin includes a Visual Inspector tool that allows users to click on an element to identify its CSS selector or find similar items (e.g., all URLs in a category page).

  11. Overview of WordPress Content Crawler

    WordPress Content Crawler is a WordPress plugin designed to scrape, grab, and retrieve content from almost any website on the internet. It primarily uses CSS selectors to locate and extract specific data from a target page's source code. To assist users in finding the correct selectors, the plugin includes a Visual Inspector tool that allows users to click an element to identify its CSS selector or find similar elements (e.g., all URLs in a category page).

  12. Overview of Post Meta (Custom Fields) in WP Content Crawler

    The Post Meta section allows you to save values into the WordPress wp_postmeta table. In WordPress, 'custom fields' and 'post meta' refer to the same data. Meta keys starting with an underscore (_) are treated as private and are hidden from the custom fields section in the WordPress post editor, though they are still stored in the database.