Skip to main content

Web Page Source Search

Updated

Purpose

Search for a specific tag in the page source.
 

Category Location: All, Data Services/Enrichment

 

Field description

Web page source search.png
  1. Search in this URL: The URL string you would like to search. You can specify a URL to be searched by (a) directly typing in the full URL (b) specifying an attribute that contains the full URL (c) creating the URL using a combination of text and attributes. To select an attribute for the URL or for inclusion as a parameter in the URL, use the “@” sign then select the attribute from the list that appears. An attribute that is correctly selected should appear in the following format: {{attribute_name}}.
  2. Tags to search for: Enter the tag(s) value to identify.
  3. Add attribute: Create a yes/no attribute to house if the tag was found and create a text attribute to house the first snippet found information.
  4. Tag found: Select the attribute that indicates if a tag was found (yes/no).
  5. First snippet found: Select the attribute that holds the first snippet found text information.
  6. Snippet length: Specify the number of characters to capture before and/or after the specified tag text. Maximum is 1000 characters when using the "before and after" option and 2000 characters when using either the "before" or "after" option. Minimum for all options is 2 characters.

 

Output Attributes:

Attributes designed to give you additional context regarding the search status.

  • webpage_source_search_status: Status of the search action/whether the specified URL was able to be searched or not.
  • webpage_source_search_error: Text of the error message, if an issue was encountered during the searching process. 
  • webpage_source_search_url_scraped: The complete URL you specified to be searched in the task configuration. If you specify attributes as a part of the URL, the values for those attributes will be populated here so you can see the complete URL that corresponds to the searched data.

     

Example:

  • You want to identify what websites use Magento’s open source code, so the search is for certain cart/payment pages to search for Magento tags

Related articles