Follow Links

The Follow links feature exists in Right Web Monitor Pro version only.

The Follow links feature lets the program:

1. Automatically process multiple HTML documents (even entire websites) and import into the program links placed within that documents.
2. Generate Follow Links Monitoring reports which provide you with detailed information about processed\deleted\new documents.

"Follow links" page contains following controls:

• "Follow links" checkbox determines whether the "Follow links" feature is enabled for the given resource.
• "Follow depth" edit field determines the maximum difference between the resource level from the site root and the levels of the links. Links levels are checked before they are processed/imported into the program (For example: The level difference of http://www.mysite.com/link.htm and http://www.mysite.com/folder1/link.htm links equals 1). If the difference is more than the value specified in this field the link won't be processed/imported.
• "Links to process" control set contains controls which let you adjust filter for the links which are going to be processed:
  • Select "Process links with any extensions" switch if you want the program to process encountered links with ANY extensions.
  • Select "Process only links with extensions below" switch if you want the program to process encountered links with extensions specified in the field below ONLY.
  • Select "Process all links but with extensions below" switch if you want the program to process encountered links with any BUT with extensions specified in the field below.
• "Links to import" control set contains control elements which let you adjust filter for the links which are going to be imported into the program:
  • Select "Import links with any extensions" switch if you want the program to import encountered links with ANY extensions.
  • Select "Import only links with extensions below" switch if you want the program to import encountered links with extensions specified in the field below ONLY.
  • Select "Import all links but with extensions below" switch if you want the program to import encountered links with any BUT with extensions specified in the field below.

How does it work:

1. The program sends HEAD request for the base URL (URL of the given resource). In case if content type of the resource is TEXT/HTML it downloads and saves the content of the resource locally.
2. The program creates a list of links which were found within resource content.
3. The program deletes from the list all the links with difference between their levels and the level of the resource more than specified in the "Follow depth" field.
4. The program imports from the list all the links with extensions which conform the "Links to import" filter.
5. The program processes (i.e. runs through the 1-4 steps) all the links with extensions which conform with the "Links to process" filter.

Important note: The program won't process\import links of the resources which aren't placed on the same site as the base resource (i.e. domain name of the links must be equal to the domain name of the base resource in order to get the links processed\imported).