Link Checker Bot
If you would like to add our bot in your forum's bot list to enable it to crawl and check links, here is our bot string:
| WGTools.com Link Checker Bot |
|---|
| Mozilla/5.0 (compatible; WGToolsBot/1.0; http://wgtools.com/link-checker-bot/) |
WGTools.com link checker bot crawls websites to find and check the link status of file hosts, the supported file hosts are listed in our Link Checker page.
The bot crawls websites that have added our Link Checker Addon, or any website using our link checker service.
The reason we decided to create a bot string is because some websites have "locked" content, such as forums, by making the bot, we're giving the ability for webmasters to add our bot in their forum's bot list and give it permission to view and check filehost links.
Our bot is an automatic and a manual bot at the same time, our bot automatically checks the links on your website, however it will only crawl when requested, we do not crawl websites automatically like search engine bots, such as Google Bot.
vBulletin Webmasters:
If you're using vBulletin and you have private sections then you need to edit "/includes/xml/spiders_vbulletin.xml" and add the following:
| vBulletin |
|---|
|
<spider ident="WGToolsBot"> <name>WGTools.com [LinkChecker]</name> <info>http://wgtools.com/link-checker-bot/</info> </spider> |
Also, install "KX - Spider Permissions" modification to control bots permissions:
• vBulletin 3.8.x
• vBulletin 3.7.x
Make sure that you give the bot permissions to view threads, go to ACP -> vBulletin Options -> KX - Spider -> Select yes on view threads.
phpBB3 Webmasters:
To add WGTool's link checker bot to view private sections, go to: ACP -> System -> Spiders/Robots. Then click on "Add Bot", and add the following:
| phpBB3 |
|---|
| Bot name: WGTools.com [LinkChecker] Agent Match: WGToolsBot/1.0 |
Make sure that you give the bots usergroup permission to view topics, in ACP edit the bot usergroup's permissions and enable view topics.
Note: As we mentioned, our bot will not crawl your website unless it is requested to crawl and check the filehost links on your website.
