Modules: Spiders 1.20

Posted by: wishcraftOn 2010/5/30 3:10:00 5054 reads
Resized Image

Last release in 1 series

Spiders is a robot manager tool, that imports a list of all crawler and scanner robots on the web. It allows you to use XOOPS Permissiveness to control the data that robots list online your site. It will also log the robot in using a post loader and display when the robot is online on you 'Whos Online'.

The robot text file used is taken from an online resource of Robot data and stores it in your database. Remember to adjust your mainfile.php to include the post loader after the common file is loaded if you are running a version of XOOPS before the preloaders in 2.4.x series.

Robot Manager (Spiders) is a good way to control what your site displays in search engines. I suggest you set up the robots manually with just the required fields the robot.txt file is old over 10 years and there are much better resources on the web for Bots User Agents.

Spider is only written for XOOPS 2.3 and later.

It is imperiative you update to this version - there was a minor glitch in the orginal system that could lead to security intrusions

Download: xoops2.4_spiders_1.20.zip (141Kb)
Mirror: Live Skydriver

Changes
  • New Spider Form Define fixed.
  • New Percentile Matching System (Security Patch).
  • Owner Email Enforced.
  • Reserved Keywords Updated.
  • Percentile Match for User Agents incorporated.


Whats in Version 2 Series?

In version 2.0 series Spiders will be connected to a SOAP and CURL exchange most likely in the xortify cloud for us to maintain a cloud of robots and the unit will populate itself with the latest data in install.