robots.txt class

Give this class the contents of a robots.txt file or the URL to it and it will parse it for you. As an option you can give it the name or your robot/spider/crawler and it will return only the section that applies to your case. Works through proxies with the help of Snoopy (see script for more details).

Reviews

There are no comments available yet.

Here you can write a comment


Please enter at least 10 characters.
Loading... Please wait.
* Pflichtangabe
ANG GES G P
Die EasyPhpThumbnail Klasse erlaubt Ihnen, Thumbnails zu erstellen und Bildmanipulation für GIF, JPG und PNG schnell zu handhaben. Die Klasse is ...
ANG GES G P
Class for comfortable read and write ini-files. This class provides functionality for reading ini-file from harddisk, editing it's elements (eas ...
ANG GES G P
Mit diesem Script kann man bestimmte Seiten cachen. Eignet sich gut um schlechte Datenbankperformance aus zugleichen.
ANG GES G P
Class library needed for displaying a big group of records in HTML page
ANG GES G P
Bei cphplib handelt es sich um eine Sammlung von PHP Funktionen. Diese können einfach in bestehende PHP-Scripte eingebunden und sofort genutzt we ...
ANG GES G P
CMailFile is a PHP class that allows you to attach files to an email you are sending from a PHP script.
ANG GES G P
phpMyDir liest ein vorgegebenes verzeichnis nach kriterien aus und gibt die daten als array zurück. das array beinhaltet "verzeichnis + datei + d ...
ANG GES G P
Object manipulation routine.
694 x viewed
0 x memorized
Details to the advertisement
ANG GES G P
Make a request

You are no longer logged in as a user. Please enter your name and your E-mail-adress!

Loading... Please wait.
Details to the seller

toon.goedhart@