robots.txt class

Give this class the contents of a robots.txt file or the URL to it and it will parse it for you. As an option you can give it the name or your robot/spider/crawler and it will return only the section that applies to your case. Works through proxies with the help of Snoopy (see script for more details).

Reviews

There are no comments available yet.

Here you can write a comment


Please enter at least 10 characters.
Loading... Please wait.
* Pflichtangabe
ANG GES G P
esay - isert/add elements to any position of your array(s) - delete elements from your array(s) - move elements within your array(s) - replace e ...
ANG GES G P
Description: Class that generates HTML output of a calendar month based on the table wrapper base class. It features: - Generates output any m ...
ANG GES G P
Class library for easy creation of hybrid WAP pages. The page is defined in a object oriented generic way. Depending on the user's browser eithe ...
ANG GES G P
Another MySQL interface class for php. FUNCTIONS: GetDatabases, CreateDB, DropDB, CopyDB, SelectDB, GetTableList, GetFieldList, Delete, Update, ...
ANG GES G P
class that makes it very easy to read and write XML files. It uses an in-memory tree structure to accomplish this. It allows you to create ni ...
ANG GES G P
A framework for mysql database searches and displaying the results making it quick and easy to set up a html search form.
ANG GES G P
fileupload.class extends PHP's native support for uploading image and text files through a Web browser. It can clean up the file's name, detect it ...
ANG GES G P
- Freeware - Counterklasse - speichert IP, OS ,Browser und Besuchszeit in der MySQL - Datenbank - Reloadsperre über IP - Ermittlung der User ...
258 x viewed
0 x memorized
Details to the advertisement
ANG GES G P
Make a request

You are no longer logged in as a user. Please enter your name and your E-mail-adress!

Loading... Please wait.
Details to the seller

toon.goedhart@