Give this class the contents of a robots.txt file or the URL to it and it will parse it for you. As an option you can give it the name or your robot/spider/crawler and it will return only the section that applies to your case. Works through proxies with the help of Snoopy (see script for more details).
ANG
GES
G
P
DX0 is a PHP library that generates Dynamic HTML specific to the visitor's browser. DX0 focuses on generating tight, compact DHTML. DX0 allows cla ...
ANG
GES
G
P
Compile many classes into one class. This class get around the limited
class extension that PHP offers. IE class A extends classb, classc etc is
...
ANG
GES
G
P
Diese Klasse ermöglicht die Abfrage der WHOIS Informationen und Verfügbarkeit von insgesamt 254 unterschiedlichen Top Level Domains.
Zudem kann ...
ANG
GES
G
P
A "better" CountryList class. Supports German, English and Frensh ISO 3166
Country Codes and Names.
ANG
GES
G
P
A Class to render automagically Form Fields Html code. I use it in
combination with a table that contains the fields description like type,
name ...
ANG
GES
G
P
This MySQL class has the following features:
- Debug messages (can be activate or not);
- Error handling (can be activate or not);
- Basic MySQ ...
ANG
GES
G
P
This class is an HTML parser written in PHP4, by employing which you can
parse a rather-standard HTML stream into a tree-structure, that consitut ...