robots.txt class

Give this class the contents of a robots.txt file or the URL to it and it will parse it for you. As an option you can give it the name or your robot/spider/crawler and it will return only the section that applies to your case. Works through proxies with the help of Snoopy (see script for more details).

Reviews

There are no comments available yet.

Here you can write a comment


Please enter at least 10 characters.
Loading... Please wait.
* Pflichtangabe
ANG GES G P
PHP class to generate Excel files on the fly. Supports formatting of cells, spread sheet protection.
ANG GES G P
Class to support MySQL sessions with many servers
ANG GES G P
/** Class for loading data into a single MySQL table. ** Constructor parameters LoadData(, ). ** Function parameters InputMember(, input>). */
ANG GES G P
Very Simple Template allows you to dissociate very simply HTML code from PHP code. A programer will easily rewrite an HTML project done by a grap ...
ANG GES G P
The LDAP class for PHP is an easy way to interface your PHP program with an LDAP database. The interface is similar to what you would find in a fi ...
ANG GES G P
AdminPro is a user authentication class based on MySQL and the PHP Session functions. It was written for Web sites that need some password protect ...
ANG GES G P
class that makes it very easy to read and write XML files. It uses an in-memory tree structure to accomplish this. It allows you to create ni ...
ANG GES G P
jfile class is a wrapper class for fopen/fclose and flock. With this class, its easy to open new files which are locked and released after use
282 x viewed
0 x memorized
Details to the advertisement
ANG GES G P
Make a request

You are no longer logged in as a user. Please enter your name and your E-mail-adress!

Loading... Please wait.
Details to the seller

toon.goedhart@