robots.txt class

Give this class the contents of a robots.txt file or the URL to it and it will parse it for you. As an option you can give it the name or your robot/spider/crawler and it will return only the section that applies to your case. Works through proxies with the help of Snoopy (see script for more details).

Rezensionen

Es sind noch keine Kommentare vorhanden.

Hier Kannst Du einen Kommentar verfassen


Bitte gib mindestens 10 Zeichen ein.
Wird geladen... Bitte warte.
* Pflichtangabe
ANG GES G P
A very easy to use yet powerful and quick template engine. Enables you to seperate your page layout/design from your code. It can handle simple ...
ANG GES G P
Almost every PHP and SQL site a search. The problem is that these searches almost never support booleans. If they do it's usually pretty bad. The ...
ANG GES G P
An extenstion of html_mime_mail.class with pgp support
ANG GES G P
A framework for mysql database searches and displaying the results making it quick and easy to set up a html search form.
ANG GES G P
It provides a WWW PHP interface to the Napster music network.
ANG GES G P
This is a modification on Sword Su's code. You can now collapse menus with out having to click on another. I also refined the html a bit. I a ...
ANG GES G P
PHP Klassen zum erzeugen von Atom Feeds. Setzt PHP 5.1RC voraus. Eine deutsche Anleitung ist unter http://www.flaimo.com/php/atom zu finden.
ANG GES G P
Beautifier highlights and indents source code using highlight configuration files (which are similar to Ultraedit highlighting files). As such, it ...
689 x angesehen
0 x gemerkt
Details zur Anzeige
ANG GES G P
Anfrage stellen

Du bist nicht als Benutzer angemeldet. Bitte gebe Deinen Namen und E-Mailadresse an!

Wird geladen... Bitte warte.
Details zur Anbieter

toon.goedhart@