robots.txt class

Give this class the contents of a robots.txt file or the URL to it and it will parse it for you. As an option you can give it the name or your robot/spider/crawler and it will return only the section that applies to your case. Works through proxies with the help of Snoopy (see script for more details).

Rezensionen

Es sind noch keine Kommentare vorhanden.

Hier Kannst Du einen Kommentar verfassen


Bitte gib mindestens 10 Zeichen ein.
Wird geladen... Bitte warte.
* Pflichtangabe
ANG GES G P
This is a very easy to use class for making tables with various styles. It also has an example included.
ANG GES G P
i18n ist eine sammlung von klassen um mehrsprachige php seiten besser managen zu können. zahlen, währungen, datumsangaben usw. können ebenfalls ...
ANG GES G P
Ever written some large-ish PHP app and wished you didn't have to write all those SQL statements by hand? To create all those oh-so-similar classe ...
ANG GES G P
webring provides an easy-to-configure solution for creating a webring. All URLs are stored in one file (webring.urls), and each link in the webri ...
ANG GES G P
Die EasyPhpThumbnail Klasse erlaubt Ihnen, Thumbnails zu erstellen und Bildmanipulation für GIF, JPG und PNG schnell zu handhaben. Die Klasse is ...
ANG GES G P
DX0 is a PHP library that generates Dynamic HTML specific to the visitor's browser. DX0 focuses on generating tight, compact DHTML. DX0 allows cla ...
ANG GES G P
phpSorm is mainly a base-class which provides a simple way to map a table from a relational database to a PHP-object. The extended functionality i ...
993 x angesehen
0 x gemerkt
Details zur Anzeige
ANG GES G P
Anfrage stellen

Du bist nicht als Benutzer angemeldet. Bitte gebe Deinen Namen und E-Mailadresse an!

Wird geladen... Bitte warte.
Details zur Anbieter

toon.goedhart@