robots.txt class

Give this class the contents of a robots.txt file or the URL to it and it will parse it for you. As an option you can give it the name or your robot/spider/crawler and it will return only the section that applies to your case. Works through proxies with the help of Snoopy (see script for more details).

Rezensionen

Es sind noch keine Kommentare vorhanden.

Hier Kannst Du einen Kommentar verfassen


Bitte gib mindestens 10 Zeichen ein.
Wird geladen... Bitte warte.
* Pflichtangabe
ANG GES G P
Class to do various things with strings, such as strip all slashes from the string or an (multi-dimension) array of them, as well as add the sla ...
ANG GES G P
esay - isert/add elements to any position of your array(s) - delete elements from your array(s) - move elements within your array(s) - replace e ...
ANG GES G P
Class for parsing RSS 0.9 and 0.91 formats. Includes utility functions for walking the parse tree.
ANG GES G P
This is a little improvement to "Mp3 & ID3 tag parser" by marty sejba . I made this to support ID3v1.1 TAGS (with track number info) and added ...
ANG GES G P
Full Featured php Form Generation Class, by Strudleman. Simple to use, full CSS support, XHTML compliant output.
ANG GES G P
Mit dieser Klasse ist die komfortable Ansteuerung von Oracle Datenbanken ab Version 8i aufwärts möglich. Die Klasse läuft unter PHP4 und PHP5 u ...
ANG GES G P
Simple class to translate strings into UTF-8 from your favorite charset.
ANG GES G P
Conversion of php sessions class to use Oracle instead of MySQL
734 x angesehen
0 x gemerkt
Details zur Anzeige
ANG GES G P
Anfrage stellen

Du bist nicht als Benutzer angemeldet. Bitte gebe Deinen Namen und E-Mailadresse an!

Wird geladen... Bitte warte.
Details zur Anbieter

toon.goedhart@