robots.txt class

Give this class the contents of a robots.txt file or the URL to it and it will parse it for you. As an option you can give it the name or your robot/spider/crawler and it will return only the section that applies to your case. Works through proxies with the help of Snoopy (see script for more details).

Rezensionen

Es sind noch keine Kommentare vorhanden.

Hier Kannst Du einen Kommentar verfassen


Bitte gib mindestens 10 Zeichen ein.
Wird geladen... Bitte warte.
* Pflichtangabe
ANG GES G P
phpMyDir liest ein vorgegebenes verzeichnis nach kriterien aus und gibt die daten als array zurück. das array beinhaltet "verzeichnis + datei + d ...
ANG GES G P
This class was created to simplify the process of representing images with thumbnails. This class simply gets the image's size, converts the heig ...
ANG GES G P
Prints the uptime of the system in a way you want it to, needs /proc/uptime and therefore works only with Linux.
ANG GES G P
A very easy to use yet powerful and quick template engine. Enables you to seperate your page layout/design from your code. It can handle simple ...
ANG GES G P
OO interface for generating HTML tables. All HTML 3.2 elements can be defined.
ANG GES G P
A base class and 2 derivated classes to generate clients for dictionary servers that follow the DICT protocol (RFC 2229), such as the server at ...
ANG GES G P
The LDAP class for PHP is an easy way to interface your PHP program with an LDAP database. The interface is similar to what you would find in a fi ...
ANG GES G P
Simple class to translate strings into UTF-8 from your favorite charset.
248 x angesehen
0 x gemerkt
Details zur Anzeige
ANG GES G P
Anfrage stellen

Du bist nicht als Benutzer angemeldet. Bitte gebe Deinen Namen und E-Mailadresse an!

Wird geladen... Bitte warte.
Details zur Anbieter

toon.goedhart@