diff options
Diffstat (limited to 'perl/perl-www-robotrules')
| -rw-r--r-- | perl/perl-www-robotrules/slack-desc | 11 |
1 files changed, 6 insertions, 5 deletions
diff --git a/perl/perl-www-robotrules/slack-desc b/perl/perl-www-robotrules/slack-desc index e238bd180b..a786f954e6 100644 --- a/perl/perl-www-robotrules/slack-desc +++ b/perl/perl-www-robotrules/slack-desc @@ -4,13 +4,14 @@ # the right side marks the last column you can put a character in. You must make # exactly 11 lines for the formatting to be correct. It's also customary to # leave one space after the ':'. -# |----------------------------------------------------------| + + |-----handy-ruler------------------------------------------------------| perl-www-robotrules: perl-www-robotrules (DB of robots.txt-derived perms) perl-www-robotrules: -perl-www-robotrules: This perl module parses /robots.txt files as specified -perl-www-robotrules: in "A Standard for Robot Exclusion". Webmasters can use -perl-www-robotrules: the /robots.txt file to forbid conforming robots from -perl-www-robotrules: accessing parts of their web site +perl-www-robotrules: This perl module parses /robots.txt files as specified in "A +perl-www-robotrules: Standard for Robot Exclusion". Webmasters can use the /robots.txt +perl-www-robotrules: file to forbid conforming robots from accessing parts of their +perl-www-robotrules: web site perl-www-robotrules: perl-www-robotrules: http://search.cpan.org/dist/WWW-RobotRules/ perl-www-robotrules: |