Changeset 18b22f43b623a4efb4eb2109b8b20d12d6aaebc9
- Timestamp:
- 06/02/10 03:28:05 (3 months ago)
- Author:
- Jim Garrison <jim@…>
- Children:
- f62d769ef9f30a1aa3d51cb70d64ec05c6d6088c
- Parents:
- 860a7ee3a0989629f6bf4b9f577aa37764b786a3
- git-committer:
- Jim Garrison <jim@jimgarrison.org> / 2010-06-02T00:28:05Z-0700
- Message:
-
don't index URNs
- Files:
-
Legend:
- Unmodified
- Added
- Removed
-
|
ra6150a6
|
r18b22f43
|
|
| 1 | | # Don't index "special" pages |
| | 1 | # Don't index "special" pages or URNs |
| 2 | 2 | User-agent: * |
| 3 | 3 | Disallow: /+* |
| | 4 | Disallow: /urn/ |
