Skip to content
Commit de404162 authored by nimrod's avatar nimrod
Browse files

Robots.txt improvements. 

- Replace file with configuration snippet.
- Allow some domains, disallow others.
parent e4b7a421
Hide whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment