- The content is optimized for search engines.
- The content is talked about often.
- The content is referred to often.
- The content is cited in other works.
When should you use a robots.txt file?
When you have multiple versions of a page to indicate the preferred version When your website receives a penalty from Google When you have pages
