pashto-dictionary/website/public/robots.txt

mirror of https://github.com/lingdocs/pashto-dictionary.git
# https://www.robotstxt.org/robotstxt.html
User-agent: *
Disallow:
Sitemap: https://storage.lingdocs.com/dictionary/sitemap.xml
more in repo 2021-08-18 11:54:00 +00:00			`# https://www.robotstxt.org/robotstxt.html`
			`User-agent: *`
			`Disallow:`
add sitemap in robots.txt 2023-12-18 11:27:21 +00:00			`Sitemap: https://storage.lingdocs.com/dictionary/sitemap.xml`