good stuff
This commit is contained in:
parent
ea8389ef40
commit
f4de0eeb9f
39 changed files with 5165 additions and 348 deletions
9
frontend/public/robots.txt
Normal file
9
frontend/public/robots.txt
Normal file
|
|
@ -0,0 +1,9 @@
|
|||
User-agent: *
|
||||
Allow: /
|
||||
Disallow: /api/
|
||||
Disallow: /metrics
|
||||
Disallow: /health
|
||||
Disallow: /pb/
|
||||
Disallow: /s/
|
||||
|
||||
Sitemap: https://perfect-postcode.co.uk/sitemap.xml
|
||||
Loading…
Add table
Add a link
Reference in a new issue