About our crawler
BayAreaTXBot reads public event calendars and public records once a day to keep this guide current.
How it behaves
- It identifies itself as
BayAreaTXBot/0.1 (+https://bayareatx.com/about/bot). - It honors robots.txt, including wildcard rules, and waits at least one second between requests to the same host.
- It never works around bot protection, CAPTCHAs or logins.
- It keeps facts (names, dates, addresses, prices) and links back to the source. It doesn't republish descriptions or images.
Want us to stop, or to crawl you more?
Add a User-agent: BayAreaTXBot rule to your robots.txt and we'll follow it on the next run. If you run a calendar we should include, we'd love to hear about it.