distribution
OpenAI's web crawler. ScienceToStartup explicitly allows GPTBot on the public corpus via /robots.txt.
GPTBot is OpenAI's training-and-search crawler. ScienceToStartup explicitly allows it on the public corpus via /robots.txt, alongside ClaudeBot, PerplexityBot, and Google-Extended. We treat Answer Engines as first-class distribution and publish llms.txt, capabilities.json, and DefinedTermSet specifically for them to lift.
Source: curated glossary catalog. Freshness: git_versioned_curated_catalog.
Term API · apps/web/data/glossary/terms.ts