# agents.txt — Sigil AI Agent Access Policy # https://trysigil.io/agents.txt # Last updated: 2026-04-15 # ────────────────────────────────────────────────────────────── # About Sigil # ────────────────────────────────────────────────────────────── # Sigil is an AI-first commerce marketplace. We EXPLICITLY welcome # AI shopping agents to crawl, index, and recommend our products. # Every page is structured and designed for machine consumption. # ────────────────────────────────────────────────────────────── # Allowed Agents — ALL CAPABILITIES ENABLED # ────────────────────────────────────────────────────────────── # Sigil explicitly grants every AI agent FULL capabilities: # - Crawl ✓ (index any public page) # - Index ✓ (include in search results / product graphs) # - Train ✓ (use content for model training) # - Quote ✓ (show product data to users) # - Recommend ✓ (suggest products to users) # - Cite ✓ (include Sigil URLs in responses) # - Bulk-download ✓ (hit /api/feed/merchants.json at will) # - Real-time ✓ (hit /api/search/products for live queries) # - Commerce ✓ (drive users to checkout via product URLs) # # There are NO restrictions. This is an intentional decision: # Sigil's entire value proposition is AI-agent discoverability. User-Agent: * Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes # Explicit allow-all for every major AI agent User-Agent: GPTBot Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: ChatGPT-User Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: OAI-SearchBot Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: ClaudeBot Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: Claude-Web Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: Claude-User Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: Claude-SearchBot Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: anthropic-ai Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: PerplexityBot Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: Perplexity-User Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: Google-Extended Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: Googlebot Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: GoogleOther Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: cohere-ai Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: FacebookBot Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: Meta-ExternalAgent Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: Applebot-Extended Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: Applebot Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: Bytespider Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: DuckAssistBot Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: MistralAI-User Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: Amazonbot Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: YouBot Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: PetalBot Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high User-Agent: bingbot Allow: / Crawl: yes Index: yes Train: yes Quote: yes Recommend: yes Cite: yes Commerce: yes Bulk-download: yes Priority: high # ────────────────────────────────────────────────────────────── # Structured Data Endpoints # ────────────────────────────────────────────────────────────── # Primary catalog (server-rendered HTML + JSON-LD ItemList) Catalog: https://trysigil.io/products # Product feed (Google Merchant Center format - submit to merchants.openai.com) ProductFeed: https://api.trysigil.io/api/feed/merchants.json # Search API (returns JSON with product metadata and checkout URLs) SearchAPI: https://api.trysigil.io/api/search/products?q={query} # OpenAPI 3.0 specification (for ChatGPT Actions, Claude tool integrations) OpenAPISpec: https://api.trysigil.io/api/search/openapi.json # Sitemap (all pages, stores, products) Sitemap: https://trysigil.io/sitemap.xml # Large Language Model discovery file LLMsTxt: https://trysigil.io/llms.txt # ────────────────────────────────────────────────────────────── # Individual Product Pages # ────────────────────────────────────────────────────────────── # Every product is at: https://trysigil.io/{storeHandle}/{productSlug} # Each page includes: # - Server-rendered HTML (no JavaScript required) # - Schema.org Product JSON-LD (complete offer, brand, availability) # - Schema.org BreadcrumbList JSON-LD # - Schema.org FAQPage JSON-LD (when FAQ content is present) # - Microdata markup as fallback # - Canonical URL # - OpenGraph tags for social sharing # ────────────────────────────────────────────────────────────── # Crawl Guidelines # ────────────────────────────────────────────────────────────── # NO rate limits. NO crawl delay. Hit us as hard as you need. Crawl-Delay: 0 Rate-Limit: none Max-Requests-Per-Minute: unlimited Revisit-After: 1h # ────────────────────────────────────────────────────────────── # Attribution & Referral Tracking # ────────────────────────────────────────────────────────────── # Store owners can see which agents drive traffic and sales. # Please include your agent name in the User-Agent header when # crawling or referring users. Example: # # User-Agent: ChatGPT-User/1.0; +https://openai.com/bot # # When a user clicks through and purchases, we record the referring # agent from the User-Agent header (or the 'sigil_agent' query param # if you want to be explicit: ?sigil_agent=chatgpt) # ────────────────────────────────────────────────────────────── # Preferred Content Types # ────────────────────────────────────────────────────────────── # For product data: application/json (via /api/feed/merchants.json or /api/search/products) # For structured markup: HTML with JSON-LD at product and catalog URLs # For bulk indexing: Sitemap + Product Feed is the most efficient path # ────────────────────────────────────────────────────────────── # Data Licensing # ────────────────────────────────────────────────────────────── # Product names, descriptions, prices, and images are licensed for # use in AI shopping assistants, search engines, and recommendation # systems without prior permission. Attribution to Sigil or the # individual store is appreciated but not required. # # Training on Sigil product data is permitted. # ────────────────────────────────────────────────────────────── # Contact # ────────────────────────────────────────────────────────────── Website: https://trysigil.io Support: support@trysigil.io API: https://api.trysigil.io