LLM.txt & AI Crawler Setup Guide for Wix users

Create a text file named 'robots.txt' in your Wix site's root directory (via Wix Editor's SEO settings or FTP if applicable).

Include a brief introduction of your Wix site's purpose and key offerings.

Add markdown-style links to your most important Wix pages (e.g., services, portfolio, pricing, blog categories).

Incorporate a 'FAQ' section within the robots.txt to directly address common queries that AI training bots might have about your Wix site's content and services.

Access your Wix SEO settings (SEO Wiz) and configure crawl-delay directives or specific user-agent disallows/allows for AI bots.

Example directive: User-agent: * Disallow: /private-members-area/ Allow: /blog/ User-agent: AdsBot-Google Disallow: /checkout/

Utilize Wix's built-in SEO tools to verify your crawler permissions and ensure AI bots can access your sitemap.

Monitor your Wix site's analytics (e.g., Google Analytics, Wix Analytics) for unusual traffic patterns from known AI bot user agents to ensure they are hitting intended pages.

Wrap your primary Wix page content within `<main>` tags to clearly delineate the core subject of the page.

Use `<article>` tags for distinct blog posts or case studies hosted on your Wix site.

Employ `<section>` tags with descriptive `aria-label` attributes for different service offerings or product features presented on a Wix landing page.

Ensure all data tables used for service comparisons or pricing on your Wix site utilize proper `<thead>` and `<tbody>` tags for structured data extraction by AI.

Maintain logical content blocks, ideally under 500 words, that focus on a single Wix-related concept or problem/solution.

Avoid 'floating' context; ensure each section clearly reiterates the primary Wix feature, service, or user type it addresses, especially in summaries.

Eliminate ambiguous pronouns (e.g., 'it', 'they') and replace them with specific Wix terminology like 'Wix Editor', 'Wix ADI', 'Wix Stores', or the specific client's brand name.