---
title: "AI & search optimization (GEO/SEO)"
slug: "ai-search-optimization-geo-seo"
updated: 2026-07-22T04:45:30Z
published: 2026-07-22T04:45:30Z
canonical: "docs.document360.com/ai-search-optimization-geo-seo"
---

> ## Documentation Index
> Fetch the complete documentation index at: https://docs.document360.com/llms.txt
> Use this file to discover all available pages before exploring further.

# AI & search optimization (GEO/SEO)

The AI & search optimization (GEO/SEO) settings page is where you manage how search engines and AI crawlers discover, crawl, and index your knowledge base site. It brings together Robots.txt, your sitemap, and llms.txt in a single location, so you can control site-wide crawler behavior without visiting each setting separately.

You can access this page by navigating to **Settings** (<span class="fa-regular fa-gear"></span>) > **Knowledge base site** > **AI & search optimization (GEO/SEO)**.

<div align="center">
<img src="https://cdn.document360.io/860f9f88-412e-4570-8222-d5bf2f4b7dd1/Images/Documentation/ai-and-search-optimization.png" class="article_image" alt="AI & search optimization (GEO/SEO) page">
</div>

## Before you begin

- You have a Project **Owner** or **Admin** role to edit Robots.txt.
- Your project is set to **public** or **mixed** access mode for the Sitemap and LLMs.txt URLs to be available. Private projects are not indexed by search engines and do not generate these files.

## What you can do on this page

From here, you can edit your Robots.txt rules and view the auto-generated Sitemap and LLMs.txt URLs for your knowledge base site.


<div class="doc360-card-row">
  <div class="doc360-card">
    <div class="doc360-card__header">
      <p class="doc360-card__title">Robots.txt</p>
    </div>
    <p class="doc360-card__desc">Edit crawl rules that tell search engine crawlers which pages or sections they can or cannot request.</p>
    <a href="https://docs.document360.com/docs/robotstxt" class="doc360-card__link">Learn more →</a>
  </div>
  <div class="doc360-card">
    <div class="doc360-card__header">
      <p class="doc360-card__title">Sitemap</p>
    </div>
    <p class="doc360-card__desc">View the auto-generated sitemap URL that gives crawlers a complete list of your indexable pages.</p>
    <a href="https://docs.document360.com/docs/sitemap-generator" class="doc360-card__link">Learn more →</a>
  </div>
  <div class="doc360-card">
    <div class="doc360-card__header">
      <p class="doc360-card__title">LLMs.txt</p>
    </div>
    <p class="doc360-card__desc">View the auto-generated LLMs URL that helps AI models accurately retrieve and cite your content.</p>
    <a href="https://docs.document360.com/docs/llms-txt" class="doc360-card__link">Learn more →</a>
  </div>
</div>

:::(Info) (<span class="fa-regular fa-circle-exclamation"></span> NOTE)
Robots.txt does not restrict human access and should not be used as a security measure. To exclude individual articles or categories from search results, use Search visibility settings instead.

:::


## Best practices

- Always include your sitemap URL inside your Robots.txt rules so crawlers can discover both files in one place.
- Pair Robots.txt with Search visibility settings for precise, layered control over what gets indexed.
- Keep article AI & search descriptions between 150–160 characters — this length benefits both search engine snippets and `llms.txt` entries.
- Revisit this page after major restructuring (renamed categories, changed slugs, or a visibility change) to confirm your crawler-facing files still reflect the correct URLs.