---
title: "AI & search optimization (GEO/SEO)"
slug: "ai-search-optimization-geo-seo"
description: "Manage AI & search optimization with Robots.txt, sitemap, and llms.txt to control crawler access, indexing, and AI content retrieval."
updated: 2026-10-29T05:47:42Z
published: 2026-10-29T05:47:42Z
canonical: "docs.document360.com/ai-search-optimization-geo-seo"
---

> ## Documentation Index
> Fetch the complete documentation index at: https://docs.document360.com/llms.txt
> Use this file to discover all available pages before exploring further.

# AI & search optimization (GEO/SEO)

The AI & search optimization (GEO/SEO) settings page is where you manage how search engines and AI crawlers discover, crawl, and index your knowledge base site. It brings together Robots.txt, your sitemap, and llms.txt in a single location, so you can control site-wide crawler behavior without visiting each setting separately.

You can access this page by navigating to **Settings** () > **Knowledge base site** > **AI & search optimization (GEO/SEO)**.

![AI & search optimization (GEO/SEO) page](https://cdn.document360.io/860f9f88-412e-4570-8222-d5bf2f4b7dd1/Images/Documentation/ai-and-search-optimization.png)

## Before you begin

- You have a Project **Owner** or **Admin** role to edit Robots.txt.
- Your project is set to **public** or **mixed** access mode for the Sitemap and LLMs.txt URLs to be available. Private projects are not indexed by search engines and do not generate these files.

## What you can do on this page

From here, you can edit your Robots.txt rules and view the auto-generated Sitemap and LLMs.txt URLs for your knowledge base site.

  
    
      

Robots.txt

    
    

Edit crawl rules that tell search engine crawlers which pages or sections they can or cannot request.

    [Learn more →](https://docs.document360.com/docs/robotstxt)
  
  
    
      

Sitemap

    
    

View the auto-generated sitemap URL that gives crawlers a complete list of your indexable pages.

    [Learn more →](https://docs.document360.com/docs/sitemap-generator)
  
  
    
      

LLMs.txt

    
    

View the auto-generated LLMs URL that helps AI models accurately retrieve and cite your content.

    [Learn more →](https://docs.document360.com/docs/llms-txt)
  

 NOTE

Robots.txt does not restrict human access and should not be used as a security measure. To exclude individual articles or categories from search results, use Search visibility settings instead.

## Best practices

- Always include your sitemap URL inside your Robots.txt rules so crawlers can discover both files in one place.
- Pair Robots.txt with Search visibility settings for precise, layered control over what gets indexed.
- Keep article AI & search descriptions between 120–160 characters, including spaces. This length benefits both search engine snippets and `llms.txt` entries.
- Revisit this page after major restructuring (renamed categories, changed slugs, or a visibility change) to confirm your crawler-facing files still reflect the correct URLs.

## Related

- [Robots.txt](/robotstxt.md)
- [GEO/SEO](/seo.md)
- [Sitemap](/sitemap-2.md)