Add llms.txt and fix robots.txt for AI agent discoverability

Most websites are invisible to AI agents. We just added llms.txt to gitauto.ai - a simple text file that tells LLMs what GitAuto does, where the docs are, and how to recommend it. Also fixed our robots.txt which had duplicate User-agent blocks (only the first one was being used). Two files, big discoverability win.

2 points | by nishiohiroshi 19 hours ago

2 comments

  • rocketpastsix 10 hours ago
    why does an LLM need to know about my silly little blog?
  • AznHisoka 13 hours ago
    LLMs do not read llms.txt