As of now the plugin excludes individual pages and posts marked as no index by most SEO plugins and you can select which post types are included. We will be adding manual entry field on the next release that will give users additional fine tune control.
For even more control, you have the option of using our plugin to produce an initial draft of your llms.txt file, copy/paste that into a text document until you get it designed exactly to your specifications, deactivate our plugin, and remove or paste over the auto-generated llms.txt file using your own llms.txt file uploaded to the root of your website.
Hello Ryan,
I am also experiencing some issues with pages ending up in “llms.txt” even though they are marked as “noindex” in YOAST SEO.
I really like your suggestion to manually edit llms.txt.
However, I noticed that after deactivating the plugin, the reference to llms.txt in
sitemap_index.xml and llms-sitemap.xml suddenly disappears.
I think that the llms.txt file is then not read by crawlers, right?
Would it be possible (in the short term) to add an option called “never” to the “update frequency” in the plugin? That way, the plugin could remain activated, the xml files would work, but the manual llms.txt would not be overwritten after a week (currently the longest option)?
Kind regards
Kiu
