{ "id": "hc3pIv1ODZdg8iwV", "name": "Auto llms.txt Generator from Sitemap - Form + Page Titles + Copy or Download", "tags": [], "nodes": [ { "id": "c955f268-604d-4a0a-bab5-1dd3d5367223", "name": "Sticky Note", "type": "n8n-nodes-base.stickyNote", "position": [ -896, -208 ], "parameters": { "width": 432, "height": 1032, "content": "## Auto llms.txt Generator from Sitemap\n\nGive AI answer engines a clean map of your website. Fill a short form with your sitemap URL, and this workflow reads the live sitemap, visits each page, pulls the real title and meta description, and builds a ready to host llms.txt file. The result page lets you preview, copy, or download it. No crawler service, no CSV upload, no AI credits, and no credentials needed.\n\n### How it works\n1. **On Form Submission** collects the site name, description, sitemap URL and a page cap.\n2. The workflow fetches your sitemap and expands a sitemap index into its child sitemaps when needed.\n3. Page URLs are collected, deduplicated and grouped into sections based on the first URL folder.\n4. Each page is fetched once and its title and meta description are read from the HTML.\n5. A markdown llms.txt file is built and shown on a styled result page with Copy and Download buttons.\n\n### Setup steps\n1. No credentials are needed. Open node 1 and copy the form URL, or use the Test URL inside the editor.\n2. Open the form, enter your site name, description, sitemap URL and page cap, then submit.\n3. On the result page press Copy or Download to save the file.\n4. Upload llms.txt to your site root at yourdomain.com/llms.txt.\n\n### Customization\nRaise Max Pages for larger sites, change the section grouping rule in node 6, or edit the result page styling in node 8 to match your brand." }, "typeVersion": 1 }, { "id": "eaf3d167-32b7-4603-9db9-5273ff442570", "name": "Sticky Note1", "type": "n8n-nodes-base.stickyNote", "position": [ -416, 144 ], "parameters": { "color": 7, "width": 512, "height": 360, "content": "## 1. Form and config\nCollects the site name, description, sitemap URL and page cap, then normalizes them for the rest of the flow." }, "typeVersion": 1 }, { "id": "95d7c250-0a37-454f-8fd1-405c3ae555bc", "name": "Sticky Note2", "type": "n8n-nodes-base.stickyNote", "position": [ 128, 144 ], "parameters": { "color": 7, "width": 710, "height": 360, "content": "## 2. Read sitemaps\nFetches the sitemap, expands a sitemap index when present, and collects clean deduplicated page URLs." }, "typeVersion": 1 }, { "id": "ba496578-1158-4e7c-9a88-21b46ca86b64", "name": "Sticky Note3", "type": "n8n-nodes-base.stickyNote", "position": [ 880, 144 ], "parameters": { "color": 7, "width": 924, "height": 360, "content": "## 3. Build and show\nReads each page title and description, writes the llms.txt file, and shows a copy or download result page." }, "typeVersion": 1 }, { "id": "a8220c89-0199-4d80-994c-437586756fcd", "name": "1. On Form Submission", "type": "n8n-nodes-base.formTrigger", "position": [ -336, 320 ], "parameters": { "options": {}, "formTitle": "llms.txt Generator", "formFields": { "values": [ { "fieldLabel": "Site Name", "placeholder": "My Website", "requiredField": true }, { "fieldLabel": "Site Description", "placeholder": "One line about the site" }, { "fieldLabel": "Sitemap URL", "placeholder": "https://example.com/sitemap.xml", "requiredField": true }, { "fieldType": "number", "fieldLabel": "Max Pages", "placeholder": "50" } ] }, "formDescription": "Enter your site details and get a ready to host llms.txt file." }, "typeVersion": 2.2 }, { "id": "d5231a4c-dcc6-479c-a44f-c86867131b37", "name": "2. Set Config", "type": "n8n-nodes-base.set", "position": [ -112, 320 ], "parameters": { "options": {}, "assignments": { "assignments": [ { "id": "23145ef5-4e62-4af8-abc5-8e47c1a2f3b0", "name": "siteName", "type": "string", "value": "={{ $json['Site Name'] }}" }, { "id": "90858002-f2ad-4925-a938-d5a180fe063e", "name": "siteDescription", "type": "string", "value": "={{ $json['Site Description'] }}" }, { "id": "d582fb73-0120-4163-9a10-476231b1b773", "name": "sitemapUrl", "type": "string", "value": "={{ $json['Sitemap URL'] }}" }, { "id": "f176194e-5d3a-4224-98c0-0d4776b7b423", "name": "maxPages", "type": "number", "value": "={{ $json['Max Pages'] || 50 }}" } ] } }, "typeVersion": 3.4 }, { "id": "fe8f7bf1-c993-4eff-ac5c-cbb89b9c31a3", "name": "3. Fetch Sitemap", "type": "n8n-nodes-base.httpRequest", "position": [ 192, 320 ], "parameters": { "url": "={{ $json.sitemapUrl }}", "options": { "response": { "response": { "responseFormat": "text" } } }, "sendHeaders": true, "headerParameters": { "parameters": [ { "name": "User-Agent", "value": "Mozilla/5.0 (compatible; n8n-llms-txt-generator/1.0)" } ] } }, "typeVersion": 4.2 }, { "id": "f9653f4b-bd02-4db8-a6c7-8df47aa6cdfe", "name": "4. Resolve Leaf Sitemaps", "type": "n8n-nodes-base.code", "position": [ 400, 320 ], "parameters": { "jsCode": "const xml = $json.data || '';\nconst primary = $('2. Set Config').first().json.sitemapUrl;\nconst isIndex = /]/i.test(xml);\nconst out = [];\nif (isIndex) {\n const re = /\\s*([^<]+?)\\s*<\\/loc>/gi;\n let m;\n while ((m = re.exec(xml)) !== null) {\n out.push({ json: { sitemapUrl: m[1].trim() } });\n }\n}\nif (out.length === 0) {\n out.push({ json: { sitemapUrl: primary } });\n}\nreturn out;" }, "typeVersion": 2 }, { "id": "b464ebf6-54fd-4f7f-9b4c-2a735908c550", "name": "5. Fetch Leaf Sitemaps", "type": "n8n-nodes-base.httpRequest", "onError": "continueRegularOutput", "position": [ 624, 320 ], "parameters": { "url": "={{ $json.sitemapUrl }}", "options": { "response": { "response": { "responseFormat": "text" } } }, "sendHeaders": true, "headerParameters": { "parameters": [ { "name": "User-Agent", "value": "Mozilla/5.0 (compatible; n8n-llms-txt-generator/1.0)" } ] } }, "typeVersion": 4.2, "alwaysOutputData": true }, { "id": "3a43760e-719d-47ca-925e-d3fcc52449a0", "name": "6. Extract Page URLs", "type": "n8n-nodes-base.code", "position": [ 928, 320 ], "parameters": { "jsCode": "const cfg = $('2. Set Config').first().json;\nconst maxPages = Number(cfg.maxPages) || 50;\nconst all = $input.all();\nconst seen = new Set();\nconst out = [];\nfor (const it of all) {\n const xml = (it.json && it.json.data) ? it.json.data : '';\n const re = /\\s*([^<]+?)\\s*<\\/loc>/gi;\n let m;\n while ((m = re.exec(xml)) !== null) {\n let u = m[1].trim();\n if (!u) continue;\n if (/\\.xml($|\\?)/i.test(u)) continue;\n if (/sitemap/i.test(u)) continue;\n if (seen.has(u)) continue;\n seen.add(u);\n let section = 'Pages';\n try {\n const parts = new URL(u).pathname.split('/').filter(Boolean);\n if (parts.length > 1) section = parts[0];\n } catch (e) {}\n out.push({ json: { url: u, section } });\n if (out.length >= maxPages) break;\n }\n if (out.length >= maxPages) break;\n}\nreturn out;" }, "typeVersion": 2 }, { "id": "c922c29a-4ec9-4e70-91bd-7c536eaf50f3", "name": "7. Fetch Page HTML", "type": "n8n-nodes-base.httpRequest", "onError": "continueRegularOutput", "position": [ 1152, 320 ], "parameters": { "url": "={{ $json.url }}", "options": { "response": { "response": { "responseFormat": "text" } } }, "sendHeaders": true, "headerParameters": { "parameters": [ { "name": "User-Agent", "value": "Mozilla/5.0 (compatible; n8n-llms-txt-generator/1.0)" } ] } }, "typeVersion": 4.2, "alwaysOutputData": true }, { "id": "1dcc4bdb-664c-476d-82e6-fedfecf41550", "name": "8. Build llms.txt File", "type": "n8n-nodes-base.code", "position": [ 1360, 320 ], "parameters": { "jsCode": "const cfg = $('2. Set Config').first().json;\nconst siteName = cfg.siteName || 'My Website';\nconst siteDescription = cfg.siteDescription || '';\nconst pages = $('6. Extract Page URLs').all();\nconst htmls = $input.all();\n\nfunction decode(s) {\n return String(s)\n .replace(/&/g, '&').replace(/</g, '<').replace(/>/g, '>')\n .replace(/"/g, '\"').replace(/'/g, \"'\").replace(/ /g, ' ')\n .replace(/\\s+/g, ' ').trim();\n}\nfunction titleFromSlug(u) {\n try {\n const parts = new URL(u).pathname.split('/').filter(Boolean);\n const slug = parts.length ? parts[parts.length - 1] : u;\n const clean = slug.replace(/\\.[a-z]+$/i, '').replace(/[-_]+/g, ' ').trim();\n if (!clean) return siteName + ' home';\n return clean.replace(/\\b\\w/g, c => c.toUpperCase());\n } catch (e) { return u; }\n}\n\nconst sections = {};\nconst order = [];\nfor (let i = 0; i < pages.length; i++) {\n const url = pages[i].json.url;\n const section = pages[i].json.section || 'Pages';\n const html = (htmls[i] && htmls[i].json && htmls[i].json.data) ? htmls[i].json.data : '';\n let title = '';\n let desc = '';\n if (html) {\n const t = html.match(/]*>([\\s\\S]*?)<\\/title>/i);\n if (t) title = decode(t[1]);\n let d = html.match(/]+name=[\"']description[\"'][^>]*content=[\"']([\\s\\S]*?)[\"']/i);\n if (!d) d = html.match(/]+content=[\"']([\\s\\S]*?)[\"'][^>]+name=[\"']description[\"']/i);\n if (d) desc = decode(d[1]);\n }\n if (!title) title = titleFromSlug(url);\n if (!sections[section]) { sections[section] = []; order.push(section); }\n let line = '- [' + title + '](' + url + ')';\n if (desc) line += ': ' + desc;\n sections[section].push(line);\n}\n\nlet out = '# ' + siteName + '\\n';\nif (siteDescription) out += '\\n> ' + siteDescription + '\\n';\nout += '\\n';\nconst names = order.sort();\nfor (const s of names) {\n const heading = s.charAt(0).toUpperCase() + s.slice(1);\n out += '## ' + heading + '\\n';\n for (const line of sections[s]) out += line + '\\n';\n out += '\\n';\n}\n\nconst esc = (s) => String(s).replace(/&/g, '&').replace(//g, '>');\nconst pageCount = pages.length;\n\nconst pageHtml = `\n\n
\n
${pageCount} pages mapped
\n
Your llms.txt is ready
\n
Review it below, then copy or download. Upload the file to your site root at yourdomain.com/llms.txt
\n \n
\n \n \n
\n
\n`;\n\nreturn [{ json: { pageCount: pageCount, fileName: 'llms.txt', content: out, pageHtml: pageHtml } }];" }, "typeVersion": 2 }, { "id": "5c7d86ff-cbf6-4e2b-a2cf-fb7cd86c9067", "name": "9. Show Result Page", "type": "n8n-nodes-base.form", "position": [ 1584, 320 ], "parameters": { "operation": "completion", "respondWith": "showText", "responseText": "={{ $json.pageHtml }}" }, "typeVersion": 1 } ], "active": false, "settings": { "binaryMode": "separate", "executionOrder": "v1" }, "versionId": "389f2789-5163-474e-a40d-764c81ff89b6", "nodeGroups": [], "connections": { "2. Set Config": { "main": [ [ { "node": "3. Fetch Sitemap", "type": "main", "index": 0 } ] ] }, "3. Fetch Sitemap": { "main": [ [ { "node": "4. Resolve Leaf Sitemaps", "type": "main", "index": 0 } ] ] }, "7. Fetch Page HTML": { "main": [ [ { "node": "8. Build llms.txt File", "type": "main", "index": 0 } ] ] }, "6. Extract Page URLs": { "main": [ [ { "node": "7. Fetch Page HTML", "type": "main", "index": 0 } ] ] }, "1. On Form Submission": { "main": [ [ { "node": "2. Set Config", "type": "main", "index": 0 } ] ] }, "5. Fetch Leaf Sitemaps": { "main": [ [ { "node": "6. Extract Page URLs", "type": "main", "index": 0 } ] ] }, "8. Build llms.txt File": { "main": [ [ { "node": "9. Show Result Page", "type": "main", "index": 0 } ] ] }, "4. Resolve Leaf Sitemaps": { "main": [ [ { "node": "5. Fetch Leaf Sitemaps", "type": "main", "index": 0 } ] ] } } }