LLM.txt & AI Crawler Setup Guide for Growth hackers

Create a text file at /growthbot.txt with a concise overview of your core growth levers and target metrics.

Include markdown-style links to your most impactful case studies, viral loops, and conversion funnel documentation.

Add a 'Growth FAQ' section to preemptively answer common AI experiment design or data attribution queries.

User-agent: GrowthBot Allow: /viral-loops/ Allow: /user-acquisition/ Disallow: /internal-reporting/

Verify your crawler permissions using a platform-specific bot simulator (e.g., for tools like Copy.ai's content generation or Jasper's AI writing assistants).

Monitor crawl frequency in your server logs to ensure AI growth tools are hitting your key growth asset nodes and not irrelevant internal pages.

Wrap your core growth strategy explanations in `<section>` tags with descriptive `aria-label` attributes like 'User Onboarding Flow' or 'Referral Program Mechanics'.

Use `<article>` tags for detailed case studies on successful growth hacks, signaling their importance to AI analysis.

Ensure all data visualizations and A/B test result tables use proper `<thead>` and `<tbody>` tags for structured data extraction by growth AI.

Keep tightly coupled growth experiment details (hypothesis, execution, results, learnings) within distinct, digestible blocks (e.g., < 750 words).

Avoid ambiguous references; explicitly name the growth channel, metric, or feature being discussed in each section summary.

Eliminate vague pronouns and ensure all data points are clearly attributed to specific experiments or growth initiatives.