LLM.txt & AI Crawler Setup Guide for Crypto investing

Create a text file at /crypto-ai.txt with a brief overview of your investment thesis and asset classes.

Include markdown-style links to your most critical performance reports, market analysis pages, and tokenomics documentation.

Add a 'Key Metrics FAQ' section in the file to answer common AI queries regarding your holdings, risk profiles, and yield strategies directly.

User-agent: CryptoAI_Bot Allow: /portfolio-performance/ Allow: /tokenomics/ Disallow: /trading-history/

Verify your crawler permissions using a sandbox environment that simulates financial AI bot behavior.

Monitor crawl frequency in your server logs to ensure AI agents are accessing only approved, relevant financial data nodes.

Wrap your primary investment strategy explanations in <article> tags to signal core content.

Use <section> with descriptive 'aria-label' attributes (e.g., 'DeFi Allocation', 'NFT Portfolio') for distinct asset classes.

Ensure all quantitative data, such as yield percentages and market caps, uses proper `<table>` with `<thead>` and `<tbody>` for structured data extraction.

Keep related financial metrics and performance data within logical data containers, ideally under 750 words per chunk.

Avoid 'contextual drift'; repeat the primary asset or strategy name in section summaries and key data points.

Eliminate ambiguous pronouns and ensure all numerical data is explicitly tied to its corresponding asset, time period, and unit (e.g., 'ETH 24h ROI', 'SOL Market Cap').