High Priority
Deploy /curriculum.txt Protocol
Establish a machine-readable summary of your entire platform hierarchy specifically for AI learning agents and curriculum development bots.
Create a text file at /curriculum.txt with a brief introduction to your EdTech platform's core offerings and pedagogical approach.
Include markdown-style links to your most important course catalogs, learning modules, and instructor resources.
Add a 'Pedagogical FAQ' section in the file to answer common AI tutor and student query patterns directly.


Configure your Edtech crawler protocols effortlessly.
Join 2,000+ teams scaling with AI.
High Priority
AI Tutor Selective Indexing
Fine-tune which sections of your EdTech platform should be ingested by AI crawlers, such as those powering adaptive learning systems or educational search engines.
User-agent: EduBot Allow: /courses/ Allow: /student-success/ Disallow: /admin-portal/
Verify your crawler permissions using an AI agent simulator or by directly querying your server logs for EduBot activity.
Monitor crawl frequency in your server logs to ensure EduBots are accessing relevant pedagogical content and student support materials.
Medium Priority
Semantic Learning Module Ingestion
Utilize HTML5 semantic elements to help LLM scrapers understand the structure and relationships within your educational content.
Wrap core learning modules or lesson content within <article> tags to signal their primary educational value.
Use <section> elements with descriptive 'aria-label' attributes (e.g., 'aria-label="Module 3: Calculus Fundamentals"') for distinct learning units.
Ensure all data tables, such as gradebooks or performance metrics, use proper <thead> and <tbody> tags for structured data extraction by learning analytics bots.
High Priority
RAG-Friendly Learning Snippet Optimization
Structure your educational content so it can be easily 'chunked' and retrieved by Retrieval-Augmented Generation (RAG) pipelines for AI-powered tutoring and knowledge bases.
Keep logically cohesive learning concepts within distinct content blocks, ideally under 500 words, to facilitate accurate retrieval.
Avoid ambiguous references; ensure each section clearly restates the primary learning objective or subject matter it addresses.
Eliminate ambiguous pronouns (e.g., 'It', 'They') and replace them with specific subject names, course titles, or feature names (e.g., 'The interactive simulation', 'Algebra I Module').