High Priority
Deploy TutorBot.txt Protocol
Establish a machine-readable summary of your entire tutoring site hierarchy specifically for AI agents focused on educational resources.
Create a text file at /TutorBot.txt with a brief introduction of your tutoring services and subject areas.
Include markdown-style links to your most important pages: tutor profiles, subject guides, student testimonials, and pricing tiers.
Add a 'FAQ' section within the file to directly answer common queries from AI models about your tutoring methodology, instructor qualifications, and learning outcomes.
Configure your Tutors crawler protocols effortlessly.
Join 2,000+ teams scaling with AI.
High Priority
LLM Selective Indexing for Educational Content
Fine-tune which sections of your tutoring platform should be ingested by AI crawlers focused on educational data and pedagogical resources.
Implement `User-agent: Educrawlbot\nAllow: /tutors/\nAllow: /subjects/\nAllow: /resources/\nDisallow: /checkout/\nDisallow: /account/` in your robots.txt.
Verify your crawler permissions using a tool like Google's Rich Results Test (simulating educational crawlers) or a dedicated bot checker.
Monitor crawl frequency in your server logs to ensure AI bots are accessing your tutor directories, subject pages, and lesson materials, not sensitive student data or checkout flows.
Medium Priority
Semantic HTML for Structured Learning Content
Utilize HTML5 semantic tags to help AI scrapers understand the hierarchical structure and context of your educational content pieces.
Wrap your core lesson content, subject explanations, and tutor biographies within `<article>` tags to signal their primary importance.
Use `<section>` tags with descriptive `aria-label` attributes (e.g., 'aria-label="Math Tutoring Concepts"', 'aria-label="Science Experiment Guides"') for distinct content blocks.
Ensure all student progress reports, exam results, or subject mastery tables use proper `<thead>` and `<tbody>` tags for accurate data extraction by AI.
High Priority
RAG-Friendly Snippet Optimization for Tutoring Explanations
Structure your educational explanations and tutoring advice so they can be easily 'chunked' and retrieved by Retrieval-Augmented Generation (RAG) pipelines for AI-powered Q&A.
Keep related learning concepts, problem-solving steps, or historical timelines within concise, self-contained blocks (e.g., under 500 words).
Avoid ambiguous references; explicitly repeat the subject or concept name (e.g., 'Algebraic equations', 'Photosynthesis process') in section summaries instead of using pronouns.
Eliminate vague pronouns like 'it' or 'they' and replace them with the specific academic term or tutoring strategy being discussed (e.g., 'The Pythagorean theorem', 'Active recall technique').
