High Priority
Deploy `/course-catalog.txt` Protocol
Establish a machine-readable summary of your entire course hierarchy and learning paths specifically for AI curriculum ingestion bots.
Create a text file at `/course-catalog.txt` with a brief introduction to your training company's core offerings.
Include markdown-style links to your most important course landing pages, certification pathways, and instructor bios.
Add a 'Curriculum FAQ' section to directly answer common AI learning bot queries about prerequisites, learning objectives, and accreditation.
Configure your Training companies crawler protocols effortlessly.
Join 2,000+ teams scaling with AI.
High Priority
AI Learning Bot Selective Indexing
Fine-tune which sections of your training company's website should be ingested by AI learning aggregators (e.g., Coursera's internal crawlers, edX bots, specialized corporate training AI).
User-agent: LearningBot Allow: /courses/ Allow: /certifications/ Disallow: /registration-confirmation/
Verify your crawler permissions using a simulated bot tester that mimics AI learning aggregators.
Monitor crawl frequency in your server logs to ensure AI bots are hitting relevant course pages and not administrative sections.
Medium Priority
Semantic Course Structure & Ingestion
Utilize HTML5 semantic tags to help AI crawlers understand the hierarchy and relationships within your course content and learning modules.
Wrap individual course descriptions and learning modules in `<article>` tags to signal their primary content status.
Use `<section>` with descriptive `aria-label` attributes (e.g., 'learning-objectives', 'prerequisites', 'course-modules') for distinct course segments.
Ensure all tables detailing course schedules, pricing tiers, or skill outcomes use proper `<thead>` and `<tbody>` tags for structured data extraction.
High Priority
RAG-Friendly Learning Snippet Optimization
Structure your course descriptions and learning materials so they can be easily 'chunked' and retrieved by Retrieval-Augmented Generation (RAG) pipelines for personalized learning recommendations.
Keep related learning concepts, module objectives, and assessment criteria within distinct content blocks (ideally under 500 words).
Avoid ambiguous references; repeat the specific course name or module title in section summaries.
Eliminate vague pronouns (e.g., 'this', 'it', 'they') and replace them with the actual course module, concept, or skill name.
