🌐
Ingest from URL or GitHub
Paste a webpage URL or a GitHub repo. The pipeline fetches → parses → classifies → enriches → submits.
🔗 Single URL
🐙 GitHub repo (batch)
🕘 Recent ingest batches
No batches yet. Try ingesting a URL above.
🤖 What the pipeline does
- Fetch — HTTP GET (auto-rewrites
github.com/.../blob/→raw.githubusercontent) - Parse — HTML title/meta/h1, Markdown frontmatter/h1/code blocks, JSON manifests
- Classify — routes to one of 15 categories with confidence + reason chain
- Enrich — extracts name, description, how-to-use, example, tags, version, owner
- Submit — lands in pending review queue (or auto-vets if source is in
config/library_trusted_sources.json)
Per-item progress is observable on the batch progress page.