🕷️ Crawl for Knowledge
Train your bots by crawling websites — spider mode extracts every page (max 10 URLs per extension)
1
Pages Indexed
1
URLs Crawled
445
Total Words
0
Active Crawls
Start a New Crawl
Knowledge Base
| Ext | Page Title | URL | Words | Depth | Crawled | Status | Actions |
|---|
Crawl History
| Ext | URL | Status | Pages | Words | Started | Duration |
|---|