logoRocketFlow

Auto-Retrain

Automatically re-crawl URL-based knowledge sources to keep your chatbot up to date

Auto-Retrain

Keep your chatbot's knowledge current by automatically re-crawling URL sources on a schedule.

Enabling

In the Knowledge tab, toggle the auto-retrain switch on any URL-type source. Sources show an "Auto-retrain" badge when enabled.

How It Works

  1. A scheduled task runs every hour
  2. Finds URL sources with auto-retrain enabled
  3. Checks if enough time has passed since the last retrain (default: 24 hours)
  4. Re-crawls the URL
  5. Compares word count — if content changed by more than 10 words, re-indexes
  6. If unchanged, skips re-indexing (saves processing)

Status Indicators

BadgeMeaning
Auto-retrainEnabled, running normally
Retrain failedLast crawl attempt failed

Configuration

  • Interval: 24 hours (configurable per source via retrainInterval)
  • Content change detection: Compares word counts before and after crawl
  • Skips unchanged content: Only re-indexes when content actually changed

Last updated on