Introduction: The URL Sources section of your Knowledge Base allows you to add specific website pages to train your AI to deliver accurate, brand-specific answers during customer conversations. While your AI automatically crawls your entire website and product catalog, URL Sources gives you control over which additional pages or external resources your AI should reference when answering customer questions.
How URL Sources Works: URL Sources enables you to:
Add specific web pages that contain important information for your customers
Enhance your AI's knowledge with blog posts, FAQs, guides, or other content
Ensure your AI references your most current and accurate information
Track which URLs are being used in customer conversations
Website Pre-Scanning: Your AI is already trained on your entire website content through our automatic pre-scanning process. This means:
Most of your website pages are already indexed and available to your AI
The URL Sources feature is primarily for adding specific pages you want to emphasize or external resources
Adding URLs to the Knowledge Base ensures those specific pages are prioritized when answering related questions
If you've recently added new pages to your website, you can add them here to make them immediately available to your AI
How to Add URLs:
Navigate to AI Training → Knowledge Base in your dashboard
Select the URL Sources tab
Type a valid URL in the text field
Click the Add URL button
The URL will be processed, indexed, and made available for your AI to reference
URL Guidelines: For best results, follow these guidelines when adding URLs:
Add pages with clear, relevant content that answers common customer questions
Focus on pages with detailed product information, sizing guides, care instructions, or FAQs
Ensure URLs are publicly accessible (not password-protected)
Use fully-qualified URLs (including https:// prefix)
Add each important page individually rather than just your homepage
Managing Your URLs:
Use the search bar to quickly find specific URLs in your list
View all added URLs in the list below the input field
Each entry shows the URL, last scanned date, and times used in conversations
Monitor the "Times used" column to see which URLs are most valuable to customers
Note that the "Times used" counter updates periodically, so recently added URLs or recent conversations may not be reflected immediately
Handling Dynamic Content: Some websites use JavaScript to generate content dynamically, which can present challenges:
Content that is loaded via JavaScript after the page loads may not be fully captured during indexing
Complex single-page applications (SPAs) might not have all their content properly indexed
If you notice your AI is not answering questions about content on dynamic pages correctly, try these solutions:
Create static versions of important content pages if possible
Break down complex dynamic pages into simpler, content-focused pages
For critical information on dynamic pages, consider adding it to Custom FAQs or File Sources instead
Troubleshooting Common Issues:
Invalid URL Error: Ensure your URL is properly formatted and includes the https:// prefix
URL Not Found Error: Make sure the page exists and is publicly accessible
Page Size Limit Error: Very large pages may exceed the maximum size limit
Times Used Shows 0: This counter updates periodically, so recently added URLs or recent conversations may not be reflected immediately
Dynamic Content Not Recognized: If your page uses JavaScript to load content, the AI may not be able to access all information. Consider creating static versions of important content.
Best Practices:
Add URLs for policy pages, sizing guides, and FAQ pages that customers frequently ask about
Include URLs for important blog posts or articles that explain your products in detail
Consider adding external resources that provide valuable information about your products
Regularly review your URL list and remove outdated or unused pages
Test your AI's knowledge using the Test & Train feature after adding new URLs
For dynamic content pages, verify the AI's knowledge by testing questions about that content
How Your AI Uses URL Sources: When customers ask questions, your AI will:
Search through indexed content from your added URLs for relevant information
Use this information to provide accurate, brand-specific answers
Reference the appropriate URL when answering questions based on that content
Always use the most up-to-date version of the content (pages are regularly re-indexed)