Web CrawlerVersion: v3
Get all trained page links by knowledge base
GET/knowledge-bases/crawler
Lists discovered and trained website pages for a knowledge base, with pagination and optional URL filter. WHEN TO USE: use this when you need to inspect crawled pages; use discoverWebsite to find new pages; use deleteTrainedUrlsForKnowledgeBase to remove pages the AI should stop using. RETURNS: a paginated list of crawled URLs with status, title, and identifiers.
Authorizations
Authorizationstringheaderrequired
Bearer authentication header of the form Bearer <token>, where <token> is your access token.
Scope:
knowledge-bases. readonlyAuth methods:
OAuthPrivate IntegrationToken type:
Sub-Account TokenRequest
Headers
Versionstringrequired
API Version
Available options
v3Example:
v3Query Parameters
knowledgeBaseIdstringrequired
knowledge base ID as string
Example:
tDtDnQdgm2LXpyiqYvZ6locationIdstringrequired
location ID as string
Example:
tDtDnQdgm2LXpyiqYvZ6pagenumber
Page number
Example:
1pageLengthnumber
Records per page
Example:
1querystring
query to filter on url links
Example:
www.example.com/Response
Trained page links retrieved successfully
countnumberrequired
Total count of URLs in the knowledge base
Example:
64urlsobject[]required
Array of crawled URLs with their details