Skip to main content
Web CrawlerVersion: v3

Get all trained page links by knowledge base

GET/knowledge-bases/crawler

Lists discovered and trained website pages for a knowledge base, with pagination and optional URL filter. WHEN TO USE: use this when you need to inspect crawled pages; use discoverWebsite to find new pages; use deleteTrainedUrlsForKnowledgeBase to remove pages the AI should stop using. RETURNS: a paginated list of crawled URLs with status, title, and identifiers.

Authorizations

Authorizationstringheaderrequired

Bearer authentication header of the form Bearer <token>, where <token> is your access token.

Scope:knowledge-bases.readonly
Auth methods:OAuthPrivate Integration
Token type:Sub-Account Token

Request​

Headers

Versionstringrequired

API Version

Available optionsv3
Example:v3

Query Parameters

knowledgeBaseIdstringrequired

knowledge base ID as string

Example:tDtDnQdgm2LXpyiqYvZ6
locationIdstringrequired

location ID as string

Example:tDtDnQdgm2LXpyiqYvZ6
pagenumber

Page number

Example:1
pageLengthnumber

Records per page

Example:1
querystring

query to filter on url links

Example:www.example.com/

Response

Trained page links retrieved successfully

countnumberrequired

Total count of URLs in the knowledge base

Example:64
urlsobject[]required

Array of crawled URLs with their details