--- title: Configure crawl settings for a Cornerstone external content connector description: Specify the organization units you want your Cornerstone external content connector to crawl. Define inclusion or exclusion filters to dictate the types of content the crawl retrieves and feeds to AI Search for indexing. locale: en-US canonical_url: https://www.servicenow.com/docs/r/australia/platform-administration/search-administration/configure-crawl-settings-cornerstone-external-content-connector.html release: australia product: Search Administration classification: search-administration topic_type: task last_updated: "2026-05-15" reading_time_minutes: 4 keywords: [ServiceNow Otto, AI Agents, generative AI, agentic AI] breadcrumb: [Cornerstone external content connector, Configure, External Content Connectors, Search administration, Configure core features, Administer the ServiceNow AI Platform] --- # Configure crawl settings for a Cornerstone external content connector Specify the organization units you want your Cornerstone external content connector to crawl. Define inclusion or exclusion filters to dictate the types of content the crawl retrieves and feeds to AI Search for indexing. ## Before you begin A connector administrator must have already created the Cornerstone external content connector that you want to configure crawl settings for. To learn about this procedure, see [Create a Cornerstone external content connector](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/search-administration/create-ext-cont-connector-cornerstone.md). Role required: sn\_ext\_conn.xcc\_admin ## About this task This task is optional. By default, the Cornerstone external content connector crawls your Cornerstone Learning Management System \(LMS\) and sends all Catalogue and Learning objects it finds to AI Search for indexing. Only perform this task if you want the connector to use any of the following non-default settings: - Inclusion or exclusion filters for the organization units to retrieve content from when running content crawls - Inclusion or exclusion filters for the types of Catalogue and Learning objects to retrieve content from when running content crawls Content is only retrieved from the source system if it passes all of your configured crawl setting filters. If any crawl setting filter excludes a content item, the external content connector doesn't retrieve it. **Important:** By default, each external content connector can index up to one million \(1,000,000\) content items from its source system. When a connector exceeds this limit, it continues to crawl the source system, but only sends content item deletions and updates to AI Search for indexing, ignoring new content items. The connector logs an error message for every 10,000 content items it crawls beyond the indexing limit. When a connector's indexed content item count exceeds 800,000, a warning message appears in the connector's UI to indicate that it's approaching the indexing limit. If the connector reaches the indexing limit, an error message appears in its UI. External content connectors that support user permissions crawls can handle permissions for up to five hundred thousand \(500,000\) users and their groups. If a connector retrieves users in excess of this limit, user and group permissions may not be correctly applied to the connector's retrieved content. As a result, the content may not be searchable. If one of your connectors reaches the content indexing limit, you can update its crawl settings and file inclusion/exclusion filters to reduce the number of content items it retrieves. If you need to index more content items than the limit allows, you can create a Customer Service and Support case at [https://support.servicenow.com/now](https://support.servicenow.com/now) to request a limit increase for the connector. ## Procedure 1. Navigate to **All** > **External Content Connectors** > **External Content Admin Home**. 2. In the Connectors list, select the record for the Cornerstone external content connector whose settings you want to modify. 3. In the connector editor's Settings tab, select **Crawl settings**. 4. Select one of the following **Organization units** options: - To crawl all organization units from the source system, select **Crawl all organization units**. - To crawl only a specified set of organization units from the source system, select **Include only these organization units**, then use the **Add organization units to include** field and **Add** button to enter names for organization units you want the connector to include when crawling. As an example, you might enter `Marketing` and `Sales` to only retrieve searchable content from the specified organization units. - To crawl all but a specified set of organization units from the source system, select **Exclude only these organization units**, then use the **Add organization units to exclude** field and **Add** button to enter names for organization units you want the connector to exclude when crawling. As an example, you might enter `Internal` to exclude searchable content from the specified organization unit. 5. In the Catalog/trainings and User/learner sections, select the options for the Cornerstone LMS content types that you want the connector to retrieve when running content crawls. 6. If you want AI Search to automatically generate captions for content in attachments and files retrieved by the connector, select the **Multimodal captions** option. When you select this option, the Platform Multimodal Service automatically generates descriptive captions for images, tables, charts, and other visual elements found in retrieved attachments and files. You can discover these retrieved attachments and files by searching for terms from their generated captions. This option is only available when the Platform Multimodal Service plugin is activated on your instance. - For details on activating the plugin, see [Activate the Platform Multimodal Service plugin](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/ai-search/activate-platform-multimodal-service-plugin.md). - To learn how to select the VLM \(visual learning model\) provider and model used for the Platform Multimodal Service, see [Configure multimodal captioning for AI Search](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/search-administration/configure-multimodal-captioning-for-ai-search.md). 7. Select **Save and validate**. ## Result The Cornerstone external content connector is updated with your modified crawl settings. ## What to do next To retrieve content from your Cornerstone source system using your modified crawl settings, create and run a one-time content crawl for your Cornerstone external content connector. To learn about creating and running one-time content crawls, see [Create a content crawl for an external content connector](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/search-administration/create-content-crawl-external-content-connector.md). **Parent Topic:**[Cornerstone external content connector](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/search-administration/cornerstone-external-content-connector.md)