Sites are not automatically crawled even if you select the option to include the sites in search when you add a link to the site directory. Before sites are included in the content source for the site directory, they must be approved before their content will appear in search results.

Any user in the Administrator'site group or with the Manage Search right can approve or reject sites or submit a previously approved or rejected site for approval.

Approve a Site

1. On the Site Settings page, in the Search Settings and Indexed Content section, click Manage crawls of Site Directory.
2. In the Crawl status of sites list, click Requested Sites to view sites that have not yet been approved or rejected.
3. In the Crawling Behavior column, click the arrow next to the site that you want to approve, and then click Crawl this site.

    Note   If you created one or more content source groups, you can click Crawl site in "content source group" on "Non_Portal_Content" to include a site in that content source group. It will be included in all future updates of the content source for that content source group, as well as any updates of the content source for the entire site directory or full updates of the content index for non–portal site content. Sites crawled as part of that source group will show up in searches scoped to that source group.

4. To approve multiple sites, select the check box next to each site that you want to approve, and then click Crawl this site in the Edit Multiple list on the toolbar.

Approved sites are moved to the Approved Sites view and are crawled the next time the content index for non–portal site content or the content source for the site directory are crawled. Content for approved sites appears in search results.

Reject a Site

A portal site administrator or other user with the Manage Search right may decide that the content of a site added to the site directory is not appropriate for users of the portal and reject the site from inclusion in search results.

1. On the Site Settings page, in the Search Settings and Indexed Content section, click Manage crawls of Site Directory.
2. In the Crawling Behavior column, click the arrow next to the site that you want to reject, and then click Do not crawl this site.
3. To reject multiple sites, select the check box next to each site that you want to reject, and then click Do not crawl this site in the Edit Multiple list on the toolbar.

Rejected sites are moved to the Rejected Sites view and are not crawled during updates. Content for rejected sites does not appear in search results.

Require Approval for Crawling

You may decide that a site that was previously approved or rejected for crawling merits another review by a portal site administrator or other search manager.

1. On the Site Settings page, in the Search Settings and Indexed Content section, click Manage crawls of Site Directory.
2. In the Approved Sites view, in the Crawling Behavior column, click the arrow next to the site that you want to set for review, and then click Require approval for crawling.

    Note   If the site was previously approved, content for the site will appear in searches until the next update of the content index or content source.

3. To require approval for crawling for multiple sites, select the check box next to each site that you want to review, and then click Require approval for crawling in the Edit Multiple list on the toolbar.

Sites that are set for approval or rejection appear in the Requested Sites view and are not crawled until they are approved. Content for these sites does not appear in search results unless the sites were previously approved and the content index for the sites has not been updated.

This topic is part of an eight-topic series.

• Introduction
• Adding Sites to the Site Directory
• Approving or Rejecting Sites for Crawling
• Configuring a Content Source Group
• Assigning Source Groups to Sites
• Creating Search Scopes for Sites in the Site Directory
• Crawling the Site Directory in a Shared Services Configuration
• Best Practices for Configuring the Site Directory in a Shared Services Configuration