Crawl your tenant with SProbot

SProbot automatically indexes and crawls the SharePoint sites and teams on your tenant to make it possible for them to be reported on, assessment by AI, and cleaned up.

When you connect to your tenant, it will automatically start indexing daily, and individual sites will be crawled over a longer period of time.

You can see the status of both processes in the Crawl & Assess screen.

What is the index?

The index provides up-to-date (within 36-72 hours) information on:

• Storage, file count and activity metrics
• Security configurations
• Owners and members
• Guest users

What is the crawl?

The crawl runs over a longer period of time and analyzes individual items to get detailed information about:

• Large files
• Inactive files
• Sharing links

You do not need to take any action for either of these processes, they are designed to run automatically without input from you.

How long does it take for my sites to be crawled?

When you start using SProbot for the first time, you'll see detailed information appearing per site as the crawl progresses. Crawling all sites usually takes at least a week or two and may take significantly longer for larger tenants.

The counter displays the number of sites which have been processed by the current crawl run. When all sites have been crawled or at least a week has passed, a new run will automatically start.

How do I see when last a site was crawled?

You can see the last crawl date for a specific workspace in the Cleanup  > Search screen, or within the workspace itself.

If a workspace is currently being crawled, you'll see the orange crawl indicator in the search list.

You'll also see it within the info tiles for reports which are dependent on crawl data.