Crawler Performance, Hosts, and Impact [Hit] Rules

As part of the crawl processing flow, the Crawl Component starts “robot” threads that orchestrate items from gathering to feeding and finally committing their final state (see this previous post on Crawl Orchestration for more details and an illustration of that flow). In this post, we focus more on the “robot” threads, Crawler impact rules,…

2

Search Health Reports (SRx) - Digging in further with PowerShell

After introducing the Search Health Reports (SRx) last year, we continued to extend the battery of PowerShell tests for analyzing and troubleshooting a SharePoint 2013 and SharePoint 2016 on-premises search farm. Because most of these efforts resulted in new or improved tests, we largely suggested and recommended the RunAllTests report and Indexer Disk report to leverage the SRx…

0

SP2013 Crawling *Explained: Enumeration/Discovery (Part 3b)

With VerboseEx logging enabled, the crawl of a single item (or interchangeably, a “document”) can generate more than 6000 ULS events, at times making troubleshooting a particular document analogous to finding the needle in the haystack. In this series of posts, I first described the high level orchestration for crawling a document, deep dived on the…

3

Search Performance: A case of AV slowing down crawls

In the services world supporting Search, I commonly see the nasty impact of Anti-Virus (AV) on the performance of SharePoint Search. Before diving into this scenario, I want to first reiterate the following KB: Certain folders may have to be excluded from antivirus scanning when you use file-level antivirus software in SharePoint https://support.microsoft.com/en-us/kb/952167 Which states: These…

1

Announcing the Search Health Reports (SRx) for SharePoint Search Diagnostics

Brought to you by SearchEngineers@microsoft.com, the Search Health Reports (SRx) is a PowerShell-driven tool for surfacing complex diagnostics for SharePoint Search through new multifaceted reports. The SRx includes a battery of tests that leverage a customized SSA object extended with contextual data from many disparate sources. Our goal with this project is straightforward – empower…

14

PowerShell: Getting Link Counts per Host Domain

Let’s consider this throwback Thursday. A couple of years ago, I posted this “PowerShell to Rebalance Crawl Store DBs in SP2013”. As a side note, I mentioned the following PowerShell to leverage the CrawlLog object for viewing some Crawl Store level statistics about crawled documents, such as the “Document Count”. For example: $crawlLog = New-Object…

0

SP2013: Using Get-SPIndexReports to Troubleshoot Failed Master Merge

Ever had an SP2013 Index Component report a yellow exclamation point () to indicate a “degraded index component” and then wondered what that really meant? From my experience, these almost always either tied to an underlying disk problem and/or some external software interfering with the component (most commonly, AntiVirus or file-level backup utilities). In this post, we’ll specifically look…

5

MS Ignite “Effective Search Deployment” Session References (BRK3176)

Thank you everyone that came by to talk about our favorite subject… Search. We are incredibly grateful for the number of folks that added us to their schedule, and we hope you came away learning something new. If your company or organization has a Premier Support contract and you need to engage us on anything…

1

Another Shameless Self-Promotion: Presenting at Microsoft Ignite 2015

Coming to Microsoft Ignite next week? Then I invite you to come see Kristopher Loranger and I present on Tuesday, May 5: Effective Search Deployment and Operations in SharePoint Server 2013       We’ll be covering some architecture best practices, detailed look at query flows and the indexer. Most of the focus will be OnPrem SP2013, but we expect…

0

The most important Timer Job for Search you may not know exists

What comes to mind when I say “Application Server Administration Services” timer job? Based on the name alone, Search is probably the last answer – it was for me… until I learned just how important this timer job is to Search. Having failures during a topology change? Go check this timer job. Master merge not being triggered? Go…

2