Crawling Novell Netware with SharePoint Server 2007 and Search Server 2008


Search in SharePoint Server 2007 and Search Server 2008 can crawl a variety of content sources. For several of the “out of the box” content sources security information in the form of ACLs are collected as part of the indexing process.  At query time, search results are trimmed based on the identity of the user submitting the query, and the ACLs collected from crawling.

In certain scenarios, the built-in security trimming is not sufficient for your requirements or the indexing connector isn’t able to collect ACLs at crawl time – in this scenario you’ll need to implement a Custom Security Trimmer. For example, content in Novell Netware file shares can be crawled by SharePoint Server 2007 & Search Server 2008(Using the built-in Fileshare Indexing Connector along with Windows Services for Netware) but the indexing connector doesn’t know how to collect ACLs from Netware.

For security trimmed results, that scenario will require a custom security trimmer (CST) to be developed. We recently released a Novell Netware CST on CodePlex as part of the Search Community Toolkit.  This can be installed and configured in less than 30 minutes and has been tested against Netware 6.5 although it should work with earlier versions too.  It’s compatible with SharePoint Server 2007, Search Server 2008, and Search Server 2008 Express.

It includes documentation on how to configure a content source to crawl Netware and how to install the CST.  We’ll post the source code for the CST soon once we’ve finished some final testing and the code will be commented and include a doc that provides an overview of the structure of the code and explains where you might want to make your own modifications.  This will be great example of how to build your own CST if you’re looking for a good sample to start from. 

The initial version was released with an open source license at http://www.codeplex.com/sctcstn and includes the following features:

  • Netware Custom Security Trimmer Binaries
  • Documentation Providing Click Through Guidance
    • For Crawling Netware Content
    • For Installing the Binaries
    • For Security Trimming Netware Results
  • Semi-Automated Installation In Under 30 minutes
  • Forms Authentication Support
  • 64 bit Platform Support
Mitch Prince
Architect
Microsoft
John Kelly
Consultant
Microsoft
Comments (1)

  1. Joshua says:

    Hi All,

    I am a newbie to this project so was wondering if you can help me with the installation.

    We got it installed but having problem when I go search, it gives a Service Error.

    In the Sharepoint Error Log it states:

    02/24/2009 10:45:02.28     w3wp.exe (0x1C6C)                           0x0698    Search Server Common              MS Search Query Processor         980d    Exception     System.IO.FileNotFoundException: Could not load file or assembly ‘ManagedTraceProvider, Version=1.0.0.0, Culture=neutral, PublicKeyToken=e0fffb020b774993’ or one of its dependencies. The system cannot find the file specified.  File name: ‘ManagedTraceProvider, Version=1.0.0.0, Culture=neutral, PublicKeyToken=e0fffb020b774993’     at NetwareSecurityTrimmer.SecurityTrimmer.Microsoft.Office.Server.Search.Query.ISecurityTrimmer.Initialize(NameValueCollection staticProperties, SearchContext searchContext)     at Microsoft.Office.Server.Search.Administration.Security.PluggableSecurityTrimmerManager.Instantiate(Int32 idRequested)        

    02/24/2009 10:45:02.28     w3wp.exe (0x1C6C)                           0x0698    Search Server Common              MS Search Query Processor         97zu    Unexpected    Error occurred when executing pluggable security trimmer with Id 98:    

    02/24/2009 10:45:02.28     w3wp.exe (0x1C6C)                           0x0698    Search Server Common              MS Search Query Processor         97zv    Exception     System.IO.FileNotFoundException: Could not load file or assembly ‘ManagedTraceProvider, Version=1.0.0.0, Culture=neutral, PublicKeyToken=e0fffb020b774993’ or one of its dependencies. The system cannot find the file specified.  File name: ‘ManagedTraceProvider, Version=1.0.0.0, Culture=neutral, PublicKeyToken=e0fffb020b774993’     at NetwareSecurityTrimmer.SecurityTrimmer.Microsoft.Office.Server.Search.Query.ISecurityTrimmer.Initialize(NameValueCollection staticProperties, SearchContext searchContext)     at Microsoft.Office.Server.Search.Administration.Security.PluggableSecurityTrimmerManager.Instantiate(Int32 idRequested)     at Microsoft.Office.Server.Search.Administration.Security.PluggableSecurityTrimmerManager.GetPluggableSecurityTrimmer(Int32 id)     at Microsoft.Office.Server.Searc…    

    02/24/2009 10:45:02.28*    w3wp.exe (0x1C6C)                           0x0698    Search Server Common              MS Search Query Processor         97zv    Exception    …h.Query.PluggableSecurityTrimmer.Trim(UInt32[] docIds, Boolean[] displayDoc, UInt32 oldScannedCount, UInt32 logicalStartPosition, UInt32 desiredResultCount)        

    02/24/2009 10:45:02.28     w3wp.exe (0x1C6C)                           0x0698    Windows SharePoint Services       Web Parts                         89a1    Monitorable    Error while executing web part: Microsoft.Office.Server.Search.WebControls.SrhdcGenericException: Your search cannot be completed because of a service error.

    We have double checked that the installer is correctly installed and the path is set correctly. Can anybody give us some hint how to troubleshoot.

    Thanks,

    Joshua