Desktop Search IFilters

Windows Desktop Search uses plug-ins called IFilters to enable it to index new file types. IFilters are used by several other Microsoft products, including Index Server, Sharepoint, and SQL Server. By downloading new IFilters – for example, from http://addins.msn.com – you can search more filetypes. You can even write your own!

What filetypes does Windows Desktop Search index by default?

Windows Desktop Search comes with IFilters for the following file types (see the official list)CONCSearchableFileTypes.htm

Document Type	IFilter DLL
ASCX, ASP, ASPX, CSS, HHC, HTA, HTM, HTML, HHT, HTW, HTX, ODC, STM	nlhtml.dll
DOC, DOT, POT, PPS, PPT, XLB, XLC, XLS, XLT	offfilt.dll
TXT, ASM, BAT, C, CPP, CXX, CMD, DEF, DIC, H, HPP, XML, ... as plain text	query.dll
RTF	rtffilt.dll
EML	mimefilt.dll

It can also index WMA, MP3, and JPG files, because the shell provides document properties for those filetypes. This may prevent custom IFilters for these filetypes from working - see DesktopSearchBugReports for details.

What other filetypes might work?

Several Microsoft applications add their own IFilters when they're installed. This means that any files you create with those applications will automatically be indexed by Windows Desktop Search.

Document Type	IFilter installed by
MDI, TIF, TIFF	Microsoft Office Document Imaging
ONE	OneNote 2003
JNT	Tablet PC Journal application

Where can I download new IFilters?

Any well-written IFilter should work with Windows Desktop Search. The MSN team have links to several of them at http://addins.msn.com

Note that when you install a new IFilter, Windows Desktop Search won't automatically re-index your existing documents. You can force a re-index by going to Desktop Search Options and selecting Rebuild Index, or by moving the files so that Desktop Search thinks that they have changed.

Document Type	Download From
CAB	Citeknet
CEL	Alna AB
CHM	Citeknet
DAT (Palm Desktop)	Bloggit
DGN	Alna AB
DWF	IFilterShop
DWG	Autodesk , CAD & Company
GIF	IFilterShop
EPS, PS, PSD	IFilterShop
EXE	Citeknet
HLP	Citeknet
JPG, JPEG	AimingTech_ifilter , IFilterShop , PixVue
LF4T	LB
MHT	Citeknet
MP3	meticulus
MPP	Net Intent
MSG	Alna AB , Hallogram Publishing , IFilterShop
PNG	IFilterShop
PDF	Adobe , IFilterShop
PRT	Net Intent
RAR	Alna AB , Citeknet
RTF	Microsoft_filter.asp
SHTML	IFilterShop
SLDPRT, SLDDRW, SLDASM	Net Intent
SVG	IFilterShop
TIF, TIFF	PixVue , IFilterShop
VCF	IFilterShop
VDX, VSD, VSS, VST, VSX, VTS	Microsoft
WMA, WMV	IFilterShop
WP	Corel
XML	Microsoft_Filter.asp , QuiLogic
ZIP	4-Share , Alna AB , Citeknet , IFilterShop

Mozilla Thunderbird email requires a Protocol Handler from Citeknet rather than an IFilter

See also Scott Stonehouse's list of IFilters at http://www.ifilter.org/. Note that these third-party IFilters have not been tested and certified by Microsoft!

How do I see what IFilters are installed?

* Long way: Read the MSDN documentation on Finding the Filter DLL for a File._03xh.asp
* Fast way: Download the excellent IFilter Explorer tool from citeknet.com

How do I write my own IFilter?

Start with the official guide#AddingaNewFileType from the developer's page (note: this may supersede some of the information below)

* MSDN documentation:
* Introduction to IFilters_9sfm.asp
* Using Custom IFilters_912d.asp
* How to Write a FilterSP2003ta/html/ODC_HowToWriteaFilter.asp
* A couple of blogs:
* I Coffee, therefore IFilter by Michael Kaplan
* Baby Bedding
* Testing Full-Text IFilters by Andrew Cencini
* Additional information: http://www.columbiasoft.com/download/ifilters.htm

Make sure that you implement ""IPersistStream"" as well as the normal ""IPersistFile"". To optimize your IFilter for Windows Desktop Search, you can also output additional properties such as ""DocAuthor"" (document author) when implementing the ""GetValue""() method of the IFilter interface. Many of these properties are used to correctly display the Desktop Search results view. For example, outputting ""DocAuthor"" enables users to sort documents of your file type by author in the Desktop Search results view. The most important properties to output are:
* ""DocAuthor"" - the document author.
* ""PrimaryDate"" - the most important or most significant date.
* ""DocTitle"" - the title that will be displayed for the item in the search results view.
* ""PerceivedType"" (see below) – ensures that your file type shows up under the right Desktop Search category.

For a complete list of supported properties used by Windows Desktop Search, see
C:\Documents and Settings\<YOURNAME>\Local Settings\Application Data\MSN Toolbar Suite\DS\Config\Schema.txt

Use the ""PerceivedType"" property to classify your file type so that users can filter their search results by category:
* contact
* communications
* communications/e-mail
* communications/calendar
* communications/task
* communications/im (coming soon!)
* document/note
* document
* document/text
* document/spreadsheet
* document/presentation
* music
* images
* images/picture
* images/video
* folder
* favorite
* program
When you implement the ""GetChunk""() method within the IFilter interface, make sure that you output a propid of D5CDD505-2E9C-101B-9397-08002B2CF9AE/PerceivedType. Then make sure that the ""GetValue""() method returns one of the above strings. For example, if you create an IFilter for a file with the extension .FOO, and it’s a picture file format, you would want to implement ""GetChunk""() to return ""D5CDD505-2E9C-101B-9397-08002B2CF9AE/PerceivedType"" and ""GetValue""() to return VT_LPWSTR = "images/picture"

Lastly, if you register your IFilter using the same registration method as Indexing Service, Windows Desktop Search will automatically pick up your IFilter when the end user installs it. Once your IFilter is complete and tested, make it available to end users through this forum!

What order does Windows Desktop Search load IFilters in?

Ben from Citeknet explains in this newsgroup thread_frm/thread/b9ea65cc301970ec/953017650ff95351#953017650ff95351 :

''I think MSN DS does load IFilters the correct way (It seems to be the same way as Sharepoint 2003 does, using a custom tquery.dll). The only problem I can see is that it hasn't been documented correctly. It was briefly described in the Sharepoint 2001 SDKiloadfilteriywh.asp

From what I've seen, Windows Desktop Search looks for suitable IFilters in this kind of order:
*From Extension and CLSID (at HKEYLOCALMACHINE\SOFTWARE\Microsoft\RSSearch\ContentIndexCommon\Filters)
*From the content type of the file (at HKEYLOCALMACHINE\SOFTWARE\Classes\MIME\Database\Content Type)
*From the extension of the file (the same way the Win32 LoadIFilter API does)
*From Default (at HKEYLOCALMACHINE\SOFTWARE\Microsoft\RSSearch\ContentIndexCommon\Filters)

In this case, for JPG files, the content type image/jpeg has a default IFilter defined, so it gets loaded first. If you want to register a custom JPG IFilter, you need :

to replace the CLSID at HKEYLOCALMACHINE\SOFTWARE\Classes\MIME\Database\Content.Type\image/jpeg
or add the .jpg extension to HKEYLOCALMACHINE\SOFTWARE\Microsoft\RSSearch\ContentIndexCommon\Filters

Note that (2) will make the IFilter available only to MSN DS (and not to Sharepoint or other application that use content type to find IFilters).

You can check with the IFilter Explorer to see the which IFilters get loaded by MSN DS or other applications. I hope this will help to solve your problem.''

Credits

Initial content from the Windows Desktop Search team and Mike Smith-Lonergan

Back to: MSNSearchFeedback

============================================================================

WINDOWS VISTA - Indexing TIF files

I have a large archive with several years of files scanned, OCR-ed and stored in TIF format. The MODI filter that has been included with MS Office since version 2000 took care of indexing the OCR-ed text. Not any more. In Vista it does not work. Can anybody advise how to re-employ the MODI filter?

%21 Desktop Search IFilters
 
Windows Desktop Search uses plug-ins called %5bIFilters%5d to enable it to index new file types. %5bIFilters%5d are used by several other Microsoft products%2c including Index Server%2c Sharepoint%2c and SQL Server. By downloading new %5bIFilters%5d – for example%2c from http%3a//addins.msn.com – you can search more filetypes. You can even write your own%21
 
%21%21%21 What filetypes does Windows Desktop Search index by default%3f
 
Windows Desktop Search comes with %5bIFilters%5d for the following file types %28see the %5burl%3aofficial list%29%7chttp%3a//search.msn.com/docs/toolbar.aspx%3ft%3dMSNTbar%5d_CONC_SearchableFileTypes.htm
 
%7c*Document Type* %7c *IFilter DLL* %7c
%7c ASCX%2c ASP%2c ASPX%2c CSS%2c HHC%2c HTA%2c HTM%2c HTML%2c HHT%2c HTW%2c HTX%2c ODC%2c STM %7c nlhtml.dll %7c
%7c DOC%2c DOT%2c POT%2c PPS%2c PPT%2c XLB%2c XLC%2c XLS%2c XLT %7c offfilt.dll %7c
%7c TXT%2c ASM%2c BAT%2c C%2c CPP%2c CXX%2c CMD%2c DEF%2c DIC%2c H%2c HPP%2c XML%2c ... as plain text %7c query.dll %7c
%7c RTF %7c rtffilt.dll %7c
%7c EML %7c mimefilt.dll %7c
 
It can also index WMA%2c MP3%2c and JPG files%2c because the shell provides document properties for those filetypes. This may prevent custom %5bIFilters%5d for these filetypes from working - see %5bDesktopSearchBugReports%5d for details.
 
 
%21%21%21 What other filetypes might work%3f
 
Several Microsoft applications add their own %5bIFilters%5d when they%27re installed. This means that any files you create with those applications will automatically be indexed by Windows Desktop Search.
 
%7c *Document Type* %7c *IFilter installed by* %7c
%7c MDI%2c TIF%2c TIFF %7c Microsoft Office Document Imaging %7c
%7c ONE %7c %5bOneNote%5d 2003 %7c
%7c JNT %7c Tablet PC Journal application %7c
 
 
%21%21%21 Where can I download new IFilters%3f
 
Any well-written %5bIFilter%5d should work with Windows Desktop Search. The MSN team have links to several of them at http%3a//addins.msn.com 
 
Note that when you install a new %5bIFilter%2c%5d Windows Desktop Search won%27t automatically re-index your existing documents. You can force a re-index by going to _Desktop Search Options_ and selecting _Rebuild Index_%2c or by moving the files so that Desktop Search thinks that they have changed.
 
%7c *Document Type* %7c *Download From* %7c
%7c CAB %7c %5burl%3aCiteknet%7chttp%3a//www.citeknet.com%5d %7c
%7c CEL %7c %5burl%3aAlna AB%7chttp%3a//www.alnasoft.com/%5d %7c
%7c CHM %7c %5burl%3aCiteknet%7chttp%3a//www.citeknet.com%5d %7c
%7c DAT %28Palm Desktop%29%7c %5burl%3aBloggit%7chttp%3a//www.fleem.com/users/bloggit/PalmIFilter.html%5d %7c
%7c DGN %7c %5burl%3aAlna AB%7chttp%3a//www.alnasoft.com/%5d %7c
%7c DWF %7c %5burl%3aIFilterShop%7chttp%3a//www.ifiltershop.com%5d %7c
%7c DWG %7c %5burl%3aAutodesk%7chttp%3a//www.autodesk.com%5d %2c %5burl%3aCAD %26 Company%7chttp%3a//www.cad-company.nl/%5d %7c
%7c GIF %7c %5burl%3aIFilterShop%7chttp%3a//www.ifiltershop.com%5d %7c
%7c EPS%2c PS%2c PSD %7c %5burl%3aIFilterShop%7chttp%3a//www.ifiltershop.com%5d %7c
%7c EXE %7c %5burl%3aCiteknet%7chttp%3a//www.citeknet.com%5d %7c
%7c HLP %7c %5burl%3aCiteknet%7chttp%3a//www.citeknet.com%5d %7c
%7c JPG%2c JPEG %7c%5burl%3aAimingTech%7chttp%3a//www.aimingtech.com/jpeg%5d_ifilter %2c %5burl%3aIFilterShop%7chttp%3a//www.ifiltershop.com%5d %2c %5burl%3aPixVue%7chttp%3a//www.pixvue.com/help/search.html%5d %7c
%7c LF4T %7c %5burl%3aLB%7chttp%3a//www.lb-bueromoebel.de%5d %7c
%7c MHT %7c %5burl%3aCiteknet%7chttp%3a//www.citeknet.com%5d %7c
%7c MP3 %7c %5burl%3ameticulus%7chttp%3a//www.meticulus.com/mp3filter.html%5d %7c
%7c MPP %7c %5burl%3aNet Intent%7chttp%3a//www.net-intent.com/ifilters%5d %7c
%7c MSG %7c %5burl%3aAlna AB%7chttp%3a//www.alnasoft.com/%5d %2c %5burl%3aHallogram Publishing%7chttp%3a//hallogram.com/msgifilter%5d %2c %5burl%3aIFilterShop%7chttp%3a//www.ifiltershop.com%5d %7c
%7c PNG %7c %5burl%3aIFilterShop%7chttp%3a//www.ifiltershop.com%5d %7c
%7c PDF %7c %5burl%3aAdobe%7chttp%3a//download.adobe.com/pub/adobe/acrobat/win/all/ifilter60.exe%5d %2c %5burl%3aIFilterShop%7chttp%3a//www.ifiltershop.com%5d %7c
%7c PRT %7c %5burl%3aNet Intent%7chttp%3a//www.net-intent.com/ifilters%5d %7c
%7c RAR %7c %5burl%3aAlna AB%7chttp%3a//www.alnasoft.com/%5d %2c %5burl%3aCiteknet%7chttp%3a//www.citeknet.com%5d %7c
%7c RTF %7c %5burl%3aMicrosoft%7chttp%3a//www.microsoft.com/sharepoint/server/techinfo/reskit/rtf%5d_filter.asp %7c
%7c SHTML %7c %5burl%3aIFilterShop%7chttp%3a//www.ifiltershop.com%5d %7c
%7c SLDPRT%2c SLDDRW%2c SLDASM %7c %5burl%3aNet Intent%7chttp%3a//www.net-intent.com/ifilters%5d %7c
%7c SVG %7c %5burl%3aIFilterShop%7chttp%3a//www.ifiltershop.com%5d %7c
%7c TIF%2c TIFF %7c%5burl%3a PixVue%7chttp%3a//www.pixvue.com/help/search.html%5d %2c %5burl%3aIFilterShop%7chttp%3a//www.ifiltershop.com%5d %7c
%7c VCF %7c %5burl%3aIFilterShop%7chttp%3a//www.ifiltershop.com%5d %7c
%7c VDX%2c VSD%2c VSS%2c VST%2c VSX%2c VTS %7c %5burl%3aMicrosoft%7chttp%3a//www.microsoft.com/downloads/details.aspx%3ffamilyid%3ddcee9e09-448b-4386-b901-efea29cac808%26displaylang%3den%5d %7c
%7c WMA%2c WMV %7c %5burl%3aIFilterShop%7chttp%3a//www.ifiltershop.com%5d %7c
%7c WP %7c %5bCorel%7cftp%3a//ftp.corel.com/pub/WordPerfect/wpwin/8/WPIFilter.exe%5d %7c
%7c XML %7c %5burl%3aMicrosoft%7chttp%3a//www.microsoft.com/sharepoint/server/techinfo/reskit/XML%5d_Filter.asp %2c %5burl%3aQuiLogic%7chttp%3a//www.quilogic.cc/ifilter.htm%5d %7c
%7c ZIP %7c %5burl%3a4-Share%7chttp%3a//www.4-share.com/%5d %2c %5burl%3aAlna AB%7chttp%3a//www.alnasoft.com/%5d %2c %5burl%3aCiteknet%7chttp%3a//www.citeknet.com%5d %2c %5burl%3aIFilterShop%7chttp%3a//www.ifiltershop.com%5d %7c
 
Mozilla Thunderbird email requires a %5burl%3aProtocol Handler%7chttp%3a//www.citeknet.com/Products/ProtocolHandlers/WDSThunderbirdMozillaEudoraMailAddin/tabid/70/Default.aspx%5d from %5burl%3aCiteknet%7chttp%3a//www.citeknet.com%5d rather than an %5bIFilter%5d 
 
See also Scott Stonehouse%27s list of %5bIFilters%5d at http%3a//www.ifilter.org/. Note that these third-party %5bIFilters%5d have not been tested and certified by Microsoft%21
 
 
%21%21%21 How do I see what %5bIFilters%5d are installed%3f
 
	* Long way%3a Read the MSDN documentation on %5burl%3aFinding the Filter DLL for a File.%7chttp%3a//msdn.microsoft.com/library/default.asp%3furl%3d/library/en-us/indexsrv/html/ixufilt%5d_03xh.asp 
	* Fast way%3a Download the excellent %5burl%3aIFilter Explorer%7chttp%3a//www.citeknet.com/%5d tool from citeknet.com
 
 
%21%21%21 How do I write my own IFilter%3f
 
Start with the %5burl%3aofficial guide%7chttp%3a//addins.msn.com/devguide.aspx%5d%23AddingaNewFileType from the developer%27s page %28note%3a this may supersede some of the information below%29
 
	* MSDN documentation%3a
		* %5burl%3aIntroduction to IFilters%7chttp%3a//msdn.microsoft.com/library/default.asp%3furl%3d/library/en-us/indexsrv/html/ixrefint%5d_9sfm.asp
		* %5burl%3aUsing Custom IFilters%7chttp%3a//msdn.microsoft.com/library/default.asp%3furl%3d/library/en-us/indexsrv/html/ixufilt%5d_912d.asp
		* %5burl%3aHow to Write a Filter%7chttp%3a//msdn.microsoft.com/library/default.asp%3furl%3d/library/en-us/odc%5d_SP2003_ta/html/ODC_HowToWriteaFilter.asp
	* A couple of blogs%3a
		* %5burl%3aI Coffee%2c therefore IFilter%7chttp%3a//blogs.msdn.com/michkap/archive/2005/03/08/389675.aspx%5d by Michael Kaplan
                * %5burl%3aBaby Bedding%7chttp%3a//thekiddiesworld.com/bedding/%5d
		* %5burl%3aTesting Full-Text IFilters%7chttp%3a//sqljunkies.com/WebLog/acencini/articles/716.aspx%5d by Andrew Cencini
	* Additional information%3a http%3a//www.columbiasoft.com/download/ifilters.htm 
 
Make sure that you implement %22%22IPersistStream%22%22 as well as the normal %22%22IPersistFile%22%22. To optimize your %5bIFilter%5d for Windows Desktop Search%2c you can also output additional properties such as %22%22DocAuthor%22%22 %28document author%29 when implementing the %22%22GetValue%22%22%28%29 method of the %5bIFilter%5d interface. Many of these properties are used to correctly display the Desktop Search results view. For example%2c outputting %22%22DocAuthor%22%22 enables users to sort documents of your file type by author in the Desktop Search results view. The most important properties to output are%3a
	* %22%22DocAuthor%22%22 - the document author.
	* %22%22PrimaryDate%22%22 - the most important or most significant date.  
	* %22%22DocTitle%22%22 - the title that will be displayed for the item in the search results view. 
	* %22%22PerceivedType%22%22 %28see below%29 – ensures that your file type shows up under the right Desktop Search category. 
 
For a complete list of supported properties used by Windows Desktop Search%2c see 
	C%3a%5cDocuments and Settings%5c%3cYOURNAME%3e%5cLocal Settings%5cApplication Data%5cMSN Toolbar Suite%5cDS%5cConfig%5cSchema.txt
 
Use the %22%22PerceivedType%22%22 property to classify your file type so that users can filter their search results by category%3a
	* contact
	* communications
	* communications/e-mail
	* communications/calendar
	* communications/task
	* communications/im %28coming soon%21%29
	* document/note
	* document
	* document/text
	* document/spreadsheet
	* document/presentation
	* music
	* images
	* images/picture
	* images/video
	* folder
	* favorite
	* program
When you implement the %22%22GetChunk%22%22%28%29 method within the %5bIFilter%5d interface%2c make sure that you output a propid of %5bD5CDD505-2E9C-101B-9397-08002B2CF9AE/PerceivedType.%5d Then make sure that the %22%22GetValue%22%22%28%29 method returns one of the above strings. For example%2c if you create an %5bIFilter%5d for a file with the extension .FOO%2c and it’s a picture file format%2c you would want to implement %22%22GetChunk%22%22%28%29 to return %22%22D5CDD505-2E9C-101B-9397-08002B2CF9AE/PerceivedType%22%22 and %22%22GetValue%22%22%28%29 to return VT_LPWSTR %3d %22images/picture%22
 
Lastly%2c if you register your %5bIFilter%5d using the same registration method as Indexing Service%2c Windows Desktop Search will automatically pick up your %5bIFilter%5d when the end user installs it. Once your %5bIFilter%5d is complete and tested%2c make it available to end users through this forum%21
 
 
%21%21%21 What order does Windows Desktop Search load %5bIFilters%5d in%3f
 
Ben from Citeknet explains in %5burl%3athis newsgroup thread%7chttp%3a//groups-beta.google.com/group/microsoft.public.msn.search/browse%5d_frm/thread/b9ea65cc301970ec/953017650ff95351%23953017650ff95351 %3a
 
%27%27I think MSN DS does load %5bIFilters%5d the correct way %28It seems to be the same way as Sharepoint 2003 does%2c using a custom tquery.dll%29. The only problem I can see is that it hasn%27t been documented correctly. It was briefly described in the %5burl%3aSharepoint 2001 SDK%7chttp%3a//msdn.microsoft.com/library/default.asp%3furl%3d/library/en-us/spssdk/html/sdk%5d_iloadfilter_iywh.asp
 
From what I%27ve seen%2c Windows Desktop Search looks for suitable %5bIFilters%5d in this kind of order%3a
	*From Extension and CLSID %28at HKEY_LOCAL_MACHINE%5cSOFTWARE%5cMicrosoft%5cRSSearch%5cContentIndexCommon%5cFilters%29
	*From the content type of the file %28at HKEY_LOCAL_MACHINE%5cSOFTWARE%5cClasses%5cMIME%5cDatabase%5cContent Type%29
	*From the extension of the file %28the same way the Win32 %5bLoadIFilter%5d API does%29
	*From Default %28at HKEY_LOCAL_MACHINE%5cSOFTWARE%5cMicrosoft%5cRSSearch%5cContentIndexCommon%5cFilters%29
 
In this case%2c for JPG files%2c the content type image/jpeg has a default %5bIFilter%5d defined%2c so it gets loaded first. If you want to register a custom JPG %5bIFilter%2c%5d you need %3a
%23  to replace the CLSID at HKEY_LOCAL_MACHINE%5cSOFTWARE%5cClasses%5cMIME%5cDatabase%5cContent.Type%5cimage/jpeg
%23  or add the .jpg extension to HKEY_LOCAL_MACHINE%5cSOFTWARE%5cMicrosoft%5cRSSearch%5cContentIndexCommon%5cFilters
Note that %282%29 will make the %5bIFilter%5d available only to MSN DS %28and not to Sharepoint or other application that use content type to find %5bIFilters%29.%5d
 
You can check with the %5burl%3aIFilter Explorer%7chttp%3a//www.citeknet.com%5d to see the which %5bIFilters%5d get loaded by MSN DS or other applications. I hope this will help to solve your problem.%27%27
 
 
%21%21%21 Credits
 
Initial content from the Windows Desktop Search team and %5burl%3aMike Smith-Lonergan%7chttp%3a//paranoidmike.blogspot.com%5d
 
Back to%3a %5bMSNSearchFeedback%5d
 
 
%21%21%21 %3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d%3d
 
%21%21%21 WINDOWS VISTA - Indexing TIF files
 
I have a large archive with several years of files scanned%2c OCR-ed and stored in TIF format. The MODI filter that has been included with MS Office since version 2000 took care of indexing the OCR-ed text. Not any more. In Vista it does not work. Can anybody advise how to re-employ the MODI filter%3f

desktopsearchifilters