Tech Tip: Flexible Query Expansion Policies

Nitin Mangtani — Tue, 24 Oct 2006 16:34:00 +0000

Posted by Nitin Mangtani, Product Manager, Enterprise Search

The Google Search Appliance can automatically expand a search-users query by adding synonyms and words with the same stem. For example if a user enters car then search appliance will automatically search for car or cars. Administrators also have ability to custom upload their synonyms file or blacklist certain terms. So if you have a product which was originally called "product abc" and is now called "product xyz" you can create a synonyms file with these terms, as a result any searches for keyword "product abc" will automatically return relevant documents that contain the terms "product abc" or "product xyz". The end-result of query expansion is that search users find richer set of relevant results without having to re-query with different combination of terms.

You can log-in to the administrative console of Google Search Appliance and enable the Query Expansion feature. We provide you with 4 flexible options and these are:
None - This is by default and it disables the query expansion feature completely.
Standard: Enables query expansion, using Google's built-in synonyms.
Local: Enables query expansion, using only the synonyms that you upload to the appliance.
Full: Enables query expansion, using both Google's built-in synonyms and the files that you upload to the appliance.

Here is the example of the custom synonyms file uploaded to search appliance.
#Synonyms file created Oct 2006
#Author: nitinm
product abc = product xyz
FED = federal electronics division
{phone, cell, mobile, telephone}

There are two formats we support for the synonyms file
Format 1: term1 operator term2
In this format:
• term1 consists of one word or multiple words that are separated by single spaces.
• term2 consists of one word or multiple words that are separated by single spaces.
• operator is one of the following:
= Specifies that the words are equivalent. The appliance expands a search query for term1 or term2 by adding the other term.
> Causes the appliance to add term2 when a search query contains term1.

Entry format 2: {term, term, ...}
In this format:
• Each term in the list will be used to expand queries for each other term.
• The use of brackets {} was introduced with the current release

And finally you can create the blacklists file to mark certain words that should not be expanded. The blacklists file is applicable to both Google built-in synonyms and your custom synonyms file.

As you could see from the examples, we provide you a flexible way to create the synonyms file and also let you choose the policies that are applicable to your environment. The Google built-in synonyms file is also very rich and should be enabled. We recommend using the Full option to enable both Google built-in synonym file and your custom synonym file. So besides uploading / enabling new query expansion files, don't forget to enable it in your front end via the admin console.

We look forward to seeing happier search users.

New version of Google Search Appliance!

Nitin Mangtani — Tue, 19 Sep 2006 01:00:00 +0000

Posted by Nitin Mangtani, Search Product Manager

As a product manager it’s always fun to work on cool, interesting technology and then release it to customers. Today we shipped an all-new version of the Google Search Appliance with increased document capacity and some great new features. With this new release, the GB-5005 can now search up to 10 million documents while the GB-8008 can search a whopping 30 million. (By the way, if you ask nicely, we can build them even bigger! Just let us know.)

We also added some cool features such as date and number range search. So now you can restrict your search to only those documents authored between say, January 1st and September 19th 2006. Similarly, when you're looking for that special Digital Camera, you can restrict your search to cameras in the $250 to $1000 price range. My wife would perhaps like me to restrict this search to the $250 to $500 range ;-)

Finally something special for our international friends; we now have our administrative interface, product documentation and search interface available in an additional 10 languages, now totaling 16 languages: Chinese (Simplified & Traditional), Danish, Dutch, English, Finnish, French, German, Italian, Japanese, Korean, Norwegian, Portuguese (Brazilian), Russian, Spanish, Swedish.

If you are a customer, you can grab the update from our support site. If you aren't yet able to find things inside your enterprise, check out the Google Search Appliance and see if its right for you.

Google Data » Nitin Mangtani

Tech Tip: Flexible Query Expansion Policies

New version of Google Search Appliance!