
How to Improve Your Site Search Relevancy and Customer Experiences
We鈥檝e all been there. You go to a website and enter a key phrase for a specific product or information and a 鈥淣o Results Found鈥 message displays. 聽In under a second, the user has a negative impression about the website. It only takes about 50 milliseconds (or 0.05 seconds) for a visitor to form an opinion about your website that determines whether they like your site or not鈥攁nd whether they鈥檒l stay or leave. 聽
As an example, let鈥檚 say you鈥檙e looking to purchase a two-foot ladder. You enter 鈥24-inch ladder鈥 into the website search bar, but the site search hasn鈥檛 created a relevant filter that precisely matches this search term. So, you try closely related variants of the item (such as 鈥2 ft ladder鈥), and finally, after multiple attempts and possible key phrases, the product displays. 聽Already, your customer experience falls short. 聽Research shows that 88% of online consumers are less likely to return to a site after a bad experience. Users in this situation are faced with high friction by having to work too hard to find what they need and will likely leave, go to a competitor鈥檚 site, and never return. 聽
Site Search: Essential to Your Customer Experience
According to a Gartner article based on their 2019 customer experience management survey, customer experience is the new marketing battlefront, especially when talking about the user experience on websites. (See the Gartner blog: 鈥 Redesign Your Website to Do What Your Customers Want 鈥) No one disputes that product, price, and performance matter, but customer experience is now and in many cases, the basis of differentiation. According to the survey, 75% of organizations can show that customer satisfaction leads to revenue growth through increased customer retention or lifetime value. 聽
The bottom line: site search experience is essential to the overall customer experience. In the age of Google and Amazon, a fast, easy, and relevant search experience--that is, how closely related a product or document page is to a query--is no longer optional, it is expected. 聽
Site Search Factors to Improve Relevancy 聽
We鈥檝e pulled together the key factors to help you improve your site search relevancy (and customer experience) for a product search, but the same principles apply to information searches. The relevancy algorithm is the primary influencer of the search results. Once relevancy has been established, a best-in-class site search capability will offer a boost/bury metric and a popularity/learning metric to be applied to enhance it further. All of this information (relevancy + boost/bury + popularity/learning) is tabulated to provide a product score. This score is what is used to make the product more visible to the user. 聽Here are highlights of the factors to consider. Additional information can be found here . 聽
1. Site Search Algorithm 聽
Let鈥檚 say you are interested in purchasing a red shirt, which you enter as your search term. The website algorithm should enable you to see results based on product name and variations on product description and category search phrases, as shown below: 聽
Product Data (ABC123) 聽Name: Red Shirt Category: Shirt 聽
Product Data (BCD123) 聽Name: Red Shirt Description: Columbia Sport Red Shirt Category: Shirt 聽
Product Data (CDE123) 聽Name: Shirt Color: Red 聽
Once the search for 鈥渞ed shirt鈥 is executed, the products display in the following order based on relevancy.
1. BCD123
2. ABC123
3. CDE123 聽
As you can see, the search algorithm, which is configured in the background, incorporates the following factors including matches based on:
鈥xact phrase matches
鈥umber of times the terms appear within the fields used to establish relevance
鈥he proximity of the terms in the case (upper and lower casing) of phrases (for two or more terms)
鈥he boost of the data field (a section within the indexing of the data that explains how a field can be 鈥渂oosted鈥)
鈥oost and bury feature that can improve the order of results (for a category results page or a search results list page)
鈥artial matches 聽
2. Boost Scenarios 聽
Types of scenarios the boost feature can be used for:
鈥oosting specific products on a navigation page
鈥pecial promotions
鈥补濒别蝉
鈥辞濒颈诲补测
鈥尘补颈濒
鈥ew products within a category 聽
3. Bury Scenarios
Types of scenarios the bury feature can be used for:
鈥urying undesired products (the products are relevant but should not be displayed as high within the results)
鈥urying a specific brand of products
鈥urying accessories 聽 聽
4. Popularity Learning Search 聽
You need the ability to collect click metrics for each website. These metrics can be used to influence the ordering of the products. As mentioned, the popularity metric is tabulated into the relevancy score of a product. 聽
5. Visibility Rules 聽
If there is a need to remove items from a results page, the visibility rules should allow you to do so based on a global level or a set of conditions. 聽
6. Common usages for visibility rules 聽
鈥emove irrelevant products from search results
鈥emove products without inventory
鈥emove products based on a specific criterion 聽 聽
7. Troubleshooting the Product Score 聽
If the red shirt you search for is not displaying where expected, you need to determine why. An ideal site search capability will indicate how to boost value. The system should be able to indicate which boost and bury value the red shirt is assigned to. This will help determine what changes should be made to get better search results. If the boost or bury rule is not listed for the product, you need to confirm whether the trigger is set up properly.聽Here are the factors that should be used in the query generation process to impact product score calculation and relevancy:
鈥Tokenization: 聽Tokenization allows variations of a word to be searchable. For example, when a user enters a search query for 鈥渞ead鈥 other matching words like 鈥渞eading鈥 and 鈥渞eader鈥 stored in the index should be considered and all matching records should also be returned within the results set. 聽 聽
鈥Query this Field: 聽The 鈥淚s Quarriable鈥 flag on the fields section controls whether that field is also used as a separate clause, in addition to being part of the content field as noted above. The content field should always be set up as quarriable and stemmed and stored in the index. 聽 聽
鈥Wildcarding: 聽Wildcards or prefix queries should be enabled on certain fields like 鈥渢itle鈥, and 鈥淪KU鈥 to allow for partial matches. If any fields have these settings enabled, then you should be able to add appropriate term clauses to the query index to view partial matches.
鈥Field Boost: 聽If boosts are added to specific fields, these are accounted for when generating the query and calculating the score. For example, if 鈥渢itle鈥 has a boost of 20 on the field and 鈥渄escription鈥 does not, then a match against the 鈥渢itle鈥 field will return a higher score than the match against the 鈥渄escription鈥 field. 聽 聽
鈥Phrasing: 聽If the keyword contains a phrase, matches against the exact phrase, and the appearance of the individual words on the phrase should be considered when determining the score of the record. For example, when a user searches for 鈥渞ed shirt,鈥 the scores are calculated differently depending on whether the words 鈥渞ed shirt鈥 appear together in the same order, or if they appear on the record but individually as 鈥渞ed鈥 on the color field and 鈥渟hirt鈥 in the title field. For exact matches, a higher score should be applied. 聽
鈥erm Frequency: 聽The higher number of times a term appears within a record鈥檚 searchable fields, the higher the score is. 聽 聽
鈥Rare Appearance Rate: 聽Rarer terms that match within a record鈥檚 searchable fields give a higher influence on the score. 聽 聽
鈥Number of Query Terms: 聽The higher number of query terms that matched within a record鈥檚 searchable fields will provide a higher score than other products that matched fewer query terms. 聽 聽
鈥Numerical Sorting: 聽Your index feature should do lexicographical sorting (or alphabetical sorting).
Time to Act! 聽
In summary, you can see why search relevancy and customer experience are important to the overall success of your customer鈥檚 journey. Finding the information and acting on the results will provide better results and increase your business revenue.



