iO Advanced search

iO Advanced search

The advanced search function offers a series of features to optimize search in Constellio. The following functions are made available by this module: 

• Research Capsules - Available
• Words excluded from the proofreader - Available
• Synonym Management - Available
• Elevation and Exclusion Management - Available
• Research Contexts - Coming Soon 
• Learning to rank - Coming soon
• Statistics - Coming soon
• Thesaurus Configuration - Coming Soon
• Boost metadata search - Available
• Boost search by query - Available
• Facets  - Available

1. Search Capsule

Capsules are a tool intended to present information complementary to a search. A capsule can be customized. It is displayed when the user's search terms match the capsule criteria. 

1.1 Consult the capsules

To consult the capsules: 

1. Go to " Administration ";
2. Then in " Search Configuration ";
3. Click on " Search Capsules ".
4. The capsules created can be found on this page.

1.2 Add the capsules

1. Go to " Pilotage ";
2. Then in " Search Configuration ";
   
3. Click on " Research Capsules ";
   
4.  Click on " Add capsule ";
5. Fill out the form. Click on " Save " to save your capsule.

1.3 Display

Here is an example of displaying a capsule: 

 

2. Words excluded from the spell checker

Constellio's spell checker offers corrections to terms entered by the user based on the content of the index and/or past searches. 

2.1 Prerequisites 

To allow suggestions to be removed, the user must have a role that provides the "Exclude and raise search result" function. 

2.2 Keyword configuration

During a search, you have the option to remove a suggestion.

1. Conduct research;
2. He has offered you several choices;
3. Click on the "X" of the keyword you want to remove;
4. Confine deletion;
5. Go to "Administration";
6. Then in "Search configuration";
   
7. Click on "Words excluded from the spell checker";
   
8. You will find the word you removed during your search.
9. To make the word available again in the corrector, click the green arrow on the right.

3. Synonym management

Synonyms are used to provide one (or more) equivalent terms during a search. For example, if we search for "dollar", we can find the documents with the terms "dollars" or "dolar". 

3.1 Configuration

To configure the synonym list: 

1. Go to "Administration";
2. Then "Search configuration";
   
3. Click on the "Synonym Management" icon;
   
4. Click on the " Edit " button.
5.  Synonyms must be entered and separated by commas. Each group of synonyms is separated by a line.
6. After your changes, click "Save".
7. Synonyms are now effective.

4. Elevation and exclusion management

Elevation allows two functions: 

• Place a search result at the top completely for an accurate search.
• Exclude a search result for all searches.

A configuration screen is used to manage documents that are elevated or excluded from the search engine.

4.1 Consult elevations and exclusions

To know which words are high and excluded, follow these instructions: 

1. Go to "Pilotage";
2. Then in "Search Setup";
   
3. Click on "Elevation and Exclusion Management", and you will be able to see the scope of the queries.
   

4.2 Adding elevation through search

It is possible to elevate a result directly from the link of the result in the search engine.

1. Conduct a search in Constellio;
2. In the search results, click on this button to "Elevate Result";
3. This will be added in so-called high queries.

4.3 Adding an exclusion through search

It is possible to remove a search result by the "Exclude" action.

1. Conduct a search in Constellio;
2. In the search results, click this button to "Exclude";
3. This will be added in the so-called "Excluded" queries.

4.4 Removal  of an elevation and/or exclusion

To remove an elevation or exclusion, 

1. Go to "Pilotage";
2. Then in "Search Setup";
   
3. Click on "Elevation and Exclusion Management";
   
4. At the end of the query of your choice, click on the "X". 
5. To cancel all elevated queries, click the "X" at the end of the "High" query. This will cancel all elevated queries.
6. To cancel all excluded queries, click the "X" at the end of the "Excluded" query. This will cancel all excluded queries.

5. Research contexts

Search contexts are used to customize the display of search results. They are used to generate a custom HTML presentation for the display of results.

This integration approach is no longer recommended for new deployments. Integration by Javascript client is much more flexible. However, for heritage purposes, this feature has been integrated into Constellio.

5.1 Prerequisites

An additional database must be installed at Constellio to enable this functionality.

5.2 Configuration

1. To confirm the contexts, go to " Pilotage ";
2. Then in " Search Configuration ";
3. Click on " Search Context ". The list of contexts is displayed;
4. To add a context, click the " Add " button.

For context, you can also add parameters, with the "Parameter" button. Parameters are added for each context. They can be inherited for subtexts. 

6. Statistics

Constellio's statistics module allows you to consult the searches carried out by users. Various reports are available to consult the information. 

6.1 Types of reports

Here are the types of reports available to view search statistics. 

6.2 Configuring Reports

The following is a description of the fields available for configuring reports.

Click on " Apply " to generate a new report according to the parameters entered. 

6.3 Displayed fields

The following is a description of the fields displayed in the reports.

7. Learning to rank (expert) (coming soon)

This module allows Constellio to learn how to provide better results based on past research. It is based on a machine learning model that reclassifies the results.

This module works at 3 levels: 

• Description of "feature", a feature represents a criterion that will be weighted.
• Training: from the "features" chosen and past research, a model is built. 
• Template: A template shows the score of the search. 

The process must be done in a loop, in order to refine the model based on the past search result. 

7.1 Adding a feature

Click on the "Add" button on the right. Here is the add/edit screen: 

The name is used to describe the feature, for example, "pdf". 

The type of query.

q: for a feature that depends on the query. The feature determines the score of the document based on its correspondence to the Solr query indicated. 

fq: for a feature that does not depend on the query. The feature determines a value of 1 /0 based on the match to the indicated Solr filter.

The value of the query is based on the internal query sent by Constellio to Solr. 

7.2 Training

Once the features are defined, we can build a model. Constellio logs queries and associated feature calculations. 

We can thus use different techniques to generate a model that will be added to Solr. 

Currently, this process has to be done by programming outside of Constellio.

8. Thesaurus Configuration (coming soon)

Constellio allows you to integrate a thesaurus in the SKOS format to add search-level functionality for users. Here are the features: 

• Autocomplete in the search field
• Propose related research
• Link domains to research

The thesaurus is stored in the format SKOS.

8.1 Prerequisites

You must have an existing thesaurus in SKOS format. Constellio does not guarantee full support in SKOS format, so it is important to validate compatibility with our product.

8.2 Configuration

1. In Pilotage, go to " Search Configuration ";
2. Then click on " Thesaurus Management ".

The screen is divided into three tabs:

• SKOS file, indicates the loaded file and allows you to upload a new one. 
• Denied Terms: Specifies the terms to be ignored in the uploaded thesaurus.
• Statistics: allows you to retrieve statistics for indexing the thesaurus. 

8.2.1 SKOS file

This screen lists the currently loaded thesaurus if one of the following description fields is populated: 

• By the way
• Thesaurus
• Description
• Date
• Creator

This information is extracted from the currently loaded (or not) SKOS file. You have the option to download a copy with the Download button. You can empty the loaded thesaurus with the correct "Delete the saved SKOS file". The file field allows you to drag and drop a file or select the file by clicking on "Choose File". Once a new SKOS is uploaded, it is important to click on "Save".

8.2.2 Rejected terms

Enter terms to be ignored from the thesaurus. One term per line. Click on "Save" to apply the changes.

8.2.3 Statistics

Constellio offers a series of statistics for the use of the thesaurus. 

• Number of documents with at least one thesaurus concept. 
• Number of concepts used at least once.
• Number of documents without concept of the thesaurus.
• The 1000 most used concepts: download the Excel file to consult.
• Unused concepts: download Excel files for viewing.