Extracted Terms List
Extracted Terms List
This section contains a short guide on how to use the Extracted Terms list of the corpus management.
The Extracted Terms list shows terms which have been extracted from the documents in the corpus and which are not yet part of the thesaurus.
In your opened corpus, click the Extracted Terms (1) tab to open the Extracted Terms list. Details about available options find below.
Use Search Terms (2) to filter for concepts, click Search to start the search. A list of results will be displayed. Click Reset to display the whole list.
The WSI Filter (3) refers to the Word Sense Induction function in PoolParty. You can use it to filter the terms for ambiguous or unambiguous terms PoolParty has extracted from the corpus.
Use Select All and Deselect All (4) for selecting and deselecting the whole list of terms.
You can select extracted terms and add them to the Candidate Concepts list. Select one or more terms in this list using the default keys on your keyboard and mouse clicks, then click Add Candidate Concepts (5).
Use the Add to Exclude-list button or icon (6) to exclude terms from extraction.
Use Export Documents (7) to export all corpus documents.
The Word Senses icon (8, display is optional, WSI needs to be enabled) opens a list of terms whose senses are similar, ambiguous or unambiguous in the context of the corpus and the thesaurus, PoolParty calculates. Thus you can specify precisely, which additional terms could be added to the list of candidate concepts. In the dialogue that will open you also see word senses of similar terms that have been deduced from the corpus, as well as term and concept suggestions. You can decide if you want to merge senses, use the terms as candidate concepts or just return to the main window.
Use the the Similar Terms icon (9) to generate a list of terms that contains only terms which are similar to the respective term. Details find in this topic: Extracted Terms - Use the Similar Terms Function.
Use the Link (10) icon for term linking.
Extracted Terms List
This list provides an overview of statistical relevant terms that were found in the document corpus.
You can sort the results by clicking the table headers. The image above shows a table sorted by Relevance column.
You can use the following four table columns to sort terms by these relevance factors:
Relevance: The Mutual Information Score, the Content Term Score and the term frequency were combined into one score that gives an overall relevance that is normally a good starting point for going through the list of extracted terms.
Mutual Information Score (MIS): Mutual information (MI) provides information about dependency of variables and can be used to estimate if two or more consecutive words in a text should be considered a compound term that is formed by those words. The idea is that if words are independent that they will occur together just by chance. On the other hand, if they are observed together more often than expected, they are dependent and are candidates for terms. This score ranks multi term phrases higher.
Content Term Score (CTS): Content terms are enriched in documents where they appear, which means they are not the most frequent terms in the document set. But when they occur in a document they tend to occur very often, which indicates their importance for defining the content of the document. This score ranks single term phrases higher.
Frequency: The total number of occurrences of a term in the corpus.
Extracted Terms - Use the Similar Terms Function
Extracted Terms - Use the Similar Terms Function
This section contains a short guide on how to use the Similar Terms function for extracted terms.
After you have executed a corpus analysis, and opened the Extracted Terms list in its tab, you can use the Similar Terms icon for filtering.
The terms in this list are the results of the corpus analysis and can help you to further refine your thesaurus with terms as synonyms or concepts you can select and add to it from here. The analysis will calculate the terms based on PoolParty's similarity algorithms and display them here, including their similarity scores. A higher score means the similarity is higher compared to your thesaurus' concepts.
Use the Similar Terms icon in the Extracted Terms list at the end of a row.
The Search Terms field will be filled with the term you just selected and clicking Search will display only similar terms in the table.
All other functionality is similar to the options for the unfiltered Extracted Terms list.
