Overview

This text presents an automated method for creating a first-draft thesaurus from raw text. It describes natural processing steps of tokenization, surface syntactic analysis and syntactic attribute extraction. From these attributes, word and term similarity is calculated and a thesaurus is created showing important common terms and their relation to each other, common verb-noun pairings, common expressions, and word family members. The techniques are tested on 20 different corpora ranging from baseball newsgroups, assassination archives, medical X-ray reports, abstracts on AIDS, to encyclopedia articles on animals, even on the text of the book itself. The corpora range from 40,000 to 6 million characters of text, and results are presented for each in appendices. The methods described in the book have undergone extensive evaluation. Their time and space complexity are shown to be modest. The results are shown to converge to a stable state as the corpus grows. The similarities calculated are compared to those produced by psychological testing. A method of evaluation using Artificial Synonyms is tested. Gold Standards evaluation show that techniques significantly outperform non-linguistic-based techniques for the most important words in corpora. This text includes applications to the fields of information retrieval using established testbeds, existing thesaural enrichment and semantic analysis. Also included are applications showing how to create, implement, and test a first-draft thesaurus.

Full Product Details

Author:   Gregory Grefenstette
Publisher:   Springer
Imprint:   Springer
Edition:   1994 ed.
Volume:   278
Dimensions:   Width: 15.50cm , Height: 1.90cm , Length: 23.50cm
Weight:   1.390kg
ISBN:  

9780792394686

ISBN 10:   0792394682
Pages:   305
Publication Date:   31 July 1994
Audience:   Professional and scholarly ,  Professional & Vocational
Format:   Hardback
Publisher's Status:   Active
Availability:   In Print  
This item will be ordered in for you from one of our suppliers. Upon receipt, we will promptly dispatch it out to you. For in store availability, please contact us.

Table of Contents

1 INTRODUCTION.- 2 SEMANTIC EXTRACTION.- 2.1 Historical Overview.- 2.2 Cognitive Science Approaches.- 2.3 Recycling Approaches.- 2.4 Knowledge-Poor Approaches.- 3 SEXTANT.- 3.1 Philosophy.- 3.2 Methodology.- 3.3 Other examples.- 3.4 Discussion.- 4 EVALUATION.- 4.1 Deese Antonyms Discovery.- 4.2 Artificial Synonyms.- 4.3 Gold Standards Evaluations.- 4.4 Webster’s 7th.- 4.5 Syntactic vs. Document Co-occurrence.- 4.6 Summary.- 5 APPLICATIONS.- 5.1 Query Expansion.- 5.2 Thesaurus enrichment.- 5.3 Word Meaning Clustering.- 5.4 Automatic Thesaurus Construction.- 5.5 Discussion and Summary.- 6 CONCLUSION.- 6.1 Summary.- 6.2 Criticisms.- 6.3 Future Directions.- 6.4 Vision.- 1 PREPROCESSORS.- 2 WEBSTER STOPWORD LIST.- 3 SIMILARITY LIST.- 4 SEMANTIC CLUSTERING.- 5 AUTOMATIC THESAURUS GENERATION.- 6 CORPORA TREATED.- 6.1 ADI.- 6.2 AI.- 6.3 AIDS.- 6.4 ANIMALS.- 6.5 BASEBALL.- 6.6 BROWN.- 6.7 CACM.- 6.8 CISI.- 6.9 CRAN.- 6.10 HARVARD.- 6.11 JFK.- 6.12 MED.- 6.13 MERGERS.- 6.14 MOBYDICK.- 6.15 NEJM.- 6.16 NPL.- 6.17 SPORTS.- 6.18 TIME.- 6.19 XRAY.- 6.20 THESIS.

Reviews

Author Information

Tab Content 6

Author Website:  

Customer Reviews

Recent Reviews

No review item found!

Add your own review!

Countries Available

All regions