Topic Distillation and Spectral Filtering

Chakrabarti, Soumen ; Dom, Byron E. ; Gibson, David ; Kumar, Ravi ; Raghavan, Prabhakar ; Rajagopalan, Sridhar ; Tomkins, Andrew (1999) Topic Distillation and Spectral Filtering Artificial Intelligence Review, 13 (5/6). pp. 409-435. ISSN 02692821

Full text not available from this repository.

Official URL:

Related URL:


This paper discuss topic distillation, an information retrieval problemthat is emerging as a critical task for the www. Algorithms for this problemmust distill a small number of high-quality documents addressing a broadtopic from a large set of candidates.We give a review of the literature, and compare the problem with relatedtasks such as classification, clustering, and indexing. We then describe ageneral approach to topic distillation with applications to searching andpartitioning, based on the algebraic properties of matrices derived fromparticular documents within the corpus. Our method – which we call special filtering – combines the use of terms, hyperlinks and anchor-textto improve retrieval performance. We give results for broad-topic querieson the www, and also give some anecdotal results applying the sametechniques to US Supreme Court law cases, US patents, and a set of WallStreet Journal newspaper articles.

Item Type:Article
Source:Copyright of this article belongs to Springer Nature Switzerland AG
Keywords:hypertext;information filtering;information retrieval;resource discovery;spectral methods;world wide web;www
ID Code:130987
Deposited On:02 Dec 2022 05:16
Last Modified:02 Dec 2022 05:16

Repository Staff Only: item control page