Conference paper
Exploring the use of fuzzy signature for text mining
International Conference on Fuzzy Systems, pp.1-5
IEEE
6th IEEE World Congress on Computational Intelligence (Barcelona, 18/07/2010–23/07/2010)
2010
Abstract
The classical approaches for the traditional problems of text mining, such as document indexing, document clustering or text classification, represent the text as bag-of-words. Words, the units of the representation, are determined by tokenization, using e.g. whitespace and punctuation characters as separator. The bag-of-word based methods face problem with non-segmented text typical for some Asian languages, since the tokenization based solution cannot be applied anymore to determine the representation units. Several solutions were proposed so far, among them frequent max substring mining is adopted here because of its language-independency and favourable speed and store requirements. We present in this paper a fuzzy signature based solution using frequent max substring for non-segmented document representation, and propose how it could be applied for some typical text mining tasks. We show how the flexibility of fuzzy signatures can be exploited for text mining tasks. With the use of this proposed concept, complex decision models in text mining may be constructed more effectively in future.
Details
- Title
- Exploring the use of fuzzy signature for text mining
- Authors/Creators
- K.W. Wong (Author/Creator)T. Chumwatana (Author/Creator)D. Tikk (Author/Creator)
- Publication Details
- International Conference on Fuzzy Systems, pp.1-5
- Conference
- 6th IEEE World Congress on Computational Intelligence (Barcelona, 18/07/2010–23/07/2010)
- Publisher
- IEEE
- Identifiers
- 991005540664807891
- Copyright
- © 2010 IEEE.
- Murdoch Affiliation
- School of Information Technology
- Language
- English
- Resource Type
- Conference paper
Metrics
482 File views/ downloads
47 Record Views