Experiment on Methods for Clustering and Categorization of Polish Text

Authors

  • Maciej Wielgosz AGH University of Science and Technology, Cracow
  • Rafał Fraczek AGH University of Science and Technology, Cracow
  • Paweł Russek AGH University of Science and Technology, Cracow
  • Marcin Pietroń AGH University of Science and Technology, Cracow
  • Agnieszka Dabrowska-Boruch AGH University of Science and Technology, Cracow
  • Ernest Jamro AGH University of Science and Technology, Cracow
  • Kazimierz Wiatr AGH University of Science and Technology, Cracow

Keywords:

Polish text, categorization, clustering, VSM, TF-IDF

Abstract

The main goal of this work was to experimentally verify the methods for a challenging task of categorization and clustering Polish text. Supervised and unsupervised learning was employed respectively for the categorization and clustering. A profound examination of the employed methods was done for the custom-built corpus of Polish texts. The corpus was assembled by the authors from Internet resources. The corpus data was acquired from the news portal and, therefore, it was sorted by type by journalists according to their specialization. The presented algorithms employ Vector Space Model (VSM) and TF-IDF (Term Frequency-Inverse Document Frequency) weighing scheme. Series of experiments were conducted that revealed certain properties of algorithms and their accuracy. The accuracy of algorithms was elaborated regarding their ability to match human arrangement of the documents by the topic. For both the categorization and clustering, the authors used F-measure to assess the quality of allocation.

Downloads

Download data is not yet available.

Downloads

Published

2017-05-09

How to Cite

Wielgosz, M., Fraczek, R., Russek, P., Pietroń, M., Dabrowska-Boruch, A., Jamro, E., & Wiatr, K. (2017). Experiment on Methods for Clustering and Categorization of Polish Text. Computing and Informatics, 36(1), 186–204. Retrieved from https://www.cai.sk/ojs/index.php/cai/article/view/2017_1_186