zbMATH — the first resource for mathematics

The control model for the selection of reference collections providing the impartial assessment of the quality of scientific and technological publications by using bibliometric and scientometric indicators. (English. Russian original) Zbl 1384.93018
J. Comput. Syst. Sci. Int. 55, No. 5, 750-766 (2016); translation from Izv. Ross. Akad. Nauk, Teor. Sist. Upravl. 2016, No. 5, 73-89 (2016).
Summary: This paper presents a method for the impartial assessment of the quality of scientific and technological natural language documents and their collections by using bibliometric and scientometric indicators. The method of computational document search and design of document collections that are adequate for calculating reference values to assess the quality of the documents and document collections is formulated. This method is based on the mathematical modeling of natural language texts. Examples of the obtained assessments are presented.

93A30 Mathematical modelling of systems (MSC2010)
68T50 Natural language processing
93C95 Application models in control theory
Full Text: DOI
[1] Marshakova-Shaikevich, I. V., The role of bibliometrics in the evaluation of research activity of the science, Upravl. Bol’sh. Sist., 44, 210-247, (2013)
[2] L. Bornmann, A. Thor, W. Marx, and H. Schier, “The application of bibliometrics to research evaluation in the humanities and social sciences: an exploratory study using normalized google scholar data for the publications of a research institute,” J. Assoc. Inform. Sci. Technol. (in press).
[3] Bornmann, L.; Haunschild, R., The interest of the scientific community in expert opinions from journal peer review procedures, Scientometrics, 102, 2187-2188, (2015)
[4] Ruiz-Castillo, J.; Waltman, L., Field-normalized citation impact indicators using algorithmically constructed classification systems of science, J. Informetrics, 9, 102-117, (2015)
[5] Eck, N. J.; Waltman, L., Citnetexplorer: a new software tool for analyzing and visualizing citation networks, J. Informetrics, 8, 802-823, (2014)
[6] Waltman, L.; Costas, R., F1000 recommendations as a new data source for research evaluation: a comparison with citations, J. Assoc. Inform. Sci. Technol., 65, 433-445, (2014)
[7] Waltman, L.; Eck, N. J., A systematic empirical comparison of different approaches for normalizing citation impact indicators, J. Informetrics, 7, 833-849, (2013)
[8] Waltman, L.; Eck, N. J., Source normalized indicators of citation impact: an overview of different approaches and an empirical comparison, Scientometrics, 96, 699-716, (2013)
[9] Waltman, L.; Schreiber, M., On the calculation of percentile-based bibliometric indicators, J. Am. Soc. Inform. Sci. Technol., 64, 372-379, (2013)
[10] Waltman, L.; Eck, N. J.; Wouters, P., Counting publications and citations: is more always better?, J. Informetrics, 7, 635-641, (2013)
[11] Bornmann, L.; Leydesdorff, L., Does quality and content matter for citedness? A comparison with para-textual factors and over time, J. Informetrics, 9, 419-429, (2015)
[12] Bornmann, L., Redundancies in h index variants and the proposal of the number of top-cited papers as an attractive indicator, Measurement, 10, 149-153, (2012)
[13] Waltman, L.; van Raan, A. F. J.; Eck, N. J.; Peul, W. C., Citation analysis may severely underestimate the impact of clinical research as compared to basic research, PLoS ONE, 8, e62395, (2013)
[14] B. Z. Iliev, “Measuring the evaluation and impact of scientific works and their authors,” (2013); arXiv:1311/6948.
[15] S. V. Bredikhin and A. Yu. Kuznetsov, Bibliometric Methods and the Electronic Scientific Periodicals Market (IVMiMG SO RAN, NEIKON, Novosibirsk, 2012) [in Russian].
[16] Morozova, O. P., Hirsch index as a scientometric indicator: comparative analysis and its modifications, Nauch.-Tekh. Inform., Ser. 1: Organiz. Metodika Inform. Raboty, 2, 30-33, (2011)
[17] V. V. Nalimov and Z. M. Mul’chenko, Scientometry (Nauka, Moscow, 1969) [in Russian].
[18] Red’kina, N. S., Bibliometrics: history and the present, Molodye Bibliotech. Dele, 2, 76-86, (2003)
[19] Fedorets, O. V., Using the weighted impact factor to create a List of the most-cited multidisciplinary journals, Nauch.-Tekh. Inform., Ser. 1: Organiz. Metodika Inform. Raboty, 7, 22-27, (2011)
[20] Kücüktunç, O.; Saule, E.; Kaya, K.; Catalyürek, Ü V. V., Diversifying citation recommendations, ACM Trans. Intell. Syst. Technol., 5, 55, (2015)
[21] Vanclay, J. K., Impact factor: outdated artefact or stepping-stone to journal certification?, Scientometrics, 92, 211-238, (2012)
[22] Vanclay, J. K.; Bornmann, L., Metrics to evaluate research performance in Academic institutions: a critique of ERA 2010 as applied in forestry and the indirect H2 index as a possible alternative, Scientometrics, 91, 751-771, (2012)
[23] Numbers Game, or as We Now Appreciate the Work of the Scientist, Collection of Articles in Bibliometrics (MTsNMO, Moscow, 2011) [in Russian].
[24] Saracevic, T., Effects of inconsistent relevance judgments on information retrieval test results: a historical perspective, LIBRARY TRENDS.he Legacy of F. W. Lancaster, 56, 763-783, (2008)
[25] Kreines, M. G., Models and technologies for the extraction of aggregated knowledge to control processes of the retrieval of non-structured information, J. Comput. Syst. Sci. Int., 48, 272, (2009) · Zbl 1173.93310
[26] Kreines, M. G., Methods of computational analysis of semantic models for quality assessment of scientific texts, J. Comput. Syst. Sci. Int., 52, 226, (2013) · Zbl 1307.68080
[27] Petrov, A. N.; Kreines, M. G.; Afonin, A. A., Semantic search of the unstuctured natural language texts in the management of the research and development programs’ expertise, Informatiz. Obrazov. Nauki, 18, 54-67, (2013)
[28] Kreines, M. G.; Afonin, A. A., Clusterization of text collections: help with a content search and analytical tool, 510-537, (2007)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.