Application of integrative information technology in the evaluation processes of research institutions
DOI:
https://doi.org/10.32347/2411-4049.2024.1.126-142Keywords:
AHP, acceptable vote, visualization, graphs, scientific and technical activity, institutional evaluationAbstract
The article proposes a solution to the scientific-applied problem of automating decision support regarding the review of criteria and indicators used in the evaluation of state-supported scientific institutions. This topic is highly relevant for scientific and technical activities both in the conditions of martial law and during the restoration of the country in peacetime. To address this issue, an information technology for decision support by experts is proposed based on an integrative methodology that involves data structuring, support for expert judgments, and visualization of decision-making processes using methods such as approval voting, hierarchy analysis, analytical networks, computer ontologies, and elements of graph theory. A concise description of the integrative methodology and the cognitive process of solving unstructured multi-criteria problems supported by this methodology is provided. The functionality of the developed software toolkit is discussed using an illustrative example related to determining the criteria base for the evaluation of scientific institutions. Elements of the ontological evaluation framework, a hierarchical model for the decision-making task of selecting quantitative assessment alternatives, and the results of experts determining criteria weights for evaluating alternatives and conducting pairwise comparisons of alternatives are presented. The conducted research indicates that the developed methodology and software tools, which have previously been tested in law enforcement agencies, can also be applied in other structures of government administration. The obtained results, aimed at enhancing the efficiency of evaluating scientific institutions, can be utilized to support decision-making in various aspects of managing scientific and technical activities.
References
Brighenti, A.M. (2021). Science evaluation – As it is, as it could be. Social Science Information, 60(3), 324–328. https://doi.org/10.1177/05390184211021205
Pal, J.K., & Sarkar, S. (2020). Evaluation of Institutional Research Productivity. DESIDOC Journal of Library & Information Technology, 40(1), 58–69. https://doi.org/10.14429/djlit.40.1.14804
Shovkun, T.V. et al. (2009). Effectiveness of scientific activity: state, trends and assessment problems. Kyiv: UkrINTEI [in Ukrainian].
Odotiuk, I. (2012). Evaluation of the results of scientific activity in Ukraine: regulatory and legal aspect. Problemy innovatsiino-investytsiinoho rozvytku, 3, 38–42 [in Ukrainian].
Zhuk, L.V. (2019). Systems of scientific and scientific and technical activity of institutions of higher education of Ukraine: formation, evaluation, management. Lviv: Vyd-vo Lviv. politekhniky [in Ukrainian].
Yehorov, I.Yu., & Zhukovych, I.A. (2022). The development of approaches to the evaluation of the results of the activities of research institutions. Nauka ta naukoznavstvo, 3(117), 36–50. https://doi.org/10.15407/sofs2022.03.036 [in Ukrainian].
Kubalskyi, O.N. (2023). The phenomenon of science in the system of transformations of modern life. Nauka ta naukoznavstvo, 1(119), 35–46. https://doi.org/10.15407/sofs2023.01.035 [in Ukrainian].
Biloshchytskyi, A.O., et al. (2021). Methods of evaluating the productivity of subjects of scientific activity. Kyiv: Komprynt [in Ukrainian].
Hobday, A.J., Boschetti, F., Moeseneder, C., et al. (2020). Quantitative foresighting as a means of improving anticipatory scientific capacity and strategic planning. One Earth, 3(5). 631–644. https://doi.org/10.1016/j.oneear.2020.10.015
Artiukhina, M.V., Dohtieva, I.O., Zharinov, S.S. et al. (2022). Digitization of management processes for the development of international scientific and technical cooperation. Aktualni problemy ekonomiky, 6-7 (252-253), 6–19 [in Ukrainian].
Pagano, A., Giordano, R., & Vurro, M.A. (2021). Decision Support System Based on AHP for Ranking Strategies to Manage Emergencies on Drinking Water Supply Systems. Water Resources Management, 35, 1–16. https://doi.org/10.1007/s11269-020-02741-y
Padilla, L.M., Creem-Regehr, S.H., Hegarty, M. et al. (2018). Decision making with visualizations: a cognitive framework across disciplines. Cogn. Research, 3, 29. https://doi.org/10.1186/s41235-018-0120-9
Eberhard, K. (2021). The effects of visualization on judgment and decision-making: a systematic literature review. Manag Rev Q. https://doi.org/10.1007/s11301-021-00235-8
Nesterenko, O., & Trofymchuk O. (2019). Patterns in forming the ontology-based environment of information-analytical activity in administrative management. Eastern-European Journal of Enterprise Technologies. 5/2 (101). 33-42. https://doi.org/10.15587/1729-4061.2019.180107
Xu, F.-X., Liu, X.-H., Chen, W., Zhou, C., & Cao, B.-W. (2018). An ontology and AHP based quality evaluation approach for reuse parts of end-of-life construction machinery. Mathematical Problems in Engineering. 3481030. https://doi.org/10.1155/2018/3481030
Nesterenko, O., Netesin, I., Polischuk, V., & Selin, Y. (2021). Multifunctional Methodology of Expert Evaluation Alternatives in Tasks of Different Information Complexity. Proceedings of the IEEE 3rd International Conference on Advanced Trends in Information Theory (ATIT), 226–231. https://doi.org/10.1109/ATIT54053.2021.96787428
Nesterenko, O., Netesin, I., Polischuk, V., & Trofymchuk, O. (2020). Development of a procedure for expert estimation of capabilities in defense planning under multicriterial conditions. Eastern-European Journal of Enterprise Technologies, 4/2 (106), 33–43. https://doi.org/10.15587/1729-4061.2020.208603
Polishchuk, V.B., Netesin, I.E., Nesterenko, O.V. et al. (2021). Information technologies in the management of defense resources: methodological context and examples of practical implementation. Part 2. [Ed. V. B. Polishchuk]. Kyiv: UkrNTs RIT [in Ukrainian].
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Nesterenko O.V., Polischuk V.B., Zharinov S.S.
This work is licensed under a Creative Commons Attribution 4.0 International License.
The journal «Environmental safety and natural resources» works under Creative Commons Attribution 4.0 International (CC BY 4.0).
The licensing policy is compatible with the overwhelming majority of open access and archiving policies.
