OPENNESS, DIGITALIZATION AND EVALUATION IN RESEARCH: GENERAL AND SPECIAL ISSUES FOR SOCIAL STUDIES AND HUMANITIES

Keywords: open science, digitalization, research evaluation, Social Sciences and Humanities

Abstract

The paper deals with the current trends in the European Research Area (ERA) concerning openness, digitalization and evaluation in research in general and in the field of Social Sciences and Humanities (SSH) knowledge in particular. Prospects for the open science, open access to research results development in the context of the global COVID-19 pandemic are characterized; the pandemic proved the inevitability of rapid change due to the development of digital technologies. It was found out that the trend to assure open access dominates in the ERA, which is supported by the European Commission, European Association of Universities, European Federation of Academies of Sciences and Humanities, wide professional community through the Horizon Europe programme implementation. The basis of the digital technology platform for the implementation of a wide range of research processes (from providing access to cloud computing, storage and processing of large data sets to the research results exchange, etc.) is the European Open Science Cloud (EOSC). The EOSC portal implementation through the work of research infrastructures, that contribute to regional, national, European and global development, and e-infrastructures, which in the SSH are divided into relative components and have appropriate functional levels, is analyzed. It is proved that the problem of research presentation and evaluation is actualized in the process of its transition to open science; the SSH richness, diversity, interdisciplinarity, national context and stakeholders should be taken into account. The necessity of changes in the SSH researches’ evaluation and importance of the initiative to preserve and take into account their balanced multilingualism in the process of transition to open science are substantiated. It was found that the current Ukrainian regulations do not include such specifics. This significantly complicates research conduction, narrows the prospect of research results publishing due to the limited number of the SSH scientific professional journals in Ukraine, makes the training and attestation of young researchers difficult. In order to adequately respond to these challenges with the participation of the NAES of Ukraine researchers a complex of measures at the institutional and individual levels is proposed to systematically and consistently support the open science initiative.

Downloads

Download data is not yet available.

Author Biographies

Vasyl G. Kremen, National Academy of Educational Sciences of Ukraine

Doctor of Sciences in Philosophy, Professor, Full Member (Academician) of NAS of Ukraine and NAES of Ukraine, President

Volodymyr I. Lugovyi, National Academy of Educational Sciences of Ukraine, Institute of Higher Education of the National Academy of Educational Sciences of Ukraine

Doctor of Sciences in Education, Professor, Full Member (Academician) of NAES of Ukraine, First Vice-President

Iryna Yu. Reheilo, National Academy of Educational Sciences of Ukraine, Institute of Higher Education of the National Academy of Educational Sciences of Ukraine

Doctor of Sciences in Education, Senior Researcher, Head of the Scientific and Organizational Department, Chief Research Fellow of the Department for Integration of Higher Education and Research

Nataliia V. Bazeliuk, National Academy of Educational Sciences of Ukraine, Institute of Higher Education of the National Academy of Educational Sciences of Ukraine

PhD in Education, Deputy Head of the Scientific and Organizational Department, Senior Research Fellow of the Higher Education Internationalization Department

Oleksandr V. Bazeliuk, Institute of Vocational Education and Training of the National Academy of Educational Sciences of Ukraine, Institute of Higher Education of the National Academy of Educational Sciences of Ukraine

PhD in Education, Doctor of Sciences Student, Senior Research Fellow of the Higher Education Economics Department

References

First “ERAvsCORONA” Action Plan. Short-term coordinated Research & Innovation actions, Directorate-General for Research and Innovation – European Commission, Apr. 7, 2020. [Електронний ресурс]. Доступно: https://ec.europa.eu/info/sites/info/files/covid-firsteravscorona_actions.pdf

Budapest Open Access Initiative, Feb. 14, 2002. [Електронний ресурс]. Доступно:: https://www.budapestopenaccessinitiative.org/read

Commission Recommendation of 17.7.2012 on access to and preservation of scientific information. Brussels, 17.7.2012 C(2012) 4890 final, European Commission, 2012. [Електронний ресурс]. Доступно: http://ec.europa.eu/research/science-society/document_library/pdf_06/recommendation-access-and-preservation-scientific-information_en.pdf

Communication from the Commission to the European Parliament, the Council and the European Economic and Social Committee on scientific information in the digital age: access, dissemination and preservation. Brussels, 14.2.2007 COM(2007) 56 final”, Feb. 14, 2007. [Електронний ресурс]. Доступно: https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52007DC0056&from=EN

Council Conclusions on scientific information in the digital age: access, dissemination and preservation. 2832nd Competitiveness (Internal market, Industry and Research) Council meeting Brussels, 22 and 23 November 2007, Council of the European Union, 2007. [Електронний ресурс]. Доступно: http://ec.europa.eu/research/science-society/document_library/pdf_06/council-conclusions97236_en.pdf

U. von der Leyen, “Special Address by Ursula von der Leyen, President of the European Commission”, World Economic Forum, Jan. 22, 2020. [Електронний ресурс]. Доступно: https://www.weforum.org/events/world-economic-forum-annual-meeting-2020/sessions/special-address-by-ursula-von-der-leyen-president-of-the-european-commission

В.Г. Кремень, “Звіт Національної академії педагогічних наук України про стан використання коштів на наукову і науково-технічну діяльність та отримані результати за 2018-2019 рр.”, Вісник Національної академії педагогічних наук України, том 2, вип. 1, 2020. https://doi.org/10.37472/2707-305X-2020-2-1-3-5

В.І. Луговий та І.Ю. Регейло, “Про “Звіт про діяльність Національної академії педагогічних наук України у 2019 році”, Вісник Національної академії педагогічних наук України, том 2, вип. 1, 2020. https://doi.org/10.37472/2707-305X-2020-2-1-2-5

C. Stracke, “Open Science and Radical Solutions for Diversity, Equity and Quality in Research: A Literature Review of Different Research Schools, Philosophies and Frameworks and Their Potential Impact on Science and Education”, in Radical Solutions and Open Science. Lecture Notes in Educational Technology, Burgos D., Ed. Singapore: Springer, 2020, pp. 17-37. https://doi.org/10.1007/978-981-15-4276-3_2

H. Aguinis, G. Banks, S. Rogelberg and W. Cascio, “Actionable recommendations for narrowing the science-practice gap in open science”, Organizational Behavior and Human Decision Processes, vol. 158, pp. 27-35, 2020. https://doi.org/10.1016/j.obhdp.2020.02.007

B. Nosek et al., “Promoting an open research culture”, Science, vol. 348, no. 6242, pp. 1422-1425, 2015. https://doi.org/10.1126/science.aab2374

E. McKiernan et al., “How open science helps researchers succeed”, eLife, vol. 5, 2016. https://doi.org/10.7554/elife.16800

L. Bornmann, “What is societal impact of research and how can it be assessed? A literature survey”, Journal of the American Society for Information Science and Technology, vol. 64, no. 2, pp. 217-233, 2012. https://doi.org/10.1002/asi.22803

L. Leydesdorff, C. Wagner and L. Bornmann, “Diversity measurement: Steps towards the measurement of interdisciplinarity?”, Journal of Informetrics, vol. 13, no. 3, pp. 904-905, 2019. https://doi.org/10.1016/j.joi.2019.03.016

E. Reale et al., “A review of literature on evaluating the scientific, social and political impact of social sciences and humanities research”, Research Evaluation, vol. 27, no. 4, pp. 298-308, 2017. https://doi.org/10.1093/reseval/rvx025

L. Waltman and N. van Eck, “Field Normalization of Scientometric Indicators”, in Springer Handbook of Science and Technology Indicators, Glänzel W., Moed H.F., Schmoch U., Thelwall M., Eds. Cham: Springer, 2019, pp. 281-300. https://doi.org/10.1007/978-3-030-02511-3_11

В. Биков, О. Спірін, А. Білощицький, О. Кучанський, О. Діхтяренко and О. Новицький, “Відкриті цифрові системи в оцінюванні результатів науково-педагогічних досліджень”, Інформаційні технології і засоби навчання, том 75, вип. 1, с. 294-315, 2020. https://doi.org/10.33407/itlt.v75i1.3589

“European Open Science Cloud”, Shaping Europe’s digital future – European Commission, Last update: May 4, 2020. [Електронний ресурс]. Доступно: https://ec.europa.eu/digital-single-market/en/european-open-science-cloud

“Open science”, European Commission, Dec. 13, 2020. [Електронний ресурс]. Доступно: https://ec.europa.eu/info/files/open-science_en

Open Consultation for the Strategic Research and Innovation Agenda (SRIA) of the European Open Science Cloud (EOSC), EOSCsecretariat.eu, Jul. 20, 2020. [Електронний ресурс]. Доступно: https://www.eoscsecretariat.eu/sites/default/files/open_consultation_booklet_sria-eosc_20-july-2020.pdf

European Open Science Cloud (EOSC) Strategic Implementation Plan, European Commission, 2019. [Електронний ресурс]. Доступно: https://ec.europa.eu/info/publications/european-open-science-cloud-eosc-strategic-implementation-plan_en

European University Association. [Електронний ресурс]. Доступно: https://eua.eu/

Horizon Europe: EUA analysis of the European Commission proposal, European University Association, 2018. [Електронний ресурс]. Доступно: https://eua.eu/downloads/publications/horizon-europe-eua-analysis-of-the-european-commission-proposal.pdf

The European Federation of Academies of Sciences and Humanities, ALLEA – All European Academies, n.d. [Електронний ресурс]. Доступно: https://allea.org/.

A. Dusa, D. Nelle, G. Stock and G. Wagner, Eds. Facing the Future: European Research Infrastructures for the Humanities and Social Sciences. Berlin: GWI Wissenschaftspolitik Infrastrukturentwicklung, 2014. [Електронний ресурс]. Доступно: https://www.akademienunion.de/fileadmin/redaktion/user_upload/Publikationen/Tagungsbaende/FACING_THE_FUTURE.pdf

European Charter for Access to Research Infrastructures. Principles and Guidelines for Access and Related Services, Directorate-General for Research and Innovation – European Commission, 2016. [Електронний ресурс]. Доступно: https://ec.europa.eu/research/infrastructures/pdf/2016_charterforaccessto-ris.pdf

Міністерство освіти і науки України. [Електронний ресурс]. Доступно: https://mon.gov.ua/

Лист Національної академії педагогічних наук України “Пропозиції до проєкту розпорядження Кабінету Міністрів України “Про схвалення Концепції державної програми розвитку дослідницьких інфраструктур в Україні до 2026 року” від 23 липня 2020 р. № 2-6/330 (не опубліковано).

“E-Infrastructures”, Shaping Europe’s digital future – European Commission, Last update Nov. 12, 2019. [Електронний ресурс]. Доступно: https://ec.europa.eu/digital-single-market/en/e-infrastructures

A. Calvia-Goetz, A. Franciosi, S. Larsen, J. Marks, K. Tichmann, R. Wade, and M. Zic Fuchs, Assessing the projects on the ESFRI roadmap. A high level expert group report, Directorate-General for Research and Innovation – European Commission, 2013. [Електронний ресурс]. Доступно: https://ec.europa.eu/research/evaluations/pdf/archive/other_reports_studies_and_documents/esfri.pdf

Лист Національної академії педагогічних наук України “Про обговорення проєкту розпорядження Кабінету Міністрів України “Про схвалення Концепції реалізації державної політики розвитку українських е-інфраструктур до 2023 року та затвердження Плану заходів щодо її реалізації” від 22 липня 2020 р. № 2-6/328 (не опубліковано).

А.Г. Загородній, “Європейська хмара відкритої науки як глобальний інструмент наукових досліджень”, Світ, вип. 25-26(1109-1110), липень 2020, с. 1-3. [Електронний ресурс]. Доступно: http://www1.nas.gov.ua/svit/Article/Pages/20_2526_1.aspx

Open Data Maturity Report 2019, Publications Office of the European Union, 2019. [Електронний ресурс]. Доступно: https://doi.org/10.2830/073835

Опитування щодо інституційних репозитаріїв, відкритої науки та готовності до співпраці з НРАТ, Міністерство освіти і науки України, Серп. 14, 2020. [Електронний ресурс]. Доступно: https://mon.gov.ua/storage/app/media/14.08.2020/lokalni-repozitarii-final.pdf

EUA Roadmap on Research Assessment in the Transition to Open Science, European University Association, 2018. [Електронний ресурс]. Доступно: https://eua.eu/downloads/publications/eua-roadmap-on-research-assessment-in-the-transition-to-open-science.pdf

San Francisco Declaration on Research Assessment, 2012. [Електронний ресурс]. Доступно: https://sfdora.org/read/

D. Hicks, P. Wouters, L. Waltman, S. de Rijcke, and I. Rafols, “Bibliometrics: The Leiden Manifesto for research metrics”, Nature, vol. 520, no. 7548, pp. 429-431, 2015. https://doi.org/10.1038/520429a

European Network for Research Evaluation in the Social Sciences and the Humanities, 2016-2020. [Електронний ресурс]. Доступно: https://enressh.eu/

Challenges of the evaluation of social sciences and humanities research (SSH), ENRESSH – European Network for Research Evaluation in the SSH, 2017. [Електронний ресурс]. Доступно: https://enressh.eu/wp-content/uploads/2017/09/Guidelines_SSH_final.pdf

E. Kulczycki et al., “Multilingual Publishing in the Social Sciences and Humanities: A Seven Country European Study”, Journal of the Association for Information Science and Technology, 2020. https://doi.org/10.1002/asi.24336

M. Ochsner, N. Kancewicz-Hoffman, L. Ma, J. Holm, A. Gedutis, K. Šima S. E. Hug, A. Dewaele, and S. de Jong, ENRESSH Policy Brief. Research Evaluation, COST Action ENRESSH, Mar. 31, 2020. https://doi.org/10.6084/m9.figshare.12049314.v1

S. de Jong and J. Spaapen, ENRESSH Policy Brief. Autumn 2018. Communication, evaluation and impact of Social Sciences and Humanities, COST Action ENRESSH, May 13, 2019. [Online]. https://doi.org/10.6084/m9.figshare.8082542.v1

Лист Національної академії педагогічних наук України “Щодо громадського обговорення проєкту наказу МОН України “Про внесення змін до Порядку формування Переліку наукових фахових видань України, затвердженого наказом МОН від 15 січня 2018 року № 32” від 17 вересня 2020 р. № 2-6/383 (неопубліковано).

“Multilingualism in scholarly communication: Endorsement of Helsinki Initiative”, European University Association, Jun. 6, 2019. [Електронний ресурс]. Доступно: https://www.eua.eu/news/341:multilingualism-in-scholarly-communication-endorsement-of-helsinki-initiative.html

Helsinki Initiative on Multilingualism in Scholarly Communication, Federation of Finnish Learned Societies, Committee for Public Information, Finnish Association for Scholarly Publishing, Universities Norway & European Network for Research Evaluation in the Social Sciences and the Humanities, Apr. 2, 2019. https://doi.org/10.6084/m9.figshare.7887059


REFERENCES (TRANSLATED AND TRANSLITERATED)

First “ERAvsCORONA” Action Plan. Short-term coordinated Research & Innovation actions, Directorate-General for Research and Innovation – European Commission, Apr. 7, 2020. [Online]. Available: https://ec.europa.eu/info/sites/info/files/covid-firsteravscorona_actions.pdf. (in English)

Budapest Open Access Initiative, Feb. 14, 2002. [Online]. Available: https://www.budapestopenaccessinitiative.org/read. (in English)

Commission Recommendation of 17.7.2012 on access to and preservation of scientific information. Brussels, 17.7.2012 C(2012) 4890 final, European Commission, 2012. [Online]. Available: http://ec.europa.eu/research/science-society/document_library/pdf_06/recommendation-access-and-preservation-scientific-information_en.pdf. (in English)

Communication from the Commission to the European Parliament, the Council and the European Economic and Social Committee on scientific information in the digital age: access, dissemination and preservation. Brussels, 14.2.2007 COM(2007) 56 final”, Feb. 14, 2007. [Online]. Available: https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52007DC0056&from=EN. (in English)

Council Conclusions on scientific information in the digital age: access, dissemination and preservation. 2832nd Competitiveness (Internal market, Industry and Research) Council meeting Brussels, 22 and 23 November 2007, Council of the European Union, 2007. [Online]. Available: http://ec.europa.eu/research/science-society/document_library/pdf_06/council-conclusions97236_en.pdf. (in English)

U. von der Leyen, “Special Address by Ursula von der Leyen, President of the European Commission,” World Economic Forum, Jan. 22, 2020. [Online]. Available: https://www.weforum.org/events/world-economic-forum-annual-meeting-2020/sessions/special-address-by-ursula-von-der-leyen-president-of-the-european-commission. (in English)

V. Kremen, “National Academy of Educational Sciences of Ukraine Report on the State of Using the Funds for Research Activities and the Results Received in 2018-2019,” Herald of the National Academy of Educational Sciences of Ukraine, vol. 2, no. 1, 2020. https://doi.org/10.37472/2707-305X-2020-2-1-3-5. (in Ukrainian)

V. Lugovyi and I. Reheilo, “On the National Academy of Educational Sciences of Ukraine Activity Report 2019,” Herald of the National Academy of Educational Sciences of Ukraine, vol. 2, no. 1, 2020. https://doi.org/10.37472/2707-305X-2020-2-1-2-5. (in Ukrainian)

C. Stracke, “Open Science and Radical Solutions for Diversity, Equity and Quality in Research: A Literature Review of Different Research Schools, Philosophies and Frameworks and Their Potential Impact on Science and Education,” in Radical Solutions and Open Science. Lecture Notes in Educational Technology, Burgos D., Ed. Singapore: Springer, 2020, pp. 17-37. https://doi.org/10.1007/978-981-15-4276-3_2. (In English)

H. Aguinis, G. Banks, S. Rogelberg and W. Cascio, “Actionable recommendations for narrowing the science-practice gap in open science,” Organizational Behavior and Human Decision Processes, vol. 158, pp. 27-35, 2020. https://doi.org/10.1016/j.obhdp.2020.02.007. (in English)

B. Nosek et al., “Promoting an open research culture,” Science, vol. 348, no. 6242, pp. 1422-1425, 2015. https://doi.org/10.1126/science.aab2374. (in English)

E. McKiernan et al., “How open science helps researchers succeed,” eLife, vol. 5, 2016. https://doi.org/10.7554/elife.16800. (in English)

L. Bornmann, “What is societal impact of research and how can it be assessed? A literature survey,” Journal of the American Society for Information Science and Technology, vol. 64, no. 2, pp. 217-233, 2012. https://doi.org/10.1002/asi.22803. (in English)

L. Leydesdorff, C. Wagner and L. Bornmann, “Diversity measurement: Steps towards the measurement of interdisciplinarity?” Journal of Informetrics, vol. 13, no. 3, pp. 904-905, 2019. https://doi.org/10.1016/j.joi.2019.03.016. (In English)

E. Reale et al., “A review of literature on evaluating the scientific, social and political impact of social sciences and humanities research,” Research Evaluation, vol. 27, no. 4, pp. 298-308, 2017. https://doi.org/10.1093/reseval/rvx025. (in English)

L. Waltman and N. van Eck, “Field Normalization of Scientometric Indicators,” in Springer Handbook of Science and Technology Indicators, Glänzel W., Moed H.F., Schmoch U., Thelwall M., Eds. Cham: Springer, 2019, pp. 281-300. https://doi.org/10.1007/978-3-030-02511-3_11. (in English)

V. Bykov, O. Spirin, A. Biloshchytskyi, A. Kuchansky, O. Dikhtiarenko and O. Novytskyi, “Open digital systems for assessment of pedagogical research results,” Information Technologies and Learning Tools, vol. 75, no. 1, pp. 294-315, 2020. https://doi.org/10.33407/itlt.v75i1.3589. (in Ukrainian)

“European Open Science Cloud,” Shaping Europe’s digital future – European Commission, Last update: May 4, 2020. [Online]. Available: https://ec.europa.eu/digital-single-market/en/european-open-science-cloud. (in English)

“Open science,” European Commission, Dec. 13, 2020. [Online]. Available: https://ec.europa.eu/info/files/open-science_en. (in English)

Open Consultation for the Strategic Research and Innovation Agenda (SRIA) of the European Open Science Cloud (EOSC), EOSCsecretariat.eu, Jul. 20, 2020. [Online]. Available: https://www.eoscsecretariat.eu/sites/default/files/open_consultation_booklet_sria-eosc_20-july-2020.pdf. (in English)

European Open Science Cloud (EOSC) Strategic Implementation Plan, European Commission, 2019. [Online]. Available: https://ec.europa.eu/info/publications/european-open-science-cloud-eosc-strategic-implementation-plan_en. (in English)

European University Association. [Online]. Available: https://eua.eu/. (in English)

Horizon Europe: EUA analysis of the European Commission proposal, European University Association, 2018. [Online]. Available: https://eua.eu/downloads/publications/horizon-europe-eua-analysis-of-the-european-commission-proposal.pdf. (in English)

The European Federation of Academies of Sciences and Humanities, ALLEA – All European Academies, n.d. [Online]. Available: https://allea.org/. (in English)

A. Dusa, D. Nelle, G. Stock and G. Wagner, Eds. Facing the Future: European Research Infrastructures for the Humanities and Social Sciences. Berlin: GWI Wissenschaftspolitik Infrastrukturentwicklung, 2014. https://www.akademienunion.de/fileadmin/redaktion/user_upload/Publikationen/Tagungsbaende/FACING_THE_FUTURE.pdf. (in English)

European Charter for Access to Research Infrastructures. Principles and Guidelines for Access and Related Services, Directorate-General for Research and Innovation – European Commission, 2016. [Online]. Available: https://ec.europa.eu/research/infrastructures/pdf/2016_charterforaccessto-ris.pdf. (in English)

Ministry of Education and Science of Ukraine. [Online]. Available: https://mon.gov.ua/. (in Ukrainian)

Letter of the National Academy of Educational Sciences of Ukraine “Proposals to the draft order of the Government of Ukraine “On approving the Concept of the state program on research infrastructures development in Ukraine until 2026” of July 23, 2020 No 2-6/330 (Unpublished). (in Ukrainian)

“E-Infrastructures,” Shaping Europe’s digital future – European Commission, Last update Nov. 12, 2019. [Online]. Available: https://ec.europa.eu/digital-single-market/en/e-infrastructures. (in English)

A. Calvia-Goetz, A. Franciosi, S. Larsen, J. Marks, K. Tichmann, R. Wade, and M. Zic Fuchs, Assessing the projects on the ESFRI roadmap. A high level expert group report, Directorate-General for Research and Innovation – European Commission, 2013. [Online]. Available: https://ec.europa.eu/research/evaluations/pdf/archive/other_reports_studies_and_documents/esfri.pdf. (in English)

Letter of the National Academy of Educational Sciences of Ukraine “On discussing the draft order of the Government of Ukraine “On approving the Concept of realizing the state policy of Ukrainian e-infrastructures development until 2023 and Action plan for its implementation” of July 22, 2020 No 2-6/328 (Unpublished). (in Ukrainian)

A. Zahorodnii, “The European Open Science Cloud as a global research tool”, Svit, no. 25-26(1109-1110), Jul. 2020, pp. 1-3. http://www1.nas.gov.ua/svit/Article/Pages/20_2526_1.aspx. (in Ukrainian)

Open Data Maturity Report 2019, Publications Office of the European Union, 2019. https://doi.org/10.2830/073835. (in English)

Survey on the institutional repositories, open science and readiness to work with the National Repository of Academic Texts, Ministry of Education and Science of Ukraine, Aug. 14, 2020. [Online]. Available: https://mon.gov.ua/storage/app/media/14.08.2020/lokalni-repozitarii-final.pdf. (in Ukrainian)

EUA Roadmap on Research Assessment in the Transition to Open Science, European University Association, 2018. [Online]. Available: https://eua.eu/downloads/publications/eua-roadmap-on-research-assessment-in-the-transition-to-open-science.pdf. (in English)

San Francisco Declaration on Research Assessment, 2012. [Online]. Available: https://sfdora.org/read/. (in English)

D. Hicks, P. Wouters, L. Waltman, S. de Rijcke, and I. Rafols, “Bibliometrics: The Leiden Manifesto for research metrics,” Nature, vol. 520, no. 7548, pp. 429-431, 2015. https://doi.org/10.1038/520429a. (in English)

European Network for Research Evaluation in the Social Sciences and the Humanities, 2016-2020. [Online]. Available: https://enressh.eu/. (in English)

Challenges of the evaluation of social sciences and humanities research (SSH), ENRESSH – European Network for Research Evaluation in the SSH, 2017. [Online]. Available: https://enressh.eu/wp-content/uploads/2017/09/Guidelines_SSH_final.pdf. (in English)

E. Kulczycki et al., “Multilingual Publishing in the Social Sciences and Humanities: A Seven Country European Study,” Journal of the Association for Information Science and Technology, 2020. https://doi.org/10.1002/asi.24336. (in English)

M. Ochsner, N. Kancewicz-Hoffman, L. Ma, J. Holm, A. Gedutis, K. Šima S. E. Hug, A. Dewaele, and S. de Jong, ENRESSH Policy Brief. Research Evaluation, COST Action ENRESSH, Mar. 31, 2020. https://doi.org/10.6084/m9.figshare.12049314.v1. (in English)

S. de Jong and J. Spaapen, ENRESSH Policy Brief. Autumn 2018. Communication, evaluation and impact of Social Sciences and Humanities, COST Action ENRESSH, May 13, 2019. [Online]. https://doi.org/10.6084/m9.figshare.8082542.v1. (in English)

Letter of the National Academy of Educational Sciences of Ukraine “On the public discussion of the draft order of the MoES of Ukraine “On amendments to the Procedure for forming the List of scientific professional periodicals of Ukraine, approved by the MoES of Ukraine order of January 15, 2018 No 32” of September 17, 2020 No 2-6/383 (Unpublished). (in Ukrainian)

“Multilingualism in scholarly communication: Endorsement of Helsinki Initiative,” European University Association, Jun. 6, 2019. [Online]. Available: https://www.eua.eu/news/341:multilingualism-in-scholarly-communication-endorsement-of-helsinki-initiative.html. (in English)

Helsinki Initiative on Multilingualism in Scholarly Communication, Federation of Finnish Learned Societies, Committee for Public Information, Finnish Association for Scholarly Publishing, Universities Norway & European Network for Research Evaluation in the Social Sciences and the Humanities, Apr. 2, 2019. https://doi.org/10.6084/m9.figshare.7887059. (in English)

Published
2020-12-22
How to Cite
Kremen, V. G., Lugovyi, V. I., Reheilo, I. Y., Bazeliuk, N. V., & Bazeliuk, O. V. (2020). OPENNESS, DIGITALIZATION AND EVALUATION IN RESEARCH: GENERAL AND SPECIAL ISSUES FOR SOCIAL STUDIES AND HUMANITIES . Information Technologies and Learning Tools, 80(6), 243-266. https://doi.org/10.33407/itlt.v80i6.4155
Section
ICT to support psychological and educational research