An open toolkit for tracking open science partnership implementation and impact [version 2; peer review: 2 approved]

E. Richard Gold, Sarah E. Ali-Khan, Liz Allen, Lluis Ballell, Manoel Barral-Netto, David Carr, Damien Chalaud, Simon Chaplin, Matthew S. Clancy, Patricia Clarke, Robert Cook-Deegan, A. P. Dinsmore, Megan Doerr, Lisa Federer, Steven A. Hill, Neil Jacobs, Antoine Jean, Osmat Azzam Jefferson, Chonnettia Jones, Linda J. KahlThomas M. Kariuki, Sophie N. Kassel, Robert Kiley, Elizabeth Robboy Kittrie, Bianca Kramer, Wen Hwa Lee, Emily Macdonald, Lara M. Mangravite, Elizabeth Marincola, Daniel Mietchen, Jennifer C. Molloy, Mark Namchuk, Brian A. Nosek, Sébastien Paquet, Claude Pirmez, Annabel Seyller, Malcolm Skingle, S. Nicole Spadotto, Sophie Staniszewska, Mike Thelwall

Research output: Contribution to journalArticlepeer-review

9 Scopus citations


Serious concerns about the way research is organized collectively are increasingly being raised. They include the escalating costs of research and lower research productivity, low public trust in researchers to report the truth, lack of diversity, poor community engagement, ethical concerns over research practices, and irreproducibility. Open science (OS) collaborations comprise of a subset of open practices including open access publication, open data sharing and the absence of restrictive intellectual property rights with which institutions, firms, governments and communities are experimenting in order to overcome these concerns. We gathered two groups of international representatives from a large variety of stakeholders to construct a toolkit to guide and facilitate data collection about OS and non-OS collaborations. Ultimately, the toolkit will be used to assess and study the impact of OS collaborations on research and innovation. The toolkit contains the following four elements: 1) an annual report form of quantitative data to be completed by OS partnership administrators; 2) a series of semi-structured interview guides of stakeholders; 3) a survey form of participants in OS collaborations; and 4) a set of other quantitative measures best collected by other organizations, such as research foundations and governmental or intergovernmental agencies. We opened our toolkit to community comment and input. We present the resulting toolkit for use by government and philanthropic grantors, institutions, researchers and community organizations with the aim of measuring the implementation and impact of OS partnership across these organizations. We invite these and other stakeholders to not only measure, but to share the resulting data so that social scientists and policy makers can analyse the data across projects.

Original languageEnglish (US)
Article number1442
JournalGates Open Research
StatePublished - 2019


  • Impact
  • Implementation
  • Indicator
  • Innovation
  • Intellectual property
  • Open science
  • Partnership
  • Performance
  • Policy
  • Toolkit

ASJC Scopus subject areas

  • Medicine (miscellaneous)
  • Biochemistry, Genetics and Molecular Biology (miscellaneous)
  • Immunology and Microbiology (miscellaneous)
  • Health Policy
  • Public Health, Environmental and Occupational Health


Dive into the research topics of 'An open toolkit for tracking open science partnership implementation and impact [version 2; peer review: 2 approved]'. Together they form a unique fingerprint.

Cite this