Open Research and Innovation

From Open Education to Open Research: A New Frontier

An explanation of open research practices such as preregistration, shared protocols and open peer review, with their purposes, limits and what to look for.

On this page
  1. Openness inside the research process
  2. Preregistration
  3. Registered reports
  4. Shared protocols and materials
  5. Open peer review
  6. Replication and reproducibility
  7. Why a learner should care
  8. Costs and cautions

Openness inside the research process

Open education asks teachers to share the materials behind a course. Open research asks something comparable of researchers: make more of the working process visible, so others can understand, check and build on it. Publishing a finished article is one part of this, and is covered under open access. The practices below concern what happens before and around the article.

None of them is a guarantee of good research. They are tools that make weak points easier to spot, and their value depends on how carefully they are used.

Preregistration

Preregistration means writing down a study’s plan before collecting or analyzing the data, and placing that plan somewhere with a date stamp. A plan usually states the question, the hypotheses, how the data will be gathered and how it will be analyzed.

The reasoning is about honesty with oneself. Data can be analyzed in many reasonable ways. If researchers try several and report only the one that looks interesting, a pattern can appear that is really chance. This is related to ideas covered in correlation causation: an association in data does not by itself show a cause, and an association found after many tries is less trustworthy than one that was specified in advance.

A preregistered plan lets readers compare what was planned with what was reported. Changes are allowed, since real studies meet surprises, but they should be explained. Preregistration is most natural for studies that test a specific prediction. It fits less neatly with exploratory work, which can be valuable but should be labeled as exploratory.

A simple hypothetical illustration: a team plans to compare two teaching methods on a particular test and states in advance that they will use that test and a specific comparison. If they later report a different test because it looked better, readers can see the difference. This is an invented example, not a description of any real study.

Registered reports

A related format, called a registered report, asks a journal to review the question and methods before results exist. If the plan is accepted, the journal commits in principle to publishing the outcome whatever it shows. The aim is to reduce pressure to produce striking results. Not every field or journal uses the format, and it is still relatively uncommon.

Shared protocols and materials

A protocol is a detailed description of how a study was done: the steps, the instruments, the questions asked, the settings used. Sharing protocols and materials, such as questionnaires or code, lets another group attempt the same procedure. Some details that seem trivial to the original team, such as how a sample was stored or how a question was worded, can matter a great deal.

Sharing methods is also useful for learners. It turns a methods section from a vague summary into something you can study. It connects to the scientific method in practice, where the essential idea is that a claim should be testable by others, and to designing a fair experiment, where careful control of conditions is the point.

Protocols can be shared on dedicated platforms, in repositories or alongside articles. Some information cannot be shared openly, such as details that would identify participants, so a protocol may need to be edited before release.

Open peer review

Peer review is the process by which other experts assess a manuscript before publication. In the usual arrangement, reviewers’ identities and comments are kept confidential. Open peer review covers several variations, and the term is used inconsistently:

  • Open identities, where reviewers and authors know who each other are.
  • Open reports, where review comments are published with the article.
  • Open participation, where the wider community may comment.

Supporters argue that open reports increase accountability and give younger researchers examples of good review. Concerns include that reviewers may soften criticism if they are named, and that junior reviewers may fear consequences when assessing senior authors. Evidence on whether open review improves quality is limited and mixed, so it is best viewed as an experiment still under evaluation.

Replication and reproducibility

Two other words come up often. A study is reproducible if another person, using the same data and code, gets the same results. It is replicable if a new study, collecting new data with the same approach, finds a similar result. Open research practices aim to make both easier. Sharing code and data, covered in research data sharing, supports reproducibility. Open methods support replication.

Failed replications do not always mean the original was wrong, as differences in samples or settings can matter, but they are information worth having.

Why a learner should care

You do not need to be a researcher to benefit. When reading a study, you can ask:

  1. Was there a plan registered in advance, and does the report follow it?
  2. Are methods described well enough to repeat?
  3. Are the data or materials available, or is there a reason they are not?
  4. Are the limits and unplanned analyses stated honestly?
  5. Were the review comments or editorial decisions made visible?

These questions give you a practical way into reading papers as a non-specialist and into judging how much confidence a claim deserves. The absence of these features does not prove a study is poor, and their presence does not prove it is right.

Costs and cautions

Open practices take time, and credit for that time is not always given in hiring or promotion. Small teams and researchers in less well-funded settings may find them harder to adopt. There is also a risk of treating them as a checklist: a study can be preregistered and still be poorly designed. The main benefit is transparency, not automatic accuracy.

A newcomer interested in open science can start modestly, by learning how to write a clear plan, keep organized records, and describe methods in enough detail that someone else could follow them. These are habits worth developing in any careful work.

The complete guide to open research and innovation

From Open Education to Open Innovation: A New Paradigm
Read the guide

Keep exploring

Guides from other topics

All topics →