What this review does and does not do
This page does not summarize particular named studies or quote figures. Instead it sorts the common claims made about open education and student outcomes by how well they tend to be supported, and explains what stronger evidence would look like. If you want to check a specific number you have seen, the original source is the place to go.
The short version: some claims rest on fairly direct observation, some are plausible but thinly tested, and some are assumed because they sound reasonable. Telling these apart is most of the work.
Claims that are the most directly supported
Open materials cost learners less
This is nearly true by definition. Openly licensed or freely available materials do not require a purchase, so a student who would otherwise buy a textbook saves that amount. Because the saving is straightforward to count, it is the claim with the clearest support. Even so, the size varies: it depends on what the previous materials cost, whether students bought them at all, and whether other costs, such as printing or data, replaced it. The point about textbook costs is a good example of a claim worth stating precisely rather than broadly.
Students have the materials earlier
Where students might delay or skip purchasing a book, free access removes that barrier. This is plausible and often reported, but how much it matters for learning is a separate question.
Claims that are plausible but less well established
Pass rates and grades
Some comparisons report grades in open-materials courses being similar to those in courses using conventional materials, and some report modest differences either way. A common, careful reading is that moving to open materials does not appear to harm results on average, but that stronger claims of improvement are harder to support. Results differ by subject, institution and design. A finding that holds in one course may not hold in the next.
Persistence and completion
It is reasonable to think that lower costs and easier access might help learners stay in a course, and student retention is a frequent hope. But persistence depends on many things: workload, personal circumstances, support and motivation. Evidence that open materials alone change completion rates is limited, and when differences are reported it is often unclear how much to credit the materials versus accompanying changes.
Effects on learners who face the most barriers
A frequent claim is that open education helps disadvantaged students most. The logic is sensible, since cost savings matter more where money is tight. Some studies look at subgroups, but subgroup samples are often small, and results are not consistent. The claim is better described as an open question than as an established fact.
Claims that are mostly assumed
Open means better quality
Openness describes licensing and access, not quality. An open resource can be excellent or poor, just as a commercial one can. Treating “open” as a quality label leaps from a property of the license to a property of the teaching.
Open education improves long-term opportunity
Statements about careers, earnings or social mobility generally outrun the data. Long-term outcomes need years of follow-up and careful comparison, and few designs provide this. Credible discussion should say “may” rather than “does”.
Learner choice and flexibility improve learning
Flexibility is valued by many learners, and satisfaction is easy to measure. Whether flexibility leads to better learning is less clear; some learners do better with structure. Satisfaction and learning are related but distinct.
What stronger evidence would look like
Rough rules of thumb for judging a piece of evidence:
- A clear comparison. Results for students using open materials against a similar group using something else.
- Similar groups. Ideally, random allocation or at least careful adjustment, since learners who choose open options may differ to begin with. Controlled experiments of this type are the strongest design but are hard to run in real classrooms.
- Defined outcomes. The measure, such as an exam mark or a completion count, is stated before looking at results.
- Adequate size and time. Enough learners, over enough terms, that chance is an unlikely explanation.
- Reporting of uncertainty. Good studies describe how confident the findings are rather than only the headline difference. Some understanding of measurement uncertainty helps when reading these.
- Repetition. Similar findings in different places, by different teams.
When a result looks surprisingly large, take a second look at the design. Charts can exaggerate small differences, so misleading charts are worth watching for, such as axes that begin well above zero.
Reading secondary reports
Many people meet this topic through summaries, blog posts or reports from organizations that support open education. These can be useful, but they sometimes present early or modest findings in stronger language than the original did. A habit of checking the claim against the underlying study, and noting whether the authors had a stake in the result, makes a real difference. The advice on correlation causation in general reasoning applies throughout: a link between open materials and better results is not proof that one caused the other.
Summing up the state of play
The best-supported claim is that open materials reduce direct cost to learners. Claims that results are at least comparable are reasonably common. Claims of strong improvement, better retention for particular groups, or lasting benefits to careers are largely open or assumed. Readers should treat outcomes as varying by context and look for evidence that names its comparison, its measure and its limits.