9 Data on Grants and Program Outcomes
Learning Outcomes
By the end of this chapter, learners will
- Understand the kinds of data on grant programs that can be captured
- Reflect on their goals for collecting data on grant programs and determine appropriate metrics that achieve these goals
- Develop strategies for data collection
Introduction
Many schools have launched grant programs to incentivize and support adoption, adaptation, or creation of open educational resources. The data that you collect about these programs will be largely context-dependent; it will depend upon how the program was structured, what you funded, and what you need the data for. For example, is the data intended for program improvement? Is it needed to justify future funding of your grant program? Is it to help you celebrate and showcase your great work? Consider your goals for data collection as you consider the many types of data and metrics that you could collect (which are detailed below).
Types of Data and Metrics to Collect
Recordkeeping
The following can be tracked by you or your team for each grant cycle, and recorded at the point when you are evaluating applications:
- Total amount of funds awarded
- Number of grants awarded
- Amount of money awarded per grant
- Type of grant awarded (ie., for adoption, adaptation, creation)
- Title/program of grantee
- Course(s) the project is anticipated to be used in
- Number of applicants
- Type of grant applied to (ie., for adoption, adaptation, creation)
- Title/program of applicant
Program Outcomes
The following information will need to be provided by grantees, and can be recorded by you as grantees share updates about their projects (either in conversation, email, or a formal report that asks for this information to be reported on):
- OER grant project formats (ie., open textbooks, multimedia, modules)
- OER grant project licenses
- Open platforms used to create and disseminate OER grant projects
Program Impact
On Teaching
Data about a grant project’s impact on teaching and course outcomes will need to be reported by the grantees themselves. You may wish to have grantees simply report based on their perception, based on anecdotes and interactions with students, or based on a formal research study within their course. If grantees will be required to do the latter and report back, then this requirement should be made clear at the time of application, and sufficient time should be provided for them to conduct and complete the study. Grantees may then benefit from some of the materials and exemplars provided elsewhere in this toolkit to guide their research design and process. Comparative data can be particularly helpful in demonstrating the efficacy of a grant. Potential datapoints of interest include:
- Number of students enrolled in course(s) where an OER grant project was used
- Total estimated student savings on course materials
- Student engagement with or experience using OER grant project
- Effect on student course out