Evaluating Post-Secondary Aid: Enrollment, Persistence, and Projected Completion Effects
- Students
- Dropout and graduation
- Enrollment and attendance
- Scholarships
The United States spends billions of dollars each year on financial aid for college students, so there is great interest in how this aid affects college attendance and completion. Researchers partnered with the Susan Thompson Buffett Foundation to randomly offer scholarships to Nebraska high school graduates who applied for financial assistance. Initial results from the ongoing study indicate that scholarship offers increased college enrollment and persistence while shifting students toward more selective institutions. The effects were largest for students who had lower high school grades and ACT scores.
Policy issue
The United States spends billions of dollars on public and private financial aid for college students every year, so there is great interest in how this aid affects college enrollment and completion. Measuring the impacts of financial aid programs is challenging because many students who receive financial aid would likely attend college whether or not they have financial support, and funds from one program may reduce aid from other sources. To study how financial aid affects high school graduates’ college enrollment, researchers partnered with the Susan Thompson Buffett Foundation (STBF) to conduct a randomized evaluation of a scholarship program in Nebraska.
Context of the evaluation
Since 1965, the Susan Thompson Buffett Foundation has provided college scholarships to Nebraska high school graduates. STBF awards scholarships based on financial need, academic merit, and leadership skills. STBF’s applicants tend to come from households with incomes below that of the average Nebraska high school graduate. STBF applicants are also more likely to be first-generation women of color.
STBF supports more than 4,000 students each year with annual program costs of roughly $36 million. The largest STBF awards provide more than $70,000 toward five years of expenses at any Nebraska public college.
Details of the intervention
Researchers partnered with STBF to measure scholarship impacts for students who applied between 2012 and 2016. STBF received 1,424 eligible applications in 2012, a number which increased to 2,440 applications in 2015. Each year, STBF staff scored the applicants and sorted them into three groups. The highest-scoring applicants were guaranteed awards, the lowest-scoring applicants were removed from consideration, and the remaining applicants were eligible for randomly-assigned scholarships. Over the course of four years, 2,859 of the 6,183 applicants in the middle-scoring group were randomly offered a traditional STBF scholarship. The results reported below reflect the impact of being offered a traditional STBF scholarship on these middle-scoring applicants, who comprised the treatment group, compared to the middle-scoring applicants who were not offered a scholarship, who formed the control group.
The award size varied depending on the tuition and fees charged by the institution the scholarship recipients ultimately attended. In addition, the majority of scholarship recipients who enrolled at any of the University of Nebraska’s campuses were required to participate in Learning Communities, an academic mentoring and support program, or else risk losing their funding. Beginning in 2013, just over 200 scholarship recipients each year were randomly offered a different award, the College Opportunity Scholarship, which did not require any participation in Learning Communities activities. This exception made it possible for researchers to identify the impact of financial aid apart from any mentoring received.
Results and policy lessons
First-Year Financial Aid Receipt: Scholarship award winners received $7,156 in STBF grants, on average. On average, scholarship offers increased students’ total grants by $6,209 and increased total financial aid by $3,497. Scholarship offers reduced average federal loans by $2,292 and reduced students’ reliance on Federal Work Study wages.
Initial Enrollment: Scholarship offers increased initial college enrollment rates. Among the applicants who planned to attend community colleges, scholarship offers increased freshman enrollment from 90 percent to 95 percent. Nearly all of the increase came from enrollment at four-year colleges, which indicates that some scholarship winners who initially aspired to attend two-year colleges switched to four-year colleges after they were offered financial aid. Indeed, admissions records from the University of Nebraska reveal that many of the students who changed their stated plans did not apply to four-year programs until after they were offered scholarships. Among the applicants who initially targeted four-year colleges, effects on initial enrollment were smaller since 96 percent of scholarship applicants attended college even without STBF support. Still, scholarship offers boosted freshman enrollment by a statistically significant three percentage points, ensuring that nearly all scholarship winners attended college.
College Persistence: Scholarships dramatically reduced college dropout for both the two- and four-year college-bound students. In the four-year college-bound group, 88 percent of scholarship winners persisted to senior year, compared with just 74 percent of the control group. The effect was even larger for students who initially targeted community colleges. Scholarships doubled their enrollment rate four years out, from 28 percent in the control group to 56 percent for scholarship winners. Most students who were still enrolled after four years had transferred to four-year colleges.
Scholarship impacts on college persistence were largest for students with higher expected dropout rates in the absence of STBF support. Treated students at the bottom of the grade point average distribution in high school and attending four-year universities enrolled in sophomore year at a rate 40 percentage points higher than similar control group members. Scholarships had no discernable effects on persistence for students with high school GPAs in the top half of the applicant pool. Using ACT scores to measure academic merit instead of high school grades revealed a similar pattern.
As the study is ongoing, evidence about the impact of scholarships on the rates of completion is not yet certain. Overall, the results highlight a trade-off between using scholarships to increase college enrollment and persistence versus rewarding students for past performance. Students with higher grades and test scores are most likely to persist in college even without a STBF scholarship; conversely, students who have lower high school grades and test scores seem to benefit most from scholarships. Ultimately, the study will measure effects on college completion and how award effects on retention and degree completion influence long-run labor market outcomes.