For the last five years, I’ve been working on a Scholarship of Teaching & Learning (SoTL) project to help my college reading students succeed academically. I’ve also used it as a model for other faculty who are interested in pursuing SoTL. This journey led me to research being conducted on lifelong learning and eventually to this resilience project.
In 2012, I paired my LL ED 005 College Reading strategies course with a Psych 100 section taught by Dr. Mark Casteel. The intention of the pairing was to make the learning in LL ED more concrete and lasting when applied to actual course content. Students started off strong, holding their own against a group with better academic preparation. However, they couldn’t maintain the successes over time. They simply ran out of steam.
What next? If reading strategies alone couldn’t do the trick, what was still missing? As I explored the problem and talked with colleagues in the field, I was led to the Effective Lifelong Learning Inventory (ELLI) developed by researchers at the University of Bristol (Deakin Crick, Broadfoot, & Claxton, 2004). Thus began the journey towards incorporating strategies to build inner resources for students – a one-two punch as it were – giving students the academic strategies needed to DO the work of college while developing attributes to help them BE effective lifelong learners.
The following year, I integrated the use of ELLI into the LLED course which was now paired with Dr. Santiago-Blay’s BiSc 003 Environmental Science course. Students in the paired course and those only in BiSc 003 took a content pre/post test and also ELLI pre/post. The results were very interesting!
In terms of content and other academic measures, LL ED students were holding their own throughout the course and even made gains such that there was no statistically significant difference between their scores on the content post-test (non-graded) and others in the general course (p=.79). 84% of the LL ED students passed the course with at least a “C” or better. Most telling was that 84% of these students were retained fall to spring as compared to 74% of their peers with similar SAT reading scores (average 359) who had not taken LL ED.
To build lifelong learning into the course, I used this framework:
Students took ELLI pre- and post-semester and we saw statistically significant gains in all areas of lifelong learning except Learning Relationships for those taking LL ED. For those in the control group (only taking Bi Sc 003), no statistically significant gains were made pre- to post-semester in any dimension of ELLI.
These results were published in 2015 (Shaffer, Eshbach, & Santiago-Blay).
These results were promising, but obviously the small sample size was an issue, so I wanted to build up the data set to see a more complete picture. Over the next few years, I was able to pair the LL ED with an Anthropology course (Dr. Orleth-Diener) but then the administrative side of creating paired courses became too challenging, and so the campus went back to the standalone model in 2015. I incorporated ELLI into the course each year and here are the results pre- to post-semester for the LL ED group over time (n=90):
In 2015, I was also able to start some benchmarking by collecting first-year student ELLI scores (n = 176). We now had a more robust sample against which to make comparisons. A subset of these students also took ELLI post-semester to expand the control dataset as well (n=47). Finally, In academic year 2016-17, I was able to collect ELLI data on a sample of our seniors (n=66) and so we could begin to make some comparisons between groups.
Control Group ELLI Scores Pre- to Post-Semester
There were no changes in the control group pre- to post-semester which begs the question, “Do students grow in these dimensions of lifelong learning as a result of simply taking college courses?” In the short term (1 semester) it seems that not much change registers. However, when we compare our first year student scores with our senior scores, we do start to see some changes happening.
Comparison of First Year and Senior Benchmark ELLI Scores
What began to emerge as important were the low Resilience scores across the board. Also, when looking at senior benchmark scores, Resilience is the dimension where the largest gains are made. I interpret this to mean (and the existing research seems to support this) that students become more resilient by virtue of learning to navigate challenges. So by the time students reach their senior year, they simply have been through enough challenges that they have grown more resilient. The research also emphasizes the role of support in helping students to navigate the challenges that arise. I believe that this is one of the hallmarks of a Penn State York experience! We have small class sizes that give students ample opportunities to get to know their faculty members, and we have wonderful support staff in advising, career counseling, financial aid, student services, the library, the Nittany Success Center and all other support offices, ready and willing to help students when needed.
So with this expanded information before us, it was time to begin working more intently with resilience as an attribute that we wanted our students to acquire. Thus began the working relationship with CFRA and the current project!
Deakin Crick, R., Broadfoot, P., & Claxton, G. (2004). Developing an Effective Lifelong Learning Inventory: The ELLI project. Assessment in Education, 11(3), 247-272. doi:10.1080/0969594042000304582
Deakin Crick, R., & Yu, G. (2008). Assessing learning dispositions: Is the Effective Lifelong Learning Inventory valid and reliable as a measurement tool? Educational Research, 50(4), 387-402. doi:10.1080/00131880802499886
ELLI Vital Partnerships http://www.elli.global/
Gill, S., Shaffer, S.C., Seidel, A. (Manuscript in process). Additive effects of mindfulness practice and critical reflection on lifelong learning attributes. Penn State York.
Moore, T. & Shaffer, S. C. (Accepted 10/16). Awakening the learner within: Purposeful prompts and lifelong learning measures in a first-year composition course; Journal of the Scholarship of Teaching and Learning. Indiana University, Bloomington, IN.
Shaffer, S.C., Eshbach, B.E., & Santiago-Blay, J.A.; (Fall 2015). A dual approach to fostering under-prepared student success: Focusing on doing and becoming. InSight: A Journal of Scholarly Teaching; Vol. 10;The Center for Excellence in Teaching and Learning (CETL) Park University. Parkville, MO.