Category Archives: Research and Development

We learn fast…

I saw this article on my twitter stream, and it really piqued my interest:

We learn fast…

Quote: “The role of L & D professionals in their background and their present form will disappear soon.”

Reflection: This may be the case, but I think that many will be willing to have others tackle this problem. Those who understand this will be the most successful and stand out.

Quote: “His apprentice-employees need to be nimble and quick in learning new technologies, acquire new flexible and continuously and permanently skills.”

Reflection: This is the part where we fail. I think that we push too much on drill and kill. But it may be necessary to keep some of the drill around, just make sure that it plays a lesser role.

Quote: ” Understanding how the brain learns and how we can optimize our ability to learn pioneers will cause changes in learning and development.”

Reflection: It is interesting that this isn’t more at the core of teaching and learning. We take ideas from teaching and learning more from experience than from physical study.

 

 

 

 

Reflection 2/18/13 – 2/22/13


Accomplishments:

  • Prof Dev
    • Reflection on Rousseau: https://sites.psu.edu/rep129blog/2013/02/22/reflection-on-rousseau/
    • PSU enters the land of the MOOCs: http://news.psu.edu/story/265374/2013/02/21/academics/penn-state-joins-mooc-movement-offer-free-online-courses. It will be interesting to see how things develop in this environment. From one of the initial course offerings, it looks like Penn State will take a different approach: . https://www.coursera.org/course/cic?fb_action_ids=10151431551467560&fb_action_types=og.likes&fb_source=aggregation&fb_aggregation_id=28838148123758.This offering looks to hit on a topic of interest that would engage many learners.
    • MOOC on Evolution
      • Beginning to dislike this course. I really feel like what this course needs is some common sense to become better.
        • One reason is that I’m tired of doing the course as an undergrad. I have a degree and am interested in knowing more about Evolution and its theories. If I have the time and energy, I’d be able to ace this course. But I’m interested in learning more about Evolution. I’m sure I’m not the only person in this boat. But this is just a way for Duke to repurpose what they are already doing. How does this benefit an adult learner like me? The answer is that it doesn’t.
        • Another problem that I have is that the pedagogy that is being implemented is using an expert lecture format. Dump the information then I regergitate exactly what has been dumped on me. There is so much more to this topic than what is being taught and assessed in the course. Do I have to prove that I can do a bunch of math problems before I can understand evolution? If this is the opinion of experts in the field, then no wonder so many question the validity of evolution. Even if there are discussion forums, they mostly focus on the course itself.
      • What I would do to fix this course
        • Don’t assume that all learners are the same. Don’t teach this online course with an approach that everyone should take the course as an undergrad at Duke does. It would benefit the course and the mission of the prof and the university to get to know their audience and use a varied approach that involves leveraging the community of learners to accomplish a shared goal.
        • Use multiple choice questions to assess students informally instead of making most of the assessments multiple choice. This does a disservice to both the students and the topic being taught. While it is nice to assess what you may know and can do, these multiple choice questions only test how well you can imitate what they are being taught.
        • Leverage the community to answer questions that remain unresolved or should be considered. I think that a good place to start in this course is to focus on the question on why so many discount a valid scientific principle such as evolution. It may also be worth the effort to challenge students to provide ways that evolutionists can overcome this.
    • MOOC on Personal Finance
      • More videos to watch
      • Peer assessment is just a series of 6 questions that don’t connect on how I should counsel others on how to apply principles being taught in the course. Very disappointed that this course is not encouraging a larger discussion on personal finance and how it impact our society.
      • Multiple choice questions vaguely tied to the content of the lesson. There were no graphs in the lectures, but over half of the quiz was on the graphs and one was definitely incorrect. While I was able to answer most of those questions correctly, I’m having a hard time seeing why I’m spending the time to learn the information since I already have a basic understanding of personal finance.
      • Many are engaging in the forums, but I find that environment overwhelming.
      • To me, I need a focused topic and a way to engage in an issue or problem that points back to the material. This course has done little of that.
      • I received the following note after putting a comment about my frustrations stemming from the last multiple choice assessment which really didn’t match the content from the lectures:

        Dear Ravi Patel,

        We listened!

        Week 6 quiz will be discounted from your final grade. Coursera staff has assured us that this can be done. We have increased the number of tries to 5, in case some of you would like to continue practicing.
        There will be no substitute quiz. Please use the time and energy instead to complete your evaluations of the peer assessments.

        We regret the frustration this may have caused you.

        Fundamentals of Personal Financial Planning Course Team

        • I must say that I’m impressed that they actually read my comments in a large course like this. Hopefully, they do more than customer service on this and actually change their approach to this course. I decided to take a look at the discussion forums in this course, and as I guessed there were tons of items about the correctness of the materials. When put out information that is not correct? It should speak volumes that students in the course knew enough to put this info up. It would be better to pose a larger question and let students supply to scaffolding. Then the instructor or experts in the class could vet the information for correctness, at the very least.
    • MOOC observation: Overall, I’m seeing that instead of using Connectivist pedagogy and embracing what will improve society and engage learners that institutions who are entering the MOOC environment are using it and many weak approaches to clutter and, in my opinion, bring down what could be a good idea. Another thing on my mind is over selling. When I read the descriptions and watch the videos, I get excited because I’m intrigued about the possibilities of the learning experience. When the descriptions don’t match the course, I get frustrated. Also, when the course becomes about credit, I lose interest because I’m not their to get credit as much to continue on the trek of life-long learning. It’s hard to learn when all of the restrictions of courses are put on someone who doesn’t have the time or energy to accomplish the goals set about by the course creation team. It’s important to make the environment so that everyone can feel like they were able to accomplish a reasonable goal.
  • Spring ’13 revisions/developments
    • IST 230 (Newcomer)
      • Larry says that he will take a look and let us know. The lesson has come and gone without any correspondence. Honestly, disappointed that we didn’t get a chance to implement something that we worked on for quite awhile. My first thought is that we did alot within our team, but we weren’t successful in engaging the prof. That is something to consider next time.
    • IST 250 (Bixler)
      • Met with Brett on 1/30 to discuss adjustments
        • Mostly items that Brett will fix
        • He will send me changes to the curriculum as Word doc for me to update
    • IST 420 (Ocker)
        • Have readings for the course & need to get someone to create pdf’s – delegated this to Audrey (still waiting)
          • Double checked to make sure this was okay with Amy G, & it was
  • Spring ’13 Courses
    • IST 110
      • Sec 007 (Jim F)
        • Asked about SRTEs
  • Summer ’13 Courses
    • IST 110
      • Sec 001 (Farugia)
        • Emailed Farugia and got the okay to set up the course based upon Spring ’13 version
        • Completed 2/13/13
      • Sec 002 (Newcomer)
        • Emailed Newcomer and got a reply. Still waiting for 2nd confirmation
    • IST 111S
      • Sec 001 (Folkers)
        • Set up the course based upon SP 13 version
        • Follow up email with Deirdre to let her know that it is done on 2/12/13
    • IST 210
      • Sec 001 (Gary H)
        • Sent Gary an email n 2/21 about what he would like done to populate his section
        • Copied and completed setting up for Summer ’13 on 2/21/13
      • Sec 002 (Fred A)
        • Sent Fred an email n 2/21 about what he would like done to populate his section
    • IST 220
      • Sec 001 (Nick G)
        • Talked to Nick on 2/21 & agreed that moving his section from Spring ’13 and making adjustments to fit the summer makes the most sense. I plan to wait until the end of April to move items
      • Sec 002 (Mike M)
        • Emailed Mike on 2/21 about plan. He was fine with it.
      • Sec 003 (Hyunjeong)
        • Contacted Hyunjeong about when she would like me to move her materials over to Summer ’13 section
    • IST 295B
      • Sec 001 (Kari)
        • Contacted Madhavi on 2/20/13 about populating the Summer ’13 section
    • IST 495
      • Sec 001 (Kari)
        • Contacted Madhavi on 2/20/13 about populating the Summer ’13 section

Ongoing Projects:

    • Updated google spreadsheet for Summer ’13 

Immediate Decisions / Issues:

    • Need LMS that better integrates and includes tools that we use in our classes. Too many tools are open-source and unpredictable to count on

Important Dates:

  • MOOC Jan 4 – March 15 called Introduction to Genetics and Evolution
  • MOOC Jan 14 – Mar 4 called Fundamentals of Personal Finance
  • Feb 4-6 EDUCAUSE Learning Initiative Annual Meeting in Denver, CO
  • Feb 14 Vacation Day
  • Feb 18 WAH in AM
  • Feb 19 WAH
  • Feb 28 Vacation Day
  • March 4 Vacation Day
  • March 5 Vacation Day
  • March 6 WAH all day
  • March 15 Out for the day
  • March 18 WAH in AM
  • March 29 Vacation Day
  • April 1 Vacation Day
  • May 3 Vacation Day
  • May 6 Vacation Day
  • May 27 Memorial Day

Reflection 09/17/12-09/21/12


Accomplishments:

  • Prof Dev
  • Fall ’12 Courses
    • IST 110
      • Grade discussion with Marcela on 9/18
    • IST 220
      • Still seeing emails from students and instructors about vhol. Confirms my thinking that it would be best to think about textbook labs
    • IST 240
      • Updated assignment 2 and contacted Hal about it
    • IST 250 
      • More edits to make
      • Answered a question by Don on Elluminate and how many participants can be handled by providing my insights and ccing Gary
    • IST 402
      • drupal implementation is working well but now information is not collected by voicethread since it is embedded. Checked drupal and can see that students are using it and made Rosalie an admin so she can check too
      • she created the latest overview in ppt with audio
  • Fall ’12 revisions/developments
    • IST 230 (Newcomer)
      • Working with Greg, Will, & Toni on interactive pieces
        • Larry is going to supply some problems to work on
    • IST 420 (Ocker)
        • Spent time on 9/17 finding and adding videos to the dev space
        • Still awaiting Rosalie’s decision on which direction to move text or articles
    • gamify.JPGIST 402 (Saab)
        • David is working on adding content
        • Meeting on 9/21 to talk about gamification was great
          • David went through items in his mind map
          • Chris mentioned his ideas about leveling up
          • Brett had a great idea of allowing students to plot their plan through the course
          • Plan to meet in two weeks
  • Spring ’13 Course Prep – Mapped out on my outlook calendar courses to work on so that I’m done by the first week in December. Going to be difficult since we have to go 1 section at a time. Plan to start the 1st week of October
    • IST 110
      • Sec 001
    • IST 111S
      • Sec 001
    • IST 210 – Hyunjeong and Mike M are teaching in Spring
      • Sec 001
    • IST 220
      • Sec 001
    • IST 230
      • Sec 001
      • Sec 002
    • IST 240
      • Sec 001
    • IST 250
      • Sec 001
    • IST 260W
      • Sec 001
    • IST 295A
      • Sec 001
    • IST 301
      • Sec 001
    • IST 302
      • Sec 001
    • IST 402 TIE-
      • Sec 001
    • IST 421
      • Sec 001
    • IST 440W
      • Sec 001
    • IST 495
      • Sec 001

Ongoing Projects:

    • Updated google spreadsheet for Spring ’13 

Immediate Decisions / Issues:

    • None

Back Burner:

    • Gaming, Simulations, and Virtual World Research Committee

Days off / Conferences:

  • September 3 – Labor Day
  • August 27- October 5 Gamification MOOC
  • September 10 Brown Bag with Brendaly Drayton, Ph.D. (Diversity)
  • September 19 Educational Brown Bag
  • September 19 Bringing Gaming into Online Learning
  • September 20 MS-Office Training for Accessibility
  • Nov 1 AM Sick time for Dental Appt

Gamification MOOC Announcement

Untitled Document

Here is an announcement from the Gamification MOOC that I am involved in from yesterday:

Written Assignment 2 Stats

Approximately 10,700 students successfully submitted Written Assignment 2. This compares to 12,800 submitting Written Assignment 1. Over 43,000 students have watched the lecture videos online, out of 77,000 registered students.

Those participation percentages are higher than for many other massively open online courses, all of which have a drop-off over time. And as noted in prior announcements, although the assessments were designed to enhance the learning experience, we recognize that a large number of students are participating in the course primarily or entirely by viewing the video lectures.

We are aware that some students experienced difficulties submitting Written Assignment 2. If you are in this situation, we urge you to post on the discussion forums and explain your problem in detail. Given the large number of students, Professor Werbach cannot commit to answering questions by email. We encourage you to read the course announcements and assignment pages carefully, and to submit assignments early if at all possible. We and Coursera staff will continue to do our best to address any problems we identify.

Mon 17 Sep 2012 11:51:00 AM PDT

What I See – Participation

Stats

  • 43,000 out of 77,000 = appox 56% participation (based on total enrollment)
  • 12,800 out of 77,000 = approx 17% participation (based on total enrollment)
  • 10,700 out of 77,000 = approx 14% participation (based on total enrollment)
  • 12,800 out of 43,000 = approx 30% participation (based on those engaged if watching the videos equals engagement)
  • 10,700 out of 43,000 = approx 25% participation (based on those engaged if watching the videos equals engagement)

My Analysis of the Participation

I’m taking this course partly because I’m interested in gamification in courses and partly because of being interested in MOOC’s. I haven’t read the literature, but I’m assuming that the people from Coursera are more in touch with them, so I’ll assume that they are correct that these participation stats exceed a normal MOOC’s values.

At first glance, I would say that these values are low. I haven’t done an analysis on what happens in for-credit, paid courses online in general, but my guess is that they far exceed anything that we are seeing here. Is that a fair comparison or even one that should be made? Personally, I don’t see how we can or should compare the two since there is much more invested by students in a for-credit, paid online course than an open and free course like this.

Value of the MOOC

Does that mean that I don’t see value in MOOC’s or a place for them in education? Absolutely not!

As a participant in the course, I’m finding great value in the material and appreciate the mechanics of the course in promoting understanding of the topic. It’s nice to have an environment where you can choose your participation level. What I’m finding personally is that I’m engaging in the course because I’m finding the materials and activities beneficial. I have a chance to learn and engage in the content which is much better for me than just reading literature. I’m also getting quick and useful feedback on my understanding by completing the assignments. There is also an opportunity to engage with other learners in the discussion areas.

As such, I see the MOOC as a gateway to more formal educational experiences. It allows the learner to engage and learn according to their schedule and interest. I don’t think that we can think that this is answer to all online education, but it definitely will and should play a role in how we handle education for the future.

 

 

 

Reflection 02/20/12-02/24/12

Accomplishments:

  • Spring ’12 courses running
      • IST 230
        • Saw a note from Allan Gyorke about flipping the classroom
        • Definitely a great idea being headed up by Chris Millet and others at ETS
        • Thought about how 230 is based on this model of learning online since there aren’t any lectures
        • Live sessions are used to provide solutions and address specific problems
        • Here is a video and more info about flipping the classroom: http://tlt.its.psu.edu/flip/
      • IST 295A
        • Some students were unable to get to the course peer eval b/c I didn’t update the course schedule to include the new link.
        • Able to get to the bottom of this with the help of the WC Helpdesk
      • IST 331
        • Got a note from student about the optional evaluation
          • placed a subtitle calling it optional & info for course design and delivery team
        • More feedback about not knowing where the course schedule was
          • thinking that it makes the most sense to include this in the Lessons tab
      • IST 402
        • Met with David about peer evals for the course
          • Need to find averages for each student by sorting my email id of students and doing additional calculations
          • Best practice is to create a new sheet on the original spreadsheet by copying data for manipulation. This avoids tarnishing original data and allows for some creative manipulation
          • Found it useful to hide comments to complete the task
          • Also got same result for average wheather averaged each individual submission or averaged by category and averaged the result
        • Talked about the use of rubrics
          • Need to ask Melissa if she knows about the portability from the interface to excel of the tool being developed by Khusro and group at EMS
          • Also would be nice if could account for late submissions in the rubric
            • can’t use negatives in ANGEL rubric tool
            • move negatively across columns but the feedback will be off
      • IST 420
        • Met with John H and LA’s
          • Talked about rubrics & peer evals
    • Spring ’12 revisions
      • IST 210 (Heberling)
        • Added Ch 1 & 2 Assessments to the dev space
        • Included the essays in the exam
        • Found out that rubrics in ANGEL can be attached to assessments as well as dropboxes
        • Received assessment banks from Gary to be added to the course
        • Decided to use rubrics for assessment essay and project materials
      • IST 220 (Bertin)
        • Still waiting for more info on where the mystery section is located
      • IST 240 (Smith)
        • Received Lesson 09 materials on 2/21
        • These materials include an intro to Java and Coding Standards
        • Set the materials in place. Included the coding standards at the end of the lesson 9 materials
      • IST 402 (Cameron) – I’ll be assisting Melissa when needed
      • IST 402 (Saab)
        • Met with David on 2/20
          • I got all of the materials on my mac to populate the course
      • IST 421 (Hill)
        • Checked in with John Hill via email about setting up a meeting to discuss the 421 Development
        • Have a preliminary plan in place
        • Met on 2/23 about latest course schedule
        • Set a meeting for Fri March 2 to start making adjustments
      • IST 440W
        • No word on where this is
      • Madison proposal
        • Awaiting confirmation about both the lightning session

      Ongoing Projects:

      • Updating google doc for Summer ’12
      • Working on Summer 2012 courses: 110, 111S, 210, 220, 230, 240, 295B, 301, 302, 420 EA (Melissa), 421, 495
      • Still need IST 260W content added in drupal
        • Rest of course has begun
        • Once this is completed, I’ll check it with the WC offering
        • Sounds like there are some things that need to be adjusted

      Immediate Decisions / Issues:

      • I don’t have any major concerns since we are moving forward on most of the revisions that need to be ready for summer. The only course that is concerning me a bit is 220 since Lisa Bertin has had to pick up responsibilities for a sick colleague. We have a plan, but I haven’t seen much from it, nor have gotten much direction about what she would like me to handle.

      • Talking more about transcription. We also mentioned something to Greg about the tool that Pat Besong had developed. Greg sounded like he was interested and was going to look into using it. Not sure where that is, should we have IT add the software to the student computers? Do we need to  discuss how we will handle the transcription? Is there a protocol that you would like us to follow?

      Some things that I learned this week:

      • See notes from IST 402 in the current semester about the peer evals in google
      • See notes for IST 210 revision for rubrics in ANGEL
      • Learned that in ANGEL when in assessments, text is added to the Page Text settings field, it shows up on the screen where students can Begin Now.

      Back Burner:

      • Gaming, Simulations, and Virtual World Research Committee

      Days off / Conferences:

      • February days out of the office 3 (half day vaca in pm), 6 (vaca), & 24 (half day sick-dental/half day vaca)
      • March 22 S.T.A.R.T Conference
      • March 24 TLT Symposium 
      • June 11 & 12 Web 2012 Conference
      • June 22, 25-29 vacation days

    Reflection 01/30/12-02/03/12

    Accomplishments:

    • Spring ’12 courses running
      • IST 110
        • Created a practice peer eval for section 4 in order to prepare Jan and the LA’s for use this semester
      • IST 210
        • Sent roster to helpdesk for creation of individual sql databases for 1st assignment. Also placed a note on items to do for the semester that this needs to be done earlier.
        • Got a note on Tuesday that everything is set for the course.
        • Made the following video to send out to a student to help on the “Getting Started” Lab:
      • IST 230
      • IST 250 CE – shared google form with Stevie since Brett and Gerry don’t seem to want to go in that direction
      • IST 301 – Fixed gradebook issue and shared the following screenr:
      • IST 331
          • Got a question from the instructor about ANGEL and Elion sync issue. Encouraged a WC helpdesk request since the request is not my area of knowledge.
      • IST 420
        • Met with John, Justin and Marco on Wednesday from 1:30-2.
        • Clarified the issue with grading peer evals. We’ve decided to update the current course by making the gradebook percentage based, but in practice it will remain unchanged.
        • We’ve also decided to grade the peer evals by percents and allow the points to auto process.
        • I updated the development space to make the Categories multiples of 5 and the peer evals out of 5 points. Everything else is out of 100 to make it easier for the prof to grade and students to see progress.
    • Spring ’12 revisions
      • IST 210 (Heberling)
        • Spoke with Gary over the phone
        • Sent email to course committee on 2/2/12 to give them clarity on the plan
        • Plan to reorganize the Lesson tab to be organized based on Lesson rather than activity type
      • IST 220 (Bertin)
        • Here is the agenda from the meeting that I had with Lisa B on Monday 01/30/12:
            • Discuss 
              • textbooks/online content mix – keep the old text and update the content a bit
              • lesson assessment
                • review questions – basic knowledge, discussion forums would extend
                • discussions forums v. voicethread – pilot
                • randomly generated assessments from a bank – keep separated and 10% of the grade
              • Labs
                • Questions/concerns – instructions will have to be rewritten with an individual focus rather than team
                • Chance to try – work out bugs
              • Work flow
                • ANGEL for materials
                • Format of materials – materials will be sent via Word Docs and pdfs
                • Setting up items in ANGEL
                • Communicating progress – weekly
            • Ask Lisa for google info so can add to google spreadsheets
              • Done in email after the meeting
              • Added her to all 3 peer evals
            • Check with John F about labs
              • Checked on 1/31 and seems that the revision plan relating to the labs is fine. 
              • Sent follow up email to Lisa ccing John
            • Get Lisa rubrics for discussion forums and review questions
              • Completed on 1/30
              • Awaiting feedback
      • IST 240 (Smith)
        • Received email on 2/1/12 with materials for lessons 5 & 6
        • Also received a response to earlier email sent
        • Made adjustments to the course on most of the day 2/2/12
        • Hope to finish up Lesson 5 & 6 (actually 4 & 5 by next week with feedback)
      • IST 402 (Cameron) – I’ll be assisting Melissa when needed
      • IST 402 (Saab)
        • Won’t be starting until the beginning of February
      • IST 421 (Hill)
        • John mentioned at a meeting for 420 that he’ll be ready to discuss 2nd week of February
        • In the meantime, he sent me an email highlighting his thoughts about how to rework the course to fit into 12 weeks
        • Sent back a response on 2/3/12
        • Placed a reminder on my calendar to contact him 2nd week of February
    • Madison proposal
      • Awaiting confirmation about both the lightning session
    • Attended Adobe connect info session on 2/1/12 – Here is the link to my notes and reflections: https://sites.psu.edu/rep129blog/2012/02/01/adobe-connect-session-2112/
    • Attended Demo by Khusro Kidwai on Rubric tool. Here is a link to my notes and reflections: https://sites.psu.edu/rep129blog/2012/02/03/rubric-tool-demo/

    Ongoing Projects:

    • Updating google doc for Summer ’12
      • Used the info to put together WC Summary when Karen M asks for it
    • Working on Summer 2012 courses: 110, 111S, 210, 220, 230, 240, 295B, 301, 302, 420 EA (Melissa), 421, 495
      • Placed notes about updating IST Helpdesk about # of sections and # of students per section for IST 210 and 220
      • Added a column on the google spreadsheet for redundancy
    • Updating peer evals from drupal to google forms
      • Created peer evals for all courses in google forms, even if not currently using peer evals
      • IST 250
        • sent a note to Gerry and Brett about using google forms that led to a larger discussion about a university-based rubric tool.
        • Met with Khusro for demo on 02/1/12 at 3 PM
      • IST 301
        • Placed notes on my calendar about dev space relevancy and placement of peer evals to summer ’12 space
    • Still need IST 260W content added in drupal
      • Rest of course has begun
      • Once this is completed, I’ll check it with the WC offering
      • Sounds like there are some things that need to be adjusted

    Immediate Decisions / Issues:

    • I’ve had a few issues with students who are taking resident courses but using online materials (IST 230) who are requesting assistance from the WC and IST Helpdesk. This is because we forgot to update some materials in ANGEL, but it is also because our syllabus includes items like MSDNAA and Vlabs which are only available for UP and WC students. Here are some solutions that I think will work:
      • Remove the items referenced above from the syllabus and place in ANGEL so that those items can be removed more easily later
      • Create individual drupal sections for each ANGEL section so that instructors can customize if necessary
    • Would it make most sense to have only content on drupal? The other items seems to be better in ANGEL.

    Some things that I learned this week:

    • See IST 210 currently running video to student

    Back Burner:

    • Gaming, Simulations, and Virtual World Research Committee (maybe Kent and I need to keep this going here at the College of IST or maybe we should consider joining the group from ETS)

    Days off / Conferences:

    • February days out of the office 3 (half day vaca in pm), 6 (vaca), & 24 (half day sick-dental/half day vaca)
    • March 24 TLT Symposium attending only since our proposal wasn’t accepted
    • June 22, 25-29 vacation days

    Rubric Tool Demo

    I’ve been spending time thinking about and adjusting the IST courses peer evaluations. Beginning summer ’12, all of the courses will be run out of OIDI. Up to this point, there has a peer evaluation tool used from World Campus Learning Design. At the time of the transition, it was determined that we would not be using the current tool. I started last semester by trying a form in drupal. There are some short comings to this process. One, the interface is not easy for students to complete the form. It was not clear that students needed to complete a form for each team member. The data collected could be exported into excel, but it can be a laborious process to sort the data and do computations. At the end, all of the grades need to be manually added to ANGEL. Google forms is much easier for students to complete, but the data received is much the same as in drupal. Khusro and a programmer from EMS named Scott have been working on a rubric tool that may be a good start for creating a peer eval tool. Khusro did a thorough explanation of the how the tool works while Scott assisted in demoing the tool. My first impressions are that the tool is user friendly and robust. Currently, it is not set up to be a peer evaluation tool. It is set to allow instructors to grade their students. Melissa Hicks made a nice diagram outlining the current tool and how it would have to be modified to fit this use case. Here is the image:
    peer_eval.png

    Hopefully, this conversation is the beginning of a move toward a better tool for students university wide.

    LD Community Meeting – Jan 2012

    I decided to attend this meeting in person since it’s really not that far and a great way to see and touch base with others in the larger LD community.

    Here are a new notes:

    9:00-9:05 Welcome by Jeff Swain
    9:05-9:20 Suzzanne Shaffer discussion on critical thinking

    • http://www.criticalthinking.org/ – great place to dig deeper into what it really means by critical thinking
    • critical thinking is something that must be taught alone and changes based on the content area

    9:20-9:40 John Dolan discussion on the use of wikis in a history course

    • Start with a discussion with faculty
    • Provide a prototype for faculty to see
    • Had ITS support
    • ID sets up the wiki
    • Created groups – only those in the group could access
    • Used PSU wikispaces
    • Had some trouble with permissions and restricted pages (one student)
    • Met with faculty to discuss why students weren’t participating early in the semester
    • Removed restrictions to the wiki later in the semester – had to be done manually
    • Used versioning to salvage work that had been deleted by a teammate
    • Prof will use wikis in the future for other classes

    9:40-10:00 Matt Meyer on Yammer Experience

    • Best for more global use, rather than with one course
    • Members are added to Yammer – contained
    • Hard to filter comments

    Session: The Impact of Mobile Access on Motivation: Distance Education Student Perceptions

    The Impact of Mobile Access on Motivation: Distance Education Student Perceptions

    Glad to be able to attend a session done by former colleagues of mine from World Campus Learning Design (WCLD). As a part of an initiative of WCLD, instructional designers were asked to do some research and conduct a pilot about current areas of interest. Once such area was Mobile Learning. Stephanie and Linas explained their findings about the research and what they found from students.

    An interesting nugget from this session involved how the group determined upon which direction to take in the pilot regarding development, the group weighed Native v. Web app. Because of the cost and the need to consider different OS for development for the Native app option, they chose a Web app. It is good to go in this direction, since we know that Web apps are available on types of platforms, even those that are not mobile.

    Reflections on Exploring Research-Based Principles of Learning

    As a kick-off to the Leonhard Center fall seminar series, Susan Ambrose led a discussion of her 2010 book, “How Learning Works: 7 Research-Based Principles for Smart Teaching.” Susan is associate provost for education and director of the Eberly Center for Teaching Excellence at Carnegie Mellon University. As the description of her book states, “Any conversation about effective teaching must begin with a consideration of how students learn. However, instructors may find a gap between resources that focus on the technical research on learning and those that provide practical classroom strategies. ‘How Learning Works’ provides the bridge for such a gap.” This seminar will provide an overview of the seven principles on how to improve students’ learning in the classroom.

    This is a discussion that makes we wonder why practitioners in the classroom are not more aware of the real research that places like Carnegie Mellon are doing. Most of what was discussed was not new for those who teach and work to improve, but why make teachers have to learn everything through experience. I wish that I had sat through this discussion as a 1st year teacher.

    Point Made: Improvement in teaching based on the following principles will make an instructor more efficient and effective.

    Reflection: There was a question about the validity of becoming more efficient and effective. I thought Susan answered this brilliantly. She mentioned that often she uses a key to point out commonly made mistakes instead of marking each paper independently. This makes the process of grading more efficient and also gives her some data upon which to evaluate her teaching. My opinion is that there is always so much to do be effective as a teacher that any shortcut will only allow the instructor to focus on helping students even more in other areas or ways. To me as educators, we spend too much time on the mundane and details rather than looking at the bigger picture.

    Point Made: (Paraphrased) Learning happens in that the student does and thinks. -Herb Simon

    Reflection: How do we influence or facilitate that? I spent so much time putting together lesson plans and didn’t feel like I had the time to really reflect and make the adjustments to really improve. That is one reason why I’m doing more reflecting in my Instructional Design position.

    Point Made: Needs to be a change in the paradigm from “How do we teach?” to “How do students learn?”

    Reflection: This is where the importance of Cognitive Science comes into play. We need rely less on long-held assumptions and more on the research done on what really works.

    Point Made: Prior knowledge helps or hinders

    Reflection: There are several states of knowing that differ from the faculty to the student. As an example, students may think that they know something, but the knowledge that they have is inaccurate or inactive. It is important for educators to use valid prior knowledge or diagnose faulty prior knowledge to leverage this important tool to greater effect.

    Point Made: “How prior knowledge is organized determines its access and use because organization can facilitate or interfere with retrieval, use, and further learning. If students have not organized prior information effectively, there is a good chance that they won’t be able to access it easily, if at all. Organization is a sophisticated cognitive task, so instructors need to model effective organization and provide practice for students to help them hone this skill:” – Ambrose

    Reflection: When I was teaching, there was a specific instructor who was in charge of teaching study skills. One of the skills that was important was the use of visual models to organize thought. I really didn’t know much about this. As a math instructor, I was used to using tables and charts, but I never really thought about how organizational models could help my students to develop a deeper understanding of content. Susan used a great example of starting a class by having students make an organizer about Mexican Immigration as a pre-activity. Then during the course, she revisits this activity. This helps the students practice analytical skills and shows the teacher what is being learned.

    Point Made: Student motivation determines, directs, and sustains what they do to learn.

    Reflection: Motivation is often a dirty word in education. In my experience, I saw otherwise. Susan mentioned 2 important components of motivation, expectancy and value. Expectancy refers to fairness and consistency. Does a student believe that they have a chance to succeed? Value refers to whether a student believes that what they are learning is important to them. Both of these are perception-based from the student perspective. Motivation and student perception are important. These two elements were sort of overlooked. I wish I could have known that there is research to back this up. It would have impacted how I operated in a profound way.

    Point Made: It’s important to find the “sweet spot” of not being too easy or too hard for maximum student motivation.

    Reflection: This involves a lot of listening, observation, and reflection. Not sure how well I did this because I was often more worried about covering information instead of teaching the content.

    Point Made: Goal-oriented activities coupled with targeted feedback enhance the quality of student learning.

    Reflection: I have a vision of a ton of trial and error here. It’s definitely a process that works on refining the skill of giving student the proper activities for success.

    Point Made: To develop mastery, students must acquire component skills, practice integrating them and applying them.

    Reflection: This is where I should have depended less on textbooks for assignments. Everything in the book was so separated. It would have been better to come up with problem sets that were more valuable than the 20-50 problems that would be assigned without context.

    Point Made: As mastery develops and students gradually gain competence within a domain, they first gain and then lose conscious awareness of the skills and capabilities they are exercising.

    Reflection: When I was teaching math, it was difficult for me to separate the practice from the application and integration of concepts because I’ve mastered the topic. Somehow, that was something that I was blind to. Susan called this the expert blind spot. I stumbled upon the solution to this problem by having student tutors. It makes a lot of sense to do this because they understand each other and their needs. Plus it was good for me to watch the interaction to help inform my teaching from techniques and strategies that I could learn from them.

    Point Made: Students current level of development interacts with the social, emotional, and intellectual climate of the course to impart learning.

    Reflection: Learning doesn’t happen in a vacuum. Keeping in mind all of the circumstances and issues that a learner is dealing with is essential to helping them understand the material. As a teacher, I always felt like we were to take away the outside “distractions.” But this really resonates with me now.

    Point Made: To become self-directed learners, students must learn to monitor and adjust their approaches to learning.

    Reflection: Instead of fostering an environment with challenges that lead to learning and self-improvement, I saw many who were more interested in showing their success. Making mistakes and overcoming obstacles is the stuff of living.

    Point Made: (In reference to the push to add more and more technology to education) We need to move from actively engaged to meaningfully engaged.

    Reflection: This reminded me of the SEQUEL project that I was involved in. In this course, we focused on how to use technology to improve understanding. You have to do more than just throw technology at students; you must do it in a way that it improves learning and understanding.

    Great session! Really enjoyed it!