#EDU16 – Seeking Evidence of Impact: Methodologies in Teaching and Learning

img_1035Session Description: Benchmarking and collecting evidence of impact is important in any undertaking. In this respect, postsecondary teaching and learning presents a unique set of challenges and complexities, so the key is to identify those methods that will produce useful and actionable results. This session will consist of overviews of evaluation and research techniques and methods in three important domains in teaching and learning: online and blended learning, classrooms and learning spaces, and the LMS. We’ll conclude the session with a discussion with our domain experts about the relative strengths of the approaches they presented and considerations with respect to implementing them.
Outcomes: Learn about evaluation and research methods in key teaching and learning domains * Discover new methods that will help you conduct evaluations at your campus * Understand how these methods could be used at your institution


  • Tanya Joosten

    Director, Digital Learning R&D, DETA Center,University of Wisconsin-Milwaukee
  • Adam Finkelstein

    Academic Associate,McGill University
  • Malcolm Brown

    Director, EDUCAUSE Learning Initiative,EDUCAUSE
  • Terence O’Heron

    Director of Operations, Teaching & Learning w/Technology,The Pennsylvania State University


  • EDUCAUSE Assessment Resources
    • Learning Space Rating System
    • Information Security
    • Information Security Program Assessment Tool
    • IT Risk Register
  • EDUCAUSE Benchmarking Resources
    • Technology Research in the Academic Community
    • Core Data Service
    • Benchmarking Service

The big question… “Are these (active learning) rooms worth it?”

  • A Framework for Evaluation
  • Level of Impact (Kirkpatrick)
    • Reaction, Learning, Behavior, Results
  • Potential vs Actual – There is always potential but it may not be realized.
  • LSRS Sections – Institutional Readiness, and Features of Physical Spaces
  • Measuring Actual Use of Learning Spaces
    • Surveys
    • Observation forms were used to see how the classrooms were actually being used.
    • Heat Maps to track movement of instructor and students in the classroom.
  • Think about…
    • Providing the right people , the right information, at the right time
    • Focus on high quality faculty development in high quality spaces
    • Instructors are allowed to seek the potential and lead toward the actual
  • Online and Blended Learning
    • DETA – Toolkit Download is Available
    • The toolkit includes: access, learning effectiveness, satisfaction, instructional effectiveness
    • Research model:
    • Research questions include:
    • Framework of Inquiry:
  • Penn State LMS Research
    • Criterion
    • Assessment Strategy – Direct observations, focus groups (faculty and student), surveys (faculty and student), vendor review (support, training, and ID staff)
    • Business Requirements – Functional, technical, support, training, governance, partnership, exit strategy, cost

Faculty development is key across all implementation and research…


One thought on “#EDU16 – Seeking Evidence of Impact: Methodologies in Teaching and Learning

  1. Pingback: EDUCAUSE 2016 Highlights | eLearning and Emerging Technologies @GVSU

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s