#EDU19 – Leveraging Data-Driven Decision Making to Drive Student Success, Retention, and Accessibility Initiatives

Grand Valley State University, College of Southern Nevada, University of Kentucky, and Blackboard partnered together to deliver a session at the EDUCAUSE Annual Conference entitled: “Leveraging Data-Driven Decision Making to Drive Student Success, Retention, and Accessibility Initiatives

IMG_5995

John Scott, Product Manager, Blackboard Inc. and Eric Kunnen, Associate Director of eLearning and Emerging Technologies, Grand Valley State University presented on “A Data-Informed Approach to Inclusive Learning:  Scaling Accessibility”

The 3 presentations focused on using data-driven decision-making to streamline data collection, support student success and retention initiatives, scale accessibility, and increase campus-wide collaboration.

OUTCOMES

  • Gain insight from an unprecedented data set around content accessibility and UDL in the LMS
  • Complete an “Accessibility Strategizer” as a first step to catalyze a culture shift toward inclusion
  • Learn strategies in using data integration to support student success and retention initiatives
  • Discover ways to use student data not just for institutional reporting or service improvement but also to benefit individual students and increase campus collaboration

SPEAKERS

  • Brian Bourgon

    Director, Enterprise Applications, College of Southern Nevada
  • Eric Kunnen

    Associate Director of eLearning and Emerging Technologies, Grand Valley State University

 

 

  • Virginia Lacefield

    Enterprise Architect, University of Kentucky

 

 

  • John Scott

    Product Manager, Blackboard Inc. & Researcher & Instructor, University of California, Berkeley

PRESENTATION

#EDU19 – Transforming the Student Experience

This lightning round will pack as much information into one session as possible. Hear succinct, engaging presentations on a variety of topics. Each will be 10 minutes long, with a Q&A at the end of the session.

Lightning Round 1: Alexa Has Taken Over Our Campus!

Voice is the next disruptive technology. Voice-enabled devices are proliferating across society. Your students arrive on campus expecting it. Hear how the UT Dallas is implementing Alexa across campus. We will share our vision, implementation approaches, value received, best practices, and roadmap.

Outcomes: Learn how UT Dallas is leveraging Alexa for students, faculty, and staff * Learn about the UT Dallas vision and roadmap for voice-enabled services * Get best practices and lessons learned in implementing voice-response

Presenters: Frank Feagans, Kishore Thakur (University of Texas at Dallas)

NOTES

UT Dallas

  • New eSports Program
  • 29,000 students

  • Teach students on building Alexa skills
  • Voice as the next disruption
  • Alexa, an indispensable assistant
  • UT Dallas Alexa Pilots (News flash briefing, Ask UT Dallas, FAQs from a variety of offices (170 questions were collected), Parking (how many spots are available), “Alexa what is the status of Blackboard”

  • Next up… dining menus…

  • Using students to help build the Alexa Skills.

Lightning Round 2: Martha: Bringing AI to Life

Meet Martha, George Washington University’s virtual solutions AI agent, in an interactive implementation journey presentation. We will share our lessons learned and decision process, give demos, and entertain in-depth conversations about enhancing the student experience on campus through AI.

Outcomes: See how critical lessons learned were applied in our implementation journey * Learn about the strategic, logistical and operational planning considerations for moving to a virtual agent/AI solution on campus * Share your own institution’s efforts and questions around campus AI initiatives

Presenters: John Marshall, William Koffenberger (The George Washington University

NOTES

  • MarthaA pilot project of a “Virtual Agent” called “Martha”, an easy to use channel to search knowledge, create service requests and check the status of your outstanding requests through an intuitive conversational interface.
  • GW’s has an interactive chat bot (live in August), self service.
  • BMC Helix Case Study
    • Martha proved the feasibility of chatbots in helping IT deliver effective 24×7 support
    • Students surveyed would most likely turn to the chatbot before calling the service desk
    • 88% of the participants wanted Martha to become a permanent service for the GW community
    • Offloading level 0 and 1 calls to Martha frees up service desk technicians to tackle level 2 and 3 issues
    • Keeping support costs in check by meeting growing demand for support without adding headcount
    • Departments outside of IT now want to use chatbots to modernize service delivery for their users

Lightning Round 3: AI-Based Virtual Assistants Improve Campus Life on Through Dx

AI-based virtual assistants (VAs) are growing in popularity. Join Gonzaga University and noHold Inc. in a conversation about the role artificial intelligence is playing in higher education. Learn about implementing, deploying, and adopting AI technology to help your students and faculty help themselves.

Outcomes: Learn about implementing a VA (creating one, when it makes sense, and what is involved) * Learn about deploying a VA (logistics, potential pitfalls, and generating adoption) * Learn about the maintenance aspects of a VA (utilizing analytics and creating a financial map)

Presenters: Lyle Spencer, Borre Ulrichsen (Gonzaga University); Diego Ventura (noHold Inc.)

  • Proof of concept (low risk)
  • Decrease tickets (positioning)
  • Increase satisfaction (content maintenance)
  • Capture voice of student/staff (metrics)

Surveyed 400 students across 12 institutions:

#EDU19 – Leveraging AI to Support Data Empowered Learning

In this session, we will explore early prototypes of AI applications and discuss challenges related to ethics and privacy in higher education IT. These prototypes leverage machine learning in a way that empowers content discovery, course design and assessment, reflective teaching practices, and predictive analytics.

Outcomes: * Learn how AI will shape the future of teaching and learning * Discover new example of applied AI technologies * Learn about an effective data science pipeline for higher education IT * Reflect on the ethical and privacy challenges related to AI applications

NOTES

DART

Decibel Analysis for Research in Teaching (DART) is a software tool that analyzes classroom sound to predict with ~90% accuracy the quantity of time spent on Single Voice (e.g. lecture), Multiple Voice (e.g. pair discussion), and No Voice (e.g. clicker, question thinking) activities.

SPECTRUM DEMO

Helping instructors engage in reflective teaching practices with the support of machine learning

  • Provide insight into course content
  • Audio analysis pipeline, speech2text, sentence embedding,

  • Use these data for instructional design, time spent in class
  • Patterns of interactivity

LIFT Prototype

Leveraging AI for Academic Advising

Using machine learning enables us to provide insights into how students might perform in specific classes based on similar students in the past.

Pilot Study – Examine advisor use of LIFT during their academic review process. Academic review occurs in the period of time between semesters when advisors are reviewing student’s academic plan and progress and determining potential interventions.

  • Penn State uses Starfish
  • Privacy and Ethics – Include technical review, bias elements are evaluated, investigating what decisions are being supported by the model, are differences experienced with predicated outcomes, are they accurate, what about consequences, privacy impact assessment helps to determine what is collected, how it’s uses

#EDU19 – A Shared Vision for Change: Strategies, Approaches, Techniques

Change in higher education requires a shared vision and sustainable approaches to leading transformation. Representatives from two universities will share experiences for engaging stakeholders in a vision for change and corresponding strategies for identifying and developing people within organizations who possess critical abilities—influence, empathy, and resilience—for guiding others through uncertainty.

Outcomes: Understand how you can use images to develop a shared vision for change * Strategize how to develop and apply the capacity to influence, empathize, and be resilient when managing change * Explore how to develop abilities in others/existing staff who work on change management initiatives

Resources:

Forces Driving Change

Visual Metaphor Cards

  • Change through images, visual metaphor cards – used to stimulate discussions
  • Inclusive, creative, expressive, transparent

Identifying Skills of Others to Help with Change – Catalysts

  • Awareness
  • Experience
  • Global mindset
  • Ability to seek guidance
  • Identify professional development
  • Delayed gratification
  • Emotional intelligence

Facilitation

  • Hold the tension of uncertainty
  • Embrace ambiguity
  • Patience
  • Recognize opportunity to add value across the institution
  • Listening, engagement, reporting to multiple stakeholders
  • Fostering trust, empathy, capacity
  • Monitor willingness / eagerness to share expertise
  • Flexibility
  • Partnerships
  • Communication

#EDU19 Where Good Ideas Come From – Keynote

Welcome to EDUCAUSE 2019!

  • Welcome to EDUCAUSE 2019! 8,398 attendees, 41 countries – making this one fo the largest conferences in history.
  • Imagine and explore transformational opportunities in highered
  • DX – Digital transformation is a focus on how to create and generate change.

Digital transformation (Dx) describes a cultural, workforce, and technological shift, enabled by advances in technology that include analytics, artificial intelligence, cloud, mobile, social networks, storage capabilities, and more. Combined with external drivers such as increased expectations from students for a seamless experience, decreased funding for higher ed, and a growing need to advocate for its benefits, these forces make it possible to think differently about higher education, with the potential for new business models, better student outcomes, and different, more innovative, approaches for teaching learning, and research.

  • “The power of technology to connect us as human beings – support teaching, learning is a focus.” – Linda John, Associate Vice Provost of Learning Technologies, UW (EDUCAUSE Leadership Award).
  • Melissa Wood, Senior VP of IT at Stony Brook University (EDUCAUSE DEI Leadership Award) – “Lead from where you are.” Lead by listening.

Where Good Ideas Come From

Building on his best-selling work and book on the history of innovation, author and PBS host Steven Johnson will share his insights on the environments, practices, and platforms that best support new ideas and creativity, and provide a glimpse of the coming tech revolutions that will transform tomorrow’s educational landscape.

Presenter

  • Steven Johnson
  • Notes

    • We are too grounded in the “eureka” movement. “The apple falls from the tree…” Truly transformative ideas come out of a slower evolutionary process – a slow hunch. An inkling of possibility and exploration.
    • Highered is a wonderful place to incubate ideas.
    • People and teams that keep the hunches alive that can evolve over time and that are applicable to the world are innovative.
    • This sticker was on the original cern server where the entire web was powering the internet:

    • CERN and Tim Berger’s-Lee is a good example of the “slow hunch”. Came out of a hobby, keeping track of people in the office when he met someone new – created a hyperlink between the staff and the projects happening. “Inquire within upon everything” was used internally. Initially WWW was named “tangle”. After 5 years of this side project, perhaps this is something bigger. “I believe I have created a new global communication medium as a side job…”
    • Emerging concept of identity…
    • We need to keep side projects and hunches alive.
  • “Liquid Networks” – The enlightenment used to happen in the 18th century coffee house. Semi-public spaces. Flow of ideas happen around coffee! 🙂 We need more of these spaces to nurture ideas and help them emerge!

    • How do we handle or blind spots? Well… we can’t work alone. The importance of diversity. Diverse groups are collectively more smart, more creative, and have better decision making.
    • Innovative groups have large and engaged friend networks. We need to maintain our cross-pollination vs specialization.
    • Ada Lovelace is a fascinating figure and is widely considered to be the worlds first software programmer in 1830. Math prodigy. Charles Babbage created the first “programmable computer”.
    • Someday these machines can be used for more than numbers and calculations, but for creativity and even composing music. – Ada Lovelace
    • Let’s look at who is using technology and are having the most fun. These are areas that have influence. Just for the fun of it – trigger advanced in tech, culture, politics, etc
    • MIT and the PDP-1… the first monitor where you can push around pixels. They created a space theme game called space war (like “asteroids”). This created innovation around joysticks, input devices, mouse, visuals… and fun. A shift to computers and more creative and playful. “The personal computer” phrase was coined and lead to Atari and a company started by Steve Jobs.
    • What is happening now, that looks like play, that contains the seeds for predicting what comes next.
    • Play leading to transformative ideas… AI, deep learning, machine learning – today the major milestones have interestingly come from games.
    • December 2017 – Googles AI division deep mind, was the beginning of something with “Alpha Zero” game play algorithm and drew from extensively with chess play. Built-in and the computer used it to predict game play. After the end of 9 hours, the 2 AIs played 400 millions games. The game they were playing at the end was aggressive and better than what humans were capable.
    • There are a whole range of cause, effect, subtle language, and yet have super human skills. This is another place where the importance of diversity is crucial. Some kinds of problems are better solved by AI, but other problems will be required of humans. Key is which tool when, and the ability to collaborate.
  • To survive we need to work with AI, with a diverse group of people, those are going to be the liquid networks of the future – all connected through collaboration. – Steven Johnson

  • #EDU16 – Rethinking Academic Technology for 21st-Century Teaching and Learning

    Session Description: Pedagogical and technological changes are upsetting the status quo of course delivery. To remain relevant, academic technologists must be responsive, agile, and forward-thinking within a context of rapid change, high demand, and limited resources. Learn how one academic technology unit strategically prioritized and responded to these challenges in today’s climate.
    Outcomes: Articulate tactical work in response to the strategic goals of your institution and department *Redefine priorities in response to technological and pedagogical change *Retrofit Brown’s reflexive model to fit your own institutional culture

    Speakers:

    • Hong Chau

      Instructional Designer,Brown University
    • Catherine Zabriskie

      Director, Academic Technology Services,Brown University

    Notes:

    • Short Term – Improve the current situation with painpoints.
    • Long Term – Confirm our Vision
      • Instructional Technology Group
      • MM Labs
      • Classroom Technology
      • Media Product
    • Question: What do you spend your time on everyday – does that link to the vision?
    • Question: What are the 5 most important things that you do – why is that important to the insitution?
    • Session Materials
    • Technology Themes
      • Moving Forward and Looking Ahead
      • Responding University Needs
      • Making Connections
      • Partnering
      • Empowering Individual Growth
        brownthemese
      • Process for Visioning
        • Step 1 – Defining the work: Where are we now?
        • Step 2 – Understanding the work: What are the values/benefits of the work we do? Map the work to the themese/priorities and is there anything missing?
        • Step 3 – Where are we going? What should we stop, start, or do better and how?

    #EDU16 – Seeking Evidence of Impact: Methodologies in Teaching and Learning

    img_1035Session Description: Benchmarking and collecting evidence of impact is important in any undertaking. In this respect, postsecondary teaching and learning presents a unique set of challenges and complexities, so the key is to identify those methods that will produce useful and actionable results. This session will consist of overviews of evaluation and research techniques and methods in three important domains in teaching and learning: online and blended learning, classrooms and learning spaces, and the LMS. We’ll conclude the session with a discussion with our domain experts about the relative strengths of the approaches they presented and considerations with respect to implementing them.
    Outcomes: Learn about evaluation and research methods in key teaching and learning domains * Discover new methods that will help you conduct evaluations at your campus * Understand how these methods could be used at your institution

    Speakers:

    • Tanya Joosten

      Director, Digital Learning R&D, DETA Center,University of Wisconsin-Milwaukee
    • Adam Finkelstein

      Academic Associate,McGill University
    • Malcolm Brown

      Director, EDUCAUSE Learning Initiative,EDUCAUSE
    • Terence O’Heron

      Director of Operations, Teaching & Learning w/Technology,The Pennsylvania State University

    Notes:

    • EDUCAUSE Assessment Resources
      • Learning Space Rating System
      • Information Security
      • Information Security Program Assessment Tool
      • IT Risk Register
    • EDUCAUSE Benchmarking Resources
      • Technology Research in the Academic Community
      • Core Data Service
      • Benchmarking Service

    The big question… “Are these (active learning) rooms worth it?”

    • A Framework for Evaluation
    • Level of Impact (Kirkpatrick)
      • Reaction, Learning, Behavior, Results
        img_1030
    • Potential vs Actual – There is always potential but it may not be realized.
      img_1032
    • LSRS Sections – Institutional Readiness, and Features of Physical Spaces
      img_1031
    • Measuring Actual Use of Learning Spaces
      • Surveys
        img_1033
      • Observation forms were used to see how the classrooms were actually being used.
      • Heat Maps to track movement of instructor and students in the classroom.
    • Think about…
      • Providing the right people , the right information, at the right time
      • Focus on high quality faculty development in high quality spaces
      • Instructors are allowed to seek the potential and lead toward the actual
    • Online and Blended Learning
      • DETA – Toolkit Download is Available
      • The toolkit includes: access, learning effectiveness, satisfaction, instructional effectiveness
      • Research model:
        img_1036
      • Research questions include:
        img_1037
      • Framework of Inquiry:
        img_1038
    • Penn State LMS Research
      • Criterion
      • Assessment Strategy – Direct observations, focus groups (faculty and student), surveys (faculty and student), vendor review (support, training, and ID staff)
      • Business Requirements – Functional, technical, support, training, governance, partnership, exit strategy, cost

    Faculty development is key across all implementation and research…