The Tech Edvocate

Top Menu

  • Advertisement
  • Apps
  • Home Page
  • Home Page Five (No Sidebar)
  • Home Page Four
  • Home Page Three
  • Home Page Two
  • Home Tech2
  • Icons [No Sidebar]
  • Left Sidbear Page
  • Lynch Educational Consulting
  • My Account
  • My Speaking Page
  • Newsletter Sign Up Confirmation
  • Newsletter Unsubscription
  • Our Brands
  • Page Example
  • Privacy Policy
  • Protected Content
  • Register
  • Request a Product Review
  • Shop
  • Shortcodes Examples
  • Signup
  • Start Here
    • Governance
    • Careers
    • Contact Us
  • Terms and Conditions
  • The Edvocate
  • The Tech Edvocate Product Guide
  • Topics
  • Write For Us
  • Advertise

Main Menu

  • Start Here
    • Our Brands
    • Governance
      • Lynch Educational Consulting
      • Dr. Lynch’s Personal Website
      • Careers
    • Write For Us
    • The Tech Edvocate Product Guide
    • Contact Us
    • Books
    • Pedagogue
    • Edupedia
    • The Edvocate Podcast
    • Terms and Conditions
    • Privacy Policy
  • Topics
    • Assistive Technology
    • Child Development Tech
    • Early Childhood & K-12 EdTech
    • EdTech Futures
    • EdTech News
    • EdTech Policy & Reform
    • EdTech Startups & Businesses
    • Higher Education EdTech
    • Online Learning & eLearning
    • Parent & Family Tech
    • Personalized Learning
    • Product Reviews
  • Advertise
  • Apps
  • Tech Edvocate Awards
  • The Edvocate
  • P-20 Ed Careers

logo

The Tech Edvocate

  • Start Here
    • Our Brands
    • Governance
      • Lynch Educational Consulting
      • Dr. Lynch’s Personal Website
        • My Speaking Page
      • Careers
    • Write For Us
    • The Tech Edvocate Product Guide
    • Contact Us
    • Books
    • Pedagogue
    • Edupedia
    • The Edvocate Podcast
    • Terms and Conditions
    • Privacy Policy
  • Topics
    • Assistive Technology
    • Child Development Tech
    • Early Childhood & K-12 EdTech
    • EdTech Futures
    • EdTech News
    • EdTech Policy & Reform
    • EdTech Startups & Businesses
    • Higher Education EdTech
    • Online Learning & eLearning
    • Parent & Family Tech
    • Personalized Learning
    • Product Reviews
  • Advertise
  • Apps
  • Tech Edvocate Awards
  • The Edvocate
  • P-20 Ed Careers
  • Product Review of Planet Lettra

  • Product Review of Prifact

  • Product Review of PREto3

  • Product Review of Preschool & Kindergarten Games

  • Product Review of PraxiSchool

  • Product Review of Powtoon

  • Product Review of PowerSchool

  • Product Review of PowerMyLearning Connect

  • Product Review of Power Math

  • Product Review of Positive Penguins

EdTech News
Home›EdTech News›State-of-the-art education software often doesn’t help students learn more, study finds

State-of-the-art education software often doesn’t help students learn more, study finds

By Matthew Lynch
June 29, 2016
5374
1
Spread the love

This article was written by Jill Barshay

2 lessons from the most rigorous study to date of “adaptive-learning” courseware at colleges and universities

Even proponents of educational technology admit that a lot of software sold to schools isn’t very good. But they often highlight the promise of so-called “adaptive learning” software, in which complex algorithms react to how a student answers questions, and tailor instruction to each student. The computer recommends different lessons to different students, based upon what they already know and what they still need to work on.

Wonderful in theory, but does it work in practice?

The Bill & Melinda Gates Foundation sought to find out, and gave money to 14 colleges and universities to test some of the most popular  “adaptive learning” software in the marketplace, including products from a Pearson-Knewton joint venture, from a unit of McGraw-Hill Education called ALEKS and from the Open Learning Initiative. Most of the universities combined the software with human instruction, but a few courses were delivered entirely online. Almost 20,000 college students and 300 instructors participated in the experiment over the course of three terms between 2013 and 2015. It’s probably the largest and most rigorous study of adaptive learning to date. Then Gates hired SRI International, a nonprofit research institute, to analyze the data. (The Gates Foundation is among the funders of the Hechinger Report.)

What SRI found was sobering. In most cases, students didn’t get higher grades from using adaptive-learning software, nor were they more likely to pass a course than in a traditional face-to-face class. In some courses the researchers found that students were learning more from adaptive-learning software, but even in those cases, the positive impact tended to be “modest”. The report is here.

“I wouldn’t characterize our report as cynical, just cautious,” said Barbara Means, director of the Center for Technology in Learning at SRI International and one of three authors of the report.

Although the study was conducted exclusively at colleges and universities, Means said she suspects researchers would find similar results with adaptive software used at elementary, middle and high schools.

Means emphasized that it was an analysis of the technology available back in 2013, and that better products have come to market since. “It shouldn’t be regarded as though this is the last word. It’s just a very early snapshot,” Means added.

Still, two important lessons emerged from the report, which may continue to apply even as the software improves.

1. The software in and of itself isn’t a magical teacher

“Every piece of learning software I’ve ever studied gets positive effects in some places and not others,” said Means. “When you try to understand why that is, you find out that students and instructors used it in very different ways.”

When instructors use the same language that’s used in the software during the face-to-face instruction, it’s more potent. It also matters when teachers look at the data that the software is generating, and spend class time reinforcing ideas that were troublesome after students used the software. And on a most basic level,  students need incentives to use the software. Sometimes, the instructor just says, go use it, but doesn’t monitor whether students log in or not. Not surprisingly, usage is low or sporadic. “Sometimes instructors give students the impression that what they do in the courseware doesn’t matter,” said Means.

The research also highlighted that the technology was more effective when the professor or the university completely redesigned the course around it. One example is flipping the classroom, where lectures are delivered online and the entire classroom time is spent in smaller groups with instructors who can review difficult problems, or conduct a socratic dialogue.

Another example is to use the technology to allow students to skip some prerequisite hurdles. Students still had to learn the material, but it could be taught online, by the adaptive-learning courseware, to fill in holes while the student was learning in a more advanced class. That can help students graduate on time within four years.

“We can’t expect all the power to be in a piece of software. Because we know it’s not,” said Means.

2. Universities aren’t monitoring whether the technology they’re using is working

In conducting the study, Means frequently found that colleges and universities weren’t prepared to measure student learning in a way that would stand up to academic scrutiny. To measure how much students are learning, you need to know what students knew before they started a course. You can’t just compare student grades in an adaptive-learning class with those in a traditional class because you might have stronger students in one of them. It was a particular problem to compare different semesters, because students who fail an introductory course in the fall often retake it in the spring, and the spring classes were filled with students who struggle more.

A lot of the data collected in the study couldn’t be analyzed because it was hard to make apples-to-apples comparisons.

“I think education institutions making major changes in the instruction, such as a reliance on adaptive courseware, have a responsibility to be monitoring the effectiveness of what they’re doing,” Means said. “And then try to improve it, in a kind of continuous improvement framework that you would see in some of the leading companies in any field.

“They don’t really know if what they’re doing is a change for the better, or not,” she said. “Given the cost of higher education today, which we all know a lot about, students and the public really have a right to expect this kind of attention to the quality of the product.”

This is not just in the public interest. SRI is also in the business of selling analytical tools to universities. But if universities were to start tracking student learning, it might eliminate the need for “snapshot” reports like this, which quickly become obsolete.

 

Jill Barshay, a contributing editor, writes a weekly column, Education By The Numbers, about education data and research. She taught algebra to ninth graders for the 2013-14 school year.
This article was originally published on The Hechinger Report. Read the original article.
TagsEdtechedtechchatelearningSTEAMSTEM
Previous Article

Tapping into kids’ passion for Minecraft in ...

Next Article

School leaders say they need more practical ...

Matthew Lynch

Related articles More from author

  • Early Childhood & K-12 EdTechHigher EducationHigher Education EdTech

    Student Outcomes Is the Only Metric That Matters in EdTech

    December 18, 2017
    By Matthew Lynch
  • Child Development TechEarly Childhood & K-12 EdTechParent & Family Tech

    Rethinking Literacy in a Digital Age

    August 14, 2017
    By Matthew Lynch
  • Early Childhood & K-12 EdTechEdTech Policy & ReformHigher Education EdTech

    5 Ways to Teach Digital Citizenship to Your Students

    January 22, 2017
    By Matthew Lynch
  • Early Childhood & K-12 EdTechHigher Education EdTech

    Educators: What You Need To Know About Cell Phones

    June 27, 2016
    By Matthew Lynch
  • Early Childhood & K-12 EdTech

    7 Must Have Language Learning Apps, Tools and Resources

    August 2, 2017
    By Matthew Lynch
  • EdTech & Innovation

    25 Ways that EdTech Benefits Teachers and Students

    March 23, 2017
    By Matthew Lynch

1 comment

  1. Howard Senegal 31 December, 2016 at 14:51 Reply

    It’s when technology is combined with pedagogy and progressive learning spaces that the magic happens. Increased student engagement and success.

Leave a reply Cancel reply

  • Digital & Mobile TechnologyProduct Reviews

    Product Review of Fun With Directions HD

  • Early Childhood & K-12 EdTech

    How to Use 3D Printing in Reading Class

  • Early ChildhoodProduct Reviews

    Product Review of Argument Wars

Search

Login & Registration

  • Register
  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org

Newsletter

Signup for The Tech Edvocate Newsletter and have the latest in EdTech news and opinion delivered to your email address!

  • Recent

  • Popular

  • Comments

  • Product Review of Planet Lettra

    By Matthew Lynch
    June 28, 2022
  • Product Review of Prifact

    By Matthew Lynch
    June 28, 2022
  • Product Review of PREto3

    By Matthew Lynch
    June 28, 2022
  • Product Review of Preschool & Kindergarten Games

    By Matthew Lynch
    June 28, 2022
  • Product Review of PraxiSchool

    By Matthew Lynch
    June 28, 2022
  • 20 Top Virtual Reality Apps that are Changing Education

    By Matthew Lynch
    March 11, 2017
  • 7 Ways Technology Is Impacting Modern Education

    By Matthew Lynch
    March 4, 2017
  • Why Mobile Technology Enhances Instruction

    By Matthew Lynch
    December 14, 2016
  • 7 Roles for Artificial Intelligence in Education

    By Matthew Lynch
    May 5, 2018
  • Digital Literacy is the Most Important Lifelong Learning Tool

    By Matthew Lynch
    December 30, 2017
  • The Changing Role of Social Responsibility – Perfect Release
    on
    June 27, 2022

    How to Teach Kids Social Responsibility in a Connected World

    […] Lynch, M. (2018, ...
  • Teaching Early Geometry Concepts – Ask a Tech Teacher
    on
    June 23, 2022

    Teaching Early Geometry Concepts

    […] spend a lot ...
  • Product Review of Counting Bills & Coins – The Tech Edvocate | Gold – Silver – ...
    on
    June 21, 2022

    Product Review of Counting Bills & Coins

    […] Product Review of ...
  • The Edtech Industry Has An Oversaturation Problem - latecareer
    on
    June 20, 2022

    Is the Edtech Industry Flunking Out or Making the Grade?

    […] Lynch at The ...
  • The Edtech Industry Has An Oversaturation Problem - News Badshah
    on
    June 19, 2022

    Is the Edtech Industry Flunking Out or Making the Grade?

    […] Lynch at The ...

EdTech Policy & Reform

  • Curriculum & InstructionEdTech Policy & ReformEducation Leadership

    Why We Should Leave Behind the Cookie-cutter Education

    Spread the loveChange appears to be the only “constant” factor in the educational field. However, what happens when a more significant shift becomes necessary? To provide students with the best ...
  • Adaptive LearningCurriculum & InstructionDigital & Mobile TechnologyDigital Age TeachersEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformInstructional Technology

    Exploring New Ideas: Student-Driven Remote Learning

    Spread the loveRemote learning is taking its toll on our students. They miss the social side of school. Not seeing their classmates or teachers is leading to nervousness, anxiety, and ...
  • Digital & Mobile TechnologyEdTech & InnovationEdTech Policy & Reform

    Implementing Education Technology by Pursuing Technology Education

    Spread the loveTechnology is used for many great things in our world. It’s a powerful tool when used correctly. As such, this powerful tool can be used to transform learning.  ...
  • EdTech Policy & Reform

    How Much Bias Is Okay in Your School?

    Spread the loveThe algorithm has proven itself to be a handy tool when it comes to solving education problems. It’s also not without bias.  You may be wondering how some ...
  • EdTech Policy & ReformFeaturedFresh

    Edtech Should Complement Good Pedagogy, Not Attempt to Replace It

    Spread the loveThe newest generation of edtech is downright amazing; it’s no wonder that various education stakeholders might be a little excited about its potential to transform education. However, edtech ...

EdTech Startups & Businesses

  • EdTech Startups & Businesses

    Edtech Companies Can Learn What Not to Do From Delta Airlines

    Spread the loveIt seems that edtech companies still have a lot to learn about their business models and practices. With that being said, there is a lot they can learn ...
  • Digital LeadershipEdTech Startups & BusinessesProduct Reviews

    Product Review of Collegix

    Spread the love This is a comprehensive ERP solution for colleges and universities that provides modular, totally integrated learners services, finance, HR, and advancement. Collegix provides online and offline workarounds ...
  • Early Childhood & K-12 EdTechEdTech Startups & BusinessesProduct Reviews

    Product Review of Discovery Education

    Spread the love Discovery Education is a big player in EdTech. The company has established itself as the leading provider of digital curriculum resources, digital content, and professional development for ...
  • EdTech Startups & BusinessesProduct Reviews

    Product Review of AptaFund

    Spread the loveAptaFund is a business management software that provides essential functions to educational institutions, such as web access to educators, parents, and learners. It allows elementary schools and other educational ...
  • EdTech Startups & Businesses

    Understanding the Fundamentals of a Sales Script in Your Customer Interaction Journey

    Spread the loveSales scripts are crucial to any business and can be the main difference in achieving the set targets. A well-written sales script that factors in customers from different ...

Digital Equity

  • Digital & Mobile TechnologyDigital EquityDigital Literacy

    Teaching Learners Digital Content Creation Skills

    Spread the loveContent curation is nothing new and has always been a coveted skill. It has been this way for hundreds of years — think of art galleries, museums, or ...
  • Digital & Mobile TechnologyDigital EquityEdTech & Innovation

    Promoting Online Access With Hotspots, Laptops, and Planning

    Spread the loveWhen becoming a leader in the field of education, it is important to consider equity. Some students may not have access to devices or the internet from their ...
  • Digital EquityDigital Leadership

    How Can You Assess the Tech Needs of Your Students Outside of School?

    Spread the loveToday, I received an email from the middle school principal in Los Angeles. She explained to me that the school that she ran was in one of the ...
  • Digital Equity

    It Is Time for the Edtech Industry to Stop Denying Its Equity and Race Problem

    Spread the loveThe EdTech industry is dominated by white employees, white leaders, and white entrepreneurs. If you doubt this statement, just attend an Edtech conference. Admittedly, educators and others don’t ...
  • Digital Equity

    How OER Can Help Overcome the Higher Education Equity Barrier

    Spread the loveThe cornerstone of the American dream is the ability to succeed in life regardless of one’s family of origin. And, for most people, that requires a college education. ...

EdTech Futures

  • Adaptive LearningAssistive TechnologyEdTech FuturesInstructional TechnologyTeachers

    Will AI Replace Teachers?

    Spread the loveThrough the years, robots have taken over many jobs. First, they replaced horses and wagons and horses and plows, then they started to replace people. A few examples ...
  • EdTech FuturesHigher EducationHigher Education EdTechUncategorized

    The Future of Higher Education Must Avoid Returning to the Past

    Spread the loveColleges and universities can make higher education safer, smarter, and more accessible through automation and collaboration technologies – if they commit to it. Author: John Hulen, Director of ...
  • EdTech FuturesOnline Learning & eLearning

    IT Trends To Watch As Higher Education Moves Into a New Decade

    Spread the loveEdtech couldn’t have hoped for a better launch into the new decade than the push the industry received from COVID-19. Even the most tech-resistant institutions and individuals have ...
  • EdTech Futures

    4 Emerging EdTech Trends in 2022

    Spread the loveCovid-19 has not only changed education as we know it, but it has forced education technology (EdTech) to up its game. EdTech has been crucial since the start of this ...
  • Adult EducationEdTech & InnovationEdTech FuturesEducation LeadershipEducational LeadershipHigher EducationHigher Education EdTechThe Future of Education

    Education Technology and the Future of Higher Ed Leadership

    Spread the loveEducation Technology (EdTech) has had a more significant impact on education than anyone expected. Now its effects are reaching into the field of higher education. In this article, ...

About Us

Since technology is not going anywhere and does more good than harm, adapting is the best course of action. That is where The Tech Edvocate comes in. We plan to cover the PreK-12 and Higher Education EdTech sectors and provide our readers with the latest news and opinion on the subject. From time to time, I will invite other voices to weigh in on important issues in EdTech. We hope to provide a well-rounded, multi-faceted look at the past, present, the future of EdTech in the US and internationally.

We started this journey back in June 2016, and we plan to continue it for many more years to come. I hope that you will join us in this discussion of the past, present and future of EdTech and lend your own insight to the issues that are discussed.

Newsletter

Signup for The Tech Edvocate Newsletter and have the latest in EdTech news and opinion delivered to your email address!

Contact Us

The Tech Edvocate
5322 Markel Road, Suite 104
Richmond, VA 23230
(601) 630-5238
[email protected]

Follow us

Copyright © 2022 Matthew Lynch. All rights reserved.