The Tech Edvocate

Top Menu

  • Advertisement
  • Apps
  • Home Page
  • Home Page Five (No Sidebar)
  • Home Page Four
  • Home Page Three
  • Home Page Two
  • Home Tech2
  • Icons [No Sidebar]
  • Left Sidbear Page
  • Lynch Educational Consulting
  • My Account
  • My Speaking Page
  • Newsletter Sign Up Confirmation
  • Newsletter Unsubscription
  • Our Brands
  • Page Example
  • Privacy Policy
  • Protected Content
  • Register
  • Request a Product Review
  • Shop
  • Shortcodes Examples
  • Signup
  • Start Here
    • Governance
    • Careers
    • Contact Us
  • Terms and Conditions
  • The Edvocate
  • The Tech Edvocate Product Guide
  • Topics
  • Write For Us
  • Advertise

Main Menu

  • Start Here
    • Our Brands
    • Governance
      • Lynch Educational Consulting
      • Dr. Lynch’s Personal Website
      • Careers
    • Write For Us
    • The Tech Edvocate Product Guide
    • Contact Us
    • Books
    • Edupedia
    • Post a Job
    • The Edvocate Podcast
    • Terms and Conditions
    • Privacy Policy
  • Topics
    • Assistive Technology
    • Child Development Tech
    • Early Childhood & K-12 EdTech
    • EdTech Futures
    • EdTech News
    • EdTech Policy & Reform
    • EdTech Startups & Businesses
    • Higher Education EdTech
    • Online Learning & eLearning
    • Parent & Family Tech
    • Personalized Learning
    • Product Reviews
  • Advertise
  • Tech Edvocate Awards
  • The Edvocate
  • Pedagogue
  • School Ratings

logo

The Tech Edvocate

  • Start Here
    • Our Brands
    • Governance
      • Lynch Educational Consulting
      • Dr. Lynch’s Personal Website
        • My Speaking Page
      • Careers
    • Write For Us
    • The Tech Edvocate Product Guide
    • Contact Us
    • Books
    • Edupedia
    • Post a Job
    • The Edvocate Podcast
    • Terms and Conditions
    • Privacy Policy
  • Topics
    • Assistive Technology
    • Child Development Tech
    • Early Childhood & K-12 EdTech
    • EdTech Futures
    • EdTech News
    • EdTech Policy & Reform
    • EdTech Startups & Businesses
    • Higher Education EdTech
    • Online Learning & eLearning
    • Parent & Family Tech
    • Personalized Learning
    • Product Reviews
  • Advertise
  • Tech Edvocate Awards
  • The Edvocate
  • Pedagogue
  • School Ratings
  • Financial Aid for Traditional Students: Everything You Need to Know

  • The 5 Best WiFi Cards for Windows PCs

  • The 6 Best Prepaid Phone Plans

  • The 5 Best Sites to Buy Cheap Downloadable PC Games

  • The 6 Best Lightweight Linux Distros

  • The 6 Best TV Remote Apps to Control Your TV With Your Phone

  • The 5 Best Password Managers

  • The 5 Best Free Translation Apps

  • The 15 Things to Do When Your WiFi Is Not Working

  • The 15 Best Deep Web Search Engines to Find What Google Can’t

EdTech News
Home›EdTech News›State-of-the-art education software often doesn’t help students learn more, study finds

State-of-the-art education software often doesn’t help students learn more, study finds

By Matthew Lynch
June 29, 2016
0
Spread the love

This article was written by Jill Barshay

2 lessons from the most rigorous study to date of “adaptive-learning” courseware at colleges and universities

Even proponents of educational technology admit that a lot of software sold to schools isn’t very good. But they often highlight the promise of so-called “adaptive learning” software, in which complex algorithms react to how a student answers questions, and tailor instruction to each student. The computer recommends different lessons to different students, based upon what they already know and what they still need to work on.

Wonderful in theory, but does it work in practice?

The Bill & Melinda Gates Foundation sought to find out, and gave money to 14 colleges and universities to test some of the most popular  “adaptive learning” software in the marketplace, including products from a Pearson-Knewton joint venture, from a unit of McGraw-Hill Education called ALEKS and from the Open Learning Initiative. Most of the universities combined the software with human instruction, but a few courses were delivered entirely online. Almost 20,000 college students and 300 instructors participated in the experiment over the course of three terms between 2013 and 2015. It’s probably the largest and most rigorous study of adaptive learning to date. Then Gates hired SRI International, a nonprofit research institute, to analyze the data. (The Gates Foundation is among the funders of the Hechinger Report.)

What SRI found was sobering. In most cases, students didn’t get higher grades from using adaptive-learning software, nor were they more likely to pass a course than in a traditional face-to-face class. In some courses the researchers found that students were learning more from adaptive-learning software, but even in those cases, the positive impact tended to be “modest”. The report is here.

“I wouldn’t characterize our report as cynical, just cautious,” said Barbara Means, director of the Center for Technology in Learning at SRI International and one of three authors of the report.

Although the study was conducted exclusively at colleges and universities, Means said she suspects researchers would find similar results with adaptive software used at elementary, middle and high schools.

Means emphasized that it was an analysis of the technology available back in 2013, and that better products have come to market since. “It shouldn’t be regarded as though this is the last word. It’s just a very early snapshot,” Means added.

Still, two important lessons emerged from the report, which may continue to apply even as the software improves.

1. The software in and of itself isn’t a magical teacher

“Every piece of learning software I’ve ever studied gets positive effects in some places and not others,” said Means. “When you try to understand why that is, you find out that students and instructors used it in very different ways.”

When instructors use the same language that’s used in the software during the face-to-face instruction, it’s more potent. It also matters when teachers look at the data that the software is generating, and spend class time reinforcing ideas that were troublesome after students used the software. And on a most basic level,  students need incentives to use the software. Sometimes, the instructor just says, go use it, but doesn’t monitor whether students log in or not. Not surprisingly, usage is low or sporadic. “Sometimes instructors give students the impression that what they do in the courseware doesn’t matter,” said Means.

The research also highlighted that the technology was more effective when the professor or the university completely redesigned the course around it. One example is flipping the classroom, where lectures are delivered online and the entire classroom time is spent in smaller groups with instructors who can review difficult problems, or conduct a socratic dialogue.

Another example is to use the technology to allow students to skip some prerequisite hurdles. Students still had to learn the material, but it could be taught online, by the adaptive-learning courseware, to fill in holes while the student was learning in a more advanced class. That can help students graduate on time within four years.

“We can’t expect all the power to be in a piece of software. Because we know it’s not,” said Means.

2. Universities aren’t monitoring whether the technology they’re using is working

In conducting the study, Means frequently found that colleges and universities weren’t prepared to measure student learning in a way that would stand up to academic scrutiny. To measure how much students are learning, you need to know what students knew before they started a course. You can’t just compare student grades in an adaptive-learning class with those in a traditional class because you might have stronger students in one of them. It was a particular problem to compare different semesters, because students who fail an introductory course in the fall often retake it in the spring, and the spring classes were filled with students who struggle more.

A lot of the data collected in the study couldn’t be analyzed because it was hard to make apples-to-apples comparisons.

“I think education institutions making major changes in the instruction, such as a reliance on adaptive courseware, have a responsibility to be monitoring the effectiveness of what they’re doing,” Means said. “And then try to improve it, in a kind of continuous improvement framework that you would see in some of the leading companies in any field.

“They don’t really know if what they’re doing is a change for the better, or not,” she said. “Given the cost of higher education today, which we all know a lot about, students and the public really have a right to expect this kind of attention to the quality of the product.”

This is not just in the public interest. SRI is also in the business of selling analytical tools to universities. But if universities were to start tracking student learning, it might eliminate the need for “snapshot” reports like this, which quickly become obsolete.

 

Jill Barshay, a contributing editor, writes a weekly column, Education By The Numbers, about education data and research. She taught algebra to ninth graders for the 2013-14 school year.
This article was originally published on The Hechinger Report. Read the original article.
TagsEdtechedtechchatelearningSTEAMSTEM
Previous Article

Tapping into kids’ passion for Minecraft in ...

Next Article

School leaders say they need more practical ...

Matthew Lynch

Related articles More from author

  • EdTech NewsHigher Education EdTech

    Just how effective are language learning apps?

    July 29, 2016
    By Matthew Lynch
  • Early Childhood & K-12 EdTech

    More Guidelines for Young Children using Edtech

    August 28, 2017
    By Matthew Lynch
  • Early Childhood & K-12 EdTechHigher Education EdTech

    Technology and Multisensory Learning: A New Twist to an Old Application

    June 26, 2016
    By Matthew Lynch
  • Higher EducationHigher Education EdTech

    How Edtech Is Transforming Executive Education

    November 15, 2017
    By Matthew Lynch
  • Early Childhood & K-12 EdTechEdTech Futures

    How to Create a Makerspace in any Space

    March 10, 2017
    By Matthew Lynch
  • Uncategorized

    Trailblazers in Edtech: Anant Agarwal

    October 5, 2017
    By Matthew Lynch

Search

Login & Registration

  • Register
  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org

Newsletter

Signup for The Tech Edvocate Newsletter and have the latest in EdTech news and opinion delivered to your email address!

  • Recent

  • Popular

  • Comments

  • Financial Aid for Traditional Students: Everything You Need to Know

    By Matthew Lynch
    March 31, 2023
  • The 5 Best WiFi Cards for Windows PCs

    By Matthew Lynch
    March 30, 2023
  • The 6 Best Prepaid Phone Plans

    By Matthew Lynch
    March 30, 2023
  • The 5 Best Sites to Buy Cheap Downloadable PC Games

    By Matthew Lynch
    March 30, 2023
  • The 6 Best Lightweight Linux Distros

    By Matthew Lynch
    March 30, 2023
  • 7 Ways Technology Is Impacting Modern Education

    By Matthew Lynch
    March 4, 2017
  • 20 Top Virtual Reality Apps that are Changing Education

    By Matthew Lynch
    March 11, 2017
  • Why Mobile Technology Enhances Instruction

    By Matthew Lynch
    December 14, 2016
  • 7 Roles for Artificial Intelligence in Education

    By Matthew Lynch
    May 5, 2018
  • Digital Literacy is the Most Important Lifelong Learning Tool

    By Matthew Lynch
    December 30, 2017
  • Where to Find Dyslexia Support for Adults - Case Training Services | Registered Charity #1051587
    on
    August 2, 2022

    11 Must-Have Apps and Tools for Dyslexic Students

    […] recorders Electronic flashcards ...
  • What Types Of Posts Can You Make In Google Classroom? - The Tech Edvocate - Gossip ...
    on
    July 31, 2022

    How to Integrate Google Classroom with the Power of YouTube

    […] of your posts. ...
  • Answers to Frequently Asked Questions About Google Classroom - The Tech Edvocate - Gossip Buz
    on
    July 31, 2022

    Answers to Frequently Asked Questions About Google Classroom

    […] Answers to Frequently ...
  • 10 Important YouTube Channels For Teachers - Kiiky Wealth
    on
    July 29, 2022

    10 Incredibly Useful YouTube Channels for Teachers

    […] Thetechedvocate.org – 10 Incredibly ...
  • Teaching Learners Digital Content Curation Skills - Fab Lab Connect
    on
    June 30, 2022

    Teaching Learners Digital Content Creation Skills

    […] Read More… […]

EdTech Policy & Reform

  • Curriculum & InstructionEdTech Policy & ReformEducation Leadership

    Why We Should Leave Behind the Cookie-cutter Education

    Spread the loveChange appears to be the only “constant” factor in the educational field. However, what happens when a more significant shift becomes necessary? To provide students with the best ...
  • Adaptive LearningCurriculum & InstructionDigital & Mobile TechnologyDigital Age TeachersEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformInstructional Technology

    Exploring New Ideas: Student-Driven Remote Learning

    Spread the loveRemote learning is taking its toll on our students. They miss the social side of school. Not seeing their classmates or teachers is leading to nervousness, anxiety, and ...
  • Digital & Mobile TechnologyEdTech & InnovationEdTech Policy & Reform

    Implementing Education Technology by Pursuing Technology Education

    Spread the loveTechnology is used for many great things in our world. It’s a powerful tool when used correctly. As such, this powerful tool can be used to transform learning.  ...
  • EdTech Policy & Reform

    How Much Bias Is Okay in Your School?

    Spread the loveThe algorithm has proven itself to be a handy tool when it comes to solving education problems. It’s also not without bias.  You may be wondering how some ...
  • EdTech Policy & ReformFeaturedFresh

    Edtech Should Complement Good Pedagogy, Not Attempt to Replace It

    Spread the loveThe newest generation of edtech is downright amazing; it’s no wonder that various education stakeholders might be a little excited about its potential to transform education. However, edtech ...

EdTech Startups & Businesses

  • EdTech Startups & BusinessesOnline Learning & eLearning

    How to Use System Restore in Windows 11

    Spread the loveWindows 11, the latest operating system from Microsoft, provides users with many advanced features and services. One of the most useful features of Windows 11 is “system restore.” ...
  • EdTech Startups & Businesses

    Trends That Will Help Your EdTech Startup Succeed

    Spread the loveIf you want to thrive in the destiny of learning and self, shorten, tailor, and gamify. The bulk of EdTech businesses believes that digitizing conventional learning methods and ...
  • EdTech Startups & Businesses

    How to Sell Your Edtech Product

    Spread the loveDevelop a profile of the perfect consumer, target clients that meet that description, and plan on a long sales cycle. Selling to schools takes a different sales process ...
  • EdTech Startups & Businesses

    Edtech Companies Can Learn What Not to Do From Delta Airlines

    Spread the loveIt seems that edtech companies still have a lot to learn about their business models and practices. With that being said, there is a lot they can learn ...
  • EdTech Startups & Businesses

    Understanding the Fundamentals of a Sales Script in Your Customer Interaction Journey

    Spread the loveSales scripts are crucial to any business and can be the main difference in achieving the set targets. A well-written sales script that factors in customers from different ...

Digital Equity

  • Digital Equity

    How to Create an Equitable Digital Culture in K–12

    Spread the loveDigital equity is vital in our schools. After all, it can help close the achievement gap. However, there is one prevalent problem concerning digital equity. That is the problem ...
  • Digital & Mobile TechnologyDigital EquityDigital Literacy

    Teaching Learners Digital Content Creation Skills

    Spread the loveContent curation is nothing new and has always been a coveted skill. It has been this way for hundreds of years — think of art galleries, museums, or ...
  • Digital & Mobile TechnologyDigital EquityEdTech & Innovation

    Promoting Online Access With Hotspots, Laptops, and Planning

    Spread the loveWhen becoming a leader in the field of education, it is important to consider equity. Some students may not have access to devices or the internet from their ...
  • Digital EquityDigital Leadership

    How Can You Assess the Tech Needs of Your Students Outside of School?

    Spread the loveToday, I received an email from the middle school principal in Los Angeles. She explained to me that the school that she ran was in one of the ...
  • Digital Equity

    It Is Time for the Edtech Industry to Stop Denying Its Equity and Race Problem

    Spread the loveThe EdTech industry is dominated by white employees, white leaders, and white entrepreneurs. If you doubt this statement, just attend an Edtech conference. Admittedly, educators and others don’t ...

EdTech Futures

  • EdTech FuturesOnline Learning & eLearning

    StandStand Review: A Beautiful, Easy-to-Use Portable Standing Desk

    Spread the loveStanding desks have become increasingly popular over the years, with many people choosing to incorporate them into their daily routines. The health benefits of standing frequently throughout the ...
  • EdTech FuturesElementary EducationOnline Learning & eLearning

    Sprint Won’t Allow My Phone to Activate

    Spread the loveSprint Won’t Allow My Phone to Activate: What to Do? There are few things more frustrating than purchasing a new phone, only to find out that you can’t ...
  • EdTech FuturesElementary EducationOnline Learning & eLearning

    Spread the Word: Ninite is the Only Safe Place to Get Windows Freeware

    Spread the loveWith the internet being flooded with a plethora of freeware apps and software, it’s not easy to differentiate between the genuine and the potentially harmful ones. This is ...
  • EdTech FuturesElementary EducationOnline Learning & eLearning

    SSD vs. HDD vs. USB Flash Drive: Everything You Need to Know

    Spread the loveFor many years, the Hard Disk Drive (HDD) was the only storage device available, and it was the most reliable and efficient way of storing data, and it ...
  • EdTech Futures

    The Future Of Effective Digital Learning And Its Role In The Education System

    Spread the loveEffective digital learning is the future of education and it is here to stay. With the ever-growing trend of online learning, it is no wonder that effective digital ...

About Us

Since technology is not going anywhere and does more good than harm, adapting is the best course of action. That is where The Tech Edvocate comes in. We plan to cover the PreK-12 and Higher Education EdTech sectors and provide our readers with the latest news and opinion on the subject. From time to time, I will invite other voices to weigh in on important issues in EdTech. We hope to provide a well-rounded, multi-faceted look at the past, present, the future of EdTech in the US and internationally.

We started this journey back in June 2016, and we plan to continue it for many more years to come. I hope that you will join us in this discussion of the past, present and future of EdTech and lend your own insight to the issues that are discussed.

Newsletter

Signup for The Tech Edvocate Newsletter and have the latest in EdTech news and opinion delivered to your email address!

Contact Us

The Tech Edvocate
5322 Markel Road, Suite 104
Richmond, VA 23230
(601) 630-5238
[email protected]

Follow us

Copyright © 2023 Matthew Lynch. All rights reserved.