The Tech Edvocate

Top Menu

  • Advertisement
  • Apps
  • Home Page
  • Home Page Five (No Sidebar)
  • Home Page Four
  • Home Page Three
  • Home Page Two
  • Home Tech2
  • Icons [No Sidebar]
  • Left Sidbear Page
  • My Account
  • My Speaking Page
  • Newsletter Sign Up Confirmation
  • Newsletter Unsubscription
  • Our Brands
  • Page Example
  • Protected Content
  • Register
  • Request a Product Review
  • Shop
  • Shortcodes Examples
  • Signup
  • Start Here
    • Governance
    • Careers
    • Contact Us
  • The Edvocate
  • Topics
  • Write For Us
  • Advertise

Main Menu

  • Start Here
    • Our Brands
    • Governance
      • Dr. Lynch’s Personal Website
      • Careers
    • Write For Us
    • Contact Us
    • Books
    • Edupedia
    • The Edvocate Podcast
  • Topics
    • Assistive Technology
    • Child Development Tech
    • Early Childhood & K-12 EdTech
    • EdTech Futures
    • EdTech News
    • EdTech Policy & Reform
    • EdTech Startups & Businesses
    • Higher Education EdTech
    • Online Learning & eLearning
    • Parent & Family Tech
    • Personalized Learning
    • Product Reviews
  • Advertise
    • Request a Product Review
  • Apps
  • Tech Edvocate Awards
  • The Edvocate
  • Pedagogue

logo

The Tech Edvocate

  • Start Here
    • Our Brands
    • Governance
      • Dr. Lynch’s Personal Website
        • My Speaking Page
      • Careers
    • Write For Us
    • Contact Us
    • Books
    • Edupedia
    • The Edvocate Podcast
  • Topics
    • Assistive Technology
    • Child Development Tech
    • Early Childhood & K-12 EdTech
    • EdTech Futures
    • EdTech News
    • EdTech Policy & Reform
    • EdTech Startups & Businesses
    • Higher Education EdTech
    • Online Learning & eLearning
    • Parent & Family Tech
    • Personalized Learning
    • Product Reviews
  • Advertise
    • Request a Product Review
  • Apps
  • Tech Edvocate Awards
  • The Edvocate
  • Pedagogue
  • Screencasting Adds Engagement to K—12 Classrooms

  • 6 Resources for Teaching about Artificial Intelligence

  • How New Innovative Features in Classrooms Support EdTech

  • Distance Learning during the Pandemic: Improvise. Adapt. Overcome.

  • Universities Deploy Chatbots To Aid Students In The Admissions Process And Beyond

  • Generational Differences Affect Tech Initiatives In Higher Education

  • Mixing And Matching: How To Blend Online Learning And AI

  • Understanding Institutional Reasons to Move to Cloud

  • How to Get Your Educators Excited About Using Edtech

  • Teaching Intelligence: Digital Literacy In the ‘Alternative Facts’ Era

EdTech Policy & Reform
Home›EdTech Policy & Reform›Why the Research behind Most Edtech Products is Pure Rubbish

Why the Research behind Most Edtech Products is Pure Rubbish

By Matthew Lynch
April 19, 2018
Spread the love

Smart consumers of edtech understand that they need to consult the research before committing to any product. But the hard truth is that the research behind many edtech products may not be delivering what it is promising. Here are some factors that result in edtech product research not meeting the highest standards:

First, edtech products have an incredibly rapid life cycle. In a traditional model, research takes a very long time to plan, conduct, evaluate, and disseminate. Unfortunately, by the time that that process has taken place, a cutting-edge edtech product is likely to be out of date. This means that a lot of the research for an edtech product might have happened very quickly if the research is for a product that is still currently in use. This suggests that there were no long-term studies of outcomes. One bright spot is that the mismatch between research cycles and edtech product life cycles has led to the creation of tools that allow quick evaluation procedures, such as the EdTech RCE Coach.

Second, one of the main goals of edtech is personalized learning. And it seems like edtech tools would be the ideal product to use to deliver personalized learning. However, research data is usually presented in the aggregate, which makes it incredibly difficult to determine how well any particular tool succeeded at personalizing learning. For example, perhaps an edtech tool can improve standardized test scores by 10%. But this might mean that a substantial portion of the test subjects saw no test score improvement—they may have even seen a regression—but their poor performance is being masked by the large achievement gains of a small number of students.

Third, the realities of cost and time constraints mean that a lot of research is limited to extremely small studies. But a large sample size is essential to determining whether a particular tool is effective for a large pool of students with diverse characteristics. Without a large study sample, the results are not helpful.

Fourth, not a lot of the research meets the high standard of being chosen for publication in a peer-reviewed journal. While a tool’s website might contain what appears to be an impressive array of research results complete with visualized data, if these results are not of a quality and rigor to merit publication, there is no reason to give them great weight in decision-making.

Fifth, some tools are simply hard to test. If, for example, a math program gives students multiple options, then research studies on the tool might only apply to students who experience the tool in precisely the same way, which they may be unlikely to do.


Spread the love
Previous Article

How Google is Taking Over the Classroom

Next Article

Five Ways to Personalize Edtech Professional Development

Matthew Lynch

Related articles More from author

  • EdTech Policy & Reform

    10 Edtech Cost Saving Strategies

    July 24, 2018
    By Matthew Lynch
  • Early Childhood & K-12 EdTechEdTech Policy & ReformFeaturedFreshHigher Education EdTech

    Stop Supporting Digital Tools that Have Not Been Tested and Proven

    October 5, 2018
    By Matthew Lynch
  • EdTech FuturesEdTech Policy & Reform

    An education for the 21st century means teaching coding in schools

    December 17, 2016
    By Matthew Lynch
  • Assistive TechnologyEdTech Policy & Reform

    How assistive technology is changing special education

    December 14, 2016
    By Matthew Lynch
  • EdTech FuturesEdTech Policy & ReformHigher Education EdTechOnline Learning & eLearningPersonalized Learning

    What’s Wrong with MOOCs and Why Aren’t They Working?

    June 12, 2016
    By Matthew Lynch
  • Early Childhood & K-12 EdTechEdTech Policy & Reform

    Closing the achievement gap using iPads

    June 29, 2016
    By Matthew Lynch

Leave a reply Cancel reply

  • Uncategorized

    How to Use Emotional Design to Improve Your App

  • FeaturedFreshLanguage Learning Tech

    An Insider’s View into the Edtech Market for Language Learning

  • Best of the Best ListsEarly Childhood & K-12 EdTechHigher Education EdTech

    29 of the Best Flipped Classroom Apps for Elementary School Teachers

Search

Login & Registration

  • Register
  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org

Newsletter

Signup for The Tech Edvocate Newsletter and have the latest in EdTech news and opinion delivered to your email address!

  • Recent

  • Popular

  • Comments

  • Screencasting Adds Engagement to K—12 Classrooms

    By Matthew Lynch
    March 1, 2021
  • 6 Resources for Teaching about Artificial Intelligence

    By Matthew Lynch
    February 26, 2021
  • How New Innovative Features in Classrooms Support EdTech

    By Matthew Lynch
    February 26, 2021
  • Distance Learning during the Pandemic: Improvise. Adapt. Overcome.

    By Matthew Lynch
    February 25, 2021
  • Universities Deploy Chatbots To Aid Students In The Admissions Process And Beyond

    By Matthew Lynch
    February 24, 2021
  • 20 Top Virtual Reality Apps that are Changing Education

    By Matthew Lynch
    March 11, 2017
  • 7 Ways Technology Is Impacting Modern Education

    By Matthew Lynch
    March 4, 2017
  • Why Mobile Technology Enhances Instruction

    By Matthew Lynch
    December 14, 2016
  • What is the Future of Online Learning in Higher Education

    By Matthew Lynch
    April 2, 2018
  • 7 Roles for Artificial Intelligence in Education

    By Matthew Lynch
    May 5, 2018
  • 6 Resources for Teaching about Artificial Intelligence - The Tech Edvocate
    on
    February 26, 2021

    China Is Teaching Children about AI in Kindergarten. Should the US Be Worried?

    […] possibilities which is ...
  • How New Innovative Features in Classrooms Support EdTech - The Tech Edvocate
    on
    February 26, 2021

    The Significance of Technology in Your School

    […] Dictionary defines “Innovative” ...
  • Distance Learning during the Pandemic: Improvise. Adapt. Overcome. - The Tech Edvocate
    on
    February 25, 2021

    Virtual Learning Apps, Tools, and Resources That We Love

    […] applications and platforms ...
  • Universities Deploy Chatbots To Aid Students In The Admissions Process And Beyond - The Tech Edvocate
    on
    February 24, 2021

    How Can We Use Chatbots in Education?

    […] chatbot is any ...
  • Let’s talk Tech – Sine up for Math
    on
    February 23, 2021

    7 Ways Technology Is Impacting Modern Education

    […] Lynch, M. (2017, ...

EdTech Policy & Reform

  • EdTech Policy & Reform

    How Much Bias Is Okay in Your School?

    Spread the loveThe algorithm has proven itself to be a handy tool when it comes to solving education problems. It’s also not without bias.  You may be wondering how some ...
  • EdTech Policy & ReformFeaturedFresh

    Edtech Should Complement Good Pedagogy, Not Attempt to Replace It

    Spread the loveThe newest generation of edtech is downright amazing; it’s no wonder that various education stakeholders might be a little excited about its potential to transform education. However, edtech ...
  • EdTech Policy & ReformFeaturedFresh

    How to Teach Kids to Communicate in This Digital Age

    Spread the loveWhen even the youngest children are spending the equivalent of a full work day looking at screens, it is perhaps no surprise that parents are wondering how to ...
  • EdTech FuturesEdTech Policy & Reform

    3 Reasons Why India Will Be A Leader in the EdTech Industry in the 21st ...

    Spread the loveAccording to a joint report by KPMG and Google, the online education industry is expected to grow at a healthy rate of 8 times to become a $1.96B ...
  • Early Childhood & K-12 EdTechEdTech Policy & ReformFeaturedFresh

    How Does Technology Immersion Shape the Brain?

    Spread the loveDo you wonder what all of the screen time we have is really doing to our brains? As edtech continues to rise in prominence throughout the world, this ...

EdTech Startups & Businesses

  • EdTech Startups & BusinessesOnline Learning & eLearning

    Using Nudge Theory in Your Corporate Online Learning Classes

    Spread the loveAfter reading this headline, you may be asking yourself, what is nudge theory? Nudge theory centers on positive reinforcement and inferred suggestions to motivate a person to complete ...
  • EdTech Startups & Businesses

    Bringing Education into the Business World

    Spread the loveU.S. businesses spent nearly $20 billion on training in 2019. That number decreased by roughly half from the year before. Companies aren’t providing fewer professional development opportunities for ...
  • EdTech Startups & Businesses

    You Must Include These 3 Things in Your Edtech Business Plan

    Spread the loveDo you have a business plan? It’s the one question you’re going to be asked a lot as you begin your edtech business. The reasons to write a ...
  • EdTech Startups & Businesses

    Edtech Marketing Ideas to Implement Right Now

    Spread the loveEven if you do have the most exceptional edtech product or service in the world, you’ve still got to market it. Your sales and your success depend on ...
  • EdTech Startups & Businesses

    How Your Edtech Startup Can Make the Leap from Failure to Funded

    Spread the loveThe best ideas in edtech are often only ideas. They never become a reality because they lack the funding they need to get off the ground. Taking an ...

Digital Equity

  • Digital EquityDigital Leadership

    How Can You Assess the Tech Needs of Your Students Outside of School?

    Spread the loveToday, I received an email from the middle school principal in Los Angeles. She explained to me that the school that she ran was in one of the ...
  • Digital Equity

    It Is Time for the Edtech Industry to Stop Denying Its Equity and Race Problem

    Spread the loveThe EdTech industry is dominated by white employees, white leaders, and white entrepreneurs. If you doubt this statement, just attend an Edtech conference. Admittedly, educators and others don’t ...
  • Digital Equity

    How OER Can Help Overcome the Higher Education Equity Barrier

    Spread the loveThe cornerstone of the American dream is the ability to succeed in life regardless of one’s family of origin. And, for most people, that requires a college education. ...

EdTech Futures

  • EdTech FuturesOnline Learning & eLearning

    IT Trends To Watch As Higher Education Moves Into a New Decade

    Spread the loveEdtech couldn’t have hoped for a better launch into the new decade than the push the industry received from COVID-19. Even the most tech-resistant institutions and individuals have ...
  • EdTech Futures

    4 Emerging EdTech Trends in 2021

    Spread the loveCovid-19 has not only changed education as we know it, but it has forced education technology (EdTech) to up its game. EdTech has been crucial since the start of this ...
  • Adult EducationEdTech & InnovationEdTech FuturesEducation LeadershipEducational LeadershipHigher EducationHigher Education EdTechThe Future of Education

    Education Technology and the Future of Higher Ed Leadership

    Spread the loveEducation Technology (EdTech) has had a more significant impact on education than anyone expected. Now its effects are reaching into the field of higher education. In this article, ...
  • EdTech Futures

    Top Edtech Trends for 2021

    Spread the loveAre you ready to look ahead? Schools will soon be reflecting on what’s been working this year and what’s not. They’ll also begin thinking about their budgets for ...
  • Early Childhood & K-12 EdTechEdTech Futures

    In the Wake of Teacher Shortages, Schools are Turning to Virtual Teachers

    Spread the loveTeaching was once a greatly respected position, and today, morally it still seems to be of high value to many Americans. Institutionally, however, teaching no longer seems to ...

About Us

Since technology is not going anywhere and does more good than harm, adapting is the best course of action. That is where The Tech Edvocate comes in. We plan to cover the PreK-12 and Higher Education EdTech sectors and provide our readers with the latest news and opinion on the subject. From time to time, I will invite other voices to weigh in on important issues in EdTech. We hope to provide a well-rounded, multi-faceted look at the past, present, the future of EdTech in the US and internationally.

We started this journey back in June 2016, and we plan to continue it for many more years to come. I hope that you will join us in this discussion of the past, present and future of EdTech and lend your own insight to the issues that are discussed.

Newsletter

Signup for The Tech Edvocate Newsletter and have the latest in EdTech news and opinion delivered to your email address!

Contact Us

The Tech Edvocate
5322 Markel Road, Suite 104
Richmond, VA 23230
(601) 630-5238
advocatefored@gmail.com

Follow us

Copyright © 2021 Matthew Lynch. All rights reserved.