Sunday, July 21, 2024

Data - Can You Have Too Much of a Good Thing?

When I was growing up, I had an excellent pastor.  He was deeply insightful, and he handled the preaching of God's Word with intelligence.  He showed me what it meant to love God with all my mind.  There was one area of his life, however, where he did not apply the same level of intellect - his eating habits.  He loved snacks, but he was also very concerned about his appearance.  So he weighed himself - a lot.  He weight himself before he consumed anything and decided what to eat based on that number, resulting in unusual things, like eating half an Oreo and three peanuts for lunch.  This, friends, is the weird result of too much access to data.

You may be wondering what I am going on about in a blog that is meant to be about education.  Well, anyone who has been around education in the past 5 years or so knows that we have become obsessed with data.  Some schools even proudly market themselves with the term "data driven." We analyze every standardized test score (in spite of research showing they are not predictive of success), monitor GPAs, and act reactively to the slightest deviations in the bell curve.  Some parents hover over the school's digital reports of every grade, big or small, and contact the teacher over every lost point.  Much like my pastor's strange food decisions that no dietician would ever support, our obsession with academic data leads to strange educational decisions that are not based on good pedagogy.

I'm not saying we swing the pendulum back too far the other direction.  There was a time when we had almost no access to data.  Students and parents found out what the grade was when report cards came out.  At that point, it was too late to adjust course in any way.  That is too little access to data.  Neither of these extremes is helpful to the education or flourishing of students.  So, what is the sweet spot?

Let me try to make a comparison outside of the academia.  As you all know, I take and teach indoor cycle classes at the YMCA.  A few months after I started taking cycle classes, I began setting goals about distance, tension level, and power on the bike.  At first, I only knew how to check these statistics at the end of a class. I was often surprised to get to the end of a workout and find that I hadn’t achieved as much distance as I had thought or that my average speed was lower than I had mentally calculated.  Because I wasn’t tracking that information at all during the class, I didn’t have the ability to make adjustments that would help me reach my goals.  This is the workout equivalent of our world prior to digital grade access. I could do better on a different day, but I didn’t know how to do better in real time. 

Then, an instructor showed me how to use the bike’s computer to see real time information during class by changing the display screens.  It was tempting to stay on the screen with the information I cared most about.  After all, feedback is good, right?  I quickly learned that was unwise.  It made me so focused on the number that I couldn’t pay attention to instructions.  Worse, I was so focused on the number that I couldn’t enjoy doing the things that would improve the number, and I was in a state of stress if the average didn’t move as quickly as I thought it should.  Worst of all, I wasn’t building any internal sense of how to improve because I was relying too much on the bike itself rather than how my legs felt or how hard I was working.  This is the equivalent of reacting to every homework and quiz grade in real time. Students aren't able to enjoy learning or focus on how to learn well because they are too focused on each and every point.

Eventually, in those cycle classes, I learned to discipline myself to only visit that screen once every four minutes.  That gave me enough information to figure out what I need to do to make progress for the next four minute check, but it didn’t do my thinking for me. I could see if I was building an internal sense of how I was doing by making a mental prediction of where I would be before going to check the number. I could enjoy the music and the instructor because I wasn't staring constantly at the numbers on the screen. Teachers and parents should keep in mind that a grade is an average for a reason.  This will prevent us from overreacting to every task score.  Parents who check the average with every entry cause themselves a lot of unnecessary stress and raise the anxiety level of their children.  Perhaps, parents and students could make checking the LMS part of a weekly routine, checking it on Fridays in order to make a plan for the following week. Perhaps that's the sweet spot between too much data and no data at all.

Let's recognize that, like most complex endeavors, education is multifaceted. It has layers of purposes and goals, and there are many aspects of schooling that don't show up in data reports.  Grade data is ONE facet, but it doesn't tell the whole story. Standardized tests exist for a reason, but we go too far when we assume they show anything other than a snapshot of learning.  Evaluating a school on standardized test scores ALONE would be equivalent to judging a movie based solely on the poster.  Just because data is easy to check doesn't mean we should think it shows us everything we need to know.  Data doesn't include classroom climate, student attitudes toward learning, growth across time, use of resources, support of struggling learners, or how alumni prosper as a result of our having taught them.  

Water is a good thing, but when there is too much of it, you can drown.  

Data's a good thing, but let's not drown ourselves in too much of it.

  


No comments:

Post a Comment

Lessons in Working Memory Challenges

Last week, I got an unplanned lesson in the challenges of working memory overload.   The instructor for the weight lifting class my friend a...