July 31, 2012

Clearing my browser

Here are some blogs I'm not reading enough:

Teach. Brian. Teach.  - Brian Frank is writing quite a bit about how students respond to questions and whether or not they can explain possible misunderstandings that other students might have. He's doing some interesting mining of Khan Academy comments, without watching any of the videos.

Research You Should Know - Raymond Johnson (fellow UNI alum - Go Panthers!) has a long running series where he highlight math education research that is interesting or important. Not all of it is directly relevant to physics teaching, but there is so much good stuff there, it's tough to not get drawn in to it.

Great posts about the physics of music - from the view of a scientist and from the view of a musician.  It's neat to see this dialog happen online.

It's Okay to be Smart - This is a relatively popular science link aggregator, but new to me.  Some of it is not for me, but I find enough on here that otherwise I would have missed.

Learning About Teaching Physics - An extremely well produced podcast about education research related to teaching physics.  I wish they would make more of these!

Enough link dumping for now...

July 26, 2012

Break the cycle of Khan Academy criticisms and responses

When I first started interacting online (other than just via email) one of the most valuable lessons I learned was to "not feed the trolls". A troll is a person who posts in order to get a reaction from someone else in the hope of continuing an argument online. The "food" that a troll thrives on is attention.

For the most part, I do pretty well not feeding trolls online. But certain discussions about Khan Academy (KA) inevitably suck me in; I forgo protocol and end up in pointless discussions online trying to argue the points that numerous educators are trying to make about the shortcomings of KA. Since the KA has been used millions of times by (likely) millions of people, there are plenty of people who come to the defense of the KA and all that they do.

The KA defenders typically have a standard litany of responses to any criticisms of the KA.  Most of their responses don't actually address the criticism, though.  It makes it really hard to have a discussion about how to improve how the KA can reach its mission of providing a free world-class education for anyone anywhere.

The typical responses to KA critics (and my thoughts on them) include:

  1. The critics are just jealous of Sal Khan and his success.

    This, by far, has to be the most ridiculous and possibly most common response. (Haters gonna hate is a subset of this response.)  No educator that takes time to write a piece about the work that KA does is any sense jealous of the KA. The critics of KA are passionate about high quality education. They genuinely love the work they are doing. Anyone who loves what they do for a living does not begrudge another person success in doing what they are passionate about doing. Sal Khan is passionate about providing a free world-class education online? Awesome! We are passionate about world-class educations in our classrooms.  By the way, we've been teaching these classes for several years (sometimes multiple times a day) and we have the experience of knowing what concepts students struggle with in our classes. We'd like to suggest that the KA consider changing how they approach these topics if they want to reach their goal.

    There is no jealousy, only collegiality.
  2. The critics are worried that they are going to be put out of business by KA.

    You can easily search the internet to find articles about KA which include claims that some people think that KA threatens the security of teacher jobs. I have yet to meet a teacher or school administrator who actually believes this to be a possibility. Sal Khan himself has said that the goal of KA is not to replace teachers. The argument on the face of it makes no sense. With no teachers, there are no schools. No schools means that every household becomes a de facto homeschool operation. It seems unlikely to me that this would ever happen anywhere in the K-12 environment, let alone college.

  3. Why don't you go out and make your own set of videos?

    Generally speaking, an educator's job is not to make educational videos. Some teachers have, though, mostly for use in their own classes. I have made videos for my classes in the past, and I feel they served a useful purpose for the classes I was using them in. My videos were made for specifically for the classes I was teaching that year, and I would not expect them to be optimized for anyone to watch them and fully learn the material. The KA is attempting to provide video that can be watched by anyone at anytime, so they have a different way of structuring their videos. Some educators believe that the video format is not the correct way to introduce topics to a novice. That is a separate argument that may be worth having some other time. I'm guessing, though, that the KA is not going away anytime soon. Since it has so much traction, why not try to have the KA post the best pedagogical content that can be produced? Video may be imperfect, but it can be made better.
  4. My teacher sucks/sucked. I read the material and went to my teacher and I still didn't understand anything until I watched the KA videos.

    Eric Mazur frequently repeats the old chestnut that "the plural of anecdote is not data". So although there are dozens/hundreds/thousands/countless of people who claim that they were the victim of substandard instruction we have no way of knowing if all (or any of them) were truly in a class with a poor teacher. Honestly, we have know way of knowing whether or not learning truly happened just by you reporting that you made it through a particular class with a particular grade. An alternate explanation to their experience was that the struggle which the KA supporter went through was ultimately more useful for the learning of the material. It may be that using all the different methods of trying to learn the material, the student was engaging in deep processing of the concepts, the last step was seeing the KA video. So, it's not specifically the KA video, but the overall process of studying which led to learning.
  5. The videos aren't a replacement for teachers; they are meant to flip the class in order to make class time more interactive. Or they are meant for review and refreshing topics.

    The idea that many students would use KA as a review or method to brush up on topics no longer fresh in their minds is not a bad thing at all. But then, let's not hail KA as a revolution in education, okay? Sal Khan is not a trained educator, and while he may be relatively good at explaining his understanding of certain topics, it does not mean that his way of understanding is the best for everyone. He demonstrates knowledge of the content in the videos (mostly he does it acceptably) but often it is at a superficial level. More troubling is that he demonstrates a lack of the pedagogical content knowledge.  That is, he lacks the understanding of what it is that makes a topic difficult to understand. Furthermore, the videos are a one-way street.  There is no way for him to know if anyone watching the video is truly improving in their conceptual understanding.
  6. The videos are better than sitting in class. You aren't distracted by anything because all you see is the digital blackboard and all you hear is Sal Khan's disembodied soothing voice.

    Okay, fair point. Life is filled with lots of distractions. School, no matter what level, is no exception.  If what you need to focus on learning is a digital background with a calming voice leading you through the steps, then KA has a place for you. However, there's is so much more to learning and doing science and mathematics (two of the most prominent topics of KA) than just sitting and watching a digital blackboard!  The KA, with this limited approach, cannot help you perform experiments, take data, do video analysis, perform simulation, or otherwise engage in the material. (KA may be planning to implement some of these ideas in the future, but they are not there now.)  And what stuns me, is the number of KA supporters who claim to be bored by their teachers at school, because all they do is stand in the front and lecture, but they love KA.  What's the difference? Just because it is online doesn't mean it isn't the same delivery method.  Except, you can't ask Sal Khan to clarify or give an alternative example. Sal Khan doesn't have office hours.
  7. The KA is not only about the videos! It has exercises and metrics and badges!

    Not all learning can be quantified by computer-scored exercises. I'm much more interested in what a student knows conceptually, and that tends to require more individualized attention from a teacher.  The metrics tools may be useful for tracking students progress through the KA exercises, but since the exercises don't measure the full picture of the learning of my class it doesn't do much for me.  As for badges, well I do love a good game. But, what about encouraging learning for its own sake? How can we emphasize the importance of pure curiosity if we reward everything with meaningless badges?
  8. Don't you get it? The KA is for middle school math/freshman high school math/remedial math/high school science/introductory classes/third world countries and NOT for graduate level coursework.

    Well, I get it. KA is for anyone at anytime. But that flexibility means everyone at every level can watch any video. Although it is not always explicitly stated, I believe that KA has some vague notion of the target audience for each video that is posted. I don't believe that the fractions videos are intended for college sophomores, nor do I believe the organic chemistry videos are intended for fourth graders. Yet students from both levels are using them. And while much of the content is not intended for advanced levels of study, why should that mean that the presentation should be sub-par? My general education courses that I teach to non-science majors are still legitimate college science classes. I have high standards for myself and for the class. The content is approached differently than I would approach a senior-level course for physics majors, but the standards for the class are still equally high. Why should KA have lower standards? Why should users of KA accept that the videos have mistakes or bad pedagogy in them? They shouldn't.
  9. I'm sick of hearing complaints about KA. KA is great and if you don't like it, don't use it.

    Frank Noschese famously posted on his blog "My final remarks about the Khan Academy" and then a few months later, started tweeting more about KA. He's not the only one who has pointed out problems or issues with KA.  I hope that fans of the KA would see that the educators pointing out the problems with KA are not out to shut down KA or stop Sal Khan from doing what he does. It's because these teachers care about the quality of education that they take the time to point out the problems. If you love KA, you should want it to be better than it already is. Help us out by encouraging the Khan Academy to engage with the educators who have been reaching out to them.
To all of Khan Academy users, please know that we've heard your responses to our critiques. Before you reply to us with one of the typical responses, please consider what we are all looking for: better education for everyone.

July 18, 2012

Local musicians - Jonas Friddle and the Majority

I just heard a great group of musicians from Chicago's Old Town School of Folk Music called Jonas Friddle and the Majority.  Check them out!


July 02, 2012

Invitation to the Khan Academy

I've been watching the unfolding of Justin Reich and Dan Meyer's "Mystery Teacher Theatre 2000" challenge over the last week or so.  Last Friday, Rhett Allain posted his critique of a kinematics video from the Khan Academy.  Over the weekend, Sal Khan posted a "correction" to Rhett. Lots of angry comments were posted all over the internet, and we've got the makings for a mini-internet soap opera. 

I remember when I first started teaching, hearing all the retired teachers who were still coming to AAPT meetings yammer on about how careful you have to be when choosing words to describe the introductory topics.  Mixing up "throw" and "drop" was something I probably did the first two years I taught physics. Other teachers with decades of experience helped me understand how I could be making it harder for students to understand the more challenging topics later by not being as precise early in the year. The more experienced teachers showed me a better way, and I became a better teacher.

I see a lot of what I was doing in my first years of teaching in the Khan Academy videos.  Sal's attempt to correct Rhett illustrated (at least to me) that he truly does not have a deep conceptual understanding of the introductory physics material.  That's not to say that he is not good at explaining what he does understand. He lacks the depth of conceptual understanding which students NEED for meaningful learning. Of course, the Khan Academy has said that their videos are only a part of a student's learning process. But  I don't believe that his videos are optimized for effective learning.

I also don't think that the Khan Academy is going away anytime soon.  Since I believe that anyone can improve their abilities, I thought I would provide Sal Khan some feedback in the style of the coaching that I received from the Global Physics Department last year.  I chose a series of videos about a topic in astronomy, watched them all, took notes and recorded my feedback.  Here's my feedback video:


I hope the Khan Academy is willing to take my feedback and use it to improve their videos. I really do.  We need more GOOD resources in this world.

What I hope comes out of the MTT2K competition is that the Khan Academy would engage with the physics education community at a meaningful level. Engagement between educators should be a two-way street, though. I want a dialogue between physics teachers and the Khan Academy. So here is my invitation to Sal Khan:

Sal Khan, you are always welcome to chat online with us in the Global Physics Department meetings on Wednesday nights. Let us know if you're free at 6:30 pm California time on a given Wednesday and we'll set you up. Or, if you don't mind traveling why not come to a meeting of the American Association of Physics Teachers? I won't be in Philadelphia this summer for the AAPT meeting, but I will be in New Orleans (that's your hometown, right?) for the winter meeting. Or, if you'd like to interact at the local section level, I will be hosting a joint meeting of two of the most active sections in the country right outside Chicago in October.  Would you be willing to come and talk with physics teachers and physics education researchers face-to-face? I know you run a non-profit, but I bet we could arrange to fly you here and I have a guest bed at home you are welcome to. Let me know!