[[AAPT Session: Transforming University Physics Departments]]

This (VERY LONG) post is primarily for college teachers.

Many of us are questioning whether the way we teach science at the university level is the best way to do it. Do we really want to perpetuate the current system, which rewards students who can perform abstract calculations with aplomb, but can’t answer basic conceptual questions about the same topics? Those who want to urge a different way of teaching at the college level, however, face the sluggish inertia of our country’s venerable institutions of scholarship and learning. Universities change slowly, and with good reason – academia is our culture’s knowledge factory, and so it should be conservative. The nature of what we produce in academic science – evidence-based knowledge – requires a conservative and skeptical faculty. We don’t take every scientific fad that comes along, the scientific establishment is slow to change. But we’re much slower to change the way we teach science at the university level than we are to change our scientific models.

Part of the problem is that faculty don’t often apply the same scientifically rigorous approach to their teaching as they do to their scientific scholarship – ie., methods based on empirically-based repeatable experiments. Faculty generally use teaching methods based on personal beliefs, don’t assess the results of their teaching, and pay more attention to the anecdotes of their neighbor than the peer-reviewed literature. They don’t read the education research literature (not surprising) and doubt its generality. Now, I must say, I personally don’t believe that education research has the same level of “truthiness” as does research in the natural sciences. It’s psychological research, essentially, which is inherently limited in its validity. But, there are still some common themes that have been shown over and over again to increase student learning of the material (such as the effectiveness of peer instruction). There are things that we know about how to best educate our students.

These are all questions that we’re wrestling with at Colorado – if anybody has any thoughts, please add them in the comments. I’ll be publishing something for university faculty on this subject, so the more input I have, the better.

This session at AAPT examined how several universities have changed the culture of how physics is taught in their department. These may serve as lessons for the rest of us.

Note that there’s a brand new wiki starting up at http://stemreform.org/ to establish the content for a User’s Guide to change in STEM education. If you’ve got experience in this area, get involved with the wiki!

How have others transformed their departments?

John Belcher – TEAL at MIT

Technology-enabled active learning (TEAL) uses a system of lecture, followed by students predicting the outcome of an experiment. The experiment is done and then followed by a computer visualization of the experiment to highlight its salient features. They use a version of SCALE-UP (students in small groups at tables working together with instructor at the middle) along with Eric Mazur’s Peer Instruction, with the added emphasis on visualizations. You can download their great visualizations for electricity & magnetism here.

University of Illinois – Tim Stelzer
They changed their introductory physics course to use peer instruction and online homework. They used a team-teaching approach, where two or three faculty were responsible for planning and implementing all aspects of the course (ie., they were all responsible for lecture, rather than having one in charge of lecture and one in charge of recitations). They adapted and built on work created by others. You don’t need to recreate the wheel, he said, but you do need to adapt existing materials to your own situation.

Why change?

At MIT, they changed the way physics was taught in part due to strong pressure: There was a high failure rate in the department, and a board member actively complained that something had to change. Students also didn’t attend the lectures – which is apparently part of the student culture at MIT. John Belcher told his own story – he was an extremely popular lecturer, he worked hard and students rated him very well, but still, nobody came to class and he failed a large portion of students. His average attendance rate was just 50%!

At the University of Illinois, they were also facing serious critiques of their course which sparked change – in fact, the engineering department was no longer going to require the introductory course anymore.

If it ain’t broke, don’t fix it. But what if there’s no crisis? How do we justify the need for change? This was the topic of Laurie McNeil’s talk. She’s written a delightful (but long!) Physics Manifesto summarizing the rationale and road to change. Definitely take a look if you’re interested in this, they’ve got a wealth of experience).

Opportunities to change

While there are reasons to change, what sorts of things let a department change? At MIT, first of all, they got a bunch of money. They also had a pariah senior faculty willing to devote the 80 hrs per week to lead the changes. Dr. Belcher admitted that it burned him out took him a few years to recover.

The University of Illinois didn’t want any such superman to lead the forms – rather, they gathered a small group of faculty who were interested in supporting the reforms. This was supported by the administration, who gave the faculty teaching release time in order to develop the new course. Having transformed a single course myself, I can attest that this is absolutely necessary – you can’t transform a course while attending to all the regular duties that a faculty member is responsible for.

So, some of the key ideas of what helped these departments change were:

  • external funding
  • important people who supported the change
  • data showing that traditional methods weren’t working
  • Friendly competition between faculty – if Dr. XXX was successful in teaching this way, so can I!
  • Having a group of committed individuals
  • Having one committed individual

Faculty training was particularly important, as it was important for instructors to be familiar with the content of the new course. This can take a lot of time.

Barriers to change

The common themes for what made change difficult were:

  • Faculty lacking knowledge or experience about teaching methods
  • Faculty resisting change
  • TA’s resisting change
  • Students resisting change
  • Only a few individuals supporting change
  • Lack of resources (such as classroom space or money)

Many of these are situational, not just about certain “curmudgeonly” individuals! So, change to university courses requires attacking some of the situational constraints.

It is also important to adapt a curriculum to your particular institution. For instance, if you have a small faculty:student ratio, perhaps having a large number of student groups won’t work, or maybe you have to add some undergraduate learning assistants to help with managing student discussion in the groups. In the same vein, in order to transfer curricular materials to another institution, it’s important to provide a list of all the resources necessary to teach that course, so the new instructors are prepared.

Reactions to change

At MIT, students reacted really positively to the pilot test of the new course, but when they ran the full blown course, the students actually petitioned against the changes. What went wrong? For one, the students at MIT just didn’t want to come to lecture! That was not part of the student culture at the institution. They found that having professionals assess that students were learning more, even though they didn’t like it, was critical in convincing the department to keep the changes. They now have 80% attendance, compared to a typical 50% attendance for most general requirement courses at MIT. Another thing they found was that it was critical to train the faculty properly in how to run the new course in order to have it go smoothly.

What about the faculty? They certainly agree that it’s a good thing to have students coming to class, as well as to have more resources going into the freshman courses. There is still faculty resistance, however – they want to lecture more and are worried students aren’t synthesizing the material without their explanations. Others, though, think that teaching this way gives students a more intellectually deep understanding of the material. In general, he’s found, the younger faculty are the most enthusiastic about the changes. Laurie McNeil also said that physicists have pretty healthy egos and don’t really take direction well. And after all, why change? They get rewarded in the current structure with teaching awards. It’s easier to change newer teachers whose teaching methods are less well-established and who don’t stand to lose face by trying something new.

At UNC, similarly, Laurie McNeil found that faculty didn’t really change their teaching style that much, and TA’s were even more conservative (after all, they don’t have a lot of power in the department). The students, however, were the ones who were most resistant. This is a common theme. Denis Rancourt from U. of Ottawa told us that his students told him that they couldn’t learn unless they he forced them to.

At U. Illinois, on the other hand, they found that both students and TA’s were quite happy with the reforms, and the student ratings of their TA’s increased.

In a different session, a faculty member mentioned the “Jerry Lewis effect” of curricular reform — you may be more popular elsewhere than you are at home. In other words, it maybe harder to get someone local who shares your vision of how the materials that you’ve created will be used, whereas someone at another institution may buy-in much more easily.

How to keep change going

(sustainability!)

There was some disagreement on the panel whether it’s important to have someone in charge of the reforms – a pariah instructor dedicated to the effort – or whether that was actually harmful in terms of sustainability.

The University of Illinois said that now that the work has been done to make the changes part of the course, it has a certain inertia, it will keep going like a massive aircraft carrier. However, one audience member asked him if this is a frictionless aircraft carrier? He pointed out that education reform efforts tend to devolve, you have to keep putting energy into it to keep it going.

Many agreed that it helps to have data showing the effectiveness of the reforms (like increased student learning and attendance), as well as to have people at other institutions doing the same thing. Both validate the kind of work you are doing.

The other problem of sustainability relates to the perspective of individual faculty. The university culture is that a particular person “owns” a course, and so when someone else teaches the course then they don’t necessarily use the other person’s materials. University faculty are incredibly independent beasts – they were hired, after all, for their intellectual merit. So, it wouldn’t be appropriate to expect an instructor to adopt course materials wholesale – that is counter to the university culture. Faculty need to have creativity and power in their own classroom, so that they’re excited about teaching the course and feel that they own it and understand why things are being done in a particular way in the course. How can we create our mateials so that this is the case?

Advertisements