How we reimagine assessment when sick and dying dogs, sleepless nights, and cleaning up dog fur are as much a factor as whether or not a student did the reading or writing may be the most pressing question we face as educators.
On November 1, 2017, I offered a keynote address at the OpenTEL event at The Open University in Milton Keynes, United Kingdom. What follows is the transcript and slides for that talk.
Let me begin by thanking Maria Stott for helping make me a part of your day today. It’s an honor to be here. I must also thank Lucy Gray, who engineered my and and my colleague Jesse Stommel’s visit to Milton Keynes. These are kindnesses offered across great distance that are worth pausing over.
It is, in fact, my connection with Lucy that I want to begin with. I first met Lucy during a fully online class called Learning Online, offered by Digital Pedagogy Lab in 2016. At the time, Digital Pedagogy Lab was an experiment in digital community and professional development centered on an annual five-day event at the University of Mary Washington, and a smattering of fully online courses.
Jesse and I had been collaboratively developing Digital Pedagogy Lab, though, for four years at that point, starting from a conversation in a hotel parking lot near Stanford University. Our primary idea behind the Lab had been to provide training and experiential learning for teachers who were faced with teaching online, or in digitally-mediated hybrid environments, with very little support—oftentimes simply thrown into a virtual learning environment without any real understanding of how to teach in those environments.
Let me start, though, with a little background on our goals. We both had come out of jobs with the community college system in Colorado. Community colleges in the U.S. are two-year, publicly funded institutions that offer adult education, technical training, certificates, and associate's degrees that are meant either to give a student the fundamentals of a university-level education, or give them the credential they need to enter a four-year institution to continue their education. Traditionally, community colleges drew from the local community in their city, and thus their nomenclature.
The internet changed all of that, though. Once online courses became possible, students from all over the country could enroll in a community college to add to their credentials or establish themselves for a future degree. Enrollments increased as courses suddenly became available to anyone with internet access; and as enrollments increased, so did the demand for courses, and teachers for those courses.
Jesse and I worked for an organization—called Community Colleges of Colorado Online, or CCCOnline for short—that provided online courses to a system of community colleges in Colorado, consisting of thirteen separate campuses, each of which catered to students of distinctly different populations. CCCOnline was intended to provide the highest quality online learning for students enrolled at any of these colleges, whether they were on-campus, taking their courses from more rural locations, or from their stations abroad.
However, these courses suffered from two major problems: the first being that teachers were only minimally trained in digital pedagogy—most of their training consisted of “how-to” lessons in setting up courses and delivering grades—and therefore they were unprepared for the challenges of teaching online. And this was our primary motivation for starting up Digital Pedagogy Lab. We figured that the teachers in the Colorado community college system could not be the only group who wanted for a deeper understanding of online teaching and learning.
But more than that, we wanted Digital Pedagogy Lab to address what we saw as a deeper problem than mere training—a widespread lack of critical thinking about learning online. CCCOnline suffered from what I referred to once as a “climate of non-inquiry.” I wrote, in “The Failure of an Online Program” published on Hybrid Pedagogy, that “An insistence on doing things as we’ve always done them, on trying to match piece to piece, part to part, learning object to learning object, only limits us. Non-inquiry blinds us to the environment in which we’re actually teaching.”
Design of these courses also suffered from a perceived need for efficiency. More students meant more courses which meant more teachers. And these were largely adjunct and contingent teachers, most of whom had only the time to receive the most preliminary kinds of training before (but most usually after) starting teaching online. And, as I said, that training consisted of how-to lessons scaffolding to best practices.
But digital pedagogy should not be reduced to a set of best practices, tools, or interfaces. So, when Jesse and I started Digital Pedagogy Lab, we centered its philosophy on critical pedagogy, or on a critical digital pedagogy, as seen in the work of Paulo Freire, bell hooks, Henry Giroux, and others.
A critical digital pedagogy, we argued, was one that would ask questions about technology, about the assumptions we make about technology—its includedness in education, its politics, its economics and labor, and its repercussions for privacy and surveillance—and not simply about the use of technology. We wanted participants in Digital Pedagogy Lab to push beyond the “how” to use a tool, and into the “why” and “whether”.
The seat of critical digital pedagogy is one of inquiry and observation. It is mindful of all the variety of dimensions the digital has in our and our students’ lives. The “why” and “whether”, then, are not just about lesson planning, choosing video over text, or learning on campus versus learning online. The why and whether must begin with questions about what happens when learning goes digital, when it goes online.
Jesse reminds us, in “Why Online Programs Fail, and 5 Things We Can Do about It,” that:
Educational campuses have libraries, coffee shops, cafeterias, quads, lawns, amphitheaters, stadiums, hallways, student lounges, trees, park benches, and fountains. Ample space for rallies, study-groups, conversation, debate, student clubs, and special events. Few institutions pay much attention to re-creating these spaces online. The work done outside and between classes (which we would argue is the glue that holds education together) is attended to nominally if at all … When and where does this conversation happen in online programs? How can we facilitate the interdisciplinary dialogues that bring a campus to life? What spaces can we build online that aren’t quantified, tracked, scored, graded, assessed, and accredited? How can we use tools like Twitter (and other social media platforms) to build the hallways between our online classes?
Since on-ground college life and learning is deeply integrated into not just the student’s life but also the life of the surrounding community, critical digital pedagogy would ask: how is or does the VLE integrate into the student’s life online—whether that life takes place on social media, or in text messages and e-mails, or on other platforms where that student works, shares, and learns online? Is the VLE a walled garden? Or does it participate in meaningful ways in the wide range of digital experiences that students and teachers both have online? How are the conversations that become the marrow of learning on-ground accommodated in online space? How is diversity embraced or represented? Where does not just interdisciplinarity lie, but intersectionality? Where do chance encounters occur?
And, of course, if we venture outside of the VLE and into, say, social media, we need to wonder: what kinds of participation are we asking our students to enact online? What communities will they belong to? What are the compromises they will make, what benefits will they reap, how will their privacy be sacrificed and how can it be protected? Where there may be specific drawbacks to a VLE that doesn’t look or act like the internet despite its belonging on the web, there may be some benefits to the ways it can isolate students. For example, does the VLE provide a space for identity formation in the way university life might? Does it provide a testing ground for citizenship? Does a platform bent on content and learning management offer opportunities to safely bridge the public and the private?
Henry Giroux writes, in “On Critical Pedagogy”, that:
"Critical pedagogy asserts that students can engage their own learning from a position of agency and in so doing can actively participate in narrating their identities through a culture of questioning that opens up a space of translation between the private and the public while changing the forms of self-and social recognition." (loc. 287)
This is increasingly important in a world where authoritarianism seems to be on the rise. Does the VLE, or do any of our strategies for online learning, provide a space where students participate in narrating their identities, or in beginning to understand the interdependent nature of their own identity with the identities of others in their communities? And if so, where and how?
Because critical pedagogy asserts that learning is a matter of engaging in a process of becoming conscious—and not just becoming knowledgeable of a certain set of facts, ideas, precedent—a critical pedagogy that fronts the digital must inquire how each new tool, environment, or network makes possible that becoming conscious. It is, in other words, asking much more foundational questions of learning online than simply “how do I post to the discussion board” or “where do I post grades”. And it expects more of its teachers than analysis of learning analytics.
Consider, for example, that certain kinds of surveillance and control are possible in an on-ground classroom. And to a certain extent, students have come up in a system where they understand the ground rules of authority in even the most liberative learning environments. In digital environments, though, are we certain that students understand what is being surveilled and by whom? Do they know what analytics are being kept, who is checking those analytics, and what the repercussions of their actions or inactions online might be?
The VLE might not be as permeable, as vulnerable, as Facebook or Twitter, but it is decidedly different in its capacities for control and observation than a room where we all gather together to learn. In fact, it is less private even than students, learning alone in their bedrooms and living rooms at home, think it might be.
What students learn online is never just the content we load into the VLE.
Which is why, at it’s most practical, critical digital pedagogy looks askance at the tools we use, the tools we are asked to use, the tools that are sold to us, which then prompts us—as learners and teachers online—to ask after the promises that digital technology offers. Promises of efficiency, time savings, greater engagement, higher test scores, increased retention, and even deeper relationships with our students through the mediation of algorithms and digital clickers.
When we think through the whole context of learning online, it becomes apparent that it is never enough to do teaching with technology, to suffice with content and learning objectives and assessments. We must always step back and inquire:
- Are students online cared for? Have we found ways within the VLE or other platform to, as bell hooks writes, “respect and care for the souls of our students”?
- Have we engaged students in some way not measurable by clicks, hits, and discussion posts, or, are we letting the the technology teach in place of us?
- Is learning online rich with the problem-solving Freire recommends as an alternative to “banking education”, or does it amount to a checklist for satisfactory performance and completion? Have we laid the foundation for student agency?
What is needed, what has always been needed. is an effective digital pedagogy that lets us span the interface, cross the digital, and find one another where we are.
A critical digital pedagogy is one where learning and teaching online provides the material from which students can forge themselves into ethical subjects in the context of their lives as hybrid learners and complicated human beings.
Tim Amidon writes in “(dis)Owning Tech: Ensuring Value and Agency at the Moment of Interface”,
Educational technologies, as interfaces, offer students and educators opportunities to discover and enact agency through strategic rhetorical action. Yet, realizing this agency is complex work because “participat[ing] fully and meaningfully in [the] technological activities” that comprise so many aspects of our social, civic, and professional lives requires an increasingly sophisticated array of multiliteracies.
Critical digital pedagogy has as one of the primary ends to its inquiry the development of these multiliteracies. Look beyond the tool to how we use the tool. Look beyond how we use the tool to how the tool uses us. Look beyond how the tool uses us to how we can resist, hack, change, or simply “prefer not to.”
This doesn’t just apply to the VLE, or Twitter, Turnitin, a cool new app, or an online proctoring service. Education itself one of those tools. We could ask: how might students use and shape their educations? How do their educations use and shape them? And how might they resist, hack, change, or simply prefer not to? We don’t get to stop asking questions about the why and whether of our teaching simply because the digital provides algorithms that approximate answers.
Learning online still needs—really really requires—human teachers. Because what it comes down to is, we are the most important technology involved in digital and online learning.
Since the beginning of 2016, I’ve been working out an idea which I call critical instructional design. And I’m not the only one. Teachers and researchers in composition studies, sociology, and other fields have been at this endeavor for years. For my own part, my ideas are a response to the truly banal solutions I’ve witnessed a traditional instructional design provides for the complications of online learning—solutions which tend to reduce the complexity of learning to straightforward methodologies that provide replicable results.
Rather than researching an instructional design based on positivist, research-driven, behaviorist methods, critical instructional design turns to critical pedagogy. I believe we must try to conceive of an instructional design that approaches the very human task of learning, the impulse to learn, and the increasingly urgent need for learning to result in the wisdom of agency.
Stanley Aronowitz writes, in Against Schooling: For an Education That Matters,
Few of even the so-called educators ask the question: What matters beyond the reading, writing, and numeracy that are presumably taught in the elementary and secondary grades? The old questioning of what a kid needs to become an informed “citizen” capable of participating in making the large and small public decisions that affect the larger world as well as everyday life receives honorable mention but not serious consideration. These unasked questions are symptoms of a new regime of educational expectations that privileges job readiness above any other educational values. (xii)
Where critical pedagogy, and critical digital pedagogy, offer questions about “what a kid needs to become an informed citizen”, critical instructional design attempts to provide a platform where those questions are given a forum that pairs them with curriculum. In other words, an approach to online teaching and learning that creates a space where student agency and critical consciousness can be fostered in a way that grows knowledge and expertise in a given subject.
Of course, the first question that comes to mind when I say that is: “How?” What are the methods employed by a critical instructional design? What are its best practices? How is it replicable?
The worst best practice is to adhere to, or go searching for, best practices. I have been in countless rooms with teachers, technologists, instructional designers, and administrators calling for recommendations or a list of tools they should use, strategies that work, practices that cannot fail to produce results in the classroom. But digital tools, strategies, and best practices are a red herring in digital learning. Learning always starts with people. Instead of asking “What tool will we need?” ask “What behaviors will need to be in place?”
For critical instructional design to work, we have to find a way to re-approach what we know about teaching and learning, about learning theory, about the digital. In Zen terms, we have to find “beginner’s mind.” This may sound strange, but the truth is that critical instructional design isn’t an iteration of the instructional design that came before. It’s new, while at the same time being old; it is familiar while at the same time disorienting.
In other words, for critical instructional design to begin, those undertaking the design of learning must themselves become more critically conscious of the work at hand. The most critical stance we can take as educators is to assume we know nothing and become profoundly observational.
If we want critical instructional design to work, we can’t approach the virtual learning environment, or the student, or the writing of our syllabus, or the idea of assessment while our brain is loaded up with old stories about those things, and our habits for fronting them. Instead, we have to essentially clear our cache, assuming nothing, and think through each step of design as it arises.
The reason we have to do this is that traditional instructional design seems to work; educational psychology and behaviorism seem to work. The way we’ve been doing things has resulted in analytics that tell us something is going well (of course, the algorithms behind those analytics only measure, only can measure, statistics that help sell the platform). Too often, because we have something that works, we assume little else will.
Paulo Freire offers, in his book Pedagogy of Indignation, that
To the extent that we accept that the economy, or technology, or science, it doesn’t matter what, exerts inescapable power over us, there is nothing left for us to do other than renounce our ability to think, to conjecture, to compare, to choose, to decide, to envision, to dream. (33)
Instead of saying “I’ve always done it this way,” we need to say “How should I do this now?”
That is literally the first and, as far as I can imagine, the only best practice associated with critical instructional design. Where critical pedagogy centers on social justice and liberation, and critical digital pedagogy fronts with the complications of learning in digital environments, critical instructional design looks directly at application and asks, open-eyed and slack-jawed, “What is the best first step, the right action for the circumstance, right now?”
And what happens when we begin to let go of our old ideas of instructional design and learning theory is that we feel the return of invention and imagination to the acts of learning and teaching. Freedom occurs, only to remind us that we’ve always been free.
Giroux writes, “For me, pedagogy is part of an always unfinished project intent on developing a meaningful life for all students” (loc. 103). This is vitally important to the project of learning online. I have long believed that online learning doesn’t understand itself. That it is as a two-year-old child who discovers they can walk but doesn’t really understand the nuances of the ambulatory act, nor really even what walking’s for. As such, teaching online, designing online learning, is in fact an act of learning online… both learning in an online environment and learning what “online” even means.
At the same time as I encourage the idea of “beginner’s mind”, though, we cannot literally go back square one. Education has become too shrouded in technology for us to return to the mere classroom, mere pen and paper, chalk and chalkboard. But we can retreat to that point in our minds, to make it back to a figurative, theoretical square one, and consider what choices we would make from there. And then begin making them for the first time. What technology would we include? What technology would we veer away from? What practices are we most afraid of losing, and so what practices must we carefully and with passion fight for?
Photo by Patrick Fore on Unsplash