DB here:

When we watch films, our bodies and minds are engaged at a great many levels. Nobody doubts this claim. The interesting questions are: What forms does this engagement take? What gives movies the ability to seize our senses, prod our minds, and trigger emotions? How have filmmakers constructed films so as to tease us into such activities? What, to use a phrase from the philosopher Noël Carroll, creates the power of movies?

On this blogsite, I’ve touched on such questions in concrete cases—how eye movements shape our uptake of story information (here and here), how suspense can be created and sustained (here). Those are just small-scale samples of what is, to me, an exciting and promising way of studying certain aspects of cinema. That research trend is growing substantially, and an upcoming event on our home turf marks a new phase.

In June, the Society for Cognitive Studies of the Moving Image will hold a conference here in Madison. This organization was officially created in 2006. Its membership grew out of an informal group of scholars who had been meeting every couple of years since 1997. The meetings have been stimulating affairs, bringing together film historians and theorists, filmmakers, philosophers, and social scientists. Now we’re a full-fledged, incorporated association. We have annual membership dues (cheap at $25), a slate of officers, and a set of bylaws. The Society’s conferences will become annual next year, when we convene at the University of Copenhagen.

You can learn details about the organization here, and you can scan the conference schedule here. There’s also information about getting to Madison and visiting local attractions. (I recommend The House on the Rock.) The earlier incarnation of our group, The Center for Cognitive Studies of the Moving Image, has a rather full archive here.

As president of SCSMI, I’ve had my say about the organization’s remit on the webpage. I’m using today’s blog entry to gesticulate toward some ways that the organization tries to advance our understanding of films, filmmaking, and film viewing. I’ll also shamelessly promote our event.

What is this fascinating new film theory known as cognitivism?

There are, roughly, two ways to think about doing film theory. One way is to look at a body of research or reflection in some established area (history, philosophy, psychology, etc.) and ask: What can it tell me about movies? So you might look at Freudian psychoanalysis or Gestalt perceptual psychology as a whole and then home in on ideas that seem to have relevance to cinema.

The other way to do film theory is to look closely at some filmic phenomenon and ask: What’s the best way to understand this aspect of movies? Your reading and thinking might then lead you to adjacent fields of inquiry for help. In the first instance, you start broad and move to particular cases. In the second, you start with particular cases and explore what broader ideas or information can shed light on them.

On the whole, academic film studies of the 1970s and 1980s started from the big-picture end. Several scholars decided, on various grounds, that psychoanalysis (a mixture of Freudian and Lacanian versions), provided a powerful explanatory system for virtually all human activity. The ideas of that system were then mapped onto many humanities disciplines, and then applied to particular instances of literature, the visual arts, and cinema. Many times, the big system became a doctrinal whole, a Theory of Everything, that was unquestioningly accepted.

In a 1989 essay called “A Case for Cognitivism” (available online here), I suggested that Freud did not intend his theories to become this sort of all-encompassing doctrine. And whatever Freud thought, in that essay and a later one for Post-Theory I argued that it’s more fruitful to develop film theories in a middle-level fashion, shifting from concrete problems to broader explanatory frameworks. My collaborator Noël Carroll called this focus on particular problems “piecemeal” theorizing.

It was through middle-level, piecemeal thinking that I first became interested in the cognitive sciences. During the early 1980s, I was concerned to understand how films told their stories. This process was usually called narration. From the start it seemed clear to me that filmic storytelling doesn’t work unless the spectator does certain things. We make assumptions, frame expectations, notice certain things, draw inferences, and pass judgments on what’s happening on the screen.

Film narratives are designed for just this sort of active pickup. I was interested, then, in how certain traditions of filmmaking shaped that pickup—by parceling out story information, composing shots, structuring scenes, and so on. Going beyond those particular traditions, what general capacities of spectators enabled us to understand the twists and turns of a film’s action, as presented by the movie?

During the 1960s Christian Metz had posed my question in a precise and provocative way—“We must understand how films are understood”—and had used it to found his initial version of a semiotics of cinema. But by the early 1980s, it wasn’t a question that much exercised people working in the dominant paradigm of the moment, psychoanalysis. Moreover, I was and remain skeptical of the psychoanalytic framework; I don’t think it has very solid scientific support.

So I began reading in other domains of psychology. At this point, the “cognitive sciences” were coming into their own as a result of work in linguistics, psychology, and anthropology. I didn’t have the benefit of Howard Gardner’s masterful state-of-play survey The Mind’s New Science (1985), but I saw some of the convergences he was pointing out. Perceptual psychology, social psychology, the shortcuts and shortcomings of informal reasoning, studies in classification and story comprehension–all these illuminated my central questions.

Characterizing, quick and dirty

The answers I proposed to those questions showed up in Narration in the Fiction Film (1985). Nowadays we’d call it an attempt at reverse engineering. In many instances, that book argued, features of narratives in film seemed designed to solicit activities that research in the cognitive sciences has studied. Here’s one example.

The first time we encounter a character in a narrative, we tend to form an immediate, fairly fixed judgment about what sort of person she or he is. Why is this? Why don’t we suspend judgment and wait until we have more information? At least two reasons.

First is what psychologists call the primacy effect, the likelihood that the first item or few items in a series tend to form a benchmark for what will follow. Here are two multiplication exercises:

8 x 7 x 6 x 5 x 4 x 3 x 2 x 1 = ?

1 x 2 x 3 x 4 x 5 x 6 x 7 x 8 = ?

Give a person just one of the problems and ask him or her not to do the math but to quickly offer a rough estimate of the size of the result. What happens? People given the first problem tend to give bigger estimates than those given by people who see the second problem. Even though the product is exactly the same, the order of presentation—starting with large or small numbers—seems to have biased people toward different results. The initial items become a rangefinding device for later judgments.

A second reason for our snap judgments about characters stems from a well-supported finding of social psychology. We tend to size up other people using a rule of thumb, or heuristic, that attributes their actions to personality rather than to circumstances. If someone acts bossy in a meeting, we’re inclined to say that the person has an aggressive nature. But if you ask the person why he or she came on so strong, the answer is likely to be “I was having a bad day,” “The responses I was getting were just so lame,” “The pressures of those meetings are intolerable,” and so on. This is called the fundamental attribution error. We tend to assign behavior to character traits rather than take into account contextual factors. We are biased toward believing that others’ misbehavior is due to their temperament while ours was forced by circumstances beyond our control.

In real life, the primacy effect and the fundamental attribution error can be quite unfair ways of coming to conclusions, and they can lead us astray. But filmmakers and other storytellers, being intuitive psychologists like the rest of us, realize how strong these heuristics are, so they design their stories so as to make use of them. Usually, when a character walks into the story world, he or she is characterized by signaling key traits right off the bat.

Consider Back to the Future (released the same year as NiFF was published). It might have begun with Marty McFly skating down the street for several minutes on the way to Doc’s laboratory. Instead, the narration introduces Marty by showing him cranking up the lab’s amplifier to overdrive. He strikes a star pose, hits a guitar chord, and is blasted off his feet. He’s shaken up but awestruck: “Whoa. . . Rock and roll.” We now assume that Marty likes to take risks, that he’s committed to his music, that he’s a bit preening, and that he can bounce back. Likewise, before Marty comes in, during the opening shots exploring the lab, we get information about Doc as well, though more indirectly. For both characters, the narration encourages us to leap to conclusions that will be confirmed again and again in the story that follows.

Sometimes, though, filmmakers thwart our propensities by either neutralizing the initial cues (we don’t know how to read the character) or offering strong ones that are later countermanded (we’ve been led to misread the character). Preminger offers wonderful examples of both possibilities in Anatomy of a Murder. Either way, the filmmaker is still exploiting the primacy effect and the fundamental attribution error, but in order to yield different experiences. Meir Sternberg’s superb book, Expositional Modes and Temporal Ordering in Fiction (1978), points out such strategies and explores in detail what he called, “the rhetoric of anticipatory caution”—the ways that novelists trigger the primacy effect only to force us to reevaluate our snap judgments. Sternberg was, I think, one of the first narrative theorists to bring cognitive research to bear on storytelling strategies.

I found, in short, that experimental results in the cognitive sciences could explain, in a fairly direct way, many of the tactics that stories use to engage us. Contrary to what my Wikipedia entry implies, I’m not a cognitivist 24 hours a day; many of the research questions I tackle don’t depend on such assumptions. Still, since NiFF, I’ve revisited them a few times. Making Meaning (1988), for example, tried to show that a lot of cinematic interpretation is explainable in cognitive terms.

Most recently, some essays in Poetics of Cinema (2007) draw on psychological and anthropological research to clarify why films use certain formal strategies. For instance, what aspects of Mildred Pierce mislead us about what is happening, and how are we led to misremember those aspects? Why do actors stare at each other in a way we seldom see in life? And why don’t they blink the way we do? Another essay in the collection, “Convention, Construction, and Cinematic Vision,” moves to broader terrain. It argues that a great deal of our understanding of films relies not on codes particular to cinema (contra the semiotic tradition) but rather on our everyday inference-making habits and skills.

The cognitive turn

Written in 1982-83, Narration in the Fiction Film leaned heavily on what was then called “New Look” psychology, the first wave of cognitive research in psychology. The pioneers of that program, such as Jerome Bruner, R. L. Gregory, Ulrich Neisser, and others, emphasized the mind’s role in actively building up structures of meaning on the basis of incomplete or ambiguous information. So my claims that films cue us to flesh out their action, invoke schemas (knowledge structures), ask us to reorganize story order, and to fill in missing bits—all stem from that research program. The art historian E. H. Gombrich, another big influence on me, was perhaps the first person to see how New Look psychology could inform theorizing in the humanities.

In the late 1990s, cognitively inflected film theory really took off, and in directions that shaped the growth of SCSMI. The first avatar of the SCSMI was founded by Joseph and Barbara Anderson. Joe and I were graduate students together at Iowa in the early 1970s, where he wrote a dissertation on binocularity in the cinema, and later we worked together here at Madison, where Barb was a grad student. Joe taught a course in film perception that I sat in on occasionally, and it was a revelation. When NiFF came out, Joe (by then a film producer) felt encouraged to go on with his own work, and the result was The Reality of Illusion (1998). It proposed an alternative to the New Look orientation, grounded in J. J. Gibson’s theories of ecological perception. Since then, Joe and Barb have published two anthologies, with contributions from SCSMI members.

At the same period, Torben Grodal published Moving Pictures (1997) a comprehensive theory of cinema grounded in the cognitive sciences, with particular focus on brain functions. Torben was also a founding member of the SCSMI group.

Since 2000, publications in the area have increased markedly, parallel to the growth of cognitive studies in literature and other areas. I hope to discuss some of these books and articles in a later blog.

Broadly, cognitive film theory has tracked the development of the cognitive sciences. After the New Look and ecological frameworks, we’re seeing more emphasis on evolutionary psychology and neuroscience as explanatory forces. Film scholars who talk about adaptive fitness and mirror neurons are still, for the most part, doing middle-level, piecemeal theorizing—trying to explain particular processes by appeal to what scientific research has brought to light. None, I think, expects cognitivism to provide a Big Theory of Everything.

Early on, Noël, I, and others sought to show that the cognitive perspective offered better explanations for some aspects of cinema than the dominant psychoanalytic approach. We were sometimes chastised for being pugilistic and polemical. Yet interestingly, nobody responded to our arguments, let alone replied at the same level of detail. The situation reminded me of Godard’s response to people who complained that Letter to Jane (1972) mistreated Jane Fonda. His reply was: “I merely wrote her a letter, but she never answered.”

In the years since, I have yet to see a substantive critique of the cognitive research tradition in film studies. The only extended argument I know of isn’t really focused on cognitivism and is surprisingly flimsy. (My response to it is here.)

Advocates for Poststructuralist or Cultural Studies perspectives sometimes dismiss the cognitive framework as “common sense.” But common sense is in the eye of the beholder, and there’s no reason to assume that flagrantly uncommensical claims are any more likely to be accurate than those which seem intuitively right. In doing research, we just try to ascertain the evidence for any belief, commonsensical or not. The primacy effect might seem simply to rely on the old saw, “First impressions matter,” but it’s good to know that at least one commonplace is well supported. By contrast, the fundamental attribution error doesn’t on the face of it seem either common sense or not. It’s something that our folk psychology doesn’t guide us toward or away from. It’s actually a fresh discovery about some habits of our minds.

Moreover, a great deal of cognitivism flouts what some might take as common sense. Before Chomsky, most intellectuals thought that language was social through and through. He was able to show that certain features of it, including syntax, are likely to be part of our biological endowment. A lot of cognitive social psychology has been dedicated to showing how common-sense inferences are often illogical. These findings are now being popularized in books like Cordelia Fine’s A Mind of Its Own: How Your Brain Distorts and Deceives, and Thomas Kida’s Don’t Believe Everything You Think (from which my multiplication example comes). As for humanists’ suspicion of science, I address that unfounded fear in the introduction to Poetics of Cinema. If you prefer big-picture arguments about the issue, try Edward Slingerland’s new book.

Movies on the brain

The real debate on cognitivism in film studies has yet to take place. Meanwhile, the cognitivists keep plugging away. Over the years, the Society for Cognitive Studies of the Moving Image has attracted, broadly, three sorts of persons. All are represented in our upcoming conference.

*There are the film-trained academics like me, who have branched out into cognitive film theory to illuminate particular research projects. Our June gathering includes a great many such scholars, many of them pioneers in the cognitive perspective like the Andersons, Carroll, Grodal, Murray Smith, Carl Plantinga, Patrick Colm Hogan, et al.

*There are the psychologists, who are interested in explaining the psychological mechanisms of cinema. They tend to focus on particular phenomena, like eye movements, cutting, or other triggering processes, and they study the effects at various levels, from perceptual response to brain-scanning. Their great predecessor is Julian Hochberg, who studied cinema as a sort of stage show that displayed psychological processes with particular clarity. A magisterial collection of Hochberg’s work, In the Mind’s Eye, has recently been published. At our June gathering, an entire thread is largely devoted to psychological research into cinematic uptake. Our two plenary speakers, Uri Hasson of NYU and Dan Levin of Vanderbilt, also represent this tradition.

*Then there are the philosophers. Most are concerned with art and literature, and most incline to an Anglo-American form of conceptual analysis. These scholars come to SCSMI because they are of a cognitivist bent, or because they want to argue with cognitivist work, or because this is a useful forum for the sort of film-based questions they want to pursue. The June event includes many of the most prominent philosophers of film, and a panel session is devoted to critiques of Noël Carroll’s recent book The Philosophy of Motion Pictures.

Visit our schedule page, and you’ll get a sense of how varied this work is. Speakers are talking about everything from editing patterns to the effects of digital technology on filmic perception. The participants consider propaganda, melodrama, TV series, and videogames. There are presentations on the emotional dimensions of horror and on the ways that color works in particular movies. How do viewers who have never seen films before understand cutting? In what sense is film content fictional? How does the language of film theory affect the way we theorize? Is there something inherently filmic that sets cinema apart from other media?

Cognitivism isn’t a Big Theory of Everything; nobody has a clue about how these diverse research programs would fit together. The variety is what makes it fun. I think that anybody who wants to know more about movies would find something worthwhile at the Madison event, not least the opportunity to shmooz. And there’s The House on the Rock.

The evidence is mounting. Cognitivism is cool.

PS 17 April: This line of thought strikes a chord in Lee Marshall, who offers encouragement at Screen International here.

Last Modified: Sunday | July 26, 2020 @ 19:24    open printable version

This entry was posted on Wednesday | March 5, 2008 at 7:13 pm and is filed under Books, Film and other media, Film comments, Film theory: Cognitivism, Narrative strategies, Society for Cognitive Studies of the Moving Image. Both comments and pings are currently closed.