Why Historians Must Move Beyond Text

For generations, the study of history has been anchored to the written word. Diaries, official records, letters, and newspapers formed the backbone of historical scholarship. These documents remain essential, but they tell only part of the story. The people who produced written records were often the literate, the powerful, and the privileged. Entire populations—enslaved individuals, indigenous communities, women in many societies, peasant farmers—left sparse paper trails. To recover their experiences, historians must look elsewhere. This is where a multimodal approach to historical evidence becomes indispensable. By integrating visual, auditory, material, and digital sources alongside traditional texts, researchers and students gain access to a far wider range of human experience. The past did not happen in text alone; it happened in images, sounds, objects, and spaces. A multimodal approach meets the past on its own terms.

Defining the Multimodal Framework

A multimodal approach deliberately brings together different modes of communication to analyze historical evidence. In this context, a mode is a channel through which meaning is created and conveyed. Each mode carries distinct affordances—strengths and limitations that shape what can be expressed and understood. The major modes relevant to historical inquiry include:

  • Written texts: letters, diaries, government decrees, newspapers, manuscripts, published books, tax rolls, court records
  • Visual sources: photographs, paintings, posters, maps, cartoons, film footage, television broadcasts, diagrams, graffiti
  • Aural sources: recorded speeches, interviews, oral histories, music, ambient soundscapes, radio programs
  • Material sources: artifacts, clothing, tools, architecture, art objects, archaeological finds, household items
  • Digital sources: websites, social media archives, databases, digital maps, data visualizations, born-digital records

The foundational insight of multimodality is that no single mode can fully capture the complexity of the past. A royal decree may state official policy, but a portrait of the same monarch reveals how they wished to be seen, while a tax record shows who bore the burden of that policy, and a folk song may capture how common people subverted or resisted it. The interplay between these sources creates a richer, more layered understanding. This framework draws on the work of linguists and semioticians such as Gunther Kress and Theo van Leeuwen, who demonstrated that meaning emerges from the interaction of multiple semiotic resources. For historians, this means treating every type of evidence as worthy of rigorous attention.

Core Benefits of a Multimodal Approach

Richer Contextual Understanding

Different modes illuminate different dimensions of historical events. A photograph of a labor strike captures the physical presence and emotional intensity of participants, while a newspaper editorial articulates the ideological stakes, and a factory payroll ledger reveals the economic pressures that drove workers to action. Together, these sources allow historians to reconstruct not just what happened, but how it felt, why it mattered, and who was affected. Architectural styles, urban layouts, and the design of everyday objects also encode cultural values and social hierarchies that text alone may obscure.

Stronger Critical Thinking and Source Evaluation

Working across multiple modes forces students to ask sharper questions. Who created this source, and for what purpose? What does it emphasize, and what does it omit? How does the medium itself shape the message? A propaganda poster from wartime uses visual rhetoric to evoke emotion; a government memo from the same period presents a calculated rationale. Comparing these sources requires students to weigh evidence, identify bias, and recognize that historical truth is often contested. The Reading Like a Historian curriculum developed by the Stanford History Education Group (sheg.stanford.edu) provides excellent models for this kind of comparative analysis, pairing conflicting documents and visual sources to drive inquiry.

Increased Student Engagement and Accessibility

Students who struggle with dense academic texts often find images, audio, and physical objects more accessible and engaging. Listening to an oral history recording of a civil rights activist can bring the past to life in a way that a textbook passage cannot. Handling a reproduction of a colonial coin or examining a map from the Age of Exploration makes history tangible. Multimodal sources also accommodate diverse learning styles, helping students who are visual or kinesthetic learners connect with historical content. Moreover, these sources often represent the experiences of groups that left few written records—enslaved people, immigrants, indigenous communities—through songs, material culture, and oral traditions, making history more inclusive.

Multiple Perspectives and Inclusive History

Traditional historical study has centered on elite, literate, male figures because they produced the most surviving documents. A multimodal approach deliberately expands the archive. Archaeological evidence, domestic artifacts, folk music, vernacular architecture, and ritual objects all offer entry points into the lives of ordinary people. This widens the historical lens and helps students understand that history is shaped by many actors, not just the powerful. It also teaches that every source is partial and that historians must triangulate across evidence to approach a fuller picture.

Practical Implementation in the Classroom

Bringing multimodal analysis into teaching requires intentional planning and clear scaffolding. Teachers should introduce students to source analysis frameworks that work across modes. A good starting point is adapting the classic “5 Ws” (Who, What, When, Where, Why) for different source types. For images, students can add questions about composition, focal point, lighting, and the context of creation. For artifacts, they can ask about material, use, wear patterns, and provenance. For audio, they can note tone, background noise, pacing, and the identity of speakers.

Sample Classroom Activities

World War I: Photo and Letter Comparison

Students examine a trench photograph showing soldiers in muddy conditions, perhaps with forced smiles, alongside a censored letter from a soldier describing the same period. The photo shows camaraderie but hides death; the letter hints at fear but remains upbeat to pass censors. Discussion centers on reliability, emotion, and the gaps each source leaves. This exercise teaches students that no single source is complete.

Great Depression: Digital Storytelling Project

Students create a short multimedia narrative combining Dorothea Lange’s iconic photographs, oral history excerpts from the Works Progress Administration, unemployment statistics, and Farm Security Administration reports. They must curate and order these sources to tell a cohesive story, developing both historical content knowledge and digital literacy. The process of selection and arrangement forces them to make interpretive choices.

Civil War Soldier’s Kit: Artifact Analysis

Using reproductions of a uniform, a canteen, a letter home, and a bullet, students work in groups to infer the daily life, hardships, and priorities of a Union or Confederate soldier. They then compare their conclusions with a textbook account, noting differences in tone and detail. This activity highlights how material culture can contradict or complicate written narratives.

Teaching a Systematic Analysis Process

For students to become competent multimodal analysts, teachers should explicitly teach a repeatable process. The Library of Congress offers a useful three-step model (loc.gov/teachers/usingprimarysources/): observe (list what you see, hear, or note), reflect (what does it tell you? what did you learn?), and question (what is missing? who made it? why?). This framework works for any mode and can be practiced repeatedly with different source types until it becomes habitual.

Case Studies in Multimodal Analysis

The Fall of the Berlin Wall

This event lends itself naturally to multimodal exploration. Students can analyze news footage showing crowds tearing down the wall, personal photographs taken by West Berliners, radio broadcasts announcing the opening, written accounts from East German citizens, and a piece of the wall itself (as artifact or image). Each source reveals a different facet: the news footage captures the drama and scale; personal photographs convey individual joy and disbelief; written accounts provide political context; the physical artifact carries symbolic weight. By triangulating these sources, students can grapple with the differing emotional experiences of East and West, the role of media in shaping events, and the wall’s physical and symbolic significance.

The Civil Rights Movement: Conflicting Narratives

Pair a television news report of the Birmingham protests with a photograph of police using dogs and fire hoses, an FBI file on Martin Luther King Jr., and a first-person oral history from a young protester. The news report framed the events for a national audience, emphasizing order or disorder depending on the network’s editorial stance. The photograph captured brutality and became an enduring icon. The FBI file documented surveillance and suspicion, revealing the state’s perspective. The oral history captures the immediacy and courage of an individual. Students must reconcile these perspectives to form a more complete understanding of what happened and why it mattered.

Challenges and Practical Considerations

Authenticity and the Problem of Bias

Every source carries bias, and adding more modes does not automatically eliminate it. Photographs can be staged or cropped. Oral histories are filtered by memory and the circumstances of the interview. Artifacts may have been altered over time or removed from their original context. Students must learn to evaluate the conditions under which each source was created and preserved. Teachers should emphasize that adding more sources does not guarantee objective truth, but it does provide more vantage points for critical analysis. The goal is not to eliminate bias but to recognize and account for it.

Access and Equity

Not all schools have equal access to digital archives, artifact reproductions, or high-quality media equipment. Teachers can work around this by using freely available online collections such as the National Archives (archives.gov/education), the Digital Public Library of America (dp.la), and Smithsonian Learning Lab (learninglab.si.edu). Even without technology, printed images, read-alouds of descriptions, and simple object handling can provide multimodal experiences. Field trips to local historical societies or museums can also be invaluable.

Temporal and Interpretive Distance

Students often struggle with sources from distant eras or unfamiliar cultures. A seventeenth-century map may not look like a map today; a medieval song may use unfamiliar instruments and lyrics. Explicit instruction about historical context and the original audience of each mode is essential to prevent anachronistic interpretations. Teachers should help students understand that modes themselves have histories: the way a photograph communicates meaning in 2025 is not the same as in 1865. Building this awareness is part of becoming a sophisticated multimodal analyst.

Technology Tools That Support Multimodal Work

Digital tools can significantly enhance multimodal analysis. Interactive timeline creators such as TimelineJS allow students to embed text, images, videos, and audio in a chronological framework. Geographic Information Systems (GIS) like ArcGIS Online enable students to overlay historical maps onto modern ones, revealing changes in land use, population distribution, and political boundaries. Video annotation tools like VideoAnt let students comment on specific segments of film or speech recordings. Digital curation platforms such as Omeka or HistoryPin allow students to build online exhibits that combine multiple modes. These tools not only facilitate analysis but also teach valuable digital literacy skills that students will carry into college and careers.

Assessment Strategies for Multimodal History

Assessment should reflect the diversity of sources and skills students are using. Traditional tests that ask only for factual recall may not capture multimodal competence. Instead, consider using rubrics that evaluate:

  • Source Analysis: the ability to identify creator, context, purpose, and bias for each mode
  • Integration: how well the student combines evidence from different modes to form a coherent argument
  • Critical Reflection: recognition of gaps, contradictions, and limitations in the evidence
  • Ethical Use: proper citation and respectful treatment of culturally sensitive sources

For example, in a digital storytelling project, the rubric might weigh historical accuracy, the quality of multimodal choices, and the persuasive power of the narrative. Students can also self-assess their process, noting which modes they found most challenging or enlightening. Portfolios that collect multimodal analyses over time allow students to demonstrate growth in their analytical skills.

Conclusion

A multimodal approach to historical evidence is not a passing pedagogical trend. It reflects the reality that human beings have always communicated through many channels—images, sounds, objects, and spaces, as well as words. By systematically incorporating visual, auditory, material, and digital sources into historical inquiry, educators empower students to become more discerning consumers and creators of knowledge. This method builds critical thinking, fosters inclusivity, and makes history vivid and relevant. The most effective history classrooms are those where students learn to read images as carefully as texts, to listen to the past through recordings and oral histories, to handle artifacts with curiosity and respect, and to question every source, regardless of its form. When students develop the habit of looking beyond the written word, they discover that the past is not a single story but a conversation across time, carried in many voices and many modes.