Defining Primary and Secondary Sources in Historical Research

Historians classify sources into two broad categories. Primary sources are original materials produced during the period under study—documents, photographs, artifacts, and, importantly, diaries. They offer direct, unfiltered evidence. Secondary sources are works that analyze, interpret, or critique primary sources—textbooks, journal articles, documentaries, and scholarly monographs. The distinction is not always absolute: a diary can serve as a primary source for the era it describes, but when a historian publishes an annotated edition of that diary, the published version becomes a secondary source as well. Unlike official records designed for posterity, diaries are often impulsive, intimate, and created without an external audience, making them uniquely valuable for capturing the unvarnished texture of daily life.

In the 20th century—arguably the most documented century in history—diaries occupy a unique position. They bridge the gap between official records (government memos, military reports, newspaper accounts) and the private experiences of individuals. This article explores how diaries function both as primary witnesses to the past and as secondary materials that historians use to build interpretations. The interplay between these two roles demands careful methodological handling, as a single diary can shift from raw testimony to analyzed evidence depending on how it is employed.

The Golden Age of Diary-Keeping: Why the 20th Century Matters

The 20th century witnessed an explosion in diary writing, driven by rising literacy rates, cheaper paper and printing, and a cultural emphasis on self-reflection. By 1900, literacy in much of Europe and North America exceeded 80 percent, and pocket notebooks became affordable for factory workers and farmers alike. Wars, political upheavals, economic depressions, and social movements all produced an abundance of personal records. Diaries from this period capture voices seldom heard in official archives—women, colonized peoples, factory workers, soldiers, and children. The sheer volume is staggering: the Mass Observation project in Britain alone collected over 500 personal diaries from the 1930s through the 1950s, while the Library of Congress holds thousands of American diaries spanning the century.

Major events like the World Wars, the Great Depression, the Holocaust, the Cold War, and the Civil Rights Movement are all illuminated by diarists who recorded not only facts but also emotions, fears, and hopes. These personal documents allow historians to reconstruct the texture of daily life—what people ate, how they mourned, what they whispered when no one else was listening. Diaries also expose the gap between public rhetoric and private belief: a soldier might write gung-ho letters home but confess terror and doubt in his journal.

Diaries as Primary Sources: Firsthand Testimony

When used as primary sources, diaries provide raw, contemporaneous accounts. They are often written with no intent of publication, which can reduce the risk of self-censorship or performance for an external audience. For example, the diary of Anne Frank, written between 1942 and 1944, gives a deeply personal view of life in hiding during the Nazi occupation. It is a primary source for the Holocaust, but also for adolescence, family dynamics, and the psychology of fear. Anne’s diary offers details that official Nazi documents never capture: the taste of stale bread, the sound of bombs falling, the tension of sharing a cramped attic with seven other people. Similarly, the diaries of ordinary Soviet citizens during the Stalinist purges—many of which survived only because they were hidden in walls or buried—reveal how fear pervaded everyday interactions, something that official party records gloss over.

Another powerful example is Victor Klemperer’s I Will Bear Witness (1933–1945). Klemperer, a Jewish professor in Nazi Germany, meticulously recorded the incremental erosion of civil rights and the spread of totalitarianism. His diary is a primary source for the Holocaust and for daily life under the Third Reich. It is often cited alongside official Nazi documents to show how ideology translated into practical oppression. For instance, Klemperer notes the exact date Jews were banned from public libraries, the way shopkeepers began refusing service, the casual cruelty of neighbors who suddenly became informants. Such granular detail is invaluable for historians seeking to understand how ordinary Germans participated in—or acquiesced to—the regime.

Historians rely on such diaries to fill gaps in the official record: why did ordinary people support or resist regimes? How did families cope with rationing and bombing? What did soldiers think as they marched toward battle? The diary of Charles Lynch, an American GI in the Battle of the Bulge, records not only combat but also moments of boredom, the struggle to write in freezing foxholes, and the black humor soldiers used to cope with death. These firsthand testimonies challenge sanitized official histories that emphasize strategy and heroism while ignoring confusion, fear, and desertion.

The Emotional Landscape: What Diaries Reveal That Official Documents Miss

Official records—government reports, military dispatches, census data—tend to be dry, statistical, and biased toward institutional perspectives. Diaries, by contrast, capture emotional and psychological responses. A diary entry from a soldier in the trenches of World War I might describe not only the artillery barrage but also the smell of mud, the fear of the next attack, the loneliness of missing home. These details help historians understand the human cost of war, not just the strategic outcomes. The diaries of the Russian peasantry during collectivization, for example, record the despair of losing land and livestock, and the moral dilemmas of informing on neighbors. Such sources are crucial for creating a history that accounts for personal suffering alongside political achievements.

For instance, the diaries of Vera Brittain (published as Testament of Youth) record her anguish as she lost her fiancé and brother in WWI. They are primary sources for grief, gender roles, and the anti-war movement. Brittain’s diary entries from 1915 show her oscillating between numbness and raw pain: “I cannot believe he is dead. I keep expecting a letter. The world goes on as if nothing happened.” Similarly, the Mass-Observation archives in the UK (from 1937 onward) asked ordinary Britons to keep diaries of their daily lives, yielding a massive collection of primary material about work, leisure, and politics during the mid-20th century. One participant, Nella Last, a housewife from Barrow-in-Furness, wrote over two million words from 1939 to 1966. Her diary reveals the everyday tensions of wartime rationing, the boredom of domestic routine, and the quiet pride of contributing to the war effort. These emotional landscapes are invisible in census data or government white papers.

Methodological Challenges: How Historians Use Diaries Critically

Using diaries as primary sources is not straightforward. Historians must consider authenticity (is the diary genuine and unaltered?), representativeness (does this diarist reflect a broader experience or only their own?), and audience (did the diarist intend for it to be read?). The Diary of Anne Frank, for example, was partly edited by Anne herself with a mind to post-war publication, and later versions were altered by her father. Scholars must work with critical editions to separate the original manuscript from later revisions. The so-called “critical edition” published in 2003 includes three versions: Anne’s original diary, her edited revision, and the text as edited by Otto Frank. This allows historians to study the process of self-censorship and the impact of posthumous editing.

Moreover, diaries are inherently subjective and selective. A diarist may omit embarrassing details, exaggerate their heroism, or simply forget to record mundane but informative events. To mitigate these limitations, historians practice cross-referencing: they compare diary entries with other primary sources such as letters, photographs, birth records, and official documents. Only when multiple sources converge can a historian be confident in a conclusion. For example, a diary entry claiming a soldier was at a certain battle can be checked against military to orders and casualty lists. The diary of a Holocaust survivor can be compared with Nazi deportation records to verify dates and locations. Digital tools now enable automated comparison: text mining can flag inconsistencies between diary claims and other records, while handwriting analysis can help authenticate manuscripts.

Authenticity and Provenance

One of the trickiest challenges is provenance—the chain of custody from diary writer to archive. Diaries may be forged, altered, or selectively published. The notorious “Hitler Diaries” scandal in 1983 is a cautionary tale: purported diaries of Adolf Hitler were revealed to be forgeries, but only after years of controversy. Historians now demand rigorous forensic analysis, including ink dating, paper analysis, and handwriting verification. For 20th-century diaries, provenance often involves families who may have redacted sensitive passages. Researchers must examine the original manuscript when possible, or at least high-resolution digital images, to identify erasures, pasted overlays, or chemical alterations.

Selection and Survivorship Bias

The diaries that survive are disproportionately those of the literate, wealthy, and politically connected. Poor farmers, illiterate workers, and isolated communities left few personal records. Even when diaries do survive, they may have been preserved precisely because they align with a particular narrative—heroic war diaries, saintly resistance accounts. This survivorship bias skews our view of the past. Historians compensate by actively seeking out the records of marginalized groups: diaries written by Vella (Vietnamese) women during the 1970s occupation, diaries of Cape Coloured children under apartheid, diaries of factory girls in early 20th-century Japan. But the effort is never fully successful; many voices are silenced forever.

Digitization and New Access

The 21st century has transformed access to 20th-century diaries. Major archives—such as the British Library, the Library of Congress, and the United States Holocaust Memorial Museum—have digitized thousands of diaries, making them available to researchers worldwide. Projects like the Great Diary Project have digitized over 7,000 personal journals from the past 400 years, many from the 20th century. The Mass Observation Online database allows historians to search for patterns across hundreds of diaries quickly, performing keyword searches for themes like “food,” “fear,” or “hope” across decades of entries.

Digital tools also enable new kinds of analysis: sentiment analysis can track emotional shifts across decades; network analysis can map connections between diarists and their correspondents. For instance, researchers at the University of Sussex used sentiment analysis on Mass Observation diaries to chart the rise and fall of public morale during the Blitz, finding that initial stoicism gave way to fatigue and anger by 1941. However, scholars must remain cautious: digital surrogates are not perfect copies, and the context of the physical diary (paper quality, handwriting, marginalia) may be lost. A smudge, a torn page, or a change in ink color can tell a story that a pixelated scan cannot. Moreover, digitization often privileges the most canonical diaries, further skewing representativeness. Ethically, digitizers must respect privacy: diaries written within the last 70 years may still contain sensitive information about living persons, and researchers must navigate copyright and consent laws.

Diaries as Secondary Sources: Interpretation and Analysis

Once a diary is published, annotated, and interpreted by a historian, it transforms into a secondary source. The diary itself is the primary material; the historian’s introduction, footnotes, and contextual analysis are secondary. For example, Samuel Pepys’ Diary (17th century) is a primary source for Restoration London, but the many scholarly editions that explain its references and assess its credibility are secondary sources. In 20th-century history, the same applies to Anne Frank’s diary: school textbooks and historical monographs that use her diary to illustrate the Holocaust are secondary works. These secondary uses often shape public memory far more than the raw text does.

Historians also create synthetic studies that draw on multiple diaries to understand a phenomenon. For instance, a historian might analyze a hundred diaries from American GIs in World War II to write a book about combat trauma. That book is a secondary source, but its building blocks are primary diaries. The diary of Zlata Filipović (written during the Bosnian War in the 1990s) is a primary source for the Siege of Sarajevo; a documentary that uses excerpts is a secondary source. The secondary frame—selection of excerpts, narrative tone, explanatory narration—shapes how viewers understand the war. Similarly, the “Children’s Diaries of the Holocaust” collection published by the United States Holocaust Memorial Museum is a secondary compilation that selects and contextualizes child diaries to teach about genocide.

Influential 20th-Century Diaries and Their Secondary Lives

  • The Diary of a Young Girl by Anne Frank – translated into 70+ languages; used in classrooms worldwide as a Holocaust primer. Secondary analyses often focus on its literary qualities and its role in shaping collective memory. Dozens of PhD theses have examined how Anne’s diary is taught in different countries, revealing how secondary narratives adapt to local political agendas.
  • I Will Bear Witness by Victor Klemperer – a key secondary source for scholars of the Third Reich; widely cited in studies of everyday life under Nazism. The diary’s publication in 1995 transformed Holocaust historiography by providing a detailed timeline of how anti-Jewish measures escalated at the local level.
  • Zlata’s Diary by Zlata Filipović – often compared to Anne Frank; secondary works use it to discuss child perspectives on war and the international response to the Bosnian genocide. Some critics argue that the diary was heavily edited for Western audiences, raising questions about authenticity and commercial pressure.
  • The Diary of a Nisei War Bride (various authors) – provides primary insight into Japanese-American experiences after WWII; secondary studies use them to analyze assimilation and gender. The diaries of women who emigrated to the U.S. as war brides highlight cultural conflict and resilience in ways that census data cannot.
  • Diaries of Nella Last – a British housewife who kept a diary for the Mass-Observation project from 1939 to 1966; secondary works use her entries to examine domestic life, war, and aging. Her diary has been adapted into a BBC radio play, becoming a secondary source for public history.
  • “The War Diary of a British Tommy” – the diary of Private Jack Swaab (1940-1945) – used in several secondary studies of British soldiers’ morale, particularly their attitudes toward death, religion, and home.

These examples show how a single diary can be both a primary artifact and the basis for secondary interpretations that reach broader audiences. The line between primary and secondary can blur: a diary published in a scholarly edition with footnotes is used as a primary source by students, but the footnotes themselves are secondary. Effective historical research requires distinguishing between the voice of the diarist and the voice of the historian.

The Limitations and Strengths of Diaries in 20th-Century Historiography

Strengths

  • Immediacy: diaries capture events and emotions as they happen, not in retrospective memory. This limits the distortion of nostalgia or forgetting. The diary of Mihail Sebastian, written in Romania during World War II, records day-by-day the spread of fascism in a way that memoirs written forty years later could not replicate.
  • Voice of the marginalized: diaries give agency to people ignored by official records—women, minorities, poor people, children. The “Diaries of Indian Indentured Labourers” in Fiji and the Caribbean offer rare bottom-up perspectives on colonialism and exploitation.
  • Rich detail: everyday life, sensory experiences, private thoughts—all are preserved. What did a 1920s flapper eat for breakfast? How did a Chinese immigrant feel on arriving at Ellis Island? Diaries answer these questions better than any other source.
  • Comparing public and private: diaries allow historians to contrast what people said in public (speeches, letters) with what they wrote privately, revealing dissent, hypocrisy, or hidden resistance.

Limitations

  • Subjectivity and bias: diarists are not impartial; they have axes to grind, loves to cherish, and memories to shape. A diary written by a Nazi official may be truthful about events but biased in interpretation, celebrating cruelty that a Jewish diarist would condemn.
  • Incompleteness: many diaries are missing days, pages, or entire periods; writers may skip traumatic events or mundane routines. The diary of a soldier may stop abruptly during a battle, leaving historians to wonder if he was killed, captured, or simply too tired to write.
  • Survivorship bias: the diaries that survive are often those of the literate, the privileged, or the lucky. We have far fewer diaries from the illiterate, the very poor, or those who died young. The diaries of Holocaust victims were often destroyed by the Nazis; those that survived are a tiny, unrepresentative sample.
  • Editing and censorship: after publication, diaries may be heavily edited by publishers or families, changing the original meaning. The original diary of Anne Frank contains passages about her sexual awakening that were omitted from the first edition. Victorian-era diaries were often bowdlerized to remove “improper” content, distorting historical understanding.
  • Privacy and ethics: many 20th-century diaries are still under copyright or involve living subjects. Publishing diaries without consent can cause harm, forcing historians to balance scholarly value against ethical responsibilities.

Historians must treat diaries as one piece of a larger puzzle. A diary alone cannot prove a historical claim; but combined with census data, newspapers, letters, and official documents, it can provide a powerful corroboration or a compelling counter-narrative. For example, the diary of a Japanese-American internment camp detainee, cross-referenced with War Relocation Authority records, can confirm patterns of forced labor and break the official story of peaceful relocation.

The Future of Diary Research: Big Data, AI, and New Frontiers

As we move further into the 21st century, diary research is being transformed by technology. Thousands of unpublished diaries are being scanned and transcribed via crowdsourcing projects like Transcribe Bentham and the Australian Women’s Register. Optical character recognition (OCR) now works for handwritten text, enabling full-text search across massive collections. Natural language processing (NLP) can identify emotional arcs, recurring themes, and social networks within and across diaries. For instance, a team at the University of Oxford used NLP on 500 British WWI diaries to map the rise and fall of morale across units, correlating diary sentiment with battle casualties and leave schedules.

Yet these tools raise new questions. Automated analysis may flatten the idiosyncratic voice of a diarist, reducing rich prose to data points. Privacy concerns intensify: a diary written in 1980 may be digitized and analyzed without the writer’s knowledge. Historians must advocate for transparent ethics guidelines and responsible data usage. Additionally, the digital divide means that diaries from the Global South are often overlooked in favor of Western collections. Initiatives like the “Diaries of the Indian Ocean” project seek to redress this imbalance by digitizing diaries in Swahili, Hindi, and Arabic.

The long-term goal is to create a global, searchable corpus of 20th-century diaries, allowing historians to ask questions that were impossible a generation ago: How did diary writing vary by region and class? Did the emotional content of diaries change over the course of the century? How do diaries from different wars compare in their descriptions of violence and peace? Such large-scale analysis must always be grounded in close reading of individual entries, but the potential is immense.

Conclusion: The Enduring Value of the Personal Record

Diaries are among the most intimate and revealing sources available to historians of the 20th century. As primary sources, they offer direct, unfiltered testimony from the people who lived through world-changing events. As secondary sources, when interpreted by scholars, they shape our collective understanding of war, peace, oppression, and resilience. The best historical work uses diaries critically—acknowledging their limitations while exploiting their unique strengths. The diaries of Anne Frank, Victor Klemperer, Nella Last, and thousands of less famous writers ensure that the 20th century will not be remembered only through the eyes of generals and presidents, but also through the hopes and fears of ordinary people. In an age of digital archives and big data, the personal diary remains an irreplaceable tool for understanding the human dimension of history. As we continue to digitize and analyze these fragile documents, we must remember that each page represents a real person confronting a world they did not choose, but chose to record.

For further reading, consult the UK National Archives guide to 20th-century diaries, the Library of Congress diary collection, the academic overview of diary methodology by Dr. Anne K. Knowles, and the Mass Observation Online digital archive for firsthand exploration of this rich source base.