6 July 2022
Almila Akdag Salah & Francisca Pessanha, Utrecht University, Netherlands
What can breathing patterns tell us to analyze Oral History Archives?
Computational technologies have revolutionized the archival sciences field, prompting new approaches to process the extensive data in these collections. Automatic speech recognition (ASR) and natural language processing (NLP) create unique possibilities for analysis of oral history interviews, where otherwise the transcription and analysis of the full recording would be too time-consuming. However, many oral historians note the loss of aural information when converting the speech into text, pointing out the relevance of subjective cues for a full understanding of the interviewee narrative.
For the oral historians who emphasize the shortcomings of memory and storytelling as the strong points of oral history studies, the nonverbal cues of the interviewees, as well as the dialogue between the interviewee and the interviewer contain important information that needs to be included in the archive, and should be analyzed further to complete the research. The ability to look at human emotions, and somatic reactions while narrating important life events, both on an individual level, as well as on a collective level, gives scholars from many fields the means to focus on the feelings, mood, culture and subjective experiences on a mass scale. We argue in this talk that the advancements in affective computing, social signal processing, and automatic analysis of non-verbal communication is providing us with new tools that can capture the subjective and the emotional content of the OH-archives as well. To demonstrate our point, we will focus on one of the somatic cues of emotionality, namely breathing. Studies show a correlation between respiratory feedback and emotions such as joy, anger, fear and sadness. However, unlike speech and paralinguistic speech that is developed to a point where automatic tools perform relatively well, to capture and analyze breathing signals automatically in oral history archives is a challenge due to the lack of ground truth of breathing signals. We will highlight first the challenge of using cross dataset training to predict breathing signals automatically in a depression dataset, while also summarizing reports on affective states and expected/observed breathing patterns from the literature.
Dr. Almila Akdag Salah is an assist prof. at the Utrecht University, Dept. of Information and Computational Sciences. Her research interests combine qualitative and quantitative methods to study mainly humanities and social data. She is currently the Visual Media and Interactivity WG leader at DARIAH (the Digital Research Infrastructure for the Arts and Humanities.
Francisca Pessanha is a PhD candidate at the Information and Computer Sciences Department of Utrecht University. They obtained an integrated M.Sc degree in Bioengineering with a specialization in Biomedical Engineering at Porto University in 2020. During this period, Francisca was a visiting researcher at both Cambridge and Utrecht University, working in facial pain estimation assessment in animals. Their current research focuses on affective computing, particularly computer vision and paralinguistics for affective state analysis.
Myriam Fellous-Sigrist, King's College London, United Kingdom
Between access and protection: applied ethics for curating digital oral history
I will show how these concepts can assist us to better understand why digital (and especially online) dissemination still makes many oral history custodians uncomfortable across a large range of professional contexts, including universities, archives centres, libraries, museums and charities. The scalability and sustainability of solutions found so far are some of the remaining challenges which need to be addressed if practitioners want to live up to the democratic ambitions shared by oral history and digital humanities.
I am an oral historian and a researcher in Digital Humanities. I recently defended my PhD at King’s College London; my project focused on the ethical, legal and curatorial issues of digital oral history. I am currently working at the British Library as a rights officer for the Unlocking Our Sound Heritage project. I previously worked in the research data management team at University College London Library and as a project manager in an industrial heritage organisation in France. Since 2014 I have been a member of the executive and editorial boards of the French Association for Audiovisual and Oral Archives (AFAS).