Listening with whales scientifically

How to cite this page: O’Mahony, Éadin, Marie Comuzzo, Eric R. Snyder, and Alex South. “Listening with Whales Scientifically,” Listening With Whales, 20 February 2026, https://listeningwithwhales.org/scientific.

What does it mean to listen scientifically with whales?

To listen scientifically can mean many things

Scientists listen through sound, using hydrophones to record their songs and calls. They listen through images, using spectrograms that translate sound into visual patterns. They listen through machines, which help detect and classify whale vocalizations across vast datasets. And they listen through DNA, reading genetic sequences that carry traces of ancestry, survival, and loss. Each of these offers a different way of encountering whales, not just in the present but also across time, space, and more-than-human culture.

To the right, a historic example from woods hole oceanographic institution.

We can listen in the most literal sense: using our ears, and by extension underwater microphones, hydrophones, to hear and record the sounds that whales produce to communicate with each other and to navigate their environment. 

HYDROPHONES

We listen through sound, using hydrophones to record whales' songs and calls.

SPECTrOGRAMS

We listen through images, using spectrograms that translate sound into visual patterns.

DATA AND ML/AI

We listen through machines, which help detect and classify whale vocalizations across vast datasets.

DNA: GENETICS

And we listen through DNA, reading genetic sequences that carry traces of ancestry, survival, and loss.

This deepens our understanding of whales and the world they inhabit. It shapes the ways in which we tell their stories, and in turn, how their stories influence our culture.

Listening to familial structures

A pod of cachalots.
A pod of cachalots. Gabriel Barathieu, CC BY-SA 2.0, via Wikimedia Commons

In their popular writings, scientists find as much wonder and beauty in their sounds as the rest of us.

When “on duty,” however, scientists attend to whale song as a stream of auditory objects, to be classified, measured, and analyzed in pursuit of a variety of research questions, monitoring purposes, and conservation goals.

Learn more about the difference between cultural evolution & cultural revolution in humpback whale song

We’ve used recordings to learn that cachalots form matriarchal clans who are known to each other through symbolic markers of cultural identity: specific patterns of clicks called “codas” that signal membership to a clan (Hersh et al. 2022). 

We’ve learned that male humpback whales co-compose  songs that may be shared across entire ocean basins, and when one whale introduces a change, others follow, resulting in an everchanging song (Payne & Payne, 1985). For more on the origins of humpback songs check out listening with whales historically & musically.

This accumulation of small changes is known as “cultural evolution.” In the South Pacific, the rapid population-wide replacement of whole songs has also been observed in events labelled “cultural revolutions” (Garland et al., 2011).

breaching humpback in the ocean
A breaching humpback. Giles Laurent, CC BY-SA 4.0 , via Wikimedia Commons
humpback whale from above

developing an inner ear

Listening scientifically has never relied on the ear alone. Spectrograms turn sound into an image that can be measured.

They allow scientists to view patterns of sounds, how long they last, how the pitches rise and fall, making it possible to see, rather than hear how phrases repeat over time. The scientific processes of measurement, categorization, annotation, and so on, almost inevitably use spectrograms in the investigation of field recordings. In making sound visible, spectrograms allow scientists to analyze whale vocalizations with a level of precision that can feel more objective than listening alone, even as this process shifts attention away from an embodied experience of sound, allowing scientists to “transcend” what are seen as the limitations of the physical senses.

As is the case for musicians and notated scores, bioacousticians can come to hear the sounds they read on the screen in their “inner ear.” 

Spectrograms were first introduced in the mid-twentieth century, seemingly circumventing human perceptual limits and allowing the identification of sound patterns occurring at timescales faster or slower than our usual frame of reference. As is the case for musicians and notated scores, bioacousticians can come to hear the sounds they read on the screen in their “inner ear.” And yet, as the critique of musicology’s focus on scores has shown (e.g., Hasty, 1997), the experience of reading visual representations of sounds is very different to that of listening to them. For one thing, it gives us the sounds “all at once,” failing to replicate the ebb and flow of anticipation and effect that accompanies typical human listenings to structured sounds such as those of music. Recordings can last for months or years, making real-time listening impractical. Instead, scientists often turn the recordings into images so hours of data can be examined in a single figure (Wiggins and Hildebrand, 2006).

Scientific listening also involves many different people working together, and now, more and more, the use of machine learning and artificial intelligence

Where individuals listen and categorize sounds – and this has been demonstrated as efficacious in many cases (e.g., recognizing the signature whistles of different bottlenose dolphins, distinguishing among killer whale dialects, or coding the nested repetitions of humpback whale song) – studies typically involve multiple scientists to ensure the reliability of the result. 

However, as underwater recording technologies have become more robust, reliable, and cheaper, the sheer amount of data has necessitated automated detection and classification, facilitated with tools such as PAMGuard, a leading software for the detection, classification, and localization of marine mammal and other animal sounds (Gillespie et al., 2026).

As recordings accumulated, listening began to exceed the capacity of human perception alone. Because there are not enough trained experts to label the sheer number of recordings, recent work has called for citizen scientists (members of the public), using majority voting—where multiple annotators label the same sound and the most common classification is retained – to improve annotation quality (Dubus et al., 2024), drawing on the so-called “wisdom of the crowd.”

MACHINE LISTENING

Much scientific listening has become “machine listening,” in which human ears are primarily enlisted for the purposes of the initial annotation of datasets, the training of models, and their final validation.

While machine learning tools offer necessary steps in the testing of scientific hypotheses, and we don’t want to imply that bioacousticians have lost their ear for the often wondrous strangeness of the sounds they study, we want to note that when we move past listening to, we may also lose our chance to listen with whales.

The methodologies used are as diverse as the study aims, but – at least in the early stages – typically involve human researchers spending many hours listening to field recordings, usually assisted by the simultaneous viewing of spectrograms, followed by the use of machine learning tools to visualize, categorize, and analyze the sounds they hear. When coupled with machine learning tools, “listening scientifically” to whales can become a somewhat detached process, becoming less about hearing their sounds, and more about analyzing visual patterns, structures, and data that stand in for the sounds themselves.

orca

Sound is crucial to a whale’s experience in the world. Whales depend on sound to communicate and observe their surroundings. Human activities, like shipping, oil exploration, construction, and military activities, have drastically altered the acoustic world of whales. Human sonic activities have been shown to alter whale behavior, increase stress levels, and even cause mass strandings (Bernaldo de Quirós, et al., 2019). Our acoustic observations of the ocean have only existed in a post-industrial revolution world (see also listening historically), where human activities had already greatly impacted the soundscape (ZoBell, et al., 2024). 

Scientists are “listening with whales” by seeking to understand how our sonic activities have impacted their world (see also listening for peace).

While bioacoustics allows scientists to listen across distances and time, revealing some of the cultural transformations happening since 1949 (the oldest recordings we have), genetics offers another kind of listening– one that reaches far across generations, tracing lives through the molecular archives carried within their cells.

LISTENING ACROSS HISTORY THROUGH THE DNA

We also can listen in a more metaphorical sense. Every being carries within its cells a record of its life and ancestry, written in DNA.

visualization of DNA

Genetic signals reveal the lasting effects of whales’ collective trauma. 

We can listen to whales’ past: as encoded in their genomes lie signals of histories of commercial whaling, with large populations pushed by humans to the brink of extinction (see listening with whales historically and musically).

When whale populations were drastically reduced, individuals bred with close relatives. These severe levels of inbreeding are observed through what are known as “runs of homozygosity,” which are formed when both parents pass down the same segment of DNA. 

In their popular writings, scientists find as much wonder and beauty in their sounds as the rest of us.

By listening through genetic sampling, we can draw intergenerational histories that tell us about the overall health of entire species. 

Some species live for hundreds of years, and chemical and isotopic analysis of baleen reveals historical properties of the oceans, or how populations may have altered their feeding behaviors over time (Teixeira, et al., 2022). These historical analyses underline the impact humans have had on the oceans. By uncovering these traces of embodied history, we can equip ourselves with the necessary knowledge to help whales recover and thrive in perpetuity.

Baleen whales retain a record of their history; much like tree rings document the environment over a tree’s lifespan, the slow-growing baleen of mysticetes contains insights into the environmental changes whales have experienced.

Some species live for hundreds of years, and chemical and isotopic analysis of baleen reveals historical properties of the oceans, or how populations may have altered their feeding behaviors over time (Teixeira, et al., 2022). These historical analyses underline the impact humans have had on the oceans. By uncovering these traces of embodied history, we can equip ourselves with the necessary knowledge to help whales recover and thrive in perpetuity.

Baleen whales retain a record of their history; much like tree rings document the environment over a tree’s lifespan, the slow-growing baleen of mysticetes contains insights into the environmental changes whales have experienced.

Humpback Whale at Johan Petersens Fjord, East Greenland

whales’ blow or snow sampling

 a new frontier towards non-invasive genetic sampling

Traditionally, tissue samples are collected from whales using crossbows, yielding very high-quality samples that can prove extremely important for detailed genomic work. However, such high-quality data is not always needed to answer important questions: increasingly we see the adoption of non-invasive ways of sampling whales. 

This includes using remotely piloted drones to fly through the exhaled breath: whales’ blow; carefully preserving this sample to sequence the genome of the whale from the epithelial cells found in what is essentially their snot!  

We listen in a more metaphorical sense as every being carries within their cells a record of their life and ancestry.

A pod of cachalots.

EMBODIED REFLECTION

We suggest that we not only need to stay with the auditory experience, but we also need a degree of embodied reflection. We must acknowledge the histories held in bodies, as well as the ways bodies, and their ways of knowing, can produce knowledge (see also listening diffractively). 

We must self-consciously recognize the empathic leap required to move from regarding the sounds we study or the being producing it as “object,” to asking ourselves what it might be like to hear, attend to, comprehend, and to respond to the sounds as a whale, and as a human listening with that whale. Not only through sound, but also through embodied experiences and histories that are also recorded in genes. 

This certainly means imagining as fully as possible the vocal and perceptual capacities of the individual whale to which we are listening, as well as its social and physical environment. It might also include attempting to imagine what it might be like to produce these sounds. Here we have to inform ourselves by all means possible (e.g., observations, playback experiments, Indigenous knowledges) of those differences and similarities in our perceptual and cognitive abilities that separate and unite sounding whales with listening humans. 

Listening scientifically in these various ways reveals how whales and humans are members of an interspecies community that carries history and culture continuously influencing each other. Not only through sound, but also through embodied experiences and histories that are also recorded in genes. As these less invasive and more attuned ways of studying and relating to whales emerge, scientific listening itself may become listening with whales.

Indigenous+ sciences

Through her cross-disciplinary, scientific, communal, and artistic work, Dr. Jodi Edwards, an Aboriginal Yuin woman with Dharawal kinship, has worked closely with Indigenous+ and non-Indigenous people to foreground the sea kin and recognize Indigenous+ knowledge as “one of the oldest continuous scientific knowledge systems on Earth.” As Dr. Jodi Edwards has stated in her ACIUCN Species Survival Symposium speech at the Taronga Institute of Science and Larning “Species recovery to me is not a strategy, it’s a ceremony, it’s a restoring of the rhythm between us and the sea.” 

Dr. Jodi Edwards, Dr. Chels Marshall and Natalia Baechtold are also collaborating on a project titled “Unbroken Whispers – The Ripples Connecting Sea-Kin,” which centers the cultural knowledge transmitted across countless generations in Aboriginal custodial knowledge, with the aim to bring more forcefully traditional scientific knowledge within the hegemonic Western practices that currently dictate much of how scientific research on cetaceans is conducted. One of the larger goals of the project is to work towards weaving Aboriginal knowledge in national and international ocean governance.

to be continued…

What research, methods, technologies, or ways of knowing could we listen with? Add it into the current!

Did you catch a mistake? Report it for a krill!

Listening with Whales is a living, growing digital commons. Sing it out: share this page!