Article

Positive Transfer of the Whisper Speech Transformer to Human and Animal Voice Activity Detection

2023-10-02

Abstract excerpt

<h4>ABSTRACT</h4> This paper introduces WhisperSeg, utilizing the Whisper Transformer pre-trained for Automatic Speech Recognition (ASR) for human and animal Voice Activity Detection (VAD). Contrary to traditional methods that detect human voice or animal vocalizations from a short audio frame and rely on careful threshold selection, WhisperSeg processes entire spectrograms of long audio and generates plain text...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 97371147-58af-567d-ac19-cf02c128d1df
DOI: 10.1101/2023.09.30.560270

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Positive Transfer of the Whisper Speech Transformer to Human and Animal Voice Activity DetectionDOI 10.1101/2023.09.30.560270Read

Zero-Shot Transfer for Wildlife Bioacoustics DetectionSemantic proximity Read

SAM-Whistle: Adapting Foundation Models for Automated Dolphin Whistle DetectionSemantic proximity Read

Detection of Amyotrophic Lateral Sclerosis (ALS) via Acoustic AnalysisSemantic proximity Read

Speaker-Aware Simulation Improves Conversational Speech RecognitionSemantic proximity Read

<i>Can you hear me now</i>? Clinical applications of audio recordingsSemantic proximity Read

Deep audio embeddings for vocalisation clusteringSemantic proximity Read

Enhancing Arabic Speech Therapy with AI: A Specialized AI-Based System for Arabic Stuttering ClassificationSemantic proximity Read

The Rare Cry For Help: First Record of An Agonistic Call From A Snake In South AmericaSemantic proximity Read

Automatic Temporal Analysis of Speech: A Quick and Objective Pipeline for the Assessment of Overt StutteringSemantic proximity Read

Automatic Temporal Analysis of Speech: A Quick and Objective Pipeline for the Assessment of Overt StutteringSemantic proximity Read

A Intelligent Speech Recognition Method Based on Stable LearningSemantic proximity Read

HSERNet: Hybrid Speech Emotion Recognition using Conformer-Convolutional Neural NetworksSemantic proximity Read