
Nkululeko Data Directory
========================

#  


This is the default top directory for Nkululeko data import. Each database should be in its own subfolder (you can also use `ln -sf` to soft link the original database path to these subfolders) and contain a README on how to import the data to Nkululeko CSV or audformat.This README file is automatically generated by `data/make_readme.py` script (needs `mdutils` package). To update this file, run the script again after adding new datasets and adding the necessary information to each database folder's `descr.yml` file. 
## Accessibility


The column `access` in the table below indicates the database's accessibility. The following values are used:
- `public`: the database is publicly available on the internet and can be downloaded directly without any restrictions.
- `restricted`: the database is publicly available on the internet but requires registration or other restrictions to download.
- `private`: the database is not publicly available on the internet and requires the private information of the owner of the dataset.


To support open science and reproducible research, we encourage you to submit PR and recipes for the public dataset for now on.
|Name|Target|Description|Access|License|
| :--- | :--- | :--- | :--- | :--- |
|[aesdd](aesdd/)|emotion|Acted Emotional Speech Dynamic Database, Greek|public|unknown|
|[androids](androids/)|depression|Italian|public|research|
|[ased](ased/)|emotion|Amharic Speech Emotion Dataset|public|unknown|
|[asvp-esd](asvp-esd/)|emotion|The Audio, Speech and Vision Processing Lab Emotional Sound database. Multilingual, also contain vocal bursts|public|Custom academic/research use|
|[asvspoof-2019](asvspoof-2019/)|deepfake|ASVspoof 2019 Logical Access (LA) dataset for anti-spoofing countermeasure research|upon request|CC-BY-4.0|
|[asvspoof-2021](asvspoof-2021/)|deepfake|ASVspoof 2021 Logical Access (LA) and Deepfake (DF) evaluation datasets for anti-spoofing countermeasure research|upon request|see LICENSE files in ASVspoof2021_LA_eval/ and ASVspoof2021_DF_eval/|
|[banglaser](banglaser/)|emotion|Bengali|public|unknown|
|[baved](baved/)|emotion|Basic-Arabic-Vocal-Emotions-Dataset|public|CC BY 4.0|
|[cafe](cafe/)|emotion|Canadian French Emotional (CaFE) speech dataset. Childrenspeech, CanadianFrench|public|Custom academic/research use|
|[clac](clac/)|healthyspeech,age,gender|Crowdsourced Language Assessment Corpus (CLAC). English|public|Custom academic/research use|
|[cmu-mosei](cmu-mosei/)|sentiment,emotion|CMU-MOSEI, Multimodal Sentiment Analysis Dataset. English|public|unknown|
|[crema-d](crema-d/)|emotion|Crowd-sourced Emotional Multimodal Actors Dataset (CREMA-D). English,adopted from tfds|public|Custom academic/research use|
|[crema-d-csv](crema-d-csv/)|emotion|Crowd-sourced Emotional Multimodal Actors Dataset (CSV version)|public|Custom academic/research use|
|[dementiabank](dementiabank/)|dementia|Audio for dementia detection, English|restricted|Custom academic/research use|
|[dementianet](dementianet/)|audio for dementia screening|hundred of public figure audio samples with a confirmed dementia diagnosis|public|MIT|
|[demos](demos/)|emotion|DEMoS (Database of Elicited Mood in Speech). Italian|restricted|Custom academic/research use|
|[e-seravd](e-seravd/)|emotion|Indonesian Speech Emotion Recognition dataset from Movies|public|CC BY 4.0|
|[eaed](eaed/)|emotion|Egyptian-Arabic emotional speech dataset. Arabic|public|unknown|
|[eatd](eatd/)|depression, emotion|Automatic Depression Detection, a GRU/ BiLSTM-based Model and An Emotional Audio-Textual Corpus|public|unknown|
|[ekorpus](ekorpus/)|emotion|Estonian Emotional Speech Corps (EEKK)|public|unknown|
|[emns](emns/)|emotion,intensity|Emotive Narrative Storytelling (EMNS). British, singles speaker|public|CC BY 4.0|
|[emodb](emodb/)|emotion|Berlin Emotional Speech Database. German. 10 speakers, 7 emotions, 10 sentences|public|CC BY 4.0|
|[emofilm](emofilm/)|emotion|EmoFilm is a multilingual emotional speech corpus comprising 1115 audio instances produced in English, Italian, and Spanish languages|restricted|unknown|
|[emorynlp](emorynlp/)|emotion|English Emotion Dataset from Friends TV Show|public|unknown|
|[emov-db](emov-db/)|emotion|English|public|CC BY 4.0|
|[emovo](emovo/)|emotion|Italian|restricted|CC BY-NC-SA 4.0|
|[emozionalmente](emozionalmente/)|emotion|Italian|public|unknown|
|[en-dialect](en-dialect/)|dialect|English dialect classification dataset|public|unknown|
|[enterface](enterface/)|emotion|Multilingual|public|unknown|
|[erysac](erysac/)|emotion|Russian, children|public|unknown|
|[esd](esd/)|emotion|English,Chinese|public|unknown|
|[for-2sec](for-2sec/)|deepfake|Fake-or-Real (FoR) dataset - 2 seconds version|public|unknown|
|[gerparas](gerparas/)|valence,arousal,dominance|German|restricted|unknown|
|[habla](habla/)|deepfake|Hispanic American Balanced Latin-American voice anti-spoofing dataset|public|CC-BY-4.0|
|[had](had/)|deepfake|Half-Truth Audio Detection (HAD) dataset for detecting partially fake audio in Chinese speech|public|CC BY 4.0|
|[iemocap](iemocap/)|emotion,VAD|English|restricted|Custom academic/research use|
|[in-the-wild](itw/)|deepfake|audio deepfakes (and corresponding benign audio) for a set of politicians and other public figures|public|Apache-2.0|
|[indowave](indowave/)|emotion,intensity|Indonesian audio dataset for emotion classification|public|CC BY 4.0|
|[jess](jess/)|age|Jena Speaker Set|public|research|
|[jl](jl/)|emotion|English|public|ODC-By|
|[jnv](jnv/)|emotion|Japanese, non-verbals|public|unknown|
|[jtes](jtes/)|emotion|Japanese|private|unknown|
|[jvnv](jvnv/)|emotion|Japanese, verbal and non-verbal|public|unknown|
|[kbes](kbes/)|emotion|Bengali|public|unknown|
|[keio-esd](keio-esd/)|emotion|Keio Emotional Speech Dataset|public|unknown|
|[kia](kia/)|emotion|Korean, wake-up word|public|unknown|
|[laughter-types](laughter-types/)|laughter|Master Thesis from TUBerlin|public|unknown|
|[meld](meld/)|emotion|English, From Friends TV|public|CC BY 4.0|
|[meld-st](meld-st/)|emotion|MELD Speech Translation dataset|public|CC BY 4.0|
|[mesd](mesd/)|emotion|Mexican|public|unknown|
|[mess](mess/)|emotion|English|public|unknown|
|[mlendsnd](mlendsnd/)|emotion|English|public|Custom academic/research use|
|[msp-improv](msp-improv/)|emotion,VAD,naturalness|English|restricted|unknown|
|[msp-podcast](msp-podcast/)|emotion,VAD|English|restricted|unknown|
|[nEMO](nemo/)|emotion,VAD|Polish|public|unknown|
|[neurovoz](neurovoz/)|Parkinson's disease|Spanish|restricted|for research|
|[odyssey-cat-2024](odyssey-cat-2024/)|emotion|Data for Odyssey 2024 challenge, needs MSPPodcast|restricted|unknown|
|[ogvc](ogvc/)|emotion,intensity|Acted emotional speech with 8 emotions and 4 intensity levels|public|unknown|
|[oreau2](oreau2/)|emotion|French|public|unknown|
|[partialspoofing](partialspoofing/)|deepfake|PartialSpoof database for detecting partially spoofed audio|public|CC-BY-4.0|
|[polish](polish/)|emotion|Polish|public|unknown|
|[portuguese](portuguese/)|emotion|Portuguese|public|Custom academic/research use|
|[pvqd-dysphonia](pvqd-dysphonia/)|GRBAS|English|public|CC BY 4.0|
|[ravdess](ravdess/)|emotion,speaker|English|public|CC BY 4.0|
|[savee](savee/)|emotion|English, from tfds|restricted|Custom academic/research use|
|[shemo](shemo/)|emotion|Persian|public|Custom academic/research use|
|[stressdat](stressdat/)|stress|Slovak, induced stress|public|custom|
|[subesco](subesco/)|emotion|Bangla|public|Custom academic/research use|
|[svd](svd/)|pahtological speech|German speech data for detecting various pathological voices|public|unknown|
|[syntact](syntact/)|emotion|Synthesized German speech|public|Custom academic/research use|
|[tess](tess/)|emotion|British English (Toronto)|public|Custom academic/research use|
|[test](test/)|none|Test data for nkululeko|public|unknown|
|[thorsten-emotional](thorsten-emotional/)|emotion|German|public|CC BY 4.0|
|[timit](timit/)|phoneme, dialect|TIMIT Acoustic-Phonetic Continuous Speech Corpus - 39-class phoneme recognition|restricted|LDC User Agreement|
|[turev](turev/)|emotion|Turkish|public|unknown|
|[urdu](urdu/)|emotion|Urdu|public|unknown|
|[uudb](uudb/)|emotion|Urdu speech emotion dataset|public|unknown|
|[vivae](vivae/)|emotion|Variably Intense Vocalizations of Affect and Emotion Corpus (VIVAE). English vocal bursts|public|unknown|


This recipe contains information about 78 datasets.
## Performance

![Nkululeko performance](../meta/images/nkululeko_ser_20240719.png)
