VGGVox Documentation

repository·master·Indexed 19 days ago

https://github.com/a-nagrani/vggvox

Pretrained models for speaker identification and verification using Matconvnet. VGGVox maps voice spectrograms into a Euclidean space to support tasks such as speaker diarization, clustering, and verification, with models trained on VoxCeleb1 and VoxCeleb2.

Tokens
425
Snippets
2
Records
4
Agent score
14%

What's inside VGGVox

  1. How VGGVox models work

    master

    The VGGVox verification models map voice spectrograms to a compact Euclidean space. In this space, distances between embeddings directly correspond to a measure of speaker similarity. These embeddings can be utilized for several downstream tasks:

    • Speaker verification
    • Clustering
    • Diarisation
  2. Install VGGVox using vl_contrib

    master

    To use the VGGVox models, you must first have Matlab and Matconvnet installed and compiled. The recommended installation method is using the vl_contrib package manager.

    1. Install and compile Matconvnet.
    2. Use vl_contrib to install and setup the VGGVox package:
    vl_contrib install VGGVox
    vl_contrib setup VGGVox
  3. Run VGGVox demo scripts

    master

    After installation, you can evaluate the models directly on .wav audio files using the provided demo scripts. There are three available demos:

    • demo_vggvox_identif: For identification models trained on VoxCeleb1.
    • demo_vggvox_verif: For verification models trained on VoxCeleb1.
    • demo_vggvox_verif_voxceleb2: For verification models trained on VoxCeleb2 (ResNet based).
    demo_vggvox_identif 
    demo_vggvox_verif 
    demo_vggvox_verif_voxceleb2