Magic Leap SuperPoint Pretrained Network

repository·master·Indexed 24 days ago

https://github.com/magicleap/superpointpretrainednetwork

A fully convolutional deep neural network for detecting interest points and computing descriptors. This repository includes the pretrained network and a deployment script for sparse optical flow point tracking using SuperPointFrontend, PointTracker, and VideoStreamer.

Tokens
494
Snippets
1
Records
4
Agent score
31%

What's inside superpointpretrainednetwork

  1. How the SuperPoint demo works

    master

    The demo implements a sparse optical flow point tracker. It uses three main components:

    1. SuperPointFrontend: A helper class that runs the SuperPoint network on images to compute points and descriptors.
    2. PointTracker: A class that forms tracks by finding sequential pair-wise nearest neighbors using two-way matching of descriptors.
    3. VideoStreamer: A helper class that handles input from three stream types: a directory of images (e.g., .png, .jpg), a video file (e.g., .mp4, .avi), or a USB Webcam.

    The output is a sparse optical flow visualization.

  2. Reference: demo_superpoint.py command line parameters

    master

    The following flags are available for the demo_superpoint.py script:

    FlagDescription
    --HChange input image height (default: 120)
    --WChange input image width (default: 160)
    --display_scaleScale the output visualization image height and width (default: 2)
    --cudaEnable the GPU
    --img_globChange the image file extension (default: *.png)
    --min_lengthChange the minimum track length (default: 2)
    --max_lengthChange the maximum track length (default: 5)
    --conf_threshChange the point confidence threshold (default: 0.015)
    --nn_threshChange the descriptor matching distance threshold (default: 0.7)
    --show_extraShow more computer vision outputs
    --no_displayDisable visual display (useful for remote servers)
    --writeWrite the output to a directory
    --write_dirSpecify the directory to write output to
    --camidSpecify the USB Webcam ID (used with camera input)