SkyWay SDK Documentation

website·Indexed 42 days ago

https://skyway.ntt.com/ja/docs

A WebRTC platform providing SDKs and APIs to implement video, audio, and data communication. Documentation covers JavaScript, iOS, Android, Linux, and Unity SDKs, including guides on Room management, LocalStream creation, and token-based authentication via SkyWay Auth Tokens.

Tokens
89.6K
Snippets
400
Records
613
Agent score
66%

What's inside SkyWay

  1. Overview of SkyWay Channel API

    The SkyWay Channel API allows server-side creation and retrieval of SkyWay Channels. It is compliant with the JSON-RPC 2.0 specification.

    Deprecation Notice: This API is deprecated. Users are encouraged to migrate to the SkyWay Room API.

  2. Overview of SkyWay Recording

    SkyWay Recording allows you to record audio and video transmitted via an SFU and upload the generated files to a specified cloud storage. To use this feature, you must interact with the Recording API (REST API) from your own server.

    Key Technical Specifications:

    • Base URL: https://recording.skyway.ntt.com
    • Supported File Format: WebM
    • Supported Codecs: VP8, H264, OPUS (DTX is enabled by default).
    • Communication Mode: Supports communication where media data passes through an SFU. For P2P Room calls, a recording-specific SFU Room must be used simultaneously.
  3. Overview of SkyWay JavaScript SDK Libraries

    The SkyWay JavaScript SDK for web applications consists of two primary libraries:

    • Room Library: Provides access to all SkyWay features for real-time communication.
    • Token Library: A utility library used to generate authentication and authorization tokens. Note: This library uses secret keys and should be handled with caution when used in frontend environments.
  4. Overview of skyway_ros_bridge

    skyway_ros_bridge is an open-source reference implementation of a ROS node using the SkyWay Linux SDK. It enables real-time bidirectional communication between SkyWay and ROS topics:

    • SkyWay VideoStream $\leftrightarrow$ ROS sensor_msgs/Image or sensor_msgs/CompressedImage topics
    • SkyWay DataStream $\leftrightarrow$ ROS std_msgs/String topics
  5. Overview of SkyWay Speech to Text (STT)

    SkyWay STT allows developers to transcribe voice calls in real-time using a dedicated library. Key features include:

    • Real-time processing: Low-latency transcription delivered at the end of each speech segment.
    • Speaker Identification: Transcription results are linked to the specific speaker.
    • Translation: Ability to obtain both the original transcription and a translation into a specified language.
    • Archiving: Session transcriptions can be saved as JSONL files to cloud storage after the session ends.

    For users on the Free plan, this feature must be requested via the project details in the SkyWay Console. Note that end-user consent is required for transcription per SkyWay Terms of Service Article 36.

  6. Overview of SkyWay Auth Token authentication flow

    SkyWay uses token-based authentication and authorization to ensure end-users can only perform permitted operations. The typical flow is:

    1. The end-user sends authentication credentials (e.g., session token, password) to the application's backend server.
    2. The backend server authenticates the user.
    3. The backend server generates a SkyWay Auth Token with permissions appropriate for that user.
    4. The backend server sends the token to the frontend application.
    5. The frontend application configures the SkyWay SDK with the token for subsequent requests.

    To prevent tampering, tokens must be signed using a secret key obtained from the SkyWay Console application list screen.

  7. Overview of SkyWay SDK and API

    SkyWay is a set of SDKs and APIs designed to easily implement video, audio, and data communication features into applications. It consists of various SDKs tailored for different platforms and multiple server APIs that facilitate communication.
  8. Overview of SkyWay Room API

    The SkyWay Room API is a server-side API for performing operations on SkyWay Rooms. It is compliant with the JSON-RPC 2.0 specification. Note that the SkyWay Channel API is deprecated and users should use the Room API instead.
  9. Overview of SkyWay Webhook functionality

    SkyWay Webhooks allow users to receive real-time event notifications via HTTP requests sent from SkyWay to a user-specified server. This eliminates the need for polling APIs to track state changes. Supported events include:

    • Room events: Room creation, member joining/leaving, Stream publishing, and Publication subscribing.
    • Recording events: Start and end of audio/video recording sessions.
  10. Overview of SkyWay Console

    The SkyWay Console is a centralized management tool for projects and their associated applications. It allows developers to issue secret keys required for SDK usage and monitor service utilization.
  11. Overview of SkyWay AI Noise Canceller

    SkyWay AI Noise Canceller is a library developed by NTT Laboratories designed to suppress various types of audio noise to ensure clear communication. It is used in conjunction with the SkyWay SDK to perform client-side noise suppression on audio captured from a microphone before it is transmitted over the network.