VRCT Documentation

website·Indexed 30 days ago

https://misyaguziya.github.io/VRCT-Docs/

Documentation for VRCT (v3.5.1), a real-time transcription and translation tool for VRChat. Features include Speaker2Log for capturing system audio, multi-target language translation, LLM-based translation engines, WebSocket integration, OBS browser source for subtitles, and VRC mute synchronization via OSC.

Tokens
102.6K
Snippets
108
Records
965
Agent score
65%

What's inside VRCT

  1. Overview of VRCT translation software

    VRCT (v3.4.3) is a software utility designed to facilitate conversations between users speaking different languages within VRChat. It provides real-time chat and voice translation. While primarily designed for VRChat, it can also be used for other purposes, such as translating movies.
  2. Overview of Speaker2Log transcription

    Speaker2Log allows users to capture audio from a selected speaker/audio output device and convert it into text. This is primarily used to capture and read VRChat voice chat from other players. The process involves three steps: transcribing audio to text, translating the text (if enabled), and displaying the result in the chat history.
  3. Overview of VRCT Overlay Mode

    Overlay Mode allows users to display the VRCT interface directly within a VR headset while playing VRChat. This enables viewing translations and chat history without leaving the VR environment. It supports two display modes:

    • Single line Mode: Displays one line of text at a time (received messages only) for quick glances.
    • Multiple lines Mode: Displays several lines of text to provide more conversation context.
  4. Overview of VRC Mute Sync

    VRC Mute Sync automatically synchronizes the microphone mute status between VRChat and VRCT. When enabled, it detects mute/unmute actions in VRChat and automatically toggles VRCT's transcription (Voice2Chatbox). This prevents transcribed text from being sent to the chatbox while the user is muted in VRChat, ensuring privacy during breaks or private conversations.
  5. Overview of Voice2Chatbox (Voice-to-Text)

    Voice2Chatbox allows users to speak into a microphone and have VRCT convert that audio to text, translate it (if enabled), and send the resulting message to the VRChat chatbox using OSC. The process follows these steps: 1. Capture audio from the selected microphone, 2. Transcribe audio to text, 3. Translate text (optional), 4. Send to VRChat chatbox via OSC.
  6. Overview of VRCT Configuration Tabs

    The VRCT Configuration Window is divided into several tabs, each managing a specific area of the application:

    • Device Tab: Manage audio input and output devices.
    • Appearance Tab: Customize the look and feel of the application.
    • Translation Tab: Configure translation engines.
    • Transcription Tab: Configure transcription engines.
    • VR Tab: Configure VR-related settings, primarily focusing on overlays.
    • Other Tab: Miscellaneous general settings.
    • Hotkeys Tab: Configure keyboard shortcuts for various VRCT actions.
    • Plugins Tab: Manage VRCT plugin configuration options.
    • Advanced Tab: Access advanced configuration options for VRCT.
  7. Overview of VRCT features and purpose

    VRCT is a software tool designed to support conversations between people speaking different languages, primarily within VRChat (though it is also used for other purposes like movie watching). Its core capabilities include:

    • Chat Functionality: Enables text chatting within VRChat.
    • Real-time Translation: Translates VRChat voice conversations in real-time and displays them as text.
    • Microphone/Speaker Transcription: Converts speech to text to record conversation content.
    • Multi-language Support: Supports multiple languages to bridge communication gaps between users.
    • Customization: Provides various settings to improve the user experience.
  8. Overview of VRC Mute Sync

    VRC Mute Sync automatically synchronizes the microphone mute status between VRChat and VRCT. When enabled, it detects mute/unmute actions in VRChat via OSC parameters and avatar parameters, automatically enabling or disabling VRCT transcription (Voice2Chatbox). This prevents transcribed text from being sent when the user is muted in VRChat.
  9. Overview of VRCT Transcription Features

    VRCT includes two primary transcription modes:

    • Voice to Text (Voice2Chatbox): Converts the user's microphone input into text.
    • Speaker to Text (Speaker2Log): Transcribes system audio output into text.
  10. Overview of VRCT Customization and Privacy

    Users can customize VRCT through Language Presets for quick switching between language combinations and Appearance Customization to modify the UI. The application also includes a Telemetry system for anonymous usage statistics.
  11. Overview of Voice Typing Mode

    Voice Typing Mode allows users to input text into active VR applications by speaking. The system captures audio via the microphone, transcribes it to text, copies the text to the system clipboard, and automatically pastes it into the active VR application. This works in any VR application that supports clipboard operations, regardless of whether OSC integration is enabled.