Jitsu Documentation

Jitsu is an open-source event data platform (an alternative to Segment) that collects event data from websites, apps, and servers, and delivers it to data warehouses and SaaS tools.

Key features include:

• Event collection: Via SDKs, HTTP API, or a Segment proxy.
• Destination delivery: Streams or micro-batches data to ClickHouse, BigQuery, Snowflake, Redshift, Postgres, S3, GCS, and more.
• Functions: JavaScript-based transformations, filtering, and enrichment that run on every event.
• Connector syncs: Airbyte-compatible connectors to pull data into your warehouse.
• Identity Graph: Automatically builds user profiles from the event stream.
• Live Events: Real-time debugging of pipelines, function logs, and destination writes.
• MCP Server: Allows AI agents to configure and operate pipelines.

Jitsu processes events through a sequential 3-step pipeline to filter, transform, and enrich data before it reaches its destination:

1. Step 1: Builtin Transformations: System-level functions like Identity Stitching (merging user identities across sessions) that run first.
2. Step 2: User Defined Function (UDF) Pipeline: Custom JavaScript functions executed sequentially. These can be used to Filter (exclude data), Transform (modify structure), or Enrich (add external data) events.
3. Step 3: Builtin Destination Function: The final step that sends the processed event to the configured destination (e.g., Mixpanel, Amplitude, BigQuery, ClickHouse, etc.).

Jitsu consists of several independently scalable services:

Data Layer:

• Postgres: Configuration
• Kafka/Redpanda: Event bus
• ClickHouse: Live events and metrics
• MongoDB: Profiles

Use orderedmap.NewOrderedMap[K, V]() to create a high-performance ordered map that maintains amortized O(1) complexity for Set, Get, Delete, and Len operations.

Requirements:

• Requires Go v1.18 or higher for generics support. For Go 1.17 or below, use v1 of the package.

import "github.com/elliotchance/orderedmap/v2"

func main() {
	m := orderedmap.NewOrderedMap[string, any]()

	m.Set("foo", "bar")
	m.Set("qux", 1.23)
	m.Set("123", true)

	m.Delete("qux")
}

Jitsu Cloud is a hosted version of the platform. The free tier includes 200k events/month, unlimited destinations, and a free ClickHouse instance.

To get started with a workspace:

1. Create a site (a stream) and retrieve your write key.
2. Add a destination (e.g., ClickHouse, BigQuery, Snowflake, Postgres, S3) from the destination catalog.
3. Start sending events using one of the supported methods (HTML snippet, @jitsu/js, @jitsu/jitsu-react, HTTP API, or Segment proxy).

To start all necessary Jitsu services for exploration or development, use the following command. Once running, access the main UI at http://localhost:3000.

Default Credentials:

• Email: admin@jitsu.com
• Password: admin123

Note: This setup is for exploration and development only. For production, refer to the official self-hosting production deployment guide.

docker compose -f ./docker/docker-compose.yml up --force-recreate

Builtin transformation and destination functions follow strict error handling rules. Errors are logged to the destination log and can result in events being sent to dead-letter storage or a retry queue.

• Standard Error: Any standard error results in the event being sent to dead-letter storage (viewable in the UI Live Events section).
• RetryError: Throwing a RetryError sends the event to the retry queue. After a successful retry, processing resumes from the failed step with any payload changes retained.

throw new RetryError("Temporary failure");