DOCSEARCHbyAlgolia
Submit Docs

FastKafka Documentation

website·Indexed 34 days ago

https://fastkafka.airt.ai/

A framework for integrating Apache Kafka into web services, featuring asynchronous message handling via @consumes and @produces decorators. It provides built-in support for Pydantic models, Avro and JSON encoding/decoding, benchmarking tools, and a Tester class for application verification. Compatible with FastAPI and deployable via Docker.

Tokens
175.2K
Snippets
878
Records
1.1K
Agent score
41%

What's inside FastKafka

  1. Overview of message encoding and decoding in FastKafka

    FastKafka uses Pydantic models to define message schemas. Since Kafka transmits data as bytes, FastKafka provides mechanisms to encode Pydantic model instances into bytes (producing) and decode bytes back into Pydantic model instances (consuming). This is configured via the encoder and decoder parameters in the @produces and @consumes decorators.

  4. Overview of fastkafka.encoder.AvroBase

    AvroBase is a base Pydantic class that provides specialized methods for Avro encoding. It inherits from Pydantic's BaseModel, meaning it supports all standard Pydantic functionality (such as model_dump, model_copy, and model_construct) while adding Avro schema generation capabilities.

  5. Overview of message encoding and decoding in FastKafka

    FastKafka uses Pydantic models to define message schemas. Since Kafka transmits data as bytes, FastKafka provides mechanisms to encode Pydantic model instances into bytes (producing) and decode bytes back into Pydantic model instances (consuming). This is configured via the encoder and decoder parameters in the @produces and @consumes decorators.

  6. Overview of FastKafka and Redpanda integration

    FastKafka is a Python library for building asynchronous Kafka services, utilizing Pydantic for data parsing and AIOKafka for networking. Redpanda serves as a Kafka-compatible, JVM-free, and ZooKeeper-free drop-in replacement, making it suitable for high-performance streaming and simplified testing environments.

  7. Overview of message encoding and decoding in FastKafka

    FastKafka uses Pydantic models to define message schemas. Because Kafka transmits data as bytes, FastKafka provides mechanisms to encode Pydantic model instances into bytes for producing and decode bytes back into Pydantic models for consuming. This is handled via the encoder and decoder parameters in the @produces and @consumes decorators.

  10. Overview of message encoding and decoding in FastKafka

    FastKafka uses Pydantic models to define message schemas. Because Kafka transmits data as bytes, FastKafka provides mechanisms to encode Pydantic model instances into bytes (producing) and decode bytes back into Pydantic model instances (consuming). This is configured via the encoder and decoder parameters in the @produces and @consumes decorators.

  11. Overview of message encoding and decoding in FastKafka

    FastKafka uses Pydantic models to define message schemas. Since Kafka transmits data as bytes, FastKafka provides mechanisms to encode Pydantic model instances into bytes (producing) and decode bytes back into Pydantic model instances (consuming). This is configured via the encoder and decoder parameters in the @consumes and @produces decorators.