AI Novelist

To prevent context window overflow (common in LLMs at 4K-32K tokens) as a novel grows to 50+ chapters, AI Novelist automatically manages the prompt context:

• Recent Chapters: Full summaries of the last 3 chapters are preserved.
• Older Chapters: Earlier chapters are automatically compressed into a 200-word "long-term arc" summary.
• Worldview: The worldview context is automatically truncated at the head and tail if it exceeds 4000 words.

This ensures that the prompt size for Chapter 50 remains similar to Chapter 5, maintaining high generation quality without crashing the LLM.

To prevent prompts from exceeding the LLM's context window as a novel grows, AI Novelist uses a sliding-window context strategy:

1. Recent Context: The most recent 3 chapters are kept as full summaries.
2. Distant Context: Earlier chapters are compressed into a single ~200-word "distant arc" summary.
3. Worldview: The Worldview (lore) is truncated to include only the head and tail, capped at 4000 characters.

This ensures that the prompt size remains constant regardless of whether you are writing chapter 5 or chapter 50.

The Command Center is a real-time streaming interface for monitoring AI generation. Instead of waiting for a loading spinner, you see text being generated token-by-token.

Key capabilities include:

• Real-time Monitoring: Watch the AI's thought process and writing progress.
• Task Control: Pause a generation task to resume later.
• Dynamic Worldview Editing: If the AI makes a mistake (e.g., wrong character name), you can edit the worldview immediately. The updated settings will be used for the next chapter.
• Thought Library: View the plot outline the AI has planned for the current chapter.
• Pomodoro Timer: Includes a focus timer (25/5 pattern) for writing sessions.

The Console is the real-time interface for watching the AI write. It provides several interactive capabilities:

• Live Streaming: Watch the AI's prose being generated token-by-token.
• Pause/Resume: Stop the generation process and continue later.
• Worldview Editing: You can edit the 'Worldview' in the sidebar mid-stream. If the AI makes a mistake (e.g., misnaming a character), updating the Worldview ensures all subsequent chapters follow the corrected lore.
• Regeneration: You can click the ↻ icon next to any specific chapter to regenerate only that chapter without affecting the rest of the book.

This interaction loop allows for a highly collaborative 'co-writing' experience where the user manages the high-level lore and the AI manages the prose generation.

After installing and configuring your environment variables, start the server using the following command:

python main.py

Once running, access the web interface at http://127.0.0.1:5000 (or the address/port specified by AI_NOVEL_HOST and AI_NOVEL_PORT).

To install AI Novelist, clone the repository and install the required Python dependencies. This requires Python 3.8+.

git clone https://github.com/yourname/AI_Novel.git
cd AI_Novel
pip install -r requirements.txt

If you are running AI Novelist behind an Nginx reverse proxy, you must disable proxy buffering to allow the Server-Sent Events (SSE) used by the Live Console to function correctly.

location / {
    proxy_pass http://127.0.0.1:5000;
    proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
    proxy_buffering off;  # REQUIRED for SSE
    proxy_http_version 1.1;
}

location / {
    proxy_pass http://127.0.0.1:5000;
    proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
    proxy_buffering off;  # required for SSE
    proxy_http_version 1.1;
}

If you want to modify the underlying instructions used by the AI, you can edit the prompt templates directly in the source code:

1. Open app/prompts/templates.py.
2. Modify the desired template.
3. Restart the server for changes to take effect.
4. In the Works Library, use the ↻ (rewrite) button on a chapter to re-run it with the new prompt.

All generated content is stored locally in the works_library/ directory (or the path specified by WORKS_LIBRARY_PATH_OVERRIDE).

To back up your novels, simply copy the works_library/ folder. The content is stored as plain Markdown files.

You can share your completed works with others in a read-only mode:

1. Go to the Works Library (作品库).
2. Select your novel.
3. Click the 🔗 Share (分享) button at the top.
4. The link is automatically copied to your clipboard.

Note: Friends viewing the link see a pure reading mode without sidebars or tools. Links automatically expire after 7 days.