# ComfyUI_Fill-ChatterBox

If you enjoy this project, consider supporting me on Patreon!
<p align="left">
  <a href="https://www.patreon.com/c/Machinedelusions">
    <img src="assets/Patreon.png" width="150px" alt="Patreon">
  </a>
</p>

A custom node extension for ComfyUI that adds text-to-speech (TTS) and voice conversion (VC) capabilities using the Chatterbox library.
Supports a MAXIMUM of 40 seconds. Iv tried removing this limitation, but the model falls apart really badly with anything longer than that, so it remains.

![ChatterBox Example](web/image.png)

## Installation

1. Clone this repository into your ComfyUI custom_nodes directory:
   ```bash
   cd /path/to/ComfyUI/custom_nodes
   git clone https://github.com/filliptm/ComfyUI_Fill-ChatterBox.git
   ```

2. Install the base dependencies:
   ```bash
   pip install -r ComfyUI_Fill-ChatterBox/requirements.txt
   ```

3. (Optional) Install watermarking support:
   ```bash
   pip install resemble-perth
   ```
   **Note**: The `resemble-perth` package may have compatibility issues with Python 3.12+. If you encounter import errors, the nodes will still function without watermarking.


## Usage

### Text-to-Speech Node (FL Chatterbox TTS)
- Add the "FL Chatterbox TTS" node to your workflow
- Configure text input and parameters (exaggeration, cfg_weight, temperature)
- Optionally provide an audio prompt for voice cloning

### Voice Conversion Node (FL Chatterbox VC)
- Add the "FL Chatterbox VC" node to your workflow
- Connect input audio and target voice
- Both nodes support CPU fallback if CUDA errors occur

### Dialog TTS Node (FL Chatterbox Dialog TTS)
- Add the "FL Chatterbox Dialog TTS" node to your workflow.
- This node is designed to synthesize speech for dialogs with up to 4 distinct speakers (SPEAKER A, SPEAKER B, SPEAKER C, and SPEAKER D).
- **Inputs:**
    - `dialog_text`: A multiline string where each line is prefixed by `SPEAKER A:`, `SPEAKER B:`, `SPEAKER C:`, or `SPEAKER D:`. For example:
      ```
      SPEAKER A: Hello, how are you?
      SPEAKER B: I am fine, thank you!
      SPEAKER C: What about you, Speaker D?
      SPEAKER D: I'm doing great as well!
      SPEAKER A: That's wonderful to hear.
      ```
    - `speaker_a_prompt`: An audio prompt (AUDIO type) for SPEAKER A's voice (required).
    - `speaker_b_prompt`: An audio prompt (AUDIO type) for SPEAKER B's voice (required).
    - `speaker_c_prompt`: An audio prompt (AUDIO type) for SPEAKER C's voice (optional).
    - `speaker_d_prompt`: An audio prompt (AUDIO type) for SPEAKER D's voice (optional).
    - `exaggeration`: Controls emotion intensity (0.25-2.0).
    - `cfg_weight`: Controls pace/classifier-free guidance (0.2-1.0).
    - `temperature`: Controls randomness in generation (0.05-5.0).
    - `use_cpu` (optional): Boolean, defaults to False. Forces CPU usage.
    - `keep_model_loaded` (optional): Boolean, defaults to False. Keeps the model loaded in memory.
- **Outputs:**
    - `dialog_audio`: Combined audio with all speakers
    - `speaker_a_audio`: Isolated track for Speaker A (with silence for other speakers)
    - `speaker_b_audio`: Isolated track for Speaker B (with silence for other speakers)
    - `speaker_c_audio`: Isolated track for Speaker C (with silence for other speakers)
    - `speaker_d_audio`: Isolated track for Speaker D (with silence for other speakers)
- **Note:** SPEAKER C and SPEAKER D are optional. If their audio prompts are not provided, any dialog lines with "SPEAKER C:" or "SPEAKER D:" will be skipped.

## Change Log

### 7/24/2025
- Added Dialog TTS node that handles up to 4 speakers (A, B, C, D) for conversation-style audio creation
- Extended all nodes (TTS, VC, Dialog) with seed parameters for reproducible generation
- SPEAKER C and SPEAKER D are optional in Dialog node - allows flexible 2-4 speaker conversations
- Each speaker gets isolated audio track output for advanced audio editing workflows

### 6/24/2025
- Added seed parameter to both TTS and VC nodes for reproducible generation
- Seed range: 0 to 4,294,967,295 (32-bit integer)
- Enables consistent audio output for debugging and workflow control
- Made Perth watermarking optional to fix Python 3.12+ compatibility issues
- Nodes now function without watermarking if resemble-perth import fails

### 5/31/2025
- Added Persistent model loading, and loading bar functionality
- Added Mac support (needs to be tested so HMU)
- removed the chatterbox-tts library and implemented native inference code.