Skip to content

[BUG] Stop does not work on OpenAI Compatible API Provider #404

Description

@Fuzzillogic

Problem (one or two sentences)

Stopping an in-progress question or task does not abort the underlying HTTP request to the provider. The provider continues processing / generating tokens, invisible to the user.

This bug was already reported on Roo code: RooCodeInc/Roo-Code#10779. It still is present in Zoo code 3.56.0.

Context (who is affected and when)

OpenAI API users. I use llama.cpp on a iGPU as local solution (a propos, dedicated support for llama.cpp would be welcome at some point) which now continues its lengthy process even though I hit the stop button in Zoo.

Reproduction steps

  1. Configure OpenAI API compatible provider, e.g. local llama.cpp setup
  2. Give Zoo a prompt
  3. Hit the stop button.

Expected result

Underlying HTTP request is immediatly aborted

Actual result

Underlying HTTP request continues until the end, consuming precious resources, while of no benefit to the user.

Variations tried (optional)

No response

App Version

3.56.0

API Provider (optional)

OpenAI Compatible

Model Used (optional)

N/A

Zoo Code Task Links (optional)

No response

Relevant logs or errors (optional)

If I quit VS Code, the (stopped, but continuing) request is immediately terminated, as is shown in the log of llama.cpp:


1332.16.787.326 W srv          stop: cancel task, id_task = 153
1332.20.921.482 I slot      release: id  0 | task 153 | stop processing: n_tokens = 4096, truncated = 0
1332.20.921.542 I srv  update_slots: all slots are idle

Activity

  1. proyectoauraorg commented on Jun 1, 2026

    @proyectoauraorg
    Contributor

    Claiming.

    I've identified the root cause: the and do not create an or pass an abort signal to the underlying OpenAI SDK / AI SDK requests. When the user hits Stop, the Task-level breaks out of the stream loop, but the HTTP request continues running server-side until it finishes naturally.

    In contrast, and both correctly create an and pass to their API calls.

    Fix plan:

    1. Add to both and
    2. Create the controller in / , pass to the SDK calls
    3. Check in the stream iteration loop
    4. Add abort support
    5. Regression tests

    Will follow up with a PR shortly.

  2. 175 remaining items

  3. EuphoricPenguin commented on Oct 5, 2026

    @EuphoricPenguin

    #1651 was supposed to fix this issue, but unless it isn't on the prerelease version of Zoo Code yet, this is still an issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions