How to cancel a streaming response?

[humphd]

The streaming support is great (thank you!), I'm using it like so:

      const chat = new ChatOpenAI({
        openAIApiKey: api_key,
        streaming: true,
        modelName: settings.model,
        callbackManager: CallbackManager.fromHandlers({
          handleLLMNewToken: streamHandler,
        }),
      });
      const response = await chat.call(messagesToSend);

My question is: how to I cancel this mid-response? I can't find anything in the docs/API, but maybe I'm missing it.

[JasperAlexander]

What's in streamHandler?

[humphd]

I figured this out, passing:

options: { signal: controller.signal }

[JasperAlexander]

Where is controller coming from?

[humphd]

const controller = new AbortController();
...
openAI.call([...], { options: { signal: controller.signal } });
...
controller.abort();

[thefranciscook]

I get a type error: Argument of type 'AbortSignal' is not assignable to parameter of type 'Callbacks | undefined'.

chain.call({
    ...chainValues
  }, 
  controller.signal
  );