Tracking usage in ConversationSummaryMemory?

[williamlmao]

Hi there!

I know that you can track totalTokens through callbackManager like so

  const model = new ChatOpenAI({
    callbackManager: CallbackManager.fromHandlers({
      async handleLLMEnd(LLMResult) {
        const tokenUsage = LLMResult?.llmOutput?.tokenUsage;
        console.log(
          `Total Tokens Used: ${tokenUsage.totalTokens}, Completion Tokens: ${tokenUsage.completionTokens}, Prompt Tokens: ${tokenUsage.promptTokens}`
        );
      },
    }),
  });

But if I'm using ConversationSummaryMemory, is there a way to track the additional usage of summarizing the conversation? I would like to be able to know the complete total token usage for each message. The prompt tokens, response tokens, summarization prompt tokens, summarization response tokens. Is this possible at this time?