append_to_last_tokens() — langchain Function Reference

Architecture documentation for the append_to_last_tokens() function in streaming_aiter_final_only.py from the langchain codebase.

Function python LangChainCore MessageInterface called by 1

Entity Profile

LangChainCore→ MessageInterface→ append_to_last_tokens() — langchain Function Reference

Dependency Diagram

graph TD
  4dc80c25_f757_8f83_8d42_294e5414f053["append_to_last_tokens()"]
  8ff14092_eef3_abb2_55fb_ca2a28f79a83["AsyncFinalIteratorCallbackHandler"]
  4dc80c25_f757_8f83_8d42_294e5414f053 -->|defined in| 8ff14092_eef3_abb2_55fb_ca2a28f79a83
  fe1df244_d50d_c13f_7d61_a1e52666ad43["on_llm_new_token()"]
  fe1df244_d50d_c13f_7d61_a1e52666ad43 -->|calls| 4dc80c25_f757_8f83_8d42_294e5414f053
  style 4dc80c25_f757_8f83_8d42_294e5414f053 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/langchain/langchain_classic/callbacks/streaming_aiter_final_only.py lines 19–25

    def append_to_last_tokens(self, token: str) -> None:
        """Append token to the last tokens."""
        self.last_tokens.append(token)
        self.last_tokens_stripped.append(token.strip())
        if len(self.last_tokens) > len(self.answer_prefix_tokens):
            self.last_tokens.pop(0)
            self.last_tokens_stripped.pop(0)