节点与集成
Token Splitter
The Token Splitter node splits a raw text string by first converting the text into BPE tokens, then splits these tokens into chunks and converts the tokens within a single chunk back into text.
On this page, you'll find the node parameters for the Token Splitter node, and links to more resources.
Node parameters
- Chunk Size: Enter the number of characters in each chunk.
- Chunk Overlap: Enter how much overlap to have between chunks.
Templates and examples
Browse Token Splitter node documentation integration templates or search all templates
Related resources
Refer to LangChain's token documentation and LangChain's text splitter documentation for more information about the service.
View n8n's Advanced AI documentation.
官方原文和授权
本页来自 N8N 英文官方网站固定快照，并转换成 xueai 静态页面。内容以 N8N 持续更新的官方页面为准。