AI备忘录 - Tokenization理解[译] 的评论
type: channel
link: https://www.aiuai.cn/aifarm2111.html
description: 原文：Understanding Tokenization in NLP - 2023.07.05Tokenization 是将一连串的文字( a stream of text)分解为单词(wo...