byte pair encoding

名词 n.

英文释义

名词 n.
  1. A lossless data compression algorithm that iteratively replaces the most frequent pair of adjacent bytes in a sequence with a new byte not already present in the data. countable,uncountable
  2. A subword tokenization method that iteratively merges the most frequent pairs of adjacent characters in a corpus to form longer and more meaningful tokens, typically until a predefined vocabulary size is reached. countable,uncountable

词形变化

byte pair encodings plural byte-pair encoding alternative
0 次浏览 数据来源: Wiktionary