标准摘要
[中文适用范围]： ISO 24614-1 中定义的词分割基本概念和通用原则适用于中文、日文和韩文。为了对语言资源执行某些计算应用，如自然语言处理、信息检索 (IR) 和机器翻译 (MT)，需要将文本分割为标记、词、短语或其他类型的较小文本单元。本部分 ISO 24614 仅限于将文本分割为词或其他词分割单元 (WSU)。此任务本身不同于形态或句法分析，尽管它很大程度上依赖于形态句法分析。它也不同于构建词典框架并识别其词典条目（即词目和词形）的任务，后者的框架由 ISO 24611、ISO 24613 和 ISO 24615 提供。本部分 ISO 24614 的主要目标是规定界定中文、日文和韩文 WSU 的规则。有些规则是这三种语言通用的，尽管每种语言也有其识别 WSU 的独特规则。通用特征在第 5 章讨论，然后独特的规则在第 6 章针对中文、第 7 章针对日文和第 8 章针对韩文列出。 [外文原描述]： The basic concepts and general principles of word segmentation as defined in ISO 24614-1 apply to Chinese, Japanese and Korean. Text needs to be segmented into tokens, words, phrases or some other types of smaller textual units in order to perform certain computational applications on language resources, such as natural language processing, information retrieval and machine translation. ISO 24614-2:2011 is restricted to the segmentation of a text into words or other word segmentation units (WSUs). This task is distinct from morphological or syntactic analysis per se , although it greatly depends on morphosyntactic analysis. It is also different from the task of laying out a framework for constructing a lexicon and identifying its lexical entries, namely lemmas and lexemes. The frameworks for the latter tasks are provided by ISO 24611, ISO 24613 and ISO 24615. ISO 24614-2:2011 specifies rules for delineating WSUs for Chinese, Japanese and Korean. Some rules are common to all three languages, though each language also has its own distinct rules for identifying WSUs. The common features are discussed, then the distinct rules are laid out for Chinese, for Japanese and for Korean.
英文名称Language resource management — Word segmentation of written texts — Part 2: Word segmentation for Chinese, Japanese and Korean