Finite-State Text Processing

Weighted finite-state transducers (WFSTs) are commonly used by engineers and computational linguists for processing and generating speech and text. This book first provides a detailed introduction to this formalism. It then introduces Pynini, a Python library for compiling finite-state grammars and for combining, optimizing, applying, and searching finite-state transducers. This book illustrates this library's conventions and use with a series of case studies. These include the compilation and application of context-dependent rewrite rules, the construction of morphological analyzers and generators, and text generation and processing applications.

加權有限狀態轉換器（Weighted finite-state transducers，WFSTs）是工程師和計算語言學家常用於處理和生成語音和文本的工具。本書首先詳細介紹了這種形式化方法。然後介紹了Pynini，一個用於編譯有限狀態文法、結合、優化、應用和搜索有限狀態轉換器的Python庫。本書通過一系列案例研究展示了這個庫的慣例和使用方法。這些案例包括上下文相依重寫規則的編譯和應用、形態分析器和生成器的構建，以及文本生成和處理應用。