Language

SentencePieceNormalizer コンストラクター

定義

SentencePieceNormalizer オブジェクトを作成します。

public SentencePieceNormalizer(bool removeExtraWhiteSpaces, bool addDummyPrefix, bool escapeWhiteSpaces, bool treatWhitespaceAsSuffix, System.Collections.Generic.IReadOnlyDictionary<string,int>? specialTokens);
new Microsoft.ML.Tokenizers.SentencePieceNormalizer : bool * bool * bool * bool * System.Collections.Generic.IReadOnlyDictionary<string, int> -> Microsoft.ML.Tokenizers.SentencePieceNormalizer
Public Sub New (removeExtraWhiteSpaces As Boolean, addDummyPrefix As Boolean, escapeWhiteSpaces As Boolean, treatWhitespaceAsSuffix As Boolean, specialTokens As IReadOnlyDictionary(Of String, Integer))

パラメーター

removeExtraWhiteSpaces
Boolean
addDummyPrefix
Boolean
escapeWhiteSpaces
Boolean
treatWhitespaceAsSuffix
Boolean

適用対象