o šº¥gIã@sŠddlmZejZejZejZejZejZejZejZej Z ej Z ej Z ej Z ej Z ejZejZejZeeeedœZdedefdd„ZdS)é)Ú normalizers)ÚnfcÚnfdÚnfkcÚnfkdÚ normalizerÚreturncCs&|tvrtd |t ¡¡ƒ‚t|ƒS)Nz6{} is not a known unicode normalizer. Available are {})Ú NORMALIZERSÚ ValueErrorÚformatÚkeys)r©r úV/var/www/visachat/venv/lib/python3.10/site-packages/tokenizers/normalizers/__init__.pyÚunicode_normalizer_from_strs ÿ rN)ÚrÚ NormalizerÚBertNormalizerÚNFDÚNFKDÚNFCÚNFKCÚSequenceÚ LowercaseÚPrependÚStripÚ StripAccentsÚNmtÚ PrecompiledÚReplaceÚ ByteLevelr Ústrrr r r rÚs$