U
|
L ±dø4 ã & @ s\ d Z ddlmZ ddlmZmZ G dd dZedddd d
|
d d gd dgdedddddddgddgdeddddddgdd gded d d d d!gd"d#gded$d%d d&d'd(d)gd*d+gded,d-d d&d'd(d)gd.d/gded0d1dd2d3gd4d5gded6d7d d&d(d)gd8gd9ed:d;dd<gd=d>gded?d@d d&d'd(d)gdAdBgdedCdDddEdFdGgdHdIgdedJdKd d&d'd(d)gdLdMgdedNdOd d&d'd(d)gdPdQdRgdedSdTddUdVgdWdXgdedYdZdd d!gd[d\gded]d^dd d!gd_d`gdedadbd d&d'd(d)gdcddgdededfddFdGdEgdgdhgdedidjddFdGdEgdkdlgdedmdndddddgdodpgdedqdrd d&d(d)gdsgd9edtdudd d!gdvdwgdedxdyd d&d'd(d)gdzd{gded|d}d d d!gd~dgdedddddddddgddgded
dd d d!gddgdedddd d!gddgdedddddddgdgdeddddddgddgdedddd<ddgddgdedd dd¡gd¢d£gdd¤ Zd¥S )¦zÓ
|
Metadata about languages used by our model training code for our
|
SingleByteCharSetProbers. Could be used for other things in the future.
|
|
This code is based on the language metadata from the uchardet project.
|
é )Ú ascii_letters)ÚListÚOptionalc s^ e Zd ZdZd
|
ee ee eeee ee eee dd fdd Zeddd Z Z
|
S ) ÚLanguagea Metadata about a language useful for training models
|
|
:ivar name: The human name for the language, in English.
|
:type name: str
|
:ivar iso_code: 2-letter ISO 639-1 if possible, 3-letter ISO code otherwise,
|
or use another catalog as a last resort.
|
:type iso_code: str
|
:ivar use_ascii: Whether or not ASCII letters should be included in trained
|
models.
|
:type use_ascii: bool
|
:ivar charsets: The charsets we want to support and create data for.
|
:type charsets: list of str
|
:ivar alphabet: The characters in the language's alphabet. If `use_ascii` is
|
`True`, you only need to add those not in the ASCII set.
|
:type alphabet: str
|
:ivar wiki_start_pages: The Wikipedia pages to start from if we're crawling
|
Wikipedia for training data.
|
:type wiki_start_pages: list of str
|
NT)ÚnameÚiso_codeÚ use_asciiÚcharsetsÚalphabetÚwiki_start_pagesÚreturnc sn t ¡ || _|| _|| _|| _| jr<|r6|t7 }qHt}n |sHtd|r^d t t
|
|¡nd | _ || _ d S )Nz*Must supply alphabet if use_ascii is FalseÚ ) ÚsuperÚ__init__r r r r r Ú
|
ValueErrorÚjoinÚsortedÚsetr
|
r )Úselfr r r r r
|
r ©Ú __class__© úQd:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\chardet/metadata/languages.pyr # s
|
|
zLanguage.__init__)r c C s. d dd | j ¡ D ¡}| jj d| dS )Nz, c s s* | ]"\}}| d ¡s| d|V qdS )Ú_ú=N)Ú
|
startswith)Ú.0ÚkÚvr r r Ú <genexpr>< s
|
z$Language.__repr__.<locals>.<genexpr>ú(ú))r Ú__dict__Úitemsr Ú__name__)r Z param_strr r r Ú__repr__; s
|
ÿzLanguage.__repr__)NNTNNN) r$ Ú
|
__module__Ú __qualname__Ú__doc__r ÚstrÚboolr r r% Ú __classcell__r r r r r s" ù
|
|
ør ÚArabicÚarFz
|
ISO-8859-6z WINDOWS-1256ZCP720ZCP864ub ءآأؤإئابةتثجØخدذرزسشصضطظعغػؼؽؾؿÙÙÙÙÙÙ
ÙÙÙÙÙÙÙÙÙÙÙÙu اÙصÙØØ©_اÙرئÙسÙØ©)r r r r r
|
r Ú
|
BelarusianÚbez
|
ISO-8859-5z WINDOWS-1251ÚIBM866Ú MacCyrillicu ÐÐÐÐÐÐÐÐÐÐÐÐÐÐÐÐÐРСТУÐФХЦЧШЫЬÐЮЯабвгдеÑжзÑйклмнопÑÑÑÑÑÑÑ
ÑÑÑÑÑÑÑÑʼu! ÐалоÑнаÑ_ÑÑаÑÐ¾Ð½ÐºÐ°Ú BulgarianÚbgÚIBM855ux ÐÐÐÐÐÐÐÐÐÐÐÐÐÐÐÐРСТУФХЦЧШЩЪЬЮЯабвгдежзийклмнопÑÑÑÑÑÑ
ÑÑÑÑÑÑÑÑu ÐаÑална_ÑÑÑаниÑаÚCzechÚczTz
|
ISO-8859-2z WINDOWS-1250u< áÄÄéÄÃÅóÅšťúůýžÃÄÄÃÄÃÅÃÅŠŤÃŮÎu HlavnÃ_stranaÚDanishÚdaz
|
ISO-8859-1z ISO-8859-15z WINDOWS-1252ZMacRomanu æøåÃÃÃ
ZForsideÚGermanÚdeu äöüÃáºÃÃÃzWikipedia:HauptseiteÚGreekÚelz
|
ISO-8859-7z WINDOWS-1253u αβγδεζηθικλμνξοÏÏÏÏÏÏ
ÏÏÏÏάÎήίÏÏÏÎÎÎÎÎÎÎÎÎÎÎÎÎÎÎΠΡΣΣΤΥΦΧΨΩÎÎÎÎÎÎÎu Î Ïλη:ÎÏÏιαÚEnglishÚenZ Main_Page)r r r r r Ú EsperantoÚeoz
|
ISO-8859-3uD abcÄdefgÄhÄ¥ijĵklmnoprsÅtuÅvzABCÄDEFGÄHĤIJÄ´KLMNOPRSÅTUŬVZu Vikipedio:ÄefpaÄoÚSpanishÚesu ñáéÃóúüÃÃÃÃÃÃÃzWikipedia:PortadaÚEstonianÚetz
|
ISO-8859-4z ISO-8859-13z WINDOWS-1257u6 ABDEGHIJKLMNOPRSTUVÃÃÃÃabdeghijklmnoprstuvõäöüZEsilehtÚFinnishÚfiu Ã
ÃÊŽåäöšžzWikipedia:EtusivuÚFrenchÚfru, Åà âçèéîïùûêÅÃÃÃÃÃÃÃÃÃÃu Wikipédia:Accueil_principalu BÅuf (animal)ÚHebrewÚhez
|
ISO-8859-8z WINDOWS-1255u< ××××××××××××××××× ×¡×¢×£×¤×¥×¦×§×¨×©×ª×°×±×²u ×¢×××_ר×ש×ÚCroatianÚhru@ abcÄÄdÄefghijklmnoprsÅ¡tuvzžABCÄÄDÄEFGHIJKLMNOPRSÅ TUVZŽZGlavna_stranicaÚ HungarianÚhuuP abcdefghijklmnoprstuvzáéÃóöÅúüűABCDEFGHIJKLMNOPRSTUVZÃÃÃÃÃÅÃÃÅ°u KezdÅlapÚItalianÚitu ÃÃÃÃÃÃÃà èéìòóùZPagina_principaleÚ
|
LithuanianÚltuR AÄBCÄDEÄÄFGHIÄ®YJKLMNOPRSÅ TUŲŪVZŽaÄ
bcÄdeÄÄfghiįyjklmnoprsÅ¡tuųūvzžZPagrindinis_puslapisÚLatvianÚlvuX AÄBCÄDEÄFGÄ¢HIĪJKĶLÄ»MNÅ
OPRSÅ TUŪVZŽaÄbcÄdeÄfgÄ£hiÄ«jkÄ·lļmnÅoprsÅ¡tuÅ«vzžu
|
SÄkumlapaÚ
|
MacedonianÚmku| ÐÐÐÐÐÐÐÐÐÐ
ÐÐÐÐÐÐÐÐÐÐРСТÐУФХЦЧÐШабвгдÑежзÑиÑклÑмнÑопÑÑÑÑÑÑÑ
ÑÑÑÑu Ðлавна_ÑÑÑаниÑаÚDutchÚnlZ HoofdpaginaÚPolishÚpluR AÄBCÄDEÄFGHIJKLÅMNÅOÃPRSÅTUWYZŹŻaÄ
bcÄdeÄfghijklÅmnÅoóprsÅtuwyzźżu Wikipedia:Strona_gÅównaÚ
|
PortugueseÚptu0 ÃÃÃÃÃÃÃÃÃÃÃÃáâãà çéêÃóôõúu Wikipédia:Página_principalÚRomanianÚrou ÄâîÈÈÄÃÃÈÈu Pagina_principalÄÚRussianÚruzKOI8-Ru абвгдеÑжзийклмнопÑÑÑÑÑÑ
ÑÑÑÑÑÑÑÑÑÑÐÐÐÐÐÐÐÐÐÐÐÐÐÐÐÐÐРСТУФХЦЧШЩЪЫЬÐЮЯu# ÐаглавнаÑ_ÑÑÑаниÑаÚSlovakÚskuD áäÄÄéÃĺľÅóôÅšťúýžÃÃÄÄÃÃĹĽÅÃÃÅŠŤÃÃŽu Hlavná_stránkaÚSloveneÚslu8 abcÄdefghijklmnoprsÅ¡tuvzžABCÄDEFGHIJKLMNOPRSÅ TUVZŽZ Glavna_stranÚSerbianÚsrux ÐÐÐÐÐÐÐÐÐÐÐÐÐÐÐÐÐÐÐРСТÐУФХЦЧÐШабвгдÑежзиÑклÑмнÑопÑÑÑÑÑÑÑ
ÑÑÑÑu Ðлавна_ÑÑÑана)r r r
|
r r ÚThaiÚthz ISO-8859-11zTIS-620ZCP874u à¸à¸à¸à¸à¸
à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸à¸ มยรฤลฦวศษสหฬà¸à¸®à¸¯à¸°à¸±à¸²à¸³à¸´à¸µà¸¶à¸·à¸ºà¸¸à¸¹à¸¿à¹à¹à¹à¹à¹à¹
à¹à¹à¹à¹à¹à¹à¹à¹à¹à¹à¹à¹à¹à¹à¹à¹à¹à¹à¹à¹à¹à¹u หà¸à¹à¸²à¸«à¸¥à¸±à¸ÚTurkishÚtrz
|
ISO-8859-9z WINDOWS-1254uR abcçdefgÄhıijklmnoöprsÅtuüvyzâîûABCÃDEFGÄHIÄ°JKLMNOÃPRSÅTUÃVYZÃÃÃZ Ana_SayfaÚ
|
VietnameseÚviz WINDOWS-1258uH aÄâbcdÄeêghiklmnoôơpqrstuÆ°vxyAÄÃBCDÄEÃGHIKLMNOÃÆ PQRSTUƯVXYu Chữ_Quá»c_ngữ) r, r. r2 r5 r7 r9 r; r= r? rA rC rE rG rI rK rM rO rQ rS rU rW rY r[ r] r_ ra rc re rg ri rk N)r( Ústringr Útypingr r r Z LANGUAGESr r r r Ú<module> s 5
|
ö
|
úúú
|
ú
|
úúûù
|
úø
|
|
ú
|
úúù ù
|
úù ù
|
úûù
|
úúúóúù
|
ûúù ê ú
|
