LinguaLibre

Difference between revisions of "Language codes systems used across LinguaLibre"

The current page serves to gather language codes systems uses within or by LinguaLibre's community.

Line 1: Line 1:
 +
{{#Subtitle:The current page serves to gather language codes systems uses within or by LinguaLibre's community.}}
 +
 
== List of codes used ==
 
== List of codes used ==
 
Codes used by Lingualibre or useful for users and developers to know.
 
Codes used by Lingualibre or useful for users and developers to know.
 
{| class="wikitable sortable"
 
{| class="wikitable sortable"
! Acronym || Name || Description || Reference page
+
! Acronym || English name || Description || Reference page
 
|-
 
|-
| iso639-3 || || Internation Stardard Organization's language code with 3 letters || [[:en:List of ISO 639-2 codes|List of ISO 639-2 codes]], column 2
+
| iso639-3 || || Internation Stardard Organization's language code with 3 letters || Full:[[:en:Wikipedia:WikiProject_Languages/List_of_ISO_639-3_language_codes_(2019)|:en:List of ISO 639-3 language codes (2019)]]<br>Short:[[:en:List of ISO 639-2 codes]], column 2
 
|-
 
|-
 
| Qid || Wikidata Qid || Qid for each language on Wikidata.org, also this language page's title.  || [[LinguaLibre:List_of_languages]]
 
| Qid || Wikidata Qid || Qid for each language on Wikidata.org, also this language page's title.  || [[LinguaLibre:List_of_languages]]
Line 10: Line 12:
 
| Lid || Lingualibre Qid || Qid for each language imported to Lingualibre.org, also this language page's title. || [[LinguaLibre:List_of_languages]]  
 
| Lid || Lingualibre Qid || Qid for each language imported to Lingualibre.org, also this language page's title. || [[LinguaLibre:List_of_languages]]  
 
|-
 
|-
| wikis || Wikipedia prefixes || Wikipedia.org subdomain prefixes for language-specific wikis || :en:[[:en:List of Wikipedias#Edition details|List of Wikipedias#Edition details]], column 3
+
| wikis || Wikipedia prefixes || Wikipedia.org subdomain prefixes for language-specific wikis || [[:en:List of Wikipedias#Edition details]], column 3
 
|-
 
|-
| IETF BCP47 || || Language codes uses by Google's Corpuscrawler and UNILEX || [https://github.com/google/corpuscrawler Google/corpuscrawler]
+
| IETF || IETF BCP 47 language tag || ''Internet Engineering Task Force'' (IETF)'s created ''Best Current Pracices 47'' language codes on the basis of existing ISO 639, ISO 3166 and ISO 15924 standards.  || [[:en:IETF language tag]]
 
|}
 
|}
  
 
== Languages lists using language codes ==
 
== Languages lists using language codes ==
 
{| class="wikitable sortable"
 
{| class="wikitable sortable"
! Page || Quantity || iso639-3 || Qid || Lid || wikis || ?
+
! Page || Quantity || iso639-3 || Qid || Lid || wikis || IETF
 
|-
 
|-
 
| [[LinguaLibre:List of languages]] || 100+ || yes || yes || yes || yes || no  
 
| [[LinguaLibre:List of languages]] || 100+ || yes || yes || yes || yes || no  
Line 27: Line 29:
 
| [https://github.com/unicode-org/unilex/ Unicode-org/UNILEX] || 1,000 || no || no || no || no || yes
 
| [https://github.com/unicode-org/unilex/ Unicode-org/UNILEX] || 1,000 || no || no || no || no || yes
 
|-  
 
|-  
| [https://github.com/hugolpz/Dragons_Bot/blob/main/languages.js Dragons_Bot/languages.js] || 1,000 || ? || no || no || yes || yes
+
| [https://github.com/hugolpz/Dragons_Bot/blob/main/languages.js Dragons_Bot/languages.js] || 1,000 || yes || no || no || no || yes
 
|-  
 
|-  
 
| [https://opus.nlpl.eu/OpenSubtitles-v2018.php Open Subtitles 2018]<ref>Open subtitles 2018 languages: `af,ar,bg,bn,br,bs,ca,cs,da,de,el,en,eo,es,et,eu,fa,fi,fr,gl,he,hi,hr,hu,hy,id,is,it,ja,ka,kk,ko,lt,lv,mk,ml,ms,nl,no,pl,pt,pt_br,ro,ru,si,sk,sl,sq,sr,sv,ta,te,th,tl,tr,uk,ur,vi,ze_en,ze_zh,zh_cn,zh_tw`</ref> || 63 || ? || no || no || no || ?
 
| [https://opus.nlpl.eu/OpenSubtitles-v2018.php Open Subtitles 2018]<ref>Open subtitles 2018 languages: `af,ar,bg,bn,br,bs,ca,cs,da,de,el,en,eo,es,et,eu,fa,fi,fr,gl,he,hi,hr,hu,hy,id,is,it,ja,ka,kk,ko,lt,lv,mk,ml,ms,nl,no,pl,pt,pt_br,ro,ru,si,sk,sl,sq,sr,sv,ta,te,th,tl,tr,uk,ur,vi,ze_en,ze_zh,zh_cn,zh_tw`</ref> || 63 || ? || no || no || no || ?

Revision as of 16:52, 4 March 2021


List of codes used

Codes used by Lingualibre or useful for users and developers to know.

Acronym English name Description Reference page
iso639-3 Internation Stardard Organization's language code with 3 letters Full::en:List of ISO 639-3 language codes (2019)
Short:en:List of ISO 639-2 codes, column 2
Qid Wikidata Qid Qid for each language on Wikidata.org, also this language page's title. LinguaLibre:List_of_languages
Lid Lingualibre Qid Qid for each language imported to Lingualibre.org, also this language page's title. LinguaLibre:List_of_languages
wikis Wikipedia prefixes Wikipedia.org subdomain prefixes for language-specific wikis en:List of Wikipedias#Edition details, column 3
IETF IETF BCP 47 language tag Internet Engineering Task Force (IETF)'s created Best Current Pracices 47 language codes on the basis of existing ISO 639, ISO 3166 and ISO 15924 standards. en:IETF language tag

Languages lists using language codes

Page Quantity iso639-3 Qid Lid wikis IETF
LinguaLibre:List of languages 100+ yes yes yes yes no
:en:Listof Wikipedias#Edition details ~300 no no no yes no
Google/corpuscrawler 1,001 no no no no yes
Unicode-org/UNILEX 1,000 no no no no yes
Dragons_Bot/languages.js 1,000 yes no no no yes
Open Subtitles 2018[1] 63 ? no no no ?

See also

References

  1. Open subtitles 2018 languages: `af,ar,bg,bn,br,bs,ca,cs,da,de,el,en,eo,es,et,eu,fa,fi,fr,gl,he,hi,hr,hu,hy,id,is,it,ja,ka,kk,ko,lt,lv,mk,ml,ms,nl,no,pl,pt,pt_br,ro,ru,si,sk,sl,sq,sr,sv,ta,te,th,tl,tr,uk,ur,vi,ze_en,ze_zh,zh_cn,zh_tw`