LinguaLibre

Difference between revisions of "Language codes systems used across LinguaLibre"

The current page gathers language codes systems used within or by LinguaLibre's community and tools. An emphasis is made to allow interoperability between resources, by pairing codes with their version in another's system.

Line 2: Line 2:
  
 
== List of codes used ==
 
== List of codes used ==
Codes systems used by Lingualibre or useful for users and developers to know. The <code>Acronym</code>s are recommendations, when coding, put this all into lower case.
+
Codes systems used by Lingualibre or useful for users and developers to know. The <code>Short</code> column presents recommendations especially useful to follow when coding on open source code.
 
{| class="wikitable sortable"
 
{| class="wikitable sortable"
! Acronym || English name || Description || Reference page
+
! Short || English name || Description || Reference page
 
|-
 
|-
 
| iso639-3 || ISO 639-3 || Internation Stardard Organization's language codes based on 3-letters codes. || Full:[[:en:Wikipedia:WikiProject_Languages/List_of_ISO_639-3_language_codes_(2019)|:en:List of ISO 639-3 language codes (2019)]]<br>Short:[[:en:List of ISO 639-2 codes]], column 2
 
| iso639-3 || ISO 639-3 || Internation Stardard Organization's language codes based on 3-letters codes. || Full:[[:en:Wikipedia:WikiProject_Languages/List_of_ISO_639-3_language_codes_(2019)|:en:List of ISO 639-3 language codes (2019)]]<br>Short:[[:en:List of ISO 639-2 codes]], column 2
 
|-
 
|-
| Qid || Wikidata Qid || Qid for each language on Wikidata.org, also this language page's title.  || [[LinguaLibre:List of languages]]
+
| qid || Wikidata Qid || Qid for each language on Wikidata.org, also this language page's title.  || [[LinguaLibre:List of languages]]
 
|-
 
|-
| Lid || Lingualibre Qid || Qid for each language imported to Lingualibre.org, also this language page's title. || [[LinguaLibre:List of languages]]  
+
| lid || Lingualibre Qid || Qid for each language imported to Lingualibre.org, also this language page's title. || [[LinguaLibre:List of languages]]  
 
|-
 
|-
| wikis || Wikipedia prefixes || Wikipedia.org subdomain prefixes for language-specific wikis || [[:en:List of Wikipedias#Edition details]], column 3<br> [[LinguaLibre:List of languages]]  
+
| wiki || Wikipedia prefixes || Wikipedia.org subdomain prefixes for language-specific wikis || [[:en:List of Wikipedias#Edition details]], column 3<br> [[LinguaLibre:List of languages]]  
 
|-
 
|-
| IETF || IETF BCP 47 language tag || ''Internet Engineering Task Force'' (IETF)'s created ''Best Current Pracices 47'' language codes on the basis of existing ISO 639, ISO 3166 and ISO 15924 standards.  || [[:en:IETF language tag]]
+
| ietf || IETF BCP 47 language tag || ''Internet Engineering Task Force'' (IETF)'s created ''Best Current Pracices 47'' language codes on the basis of existing ISO 639, ISO 3166 and ISO 15924 standards.  || [[:en:IETF language tag]]
 
|}
 
|}
  

Revision as of 17:35, 4 March 2021


List of codes used

Codes systems used by Lingualibre or useful for users and developers to know. The Short column presents recommendations especially useful to follow when coding on open source code.

Short English name Description Reference page
iso639-3 ISO 639-3 Internation Stardard Organization's language codes based on 3-letters codes. Full::en:List of ISO 639-3 language codes (2019)
Short:en:List of ISO 639-2 codes, column 2
qid Wikidata Qid Qid for each language on Wikidata.org, also this language page's title. LinguaLibre:List of languages
lid Lingualibre Qid Qid for each language imported to Lingualibre.org, also this language page's title. LinguaLibre:List of languages
wiki Wikipedia prefixes Wikipedia.org subdomain prefixes for language-specific wikis en:List of Wikipedias#Edition details, column 3
LinguaLibre:List of languages
ietf IETF BCP 47 language tag Internet Engineering Task Force (IETF)'s created Best Current Pracices 47 language codes on the basis of existing ISO 639, ISO 3166 and ISO 15924 standards. en:IETF language tag

Languages lists using language codes

Page Quantity iso369-2 iso639-3 Qid Lid wikis IETF
LinguaLibre:List of languages 100+ no yes yes yes yes no
:en:Listof Wikipedias#Edition details ~300 no no no no yes no
Google/corpuscrawler 1,001 no no no no no yes
Unicode-org/UNILEX 1,000 no no no no no yes
Dragons_Bot/languages.js 1,000 no yes no no no yes
Open Subtitles 2018[1] 63 mostly[2] no no no no no

See also

References

  1. Open subtitles 2018 languages: `af,ar,bg,bn,br,bs,ca,cs,da,de,el,en,eo,es,et,eu,fa,fi,fr,gl,he,hi,hr,hu,hy,id,is,it,ja,ka,kk,ko,lt,lv,mk,ml,ms,nl,no,pl,pt,pt_br,ro,ru,si,sk,sl,sq,sr,sv,ta,te,th,tl,tr,uk,ur,vi,ze_en,ze_zh,zh_cn,zh_tw`
  2. https://opus.nlpl.eu/trac/wiki/DataFormats.html