Extension:UniversalLanguageSelector/km added to category
New page
<languages />
{{TNT|Extension
|status = stable
|type1 = interface
|type2 = skin
|hook1 = BeforePageDisplay
|hook2 = PersonalUrls
|hook3 = ResourceLoaderTestModules
|hook4 = ResourceLoaderGetConfigVars
|hook5 = MakeGlobalVariablesScript
|hook6 = UserGetLanguageObject
|hook7 = SkinTemplateOutputPageBeforeExec
|hook8 = EnterMobileMode
|hook9 = GetPreferences
|hook10 = GetBetaFeaturePreferences
|username =
|author = [[Special:MyLanguage/Wikimedia Language engineering|Wikimedia Language engineering]]
|description = Tool that allows users to select a language and configure its support in an easy way.
|image =
|imagesize =
|version =
|update = 2013-04-30
|mediawiki = 1.25+
|php =
|composer = mediawiki/universal-language-selector
|license = {{EL|GNUGPL2+}}, {{EL|MIT}}
|download = {{TNT|WikimediaDownload}}
[[Special:MyLanguage/MLEB|Included in Language Extension Bundle]]
|needs-updatephp = No
|readme =
|changelog =
|parameters =
|tags =
|rights =
|example =
|compatibility = [[gerrit:66330|Not compatible with Internet Explorer 7 or lower]].
|phabricator = MediaWiki-extensions-UniversalLanguageSelector
|type3 = beta feature
}}
The '''Universal Language Selector''' is a tool that allows users to select a language and configure its support in an easy way. Where used, it also ships the functionality of both [[Special:MyLanguage/Extension:WebFonts|WebFonts]] and [[Special:MyLanguage/Extension:Narayam|Narayam]] extensions (both of which have been deprecated in favour of Universal Language Selector).
See [[Special:MyLanguage/Universal Language Selector|Universal Language Selector]] for background and additional information.
==Usage==
The primary aim is to allow users to select a language and configure its support in an easy way.
The extension provides the following features:
# Flexible and easy way to select a language from a large set of languages.
## Selection can be based on geographical region based browsing, searching.
## Search can be based on ISO language code, language name written in current user interface language or in its own script(autonym)
## Cross language search - search language names using any script
## Autocompletion of language names
## Auto correction of spelling mistakes in search strings
## Geo IP based language suggestions
## Language selection based on users browser/OS language
# Input methods
#:See [[Help:Extension:UniversalLanguageSelector/Input methods|Help:Extension:UniversalLanguageSelector/Input methods]] for complete instructions.
## An easily selectable input method collection, readily available in every editable field
## Provides a large set of input methods for wide range of languages
##* An outdated list is available at [[Extension:Narayam#Supported schemes|Extension:Narayam#Supported schemes]]
## Per-language input method preferences
# Webfonts
## A large collection of fonts to choose for each language to use as embedded font for the page
##* An outdated list is available at [[Extension:WebFonts#Supported languages|Extension:WebFonts#Supported languages]]
##* You can browse [https://git.wikimedia.org/tree/mediawiki%2Fextensions%2FUniversalLanguageSelector/HEAD/data%2Ffontrepo%2Ffonts all the fonts included]
## Per-language font preferences
[[File:ULS-GeoIP.png|400px|thumb|right|Universal Language Selector with geoip based language suggestion for a user from Spain]]
[[File:ULS-Display-Settings.png|thumb|right|400px|Language settings allow a registered user accessing English Wikipedia to change the UI to his native language.]]
[[File:ULS-Font-Settings-new.png|thumb|right|400px|A Bengali user is able to read content from the Bengali Wikipedia despite the lack of fonts in his computer. Web fonts are provided automatically for non-latin scripts for which an open source font is available. The user can decide to use their system fonts on a per language basis.]]
[[File:ULS-Input-Settings.png|thumb|right|400px|A Hindi speaker without a Hindi keyboard configures input methods so that he can type in his language.]]
[[File:ULS-Input-Search.png|thumb|220px|right|When searching a user can switch between English and Hindi.]]
==Adding fonts==
Supporting more languages is only a matter of including the proper fonts in the code. However, please note that we will add support only for ''freely licensed'' fonts, for example fonts licensed under GNU GPL, SIL OFL, etc. An example directory of such free fonts is [https://www.google.com/fonts#AboutPlace:about Google Fonts] [https://www.google.com/fonts/earlyaccess] (not yet fully examined/exploited by the authors of this extension); see also the [http://openfontlibrary.org/ Open Font Library].
First of all, you need to find or produce such a free font (this is the most important part and you have to do it yourself); then, it has to be converted to the required formats, which are eot, ttf, woff; finally, you can [https://phabricator.wikimedia.org/maniphest/task/create/?projects=MediaWiki-extensions-UniversalLanguageSelector file a request] in [[Special:MyLanguage/Phabricator|Phabricator]] for the font to be added to the extension.
[[#Preparing webfonts|#Preparing webfonts]] below explains how to convert the fonts: basic knowledge about GNU/Linux based operating system is required; if you have difficulty in doing this, you can skip this step and ask someone else to do it for you on the same Phabricator request (of course this will slow down the process).
{{anchor|Preparing webfonts}}
===Preparing webfonts===
[https://code.google.com/p/sfntly/ Sfntly] is required for creating web fonts (command line only).
Once installed, following commands can be used.
'''Creating .woff:'''
<code>java -jar /path/to/sfnttool.jar -w xyz.ttf xyz.woff</code>
'''Creating .eot:'''
<code>java -jar /path/to/sfnttool.jar -e -x xyz.ttf xyz.eot</code>
{{TNT|note}} For some languages, the font size can be very big, with careful testing, we can remove all hinting instructions to reduce the size, by passing -h option to above tool usage.
<code>java -jar /path/to/sfnttool.jar -e -h -x xyz.ttf xyz.eot</code>
Create a font.ini file. Here's an example:
<syntaxhighlight lang="rust" style="overflow:auto;">
[AbyssinicaSIL]
languages=am*, ti*
version=1.200
license=OFL 1.1
licensefile=OFL.txt
url=http://scripts.sil.org/AbyssinicaSIL
</syntaxhighlight>
An asterisk (<code>*</code>) after a language code means that this font will be the default font for that language. If you just want the option to use this font for that language, don't use the asterisk.
After creating the files, do the following:
# Create a directory for the font under data/fontrepo/fonts.
# Put the ttf, woff, eot and font.ini files in that directory and add them to the source repository (<code>git add</code>).
# Go to data/fontrepo/scripts and run <code>php compile.php</code>.
# Commit the changes to the repository (<code>git commit -a</code>) and submit them according to the [[Special:MyLanguage/Git/TLDR|Git workflow]].
==Adding support for a new key mapping (input method)==
Follow the [https://github.com/wikimedia/jquery.ime/wiki/Technical-Specification#input-method-definition instructions on the jquery.ime github wiki], but file requests in the Wikimedia-extensions-UniversalLanguageSelector [[Special:MyLanguage/Phabricator|Phabricator]] product.
==Download==
{{TNT|WikimediaGitCheckout|UniversalLanguageSelector}}
==Installation==
{{TNT|ExtensionInstall}}
=== Updating LanguageNameIndex ===
For performing cross language search, searching [[w:Endonym|autonyms]], language data needs to be populated. ULS comes with a pre-populated language name index(data/langnames.ser). In case you want to update it, install [[Special:MyLanguage/Extension:CLDR|Extension:CLDR]] and update the data with the following command.
<pre style="overflow:auto;">php UniversalLanguageSelector/data/LanguageNameIndexer.php</pre>
and verify that '''langnames.ser''' file gets generated in ULS/data/ folder.
==Configuration==
The following variables are created automatically during initialization and can be used from JavaScript using mw.config.get( NAME ):
* <code>wgULSLanguages</code> - an associative array where the keys are language codes and the values are language names in English.
* <code>wgULSAcceptLanguageList</code> - an array of language codes from the user's Accept-Language value. These are the languages selected in the user's browser preferences.
For serving fonts, you might want to add the following mime types to your webserver if not already there. [http://www.webcoder.de/2010/06/04/how-to-configure-your-webserver-for-webm-video-and-audio-files/ This guide] might help.
<pre style="overflow:auto;">
application/x-font-woff .woff
application/vnd.ms-fontobject .eot
application/x-font-ttf .ttf
</pre>
The following variables can also be configured:
* <code>$wgULSGeoService</code>- ULS can use geolocation services to suggest languages based on the country the user is visiting from. Setting this to false will prevent builtin geolocation from being used. You can provide your own geolocation by setting window.Geo to object which has key 'country_code' or 'country'. If set to true, it will query Wikimedia's geoip service. The service should return jsonp that uses the supplied callback parameter. Defaults to http://freegeoip.net/json/ and expects the same format.
* <code>$wgULSEnable</code> - Enable language selection, input methods and webfonts for everyone, unless the behavior is overridden by the configuration variables below. Even if false the classes and resource loader modules are registered for the use of other extensions. Language changing via cookie or setlang query parameter is not possible.
* <code>$wgULSAnonCanChangeLanguage</code> - Allow anonymous users to change language with cookie and setlang query param. Do not use if you are caching anonymous page views without taking cookies into account.Does not have any effect if either of <code>$wgULSEnable</code> or $wgULSEnableAnon is set to false.
* <code>$wgULSIMEEnabled</code> - Disable the input methods feature for all users by default. Can still be enabled manually by the user.
* <code>$wgULSPosition</code> - The location and the form of the language selection trigger. The possible values are: <code>personal</code>: as a link near the username or the log in link in the personal toolbar (default). <code>interlanguage</code>: as an icon near the header of the list of interlanguage links in the sidebar.
* <code>$wgULSNoImeSelectors</code> - Array of jQuery selectors of elements on which IME must not be enabled. eg: <code>array( '#wpCaptchaWord' );</code>
=== Position of ULS trigger ===
* <code>$wgULSPosition</code> - The location and the form of the language selection trigger. The possible values are: <code>personal</code>: as a link near the username or the log in link in the personal toolbar (default). <code>interlanguage</code>: as an icon near the header of the list of interlanguage links in the sidebar.
It is also possible to have ULS trigger anywhere in the screen. An element with <code>uls-settings-trigger</code> will act as a ULS trigger.
===Overriding default fonts===
ULS has a large font repository to serve as webfonts. Sometimes there are multiple fonts for a language and there is a default font for each language/script. The order of fonts or default font can be overridden as follows using global scripts (MediaWiki:Common.js) or personal scripts (Special:MyPage/common.js):
<code>$.webfonts.repository.languages.languageCode = ["system", "FontA", "FontB"];</code>
Here, languageCode should be a valid language code(eg: en, hi, nl). FontA and FontB are fonts available in font repository. In the above example for languageCode, we set a font available in local computer as default font. ie No default webfont.
===Caching configuration===
To ensure that the web fonts files are cached on the clients' machines, font file types must be added to the web server configuration. In Apache2 this consists of:
* Adding font file extensions to the FileTimes regex at FilesMatch for the relevant directory, example:
<code><nowiki><FilesMatch "\.(gif|jpe?g|png|css|js|woff|svg|eot|ttf)$"></nowiki></code>
* Adding ExpiresByType values to the relevant MIME types, similarly to image MIME types.
** Note that there's no standard MIME type for TTF. application/x-font-ttf is used for Wikimedia.
* Adding the MIME types:
<pre style="overflow:auto;">
AddType application/x-woff .woff
AddType application/vnd.ms-fontobject .eot
AddType application/x-font-ttf .ttf
</pre>
For a full example see the [https://gerrit.wikimedia.org/r/#patch,unified,657,1,files/apache/apache2.conf.appserver caching configuration update done for the Wikimedia cluster].
=== Page translation ===
UniversalLanguageSelector is one of the dependencies of the [[Special:MyLanguage/Extension:Translate|Translate extension]], which uses it for several language selection features. One of it is the [[Special:MyLanguage/MyLanguage|MyLanguage]] system for links, which depends on the interface language of the user, but more can be configured: see [[Special:MyLanguage/Help:Extension:Translate/Configuration#Page translation feature|Page translation feature]].
== Using Webfonts ==
User can choose webfonts for a language from the Language settings -> Display settings. By default, the first font in that menu will be applied to the wiki. A user can change the font and it will be remembered across the pages. Optionally user can disable the font embedding too by selecting system font.
If the font is available in user's local system, '''font will not be downloaded''' from the mediawiki server. It will be taken from the user's computer. Otherwise, font will be downloaded from the server only once. ie when the user selects the font first time. Next time onwards, font will be taken from the local cache.
=== Alternate ways to load fonts ===
==== By specifying font-family ====
Inside the wiki text <nowiki><span style="font-family:'YourFontName';">YourText</span></nowiki>, webfonts extension will check whether the font is available with the extension, if so it will download it to the client. So the reader will not face any difficulty in reading the text even if the font specified is not available in their computer.
==== By specifying language ====
Inside the wiki text <nowiki><span lang="my">YourText</span></nowiki>, webfonts extension will check whether any font is available for the given language with the extension, if so it will download it to the client. So the reader will not face any difficulty in reading the text even if the font specified is not available in their computer. If there are multiple fonts for the language, the default font will be used. If default font is not preferred, use the font-family approach to specify the font. If the tag has both lang and font-family definitions, font-family get precedence.
Example:
<nowiki><span lang=sux>