View source for Weekly updates

== Week 24 ==
I've continued the work on linking Lingua Libre to the WM projects:
* Finalize the Wikimedia Category word generator;
* Develop a Lingua Libre Bot connector for the French Wiktionary
* Ask the bot flag on the French Wiktionary and discussions on the bot's implementation

== Week 23 ==
This week, I've focused on the reuse of sounds from Lingua Libre on WM wikis:
* Create a new generator to extract word lists from WP / WT categories
* Fix a categorization issue on the template on Commons
* Bot:
** Creation of [https://meta.wikimedia.org/wiki/User:Lingua_Libre_Bot Lingua Libre Bot]
** Create a new [https://github.com/lingua-libre/Lingua-Libre-Bot Git repository] for it
** Create a main structure, which manage command-line arguments, records fetching and dispatching
** Develop a wikidata connector
** First discussions with the frwiktionary community to setup a bot connection for this wiki

== Week 22 ==
* Create a new phabricator project
** Issue centralisation and sorting
* Enhance the UX of the ''publish'' step:
** Replace the html5 <audio> player by a custom button
** Add a ''remove'' button next-to each records
** Reword the ''next'' button in ''publish on Commons'' to be clearer
* Support ''#''-separated lists as input inside the word input field, in the details step
* Manage homograph words by allowing contributors to add qualifiers inside brackets after the transcription of the word
* Many tests and bug chasing

== Week 21 ==
I attended this week-end to the Wikimedia Hackathon in Barcelona.
* Outreach:
** Introduce Lingua Libre to many people, including WMDe and WMF teams;
** Talked about the best way to integrate Lingua Libre with the incoming ''Lexeme on Wikidata'' and ''Structured Data on Commons'';
** Did ~500 records of words in Catalan, French, Occitan and Fon-gbe languages;
** Introduce Lingua Libre during the showcase;
* Tech:
** Use internally Wikidata Qid as language identifier rather than ISO 693-3 codes;
** Fix the first bugs repported.
** Add a favicon
** Enhance the [https://commons.wikimedia.org/wiki/Template:Lingua_Libre_record Template:Lingua Libre record] on commons; add i18n support and machine-readable encoding
* Move legacy version of Lingua Libre to https://v1.lingualibre.fr

== Week 20 ==
This week was focus on the preparations for the launch of the beta version.
* Improve the help pages structure, and create the main ones;
* Finish the microphone checker in the RecordWizard;
* Setup content translation of the pages which needs it;
* Setup a new production environment
** Duplicate the code-base and configuration files;
** Duplicate the database and do a bit cleanup of all tests inside it;
** Import ~400 languages from wikidata (more to come later);
* Communication on Lingua Libre's social networks;
<big>'''<big>⇒</big> The first public beta version of Lingua Libre is out!'''</big>

== Week 19 ==
* Many tests and bugfix;
* OAuth:
** R&d and enhancements around its configuration;
** Ask for the needed tokens, to be able to connect and upload files on Wikimedia Commons;
* Turn the first step of the RecordWizard in a microphone checker.

== Week 18 ==
This week was focused on code quality improvement (in anticipation of the public beta release):
* Document more the code I've written so far;
* Switch JS scripts to strict mode;
* Plug in ESLint to the project and fix all the lint errors.

== Week 17 ==
* Some LinguaLibre outreach at the WikiWorkshop (holding place during the web conference in Lyon);
* Many minor server configuration improvements;
* Meeting with Remy from Wikimédia France to start thinking about a communication plan.


== Week 16 ==
* Some LinguaLibre outreach at the Wikimedia pre-hackathon in Montpellier;
* Create a wikidata item selector;
** Switch all location fields of the RecordWizard to use wikidata items;
* Enhance the sparql endpoint configuration.

== Week 15 ==
* Turn the query display script into a MediaWiki extension, to improve performance and reusability:
** Code available here: [https://github.com/lingua-libre/QueryViz QueryViz on github];
** Add a new <code><nowiki><query></nowiki></code> tag to the parser;
** See a usage example [[DataViz:Records|here]] ([https://v2.lingualibre.fr/index.php?title=DataViz:Records&action=edit code]). 
** Add some userfriendly filtering capabilities to the results, using an optional in-query syntax, for example: <syntaxhighlight lang="sparql">#extra:{"type": "wikibase-item", "filter":"Q3", "label": "P5", "multiple": true} ?record prop:P5 entity:[EXTRA] .</syntaxhighlight>
* Create more turnkey sparql queries, see [[DataViz:Stats]].

== Week 14 ==
* Setup a blazegraph sparql endpoint, using the following documentation pages: [https://github.com/wikimedia/wikidata-query-rdf/blob/master/docs/getting-started.md], [https://github.com/wikimedia/wikidata-query-rdf/blob/master/docs/configs.md] and [https://www.mediawiki.org/wiki/Wikidata_query_service/Implementation];
** Blazegraph's default GUI allowing anyone to perform requests: https://sparql.0x010c.fr/bigdata/#query
** LinguaLibre uses the following prefixes by default:
{{Colapse|1=prefixes.conf|2=<syntaxhighlight lang="sparql">
PREFIX entity: <https://v2.lingualibre.fr/entity/>
PREFIX prop: <https://v2.lingualibre.fr/prop/direct/>
PREFIX statement: <https://v2.lingualibre.fr/entity/statement/>
PREFIX wikibase: <http://wikiba.se/ontology#>
PREFIX llp: <https://v2.lingualibre.fr/prop/>
PREFIX llv: <https://v2.lingualibre.fr/prop/statement/>
PREFIX llq: <https://v2.lingualibre.fr/prop/qualifier/>
PREFIX wd: <http://www.wikidata.org/entity/>
PREFIX wdt: <http://www.wikidata.org/prop/direct/>
</syntaxhighlight>}}
* Some demo queries are available on [[LinguaLibre:Sparql]] (including some federated queries with Wikidata!);
* Integration of query results directly inside LinguaLibre pages:
** Two examples: [[DataViz:Records]] and [[DataViz:Locutors]];
** Thanks to a [[Special:Diff/Template:DataViz|JS script]] in the [[Mediawiki:Common.js]], everybody can display it's own query results on any pages by using the [[Template:DataViz]] with his query in the ''query'' parameter.

== Week 13 ==
* Small bugfixes on the RecordWizard;
* Start a testing period of the [[Special:RecordWizard|RecordWizard]]:
** feedbacks can be made here: https://lite.framacalc.org/ligualibre2018;
** note that all records made during this period are stored on a development wiki and will be erased at the end of the test;
* Back to the skin:
** Switch from ''timeless'' to [[:mw:Skin:Foreground|Foreground]], which is also responsive but lighter, closer to the visual identity we want and easier to customize;
** Start to customize it to LinguaLibre's colors, and tweak the navigation bar.

== Week 12 ==
A big week to compensate for week 11. The RecordWizard has reached a first stable version at the end of this week. That will allow us next week to launch a first testing period on a small group.
* create a second generator, based on lists in a new ''List:'' namespace;
* deep reorganization of the step 2 and 3:
** We had before a ''Details'' step, which contained both the speaker's information and the record parameters; and a ''License'' step, which contained only a license agreement;
** This caused many issues, in term of UX (we had to disable some fields the time the user fills the previous ones), performance/code complexity (each interactions of the users needed to be tracked to update/disable some other fields) and code readability for the ''Details'' step (way too many elements in one class);
** This has changed to have a first ''Locutor'' step, which contains only the details about the speaker and his license agreement; and a ''Details'' step, which contains the record parameters. This organization is way more balanced, logical and easy to understand for the end user;
* Add an optional list randomizer;
* Add a license picker, using the standard [[Mediawiki:Licenses]] as a configuration page;
* implement the locutor profile and add a profile picker;
* consolidate the wikibase item saving process:
** manage secondary locutors;
** smart update if an item already exists (for the locutor and the records);
** factorization and cleaning of some wikibase API interactions;
* add a placeholder for the ''Tutorial'' step;
* Translate all messages into French;
* Format correctly output to Wikimedia Commons (file titles and descriptions);
* many small bug fixes during the whole week.

== Week 11 ==
Due to personal reason, the work this week was a little shortened, this has been corrected on week 12. But the work on the RecordWizard still continues:
* r&d on the internal structure and mechanisms of wikibase;
* continue and finish the work around data search in wikibase;
* a wikibase item is created for each locutor and record (but it will not update yet if it already exists);
* create some needed structural wikibase items.

== Week 10 ==
The work on the RecordWizard continues:
* enrich the word-list structure to be able to store word-related metadatas;
* add LocalSettings options to let sysadmin configure the RecordWizard, instead of using hardcoded values;
* start the connexion with the wikibase by pulling some datas;
* create a locutor profile structure and save it to the user preferences.

== Week 9 ==
The work on the RecordWizard continues:
* UI research and implementation tests for the ''Details'' step;
* Develop the concept of generator;
** Technical design:
*** Generators are JS components intended to dynamically provide a list of words to record inside the RecordWizard;
*** They should inherit the generic <code>mw.recordWizard.generator.Generator</code> class;
*** They can be registered from anywhere, including site-wide scripts like [[MediaWiki:Common.js]] or gadgets, by adding it to the <code>mw.recordWizard.generator</code> object;
*** Each one can ask for user inputs inside a dialog box.
** Implemented it inside the Details step;
** Create a first generator to show of capacities, ''Nearby items'', which fetch words from wikidata items geographically around the user.

== Week 8 ==
The work on the RecordWizard continues:
* Implement a controller and a ui to the studio step;
* Plug the UploadManager class and the new Upload2Commons extension to the studio;
* Improve the step managment;
* Improve the UX in particular through:
** an auto-scroll
** small voice amplitude graphs
** keyboard controllable actions (start/stop with the spacebar, move to the next/previous word with the arrows,...);
* Add a full warning and error handling;
* See the [https://github.com/lingua-libre/RecordWizard/commits/496f200792f72e5e0293547278df907ef0f96817 last 24 commits] on the RecordWizard repository.

== Week 7 ==
* Start to develop the core of the RecordWizard:
** Create an UploadManager;
** Setup a step controller and a step ui parent class (inspired from what the UploadWizard does);
** Initialize 6 empty steps: tutorial, details, license, studio, confirm, thanks.

== Week 6 ==
* Develop another extension, ''Upload2Commons'', to add a new module to the API, which allow a user to upload a local file to a remote wiki through OAuth:
** source code available on it's [https://github.com/lingua-libre/Upload2Commons git repository];
** test it on the [[Special:ApiSandbox#action=upload-to-commons|ApiSandbox]];
** all remote uploads leave an entry in a dedicated log: [[Special:Log/remoteupload]];
** see module documentation: {{Colapse|1=Doc from [[Special:ApiHelp/upload-to-commons]]|2={{Special:ApiHelp/upload-to-commons}}}}
* add a feature in the oauthclient-php library: [https://phabricator.wikimedia.org/T186739 T186739]

== Week 5 ==
* Many enhancements to LinguaRecorder:
** Add new export methods (Wav-encoded blob, client-download, ''<audio>'' element,...);
** Comment the code and document the whole library;
** Create a sandbox to easily demonstrate all the features;
** Test and add support to old browsers (Firefox 25+, Chrome 22+,... see the complete list [https://github.com/lingua-libre/LinguaRecorder#browser-compatibility here]).
* Present LinguaLibre during the monthly [[meta:Wikimedia Foundation metrics and activities meetings/2018-01|Wikimedia Foundation metrics and activities meetings]]

== Week 4 ==
* Create a npm package for LinguaRecorder: https://www.npmjs.com/package/lingua-recorder
* Add debugging tools to Mediawiki.
* Add [[:mw:Extension:TimedMedia|TimedMedia]] ans [[:mw:MediaWiki Language Extension Bundle|translation-related]] extensions.
* Manage permissions: allow only the users with the ''upload'' right to use the RecordWizard.
* Setup a basic recording studio.

== Week 3 ==
* Setup the server with a fresh primary MediaWiki installation to use as a development environment, accessible at https://v2.lingualibre.fr.
* Install the [[:mw:Extension:OAuthAuthentication|OAuthAuthentication extension]] to delegate the login to an other wiki. Here are the settings currently in use inside the LocalSettings.php file:{{Colapse|1=LocalSettings.php configuration|2=<syntaxhighlight lang="php">
# Remove the default TemporaryPassword and LocalPassword authentication provider
# to let OAuth as the only authentication provider usable.
$wgAuthManagerAutoConfig['primaryauth'] = [];

# Activate the OAuthAuthentication extension
wfLoadExtension( 'OAuthAuthentication' );

$wgOAuthAuthenticationUrl = 'https://oauth.0x010c.fr/index.php?title=Special:OAuth';
$wgOAuthAuthenticationConsumerKey = '<consumer_key>';
$wgOAuthAuthenticationConsumerSecret = '<consumer_secret>';
$wgOAuthAuthenticationCanonicalUrl = 'https://oauth.0x010c.fr';
$wgOAuthAuthenticationRemoteName = 'OauthWiki';
$wgOAuthAuthenticationAllowLocalUsers = false;
$wgOAuthAuthenticationReplaceLoginLink = true;
</syntaxhighlight>}}
* Setup a secondary MediaWiki installation to be used by the first one as a remote authentication provider (to replace Wikimedia Commons during the development phase), accessible at https://oauth.0x010c.fr.
* Install the [[:mw:Wikibase|Wikibase extension]]. Here is it's LocalSettings.php configuration:{{Colapse|1=LocalSettings.php configuration|2=<syntaxhighlight lang="php">
# Activate the Wikibase Repository extension
$wgEnableWikibaseRepo = true;
$wgEnableWikibaseClient = false;
require_once "$IP/extensions/Wikibase/repo/Wikibase.php";
require_once "$IP/extensions/Wikibase/repo/ExampleSettings.php";

# Create a new namespace to host properties
define( 'WB_NS_PROPERTY', 102 );
define( 'WB_NS_PROPERTY_TALK', 103 );

$wgExtraNamespaces[WB_NS_PROPERTY] = 'Property';
$wgExtraNamespaces[WB_NS_PROPERTY_TALK] = 'Property_talk';

# Store the items in the main namespace, the properties in their newly created one
$wgWBRepoSettings['entityNamespaces']['item'] = NS_MAIN;
$wgWBRepoSettings['entityNamespaces']['property'] = WB_NS_PROPERTY;

# We don't need sitelinks
$wgWBRepoSettings['siteLinkGroups'] = array();

# see https://github.com/wikimedia/mediawiki-extensions-Wikibase/blob/master/docs/options.wiki
$wgWBRepoSettings['formatterUrlProperty'] = 'P20';</syntaxhighlight>}}
* Draft the datastructure and create the first property/items needed.
* Install the [[:mw:Skin:Timeless|timeless skin]].
* First commit to initialize the new [https://github.com/lingua-libre/RecordWizard RecordWizard extension].
* Split the recording studio out of the LinguaLibre repository, to it's own new repo, [https://github.com/lingua-libre/LinguaRecorder LinguaRecorder].

== See also ==
{{Technicals}}
[[Category:Technical reports]]
[[Category:Lingua Libre history]]