dot-create_wikitext_en: Process the Latest Wiktionary Dump File

.create_wikitext_enR Documentation

Process the Latest Wiktionary Dump File

Description

Using this package can result in a lot of hits to the wiktionary API. To reduce that burden, this function downloads and processes the entire wiktionary dump, to create a local version of the English words from the latest dump.

Usage

.create_wikitext_en()

Details

This function requires a lot of RAM and is very slow. It took about 4 hrs to complete on a machine with 64GB of RAM.

Note that the data generated in this process is copyright the Wikimedia Foundation, Inc, with a creative commons BY-SA license. See https://foundation.wikimedia.org/wiki/Terms_of_Use/en for more details.

Value

A logical scalar (invisibly) indicating whether the data was updated.


jonthegeek/wikimorphemes documentation built on Sept. 1, 2022, 10:32 p.m.