For example using this Wikipedia dump:
Is there an existing library for Python that I can use to create an array with the mapping of subjects and values?
For example:
{height_ft,6},{nationality, American}
9 Answers
WikiExtractor appears to be a clean, simple, and efficient way to do this in Python today: https://github.com/attardi/wikiextractor
It provides an easy way to parse a Wikipedia dump into a simple file structure like so:
<doc>...</doc>
<doc>...</doc>
...
<doc>...</doc>
...where each doc looks like:
<doc id="2" url="http://it.wikipedia.org/wiki/Harmonium">
Harmonium.
L'harmonium è uno strumento musicale azionato con una tastiera, detta manuale.
Sono stati costruiti anche alcuni harmonium con due manuali.
...
</doc>
I know this is an old question, but I here is this great script that reads the wiki dump xml and outputs a very nice csv:
PyPI: https://pypi.org/project/wiki-dump-parser/
GitHub: https://github.com/Grasia/wiki-scripts/tree/master/wiki_dump_parser
Related