# Licence and sources of the data files

The files in this directory (`en.txt`, `de.txt`, `de.2.txt`, `en_phrases.txt`, `de_phrases.txt`) were built by
the scripts in `tools/` from the sources below. They are adapted works: pronunciations were converted to a
common phoneme notation, words were filtered, re-spelled and sorted by frequency, English loanwords were given
German pronunciations, and phrases were extracted and counted.

Because several sources are share-alike, **these data files are licensed under
[Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)](https://creativecommons.org/licenses/by-sa/4.0/)**.
You may copy, share and adapt them, also commercially, if you give credit to the sources below, link to the
licence, say what you changed, and publish your adapted version under the same licence.

This licence covers the data only, not the program code in the rest of the repository.

## Sources

| Used for | Source | Licence |
|---|---|---|
| German pronunciations (`de.txt`, `de.2.txt`) | [Wiktionary](https://de.wiktionary.org/), via [german-ipa-dict](https://github.com/devio-at/german-ipa-dict) by devio-at and [ipa-dict](https://github.com/open-dict-data/ipa-dict) by open-dict-data | [CC BY-SA](https://creativecommons.org/licenses/by-sa/4.0/) (Wiktionary content); ipa-dict itself: MIT |
| English pronunciations (`en.txt`, and anglicisms in `de.txt`) | [CMU Pronouncing Dictionary](https://github.com/cmusphinx/cmudict), Carnegie Mellon University | BSD-style, notice below |
| Word order by frequency | [FrequencyWords](https://github.com/hermitdave/FrequencyWords) by Hermit Dave, built from [OpenSubtitles 2018](http://opus.nlpl.eu/OpenSubtitles2018.php) (OPUS; subtitles from [opensubtitles.org](http://www.opensubtitles.org/)) | [CC BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/) |
| Phrases, German capitalisation and usage counts | [Leipzig Corpora Collection](https://wortschatz.uni-leipzig.de/en/download), corpora `deu-de_web-public_2019_1M` and `eng-com_web-public_2018_1M` | [CC BY](https://creativecommons.org/licenses/by/4.0/) for the downloadable corpora, see their [terms of usage](https://wortschatz.uni-leipzig.de/en/usage) |
| Telling English words from names (filter only, no content copied) | en_US Hunspell dictionary from [LibreOffice dictionaries](https://github.com/LibreOffice/dictionaries), based on SCOWL, Copyright 2000-2018 by Kevin Atkinson | permissive (SCOWL notice) |

Requested citations:

- Leipzig Corpora Collection: D. Goldhahn, T. Eckart and U. Quasthoff (2012): Building Large Monolingual
  Dictionaries at the Leipzig Corpora Collection: From 100 to 200 Languages. In: Proceedings of the 8th
  International Language Resources and Evaluation (LREC'12).
- OpenSubtitles: P. Lison and J. Tiedemann (2016): OpenSubtitles2016: Extracting Large Parallel Corpora from
  Movie and TV Subtitles. In: Proceedings of the 10th International Conference on Language Resources and
  Evaluation (LREC 2016).

## CMU Pronouncing Dictionary notice

```
Copyright (C) 1993-2015 Carnegie Mellon University. All rights reserved.

Redistribution and use in source and binary forms, with or without
modification, are permitted provided that the following conditions
are met:

1. Redistributions of source code must retain the above copyright
   notice, this list of conditions and the following disclaimer.
   The contents of this file are deemed to be source code.

2. Redistributions in binary form must reproduce the above copyright
   notice, this list of conditions and the following disclaimer in
   the documentation and/or other materials provided with the
   distribution.

This work was supported in part by funding from the Defense Advanced
Research Projects Agency, the Office of Naval Research and the National
Science Foundation of the United States of America, and by member
companies of the Carnegie Mellon Sphinx Speech Consortium. We acknowledge
the contributions of many volunteers to the expansion and improvement of
this dictionary.

THIS SOFTWARE IS PROVIDED BY CARNEGIE MELLON UNIVERSITY ``AS IS'' AND
ANY EXPRESSED OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO,
THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
PURPOSE ARE DISCLAIMED.  IN NO EVENT SHALL CARNEGIE MELLON UNIVERSITY
NOR ITS EMPLOYEES BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
```
