N-grams from NBdigital 2021

This resource contains n-grams - i.e. unigrams, bigrams and trigrams - from all books and newspapers that had been digitized at the National Library of Norway up to July 2021. The n-grams have been extracted from a material consisting of approximately 580,000 books and 3,400,000 newspapers, amounting to a total of 122 billion tokens (words and punctuation). The n-grams are offered as CSV files (UTF-8-encoded).

Columns in the n-gram CSV files:

• first - the first word (in uni-, bi- and trigrams)
• second - the second word (in bi- and trigrams)
• third - the third word (in trigrams)
• lang - the language of the n-gram (only regarding books, newspapers have no language classification as for now)
• freq - the total frequency of the n-gram in the collection of books or newspapers
• json - a dictionary with raw frequency for each year

totals.json contains aggregated frequencies per year in the book and newspaper corpora. Using these numbers, relative frequencies can be calculated in order to compare frequencies over time as in NB N-gram.

metadata-digibok.csv and metadata-digavis.csv contain simple metadata for the books and newspapers. If you need more extensive metadata, you could use Oria or the APIs at https://api.nb.no/.

See the documentation files for further information.