corpora {rcorpora}R Documentation

Load a data set from the corpora package

Description

corpora is a collection of small corpora of interesting data for the creation of bots and similar stuff.

Usage

corpora(which, category)

Arguments

which

The data set to load, a string. If not given, then all data sets in the package are listed.

category

If given, which must be missing, and the data sets in the given category are listed.

Details

This project is a collection of static corpora (plural of "corpus") that are potentially useful in the creation of weird internet stuff. I've found that, as a creator, sometimes I am making something that needs access to a lot of adjectives, but not necessarily every adjective in the English language. So for the last year I've been copy/pasting an adjs.json file from project to project. This is kind of awful, so I'm hoping that this project will at least help me keep everything in one place.

I would like this to help with rapid prototyping of projects. For example: you might use nouns.json to start with, just to see if an idea you had was any good. Once you've built the project quickly around the nouns collection, you can then rip it out and replace it with a more complex or exhaustive data source.

I'm also hoping that this can be used as a teaching tool: maybe someone has three hours to teach how to make Twitter bots. That doesn't give the student much time to find/scrape/clean/parse interesting data. My hope is that students can be pointed to this project and they can pick and choose different interesting data sources to meld together for the creation of prototypes.

See https://github.com/dariusk/corpora

Value

A data frame containing the data set (if which is given), or a character vector of data set names.

Data set categories

Data sets

animals/birds_antarctica

Birds of Antarctica, grouped by family Source: https://en.wikipedia.org/wiki/List_of_birds_of_Antarctica

animals/birds_north_america

Birds of North America, grouped by family Source: http://listing.aba.org/aba-checklist/

animals/cats
animals/collateral_adjectives

Collateral adjectives for animals.

animals/common
animals/dinosaurs

A list of dinosaurs.

animals/dog_names

1000 popular dog names from the New York City Department of Health's dog licensing data. Names are roughly in order, but that may not be totally reliable.

animals/dogs

A list of dog breeds.

animals/donkeys
animals/horses
animals/ponies
archetypes/artifact

Artifact archetypes.

archetypes/character

Common character archetypes.

archetypes/event

Archetypal events.

archetypes/setting

Setting and location archetypes.

architecture/passages

Ways to enter or exit a place.

architecture/rooms

Different kinds of rooms

art/isms

A list of modernist art isms.

colors/crayola

List of Crayola crayon standard colors

colors/dulux
colors/google_material_colors
colors/paints

List of assorted paint colors from various brands.

colors/palettes

The top 200 most popular palettes on colourlovers.com

colors/web_colors

List of named HTML colors

colors/xkcd

The 954 most common RGB monitor colors, as defined by several hundred thousand participants in the xkcd color name survey.

corporations/cars

A list of car manufacturers.

corporations/djia

Corporations of the Dow Jones Industrial Average

corporations/fortune500

The 2014 Fortune 500 list

corporations/industries

A list of all industries on LinkedIn, as of May 21, 2013 Source: http://robertwdempsey.com/liindustries

corporations/nasdaq

Corporations of the NASDAQ 100

corporations/newspapers

A list of newspapers scraped in early 2013.

divination/tarot_interpretations

Tarot card interpretations, from Mark McElroy's _A Guide to Tarot Meanings_ (http://www.madebymark.com/a-guide-to-tarot-card-meanings/)

divination/zodiac

Zodiac signs and associated information, both Western and Eastern. Source: https://en.wikipedia.org/wiki/Astrological_sign

film-tv/game-of-thrones-houses

Game of Thrones Houses

film-tv/iab_categories
film-tv/netflix-categories

Netflix Movie Categories.

film-tv/popular-movies

A bunch of movies, mostly Best Picture winners or nominees, scraped from the web.

film-tv/tv_shows

1000 entries from the list of TV shows at http://en.wikipedia.org/wiki/List_of_television_programs_by_name

foods/apple_cultivars

The 1000 most popular apple cultivars in the USDA's Pomological Watercolor collection.

foods/bad_beers

Beers with the 100 lowest scores on BeerAdvocate, adapted from https://www.beeradvocate.com/lists/bottom/

foods/beer_categories

A list of beer categories.

foods/beer_styles

A list of beer styles.

foods/breads_and_pastries

A list of classic breads and sweet pastries.

foods/combine

A list of recipe instructions.

foods/condiments

A list of condiments

foods/curds

A list of curds, cheeses, and other fermented dairy products

foods/fruits

A list of fruits.

foods/herbs_n_spices

A list of herbs and spices, and mixtures of the two.

foods/hot_peppers

Capsicum cultivars (hot peppers)

foods/iba_cocktails

Cocktails recognized by the International Bartenders Association for use in the World Cocktail Competition.

foods/menuItems

A list of the top 1000 most appearing menu items from the 1850s to today from the New York Public Library's "What's on the menu?" project. Please credit The New York Public Library as source on any applications or publications. http://menus.nypl.org/data

foods/pizzaToppings

A list of pizza toppings.

foods/sandwiches

A list of sandwiches.

foods/sausages

A list of sausages

foods/scotch_whiskey

A list of scotch whiskies

foods/tea

types of tea

foods/vegetable_cooking_times

Approximate cooking times for various vegetables Source: http://recipes.howstuffworks.com/tools-and-techniques/how-to-cook-vegetables24.htm

foods/vegetables

A list of vegetables.

foods/wine_descriptions

A list of words commonly used to describe wine.

games/bannedGames/argentina/bannedList

A list of video games banned in Argentina

games/bannedGames/brazil/bannedList

A list of video games banned in Brazil

games/bannedGames/china/bannedList

A list of video games banned in China.

games/bannedGames/denmark/bannedList

A list of video games banned in Denmark

games/cluedo

Characters, rooms and weapons from the board game Cluedo / Clue.

games/dark_souls_iii_messages

Organized components from the Dark Souls III message system

games/jeopardy_questions

A sampling of 1000 Jeopardy questions and metadata. For the full dataset, see http://www.reddit.com/r/datasets/comments/1uyd0t/200000_jeopardy_questions_in_a_json_file/

games/pokemon

Source: https://github.com/UberGames/iPokedex-DB

games/scrabble

Tile distribution and points for the English-language edition of Scrabble

games/street_fighter_ii

Street Fighter II fighting moves

games/trivial_pursuit

Pie categories and colors from Trivial Pursuit

games/wrestling_moves

A list of professional wrestling moves

games/zelda
geography/canada_provinces_and_territories

A list of Canadian provinces and territories.

geography/canadian_municipalities

Top 100 Canadian municipalities by 2011 population Source: https://en.wikipedia.org/wiki/List_of_the_100_largest_municipalities_in_Canada_by_population

geography/countries

A list of countries.

geography/countries_with_capitals

A list of countries and its respective capitals.

geography/english_towns_cities

Two lists: one for English towns, one for English cities.

geography/japanese_prefectures

Japanese regions and prefectures.

geography/london_underground_stations

London Underground stations, with their lines and Travelcard zones Source: https://en.wikipedia.org/wiki/List_of_London_Underground_stations

geography/nationalities

A list of nationalities. Source: https://www.gov.uk/government/publications/nationalities/list-of-nationalities

geography/norwegian_cities

c("Top Norwegian Cities by 2017 population Source: Norway Population 2017 (Demographics, Maps, Graphs)", "Top Norwegian Cities by 2017 population Source: http://worldpopulationreview.com/countries/norway-population")

geography/nyc_neighborhood_zips

Neighborhoods of New York City and their corresponding ZIP codes. Normal ZIP code caveats apply. Source: Compiled by United Health Fund and distributed by the New York State Department of Health: https://www.health.ny.gov/statistics/cancer/registry/appendix/neighborhoods.htm

geography/oceans

A list of oceans and seas. Source: http://en.wikipedia.org/wiki/List_of_seas

geography/rivers

A list of rivers. Source: http://en.wikipedia.org/wiki/List_of_rivers_by_length

geography/sf_neighborhoods

San Francisco neighborhoods and their locations

geography/us_airport_codes

IATA and ICAO airport codes for the primary commercial airports in each state.

geography/us_cities

Top 1000 U.S. cities by population (2016 estimates) Source: US Census American Community Survey 2016 5-year Data

geography/us_counties

U.S. Counties by State Source: https://en.wikipedia.org/wiki/List_of_counties_by_U.S._state

geography/us_metropolitan_areas

U.S. Metropolitan, Micropolitan and Combined Statistical Areas with 2016 population estimates Source: US Census American Community Survey 2016 5-year Data

geography/us_state_capitals

U.S. State Capitals Source: Wikipedia: List of U.S. state capitals

geography/venues

Venues organized by category. Source: https://developer.foursquare.com/categorytree

geography/winds

A list of regional and local winds and weather phenomena. Source: https://en.wikipedia.org/wiki/List_of_local_winds, http://www.ggweather.com/windsoftheworld.htm

governments/mass-surveillance-project-names

This is a list of government surveillance projects and related databases throughout the world. Source: Data found here: https://en.wikipedia.org/wiki/List_of_government_mass_surveillance_projects

governments/nsa_projects

A list of NSA project code names. Source: All data here is from https://docs.google.com/spreadsheets/d/1Uc1hrGqIweF0rgJ1HCbmT_0w9CYCCwZTWBGOwydscqE/htmlview?sle=true&id=1590301345#

governments/uk_political_parties

A list of uk political parties. Source: http://www.electoralcommission.org.uk/ export on 8th May 2015

governments/us_federal_agencies

A list of federal agencies. Source: This data was sourced from the GSA's list of .gov domains https://github.com/GSA/data/blob/gh-pages/dotgov-domains/2014-12-01-federal.csv

governments/us_mil_operations

Code names for US Military Operations Source: All names from the scraped pages of http://www.designation-systems.net/usmilav/codenames.html

humans/2016_us_presidential_candidates

All individuals who filed a Statement of Candidacy with the FEC to register as a presidential candidate in the 2016 United States election.

humans/atus_activities

Activity category codes used by the US Bureau of Labor Statistics in its American Time Use Survey. Categories either come with a set of example activities, or are standalone 'miscellaneous' categories denoted 'not elsewhere classified'. Source: https://www.bls.gov/tus/lexicons.htm

humans/authors
humans/bodyParts

A list of common human body parts.

humans/britishActors

A bunch of British actors.

humans/celebrities

Celebrities

humans/descriptions

A list of adjectives for describing people, taken from www.enchantedlearning.com/wordlist/adjectivesforpeople.shtml

humans/englishHonorifics

English honorifics.

humans/famousDuos

Famous duos

humans/firstNames

First names of men and women, pulled from the US Census for the 2000s.

humans/lastNames

Last names of people, pulled from the US Census for the 2000s.

humans/moods

A list of words that naturally complete the phrase 'They were feeling...'.

humans/norwayFirstNamesBoys

First names of boys, pulled from Statistics Norway 2015. Sorted from high to low distribution.

humans/norwayFirstNamesGirls

First names of girls, pulled from Statistics Norway 2015. Sorted from high to low distribution.

humans/norwayLastNames

Last names of people, pulled from Statistics Norway 2015. Sorted from high to low distribution.

humans/occupations

A list of occupations (jobs that people might have).

humans/prefixes

Prefixes taken from a form on an airline website.

humans/richpeople

A bunch of rich people from a Forbes listicle, including the source article, img, and name

humans/scientists

List of particularly famous scientists

humans/spanishFirstNames

A list of common Spanish first names of men and women. Source: https://github.com/olea/lemarios

humans/spanishLastNames

A list of common Spanish last names. Source: https://github.com/olea/lemarios

humans/spinalTapDrummers

Deceased drummers from the fictional rock band Spinal Tap, taken from Wikipedia.

humans/suffixes

Suffixes taken from a form on an airline website.

humans/thirdPersonPronouns

Third person personal pronouns with case

humans/tolkienCharacterNames

Character names from Tolkien's Middle Earth, from https://en.wikipedia.org/wiki/List_of_Middle-earth_characters

humans/us_presidents

Copy of JSON retrieved from https://www.govtrack.us/api/v2/role?role_type=president. The ID here matches the one in the corpora/data/words/us_president_quotes.json file

humans/wrestlers

A bunch of WWE wrestlers nicknames

instructions/laundry_care

A list of laundry care instructions

materials/abridged-body-fluids

abridged body fluids

materials/building-materials

building materials

materials/carbon-allotropes

carbon allotropes

materials/decorative-stones

decorative stones

materials/fabrics

fabrics

materials/fibers

fibers

materials/gemstones

A list of the names of materials commonly used as gemstones Source: https://en.wikipedia.org/wiki/List_of_gemstone_species

materials/layperson-metals

layperson metals

materials/metals

metals

materials/natural-materials

natural materials

materials/packaging

packaging

materials/plastic-brands

plastic brands

materials/sculpture-materials

sculpture materials

materials/technical-fabrics

technical fabrics

mathematics/fibonnaciSequence

The first 1000 numbers in the Fibonnaci Sequence

mathematics/primes

The first 1000 prime numbers.

mathematics/primes_binary

The first 1000 prime numbers in binary.

mathematics/trigonometry

A list of trigonometric functions, formulas, equations, etc..

medicine/diagnoses

International Statistical Classification of Diseases and Related Health Problems, 10th revision Source: http://www.cdc.gov/nchs/icd/icd10cm.htm

medicine/drugNameStems

A list of generic pharmaceutical drug name stems. Hypens indicate whether a stem appears at the beginning, middle, or end of the name. Source: http://druginfo.nlm.nih.gov/drugportal/jsp/drugportal/DrugNameGenericStems.jsp

medicine/drugs

A list of pharmaceutical drug names Source: The United States National Library of Medicine, http://druginfo.nlm.nih.gov/drugportal/

medicine/hospitals

A partial list of the hospitals in the United States Source: Wikipedia - List of Hospitals in the United States, https://en.wikipedia.org/wiki/Lists_of_hospitals_in_the_United_States

music/a_list_of_guitar_manufacturers

A list of guitar manufacturers Source: https://en.wikipedia.org/wiki/List_of_guitar_manufacturers

music/bands_that_have_opened_for_tool

Bands that have opened for Tool. You must be really dedicated to your music if you are willing to play before Tool fans.

music/female_classical_guitarists

a list of women classical guitarists Source: https://en.wikipedia.org/wiki/List_of_women_classical_guitarists

music/genres

A list of musical genres taken from wikipedia article titles.

music/hamilton_musical_obcrecording_actors_characters

Actors and the named characters played by them in the Original Broadway Cast recording of Hamilton: An American Musical. Actors who played multiple characters are listed multiple times. Source: https://en.wikipedia.org/wiki/Hamilton_(musical)#Principal_roles_and_major_casts

music/instruments

Musical Instruments

music/mtv_day_one

Music videos broadcast on MTV's first day Source: https://en.wikipedia.org/wiki/First_music_videos_aired_on_MTV

music/rock_hall_of_fame

Artists who have been added to the Rock N' Roll Hall of Fame along with their year of induction Source: https://en.wikipedia.org/wiki/List_of_Rock_and_Roll_Hall_of_Fame_inductees

music/xxl_freshman

Every rapper that's ever made the XXL Annual Freshman Cover

mythology/greek_gods

Gods and goddesses from Greek myth

mythology/greek_monsters

Monsters from Greek myth

mythology/greek_myths_master
mythology/greek_titans

Titans from Greek myth

mythology/hebrew_god

Hebrew names of God used in the Old Testament Bible

mythology/lovecraft

Deities and supernatural creatures from the works of Lovecraft and the Cthulhu mythos.

mythology/monsters

A list of monsters and other mythic creatures

mythology/norse_gods

Gods and goddesses of norse and germanic myth

objects/clothing

List of clothing types

objects/corpora_winners

Winners in the Corpora Brackets, from https://twitter.com/corporabrackets

objects/objects

List of household objects

plants/cannabis

420 popular strains of cannabis

plants/flowers
plants/plants

List of plants by common name Source: https://en.wikipedia.org/wiki/List_of_plants_by_common_name

religion/christian_saints
religion/fictional_religions
religion/parody_religions
religion/religions
science/elements
science/hail_size

Analogous objects for various hail sizes, adapted from http://www.spc.noaa.gov/misc/tables/hailsize.htm

science/minor_planets

List of names of the first 1000 numbered minor planets

science/planets

Planets (including dwarf planets as recognized by the IAU) that orbit the Sun, with their natural satellites.

science/pregnancy
science/toxic_chemicals
science/weather_conditions

A list of phrases describing weather conditions. This list includes all possible phrases that may be provided by the US National Weather Service's feeds of current weather conditions. Source: http://w1.weather.gov/xml/current_obs/weather.php

societies_and_groups/animal_welfare
societies_and_groups/designated_terrorist_groups/australia
societies_and_groups/designated_terrorist_groups/canada
societies_and_groups/designated_terrorist_groups/china
societies_and_groups/designated_terrorist_groups/egypt
societies_and_groups/designated_terrorist_groups/european_union
societies_and_groups/designated_terrorist_groups/india
societies_and_groups/designated_terrorist_groups/iran
societies_and_groups/designated_terrorist_groups/israel
societies_and_groups/designated_terrorist_groups/kazakhstan
societies_and_groups/designated_terrorist_groups/russia
societies_and_groups/designated_terrorist_groups/saudi_arabia
societies_and_groups/designated_terrorist_groups/tunisia
societies_and_groups/designated_terrorist_groups/turkey
societies_and_groups/designated_terrorist_groups/uae
societies_and_groups/designated_terrorist_groups/ukraine
societies_and_groups/designated_terrorist_groups/united_kingdom
societies_and_groups/designated_terrorist_groups/united_nations
societies_and_groups/designated_terrorist_groups/united_states
societies_and_groups/fraternities/coeducational_fraternities
societies_and_groups/fraternities/defunct
societies_and_groups/fraternities/fraternities
societies_and_groups/fraternities/professional
societies_and_groups/fraternities/service
societies_and_groups/fraternities/sororities
societies_and_groups/semi_secret
sports/football/epl_teams

Current (as of November 2016) teams in the EPL (English Premier League) and where they play

sports/football/laliga_teams

Teams in the Spanish Primera División, La Liga(2017-18) with their details

sports/football/serieA

Teams in the Italian First División, Serie A(2017-18) with their details

sports/mlb_teams

Current (as of 2016) Major League Baseball teams and where they play

sports/nba_mvps

NBA MVP award winners 1956-2017

sports/nba_teams

Current (as of 2016) teams in the NBA and where they play

sports/nfl_teams

Current (as of 2016) teams in the NFL and where they play

sports/nhl_teams

Current (as of 2016) teams in the NHL and where they play

sports/olympics

Olympic Games with host city, host nation, olympiad number (different for winter and summer), year, start date, end date, countries participating, athletes participating, and number of events. Source: Compiled from information on Olympics.org

technology/appliances

A list of home appliances

technology/computer_sciences

names of technologies related to computer science

technology/fireworks

A list (ooh!) of firework effects (aah!)

technology/guns_n_rifles

weapons used in mass shootings in the U.S.A.

technology/knots

A list of knot names.

technology/lisp

a list of LISP dialects

technology/new_technologies

new or emerging technologies

technology/photo_sharing_websites

Photo sharing websites

technology/programming_languages
technology/social_networking_websites

Social networking websites

technology/video_hosting_websites

Video hosting websites

transportation/commercial-aircraft
travel/lcc
words/adjs

A list of English adjectives.

words/adverbs
words/closed_pairs

closed pairs in English i.e both words rhyme with each other and only with each other. from https://en.wikipedia.org/wiki/List_of_closed_pairs_of_English_rhyming_words

words/common

Common English words.

words/compounds

A partial list of English compound words.

words/crash_blossoms

confusing or misleading headlines

words/eggcorns

Commonly mistaken English phrases most likely caused by hearing them rather than reading them (eggcorns) Source: Most of the examples come from http://eggcorns.lascribe.net/

words/emoji/cute_kaomoji

A general corpus of cute kaomoji.

words/emoji/emoji

All the Unicode emoji.

words/encouraging_words

a list of encouraging words to tell someone about something they created

words/ergative_verbs

'Ergative' verbs in English can be used both transitively and intransitively. Source: Curated from https://en.wiktionary.org/wiki/Category:English_ergative_verbs

words/expletives

Common expletives and spelling variants used in internet comments.

words/harvard_sentences

The Harvard sentences are a collection of sample phrases that are used for standardized testing of Voice over IP, cellular, and other telephone systems. They are phonetically balanced sentences that use specific phonemes at the same frequency they appear in English. (description from https://en.wikipedia.org/wiki/Harvard_sentences). The data represents a version with minor typos removed.

words/infinitive_verbs
words/interjections

a list of exclamatory words and expressions from http://www.enchantedlearning.com/wordlist/interjections.shtml

words/literature/infinitejest

List of names from the novel Infinite Jest by David Foster Wallace

words/literature/lovecraft_words

H.P Lovecraft favorite words, from http://arkhamarchivist.com/wordcount-lovecraft-favorite-words/

words/literature/mr_men_little_miss

Mr Men and Little Miss characters Source: http://www.mrmen.com

words/literature/shakespeare_phrases

Phrasess coined by Shakespeare, from http://www.pathguy.com/shakeswo.htm

words/literature/shakespeare_sonnets

Shakespeare's sonnets.

words/literature/shakespeare_words

Words coined by Shakespeare, from http://www.pathguy.com/shakeswo.htm

words/literature/technology_quotes
words/nouns

A list of English nouns.

words/oprah_quotes

Words of wisdom by Oprah Winfrey

words/personal_nouns

List of personal nouns in the 1890 Webster's Unabridged Dictionary. Assembled by Cory Taylor from Project Gutenberg's HTML edition of the dictionary: http://www.gutenberg.org/ebooks/673 Source: https://github.com/coryandrewtaylor/Personal-Nouns

words/personal_pronouns
words/possessive_pronouns
words/prefix_root_suffix
words/prepositions

A list of English prepositions, sourced from Wikipedia.

words/proverbs

A list of proverbs sourced from http://tww.id.au/proverbs/proverbs.html

words/resume_action_words

Resume action words Source: http://careercenter.umich.edu/article/resume-action-words

words/rhymeless_words

English words for which there is no perfect rhyme, taken from https://en.wikipedia.org/wiki/List_of_English_words_without_rhymes

words/spells

A list of Harry Potter spells and descriptions

words/state_verbs
words/states_of_drunkenness

A list of states of drunkenness.

words/stopwords/ar

Arabic stop words

words/stopwords/bg

Arabic stop words

words/stopwords/cs

Czech stop words

words/stopwords/da

Danish stop words

words/stopwords/de

German stop words

words/stopwords/en

English stop words

words/stopwords/es

Spanish stop words

words/stopwords/fi

Finnish stop words

words/stopwords/fr

French stop words

words/stopwords/gr

Greek stop words

words/stopwords/it

Italian stop words

words/stopwords/jp

Japanese stop words

words/stopwords/lv

Latvian stop words

words/stopwords/nl

Dutch stop words

words/stopwords/no

Norwegian stop words

words/stopwords/pl

Polish stop words

words/stopwords/pt

Portuguese stop words

words/stopwords/ru

Russian stop words

words/stopwords/sk

Slovak stop words

words/stopwords/sv

Swedish stop words

words/stopwords/tr

Turkish stop words

words/strange_words

Do you know the feeling when you repeat some word many times and it starts to sound weird? Below is the list of some of the strangest sounding words that people submitted during my Intro to Computational Media Class at ITP, NYU.

words/units_of_time

A list of units of time ordered by magnitude, both formal and colloquial.

words/us_president_quotes

A list of quotes from US Presidents from http://bit.ly/1hsAYQT. ID matches up with https://govtrack.us API results.

words/verbs

A list of English verbs.

words/verbs_with_conjugations
words/word_clues/clues_five

a list of common 5-letter words followed by crossword/thesaurus-style hints for that word

words/word_clues/clues_four

a list of common 4-letter words followed by crossword/thesaurus-style hints for that word

words/word_clues/clues_six

a list of common 6-letter words followed by crossword/thesaurus-style hints for that word

Examples

corpora()
corpora(category = "animals")
corpora("foods/pizzaToppings")
[Package rcorpora version 2.0.1 Index]