Hot-keys on this page

r m x p   toggle line displays

j k   next/prev highlighted chunk

0   (zero) top of page

1   (one) first highlighted chunk

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

49

50

51

52

53

54

55

56

57

58

59

60

61

62

63

64

65

66

67

68

69

70

71

72

73

74

75

76

77

78

79

80

81

82

83

84

85

86

87

88

89

90

91

92

93

94

95

96

97

98

99

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

# Natural Language Toolkit: Corpus Readers 

# 

# Copyright (C) 2001-2012 NLTK Project 

# Author: Steven Bird <sb@ldc.upenn.edu> 

#         Edward Loper <edloper@gradient.cis.upenn.edu> 

# URL: <http://www.nltk.org/> 

# For license information, see LICENSE.TXT 

 

""" 

NLTK corpus readers.  The modules in this package provide functions 

that can be used to read corpus fileids in a variety of formats.  These 

functions can be used to read both the corpus fileids that are 

distributed in the NLTK corpus package, and corpus fileids that are part 

of external corpora. 

 

Corpus Reader Functions 

======================= 

Each corpus module defines one or more "corpus reader functions", 

which can be used to read documents from that corpus.  These functions 

take an argument, ``item``, which is used to indicate which document 

should be read from the corpus: 

 

- If ``item`` is one of the unique identifiers listed in the corpus 

  module's ``items`` variable, then the corresponding document will 

  be loaded from the NLTK corpus package. 

- If ``item`` is a fileid, then that file will be read. 

 

Additionally, corpus reader functions can be given lists of item 

names; in which case, they will return a concatenation of the 

corresponding documents. 

 

Corpus reader functions are named based on the type of information 

they return.  Some common examples, and their return types, are: 

 

- words(): list of str 

- sents(): list of (list of str) 

- paras(): list of (list of (list of str)) 

- tagged_words(): list of (str,str) tuple 

- tagged_sents(): list of (list of (str,str)) 

- tagged_paras(): list of (list of (list of (str,str))) 

- chunked_sents(): list of (Tree w/ (str,str) leaves) 

- parsed_sents(): list of (Tree with str leaves) 

- parsed_paras(): list of (list of (Tree with str leaves)) 

- xml(): A single xml ElementTree 

- raw(): unprocessed corpus contents 

 

For example, to read a list of the words in the Brown Corpus, use 

``nltk.corpus.brown.words()``: 

 

    >>> from nltk.corpus import brown 

    >>> print(brown.words()) 

    ['The', 'Fulton', 'County', 'Grand', 'Jury', 'said', ...] 

 

""" 

 

from nltk.corpus.reader.plaintext import * 

from nltk.corpus.reader.util import * 

from nltk.corpus.reader.api import * 

from nltk.corpus.reader.tagged import * 

from nltk.corpus.reader.cmudict import * 

from nltk.corpus.reader.conll import * 

from nltk.corpus.reader.chunked import * 

from nltk.corpus.reader.wordlist import * 

from nltk.corpus.reader.xmldocs import * 

from nltk.corpus.reader.ppattach import * 

from nltk.corpus.reader.senseval import * 

from nltk.corpus.reader.ieer import * 

from nltk.corpus.reader.sinica_treebank import * 

from nltk.corpus.reader.bracket_parse import * 

from nltk.corpus.reader.indian import * 

from nltk.corpus.reader.toolbox import * 

from nltk.corpus.reader.timit import * 

from nltk.corpus.reader.ycoe import * 

from nltk.corpus.reader.rte import * 

from nltk.corpus.reader.string_category import * 

from nltk.corpus.reader.propbank import * 

from nltk.corpus.reader.verbnet import * 

from nltk.corpus.reader.bnc import * 

from nltk.corpus.reader.nps_chat import * 

from nltk.corpus.reader.wordnet import * 

from nltk.corpus.reader.switchboard import * 

from nltk.corpus.reader.dependency import * 

from nltk.corpus.reader.nombank import * 

from nltk.corpus.reader.ipipan import * 

from nltk.corpus.reader.pl196x import * 

from nltk.corpus.reader.knbc import * 

from nltk.corpus.reader.chasen import * 

from nltk.corpus.reader.childes import * 

from nltk.corpus.reader.aligned import * 

from nltk.corpus.reader.lin import * 

 

# Make sure that nltk.corpus.reader.bracket_parse gives the module, not 

# the function bracket_parse() defined in nltk.tree: 

from . import bracket_parse 

 

__all__ = [ 

    'CorpusReader', 'CategorizedCorpusReader', 

    'PlaintextCorpusReader', 'find_corpus_fileids', 

    'TaggedCorpusReader', 'CMUDictCorpusReader', 

    'ConllChunkCorpusReader', 'WordListCorpusReader', 

    'PPAttachmentCorpusReader', 'SensevalCorpusReader', 

    'IEERCorpusReader', 'ChunkedCorpusReader', 

    'SinicaTreebankCorpusReader', 'BracketParseCorpusReader', 

    'IndianCorpusReader', 'ToolboxCorpusReader', 

    'TimitCorpusReader', 'YCOECorpusReader', 

    'MacMorphoCorpusReader', 'SyntaxCorpusReader', 

    'AlpinoCorpusReader', 'RTECorpusReader', 

    'StringCategoryCorpusReader','EuroparlCorpusReader', 

    'CategorizedTaggedCorpusReader', 

    'CategorizedPlaintextCorpusReader', 

    'PortugueseCategorizedPlaintextCorpusReader', 

    'tagged_treebank_para_block_reader', 

    'PropbankCorpusReader', 'VerbnetCorpusReader', 

    'BNCCorpusReader', 'ConllCorpusReader', 

    'XMLCorpusReader', 'NPSChatCorpusReader', 

    'SwadeshCorpusReader', 'WordNetCorpusReader', 

    'WordNetICCorpusReader', 'SwitchboardCorpusReader', 

    'DependencyCorpusReader', 'NombankCorpusReader', 

    'IPIPANCorpusReader', 'Pl196xCorpusReader', 

    'TEICorpusView', 'KNBCorpusReader', 'ChasenCorpusReader', 

    'CHILDESCorpusReader', 'AlignedCorpusReader', 

    'TimitTaggedCorpusReader', 'LinThesaurusCorpusReader' 

]