I am using nltk, so I want to create my own custom texts just like the default ones on nltk.books. However, I've just got up to the method like
my_text = ['This', 'is', 'my', 'text']
my_text = "This is my text, this is a nice way to input text."
This is actually on the main page of nltk.org:
>>> import nltk >>> sentence = """At eight o'clock on Thursday morning ... Arthur didn't feel very good.""" >>> tokens = nltk.word_tokenize(sentence) >>> tokens ['At', 'eight', "o'clock", 'on', 'Thursday', 'morning', 'Arthur', 'did', "n't", 'feel', 'very', 'good', '.']