Natural Language Processing: Python and NLTK by unknow

Author:unknow
Language: eng
Format: azw3
Publisher: Packt Publishing
Published: 2016-11-22T05:00:00+00:00

And now we can use it on the part-of-speech tagged version of the terrible movie:

>>> from transforms import filter_insignificant >>> filter_insignificant([('the', 'DT'), ('terrible', 'JJ'), ('movie', 'NN')]) [('terrible', 'JJ'), ('movie', 'NN')]

As you can see, the word the is eliminated from the chunk.

How it works...

The filter_insignificant() function iterates over the tagged words in the chunk. For each tag, it checks whether that tag ends with any of the tag_suffixes. If it does, then the tagged word is skipped. But if the tag is ok, then the tagged word is appended to a new good chunk that is returned.

Download

Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.