Implementation of tokenization in natural language processing using NLTK module of python

Title

Implementation of tokenization in natural language processing using NLTK module of python

Creator

Mishra V.K.; Dhyani A.; Barik S.; Gupta T.

Description

With the advancement of technologies, now it is possible to analyze the large amount of unstructured text circulated online with various tools and methods for understanding the changes as well to infer meaningful insights from the text data. In this work, the aim is to understand how Python can be used for text analytics by the help of various libraries available in it. The natural language processing (NLP) is being used to analyze and synthesize natural language and speech in Python. 2023 Scrivener Publishing LLC.

Source

Mathematics and Computer Science, Vol-1, pp. 493-504.

Date

2023-01-01

Publisher

Wiley Blackwell

Subject

Natural language processing (NLP); Natural language toolkit (NLTK); Tokenization

Coverage

Mishra V.K., Galgotias University, Gautam Buddha Nagar, Uttar Pradesh, India; Dhyani A., Indian Institute of Technology, Jodhpur, Rajsthan, India; Barik S., Christ (Deemed to be) University, Delhi NCR, India; Gupta T., Christ (Deemed to be) University, Delhi NCR, India

Rights

Restricted Access

Relation

ISBN: 978-111987983-1; 978-111987967-1

Format

Online

Language

English

Type

Book chapter

Identifier

https://www.scopus.com/inward/record.uri?eid=2-s2.0-85168703092&partnerID=40&md5=5605a87496bf12599a28892b7c591a04