{"id":985,"date":"2020-03-14T10:48:19","date_gmt":"2020-03-14T17:48:19","guid":{"rendered":"https:\/\/www.asccreative.com\/thedifference\/?p=985"},"modified":"2020-12-07T01:48:56","modified_gmt":"2020-12-07T09:48:56","slug":"the-importance-of-nlp-in-conversational-chatbots","status":"publish","type":"post","link":"https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/","title":{"rendered":"The Importance of NLP in Conversational Chatbots"},"content":{"rendered":"

[et_pb_section fb_built=”1″ _builder_version=”4.6.3″ _module_preset=”default”][et_pb_row _builder_version=”4.6.3″ _module_preset=”default”][et_pb_column _builder_version=”4.6.3″ _module_preset=”default” type=”4_4″][et_pb_text _builder_version=”4.6.3″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″]<\/p>\n

\n
\n
\n
\n
\n
\n

This post is about conversational chatbots, and some of the underlying technologies that make conversational chatbots work. There are different levels of chatbot sophistication; A conversational chatbot is, as the name suggests, one where an interactive speaking conversation takes place.<\/p>\n

In other posts, we discuss OpBots. An conversational OpBot is one where a person can speak to the chatbot or machine learning engine via another communication tool, and<\/em> there is integration to the backend system that allows deeper and broader access to a businesses’ data.<\/p>\n

In order for a conversational chatbot to help, you have to first understand what they need help with. Machine learning can be useful in gaining a basic grasp on underlying customer intent, but it alone isn\u2019t sufficient to gain a full understanding of what a user is requesting.<\/p>\n

Machine learning is often mistakenly used as an umbrella term for the \u2018AI\u2019 in conversational AI. This is inaccurate.<\/p>\n

A typical machine learning model for text classification, by contrast, uses only term frequency (i.e. the number of times a particular term appears in a data corpus) to determine the intent of a query. Often these are also only simple and ineffective keyword-based algorithms.<\/p>\n

A rock-solid natural language foundation<\/strong><\/h2>\n

In addition to machine learning, the addition of a NLP (Natural Language Processing) engine ensures that the interpretation is as robust as possible. Advanced components, such as language detection, spelling correction, entity extraction and stemming are the foundation of rock-solid NLP ensures that conversational AI is able to correctly process any questions, no matter how poorly they are composed.<\/p>\n

An example of why this distinction matters:<\/p>\n

– I cancelled my trip and I want the ticket refunded<\/strong><\/p>\n

– You have cancelled my trip, I assume the ticket gets refunded?<\/strong><\/p>\n

In the first sentence \u2018I\u2019, \u2018cancelled\u2019, \u2018trip\u2019, \u2018ticket\u2019 and \u2018refunded\u2019 will be marked as important. In the second sentence \u2018you\u2019, \u2018cancelled\u2019, \u2018trip\u2019, \u2018ticket\u2019 and \u2018refunded\u2019 will be marked as important.<\/p>\n

Both \u2018you\u2019 and \u2018I\u2019 in the above sentences are known as stopwords and will be ignored by traditional algorithms. This will render the sentences essentially the same and unhelpful. Deep learning models (without the removal of stopwords) understand how<\/em> these words are connected to each other and can, therefore, infer that the sentences are different.<\/p>\n

The difference may be minimal for a machine, but the difference in outcome for a human is glaring and obvious. In the examples above, where the words used are the same for the two sentences, a simple machine learning model won\u2019t be able to distinguish between the two. In terms of business value, automating this process incorrectly without sufficient natural language understanding (NLU) could be disastrous.<\/p>\n

Learning to speak \u2018human\u2019<\/strong><\/h2>\n

By understanding which words are important in a given context, these models are able to figure out the potential mistakes and can correct it (as long as the training data quality is sufficient). It\u2019s an extra layer of understanding that reduces false positives to a minimum.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n

\u00a0<\/div>\n

[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"

This post is about conversational chatbots, and some of the underlying technologies that make conversational chatbots work. There are different levels of chatbot sophistication; A conversational chatbot is, as the name suggests, one where an interactive speaking conversation takes place. In other posts, we discuss OpBots. An conversational OpBot is one where a person can […]<\/p>\n","protected":false},"author":2,"featured_media":3136,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[11],"tags":[],"class_list":["post-985","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-product"],"yoast_head":"\nThe Importance of NLP in Conversational Chatbots | ASC Creative Ltd.<\/title>\n<meta name=\"robots\" content=\"noindex, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Importance of NLP in Conversational Chatbots | ASC Creative Ltd.\" \/>\n<meta property=\"og:description\" content=\"This post is about conversational chatbots, and some of the underlying technologies that make conversational chatbots work. There are different levels of chatbot sophistication; A conversational chatbot is, as the name suggests, one where an interactive speaking conversation takes place. In other posts, we discuss OpBots. An conversational OpBot is one where a person can […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/\" \/>\n<meta property=\"og:site_name\" content=\"ASC Creative Ltd.\" \/>\n<meta property=\"article:published_time\" content=\"2020-03-14T17:48:19+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-12-07T09:48:56+00:00\" \/>\n<meta name=\"author\" content=\"tim.bramwell\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"tim.bramwell\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/the-importance-of-nlp-in-conversational-chatbots\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/the-importance-of-nlp-in-conversational-chatbots\\\/\"},\"author\":{\"name\":\"tim.bramwell\",\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/#\\\/schema\\\/person\\\/c1edb0a96d0528296f83dc5425a139f8\"},\"headline\":\"The Importance of NLP in Conversational Chatbots\",\"datePublished\":\"2020-03-14T17:48:19+00:00\",\"dateModified\":\"2020-12-07T09:48:56+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/the-importance-of-nlp-in-conversational-chatbots\\\/\"},\"wordCount\":553,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/the-importance-of-nlp-in-conversational-chatbots\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/wp-content\\\/uploads\\\/Artboard-2-1280x720-1.png\",\"articleSection\":[\"Product\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/asccreative.net\\\/dev2\\\/the-importance-of-nlp-in-conversational-chatbots\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/the-importance-of-nlp-in-conversational-chatbots\\\/\",\"url\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/the-importance-of-nlp-in-conversational-chatbots\\\/\",\"name\":\"The Importance of NLP in Conversational Chatbots | ASC Creative Ltd.\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/the-importance-of-nlp-in-conversational-chatbots\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/the-importance-of-nlp-in-conversational-chatbots\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/wp-content\\\/uploads\\\/Artboard-2-1280x720-1.png\",\"datePublished\":\"2020-03-14T17:48:19+00:00\",\"dateModified\":\"2020-12-07T09:48:56+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/#\\\/schema\\\/person\\\/c1edb0a96d0528296f83dc5425a139f8\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/the-importance-of-nlp-in-conversational-chatbots\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/asccreative.net\\\/dev2\\\/the-importance-of-nlp-in-conversational-chatbots\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/the-importance-of-nlp-in-conversational-chatbots\\\/#primaryimage\",\"url\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/wp-content\\\/uploads\\\/Artboard-2-1280x720-1.png\",\"contentUrl\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/wp-content\\\/uploads\\\/Artboard-2-1280x720-1.png\",\"width\":1280,\"height\":502},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/the-importance-of-nlp-in-conversational-chatbots\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Importance of NLP in Conversational Chatbots\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/#website\",\"url\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/\",\"name\":\"ASC Creative Ltd.\",\"description\":\"Practical Digital Transformation \",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/#\\\/schema\\\/person\\\/c1edb0a96d0528296f83dc5425a139f8\",\"name\":\"tim.bramwell\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/d04b8754c0cba3cb7d8ac1a8793dba0c3ede7e69ca6c46abad019b5c4560a921?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/d04b8754c0cba3cb7d8ac1a8793dba0c3ede7e69ca6c46abad019b5c4560a921?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/d04b8754c0cba3cb7d8ac1a8793dba0c3ede7e69ca6c46abad019b5c4560a921?s=96&d=mm&r=g\",\"caption\":\"tim.bramwell\"},\"url\":\"https:\\\/\\\/asccreative.net\\\/dev2\\\/author\\\/tim-bramwell\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Importance of NLP in Conversational Chatbots | ASC Creative Ltd.","robots":{"index":"noindex","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_US","og_type":"article","og_title":"The Importance of NLP in Conversational Chatbots | ASC Creative Ltd.","og_description":"This post is about conversational chatbots, and some of the underlying technologies that make conversational chatbots work. There are different levels of chatbot sophistication; A conversational chatbot is, as the name suggests, one where an interactive speaking conversation takes place. In other posts, we discuss OpBots. An conversational OpBot is one where a person can […]","og_url":"https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/","og_site_name":"ASC Creative Ltd.","article_published_time":"2020-03-14T17:48:19+00:00","article_modified_time":"2020-12-07T09:48:56+00:00","author":"tim.bramwell","twitter_card":"summary_large_image","twitter_misc":{"Written by":"tim.bramwell","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/#article","isPartOf":{"@id":"https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/"},"author":{"name":"tim.bramwell","@id":"https:\/\/asccreative.net\/dev2\/#\/schema\/person\/c1edb0a96d0528296f83dc5425a139f8"},"headline":"The Importance of NLP in Conversational Chatbots","datePublished":"2020-03-14T17:48:19+00:00","dateModified":"2020-12-07T09:48:56+00:00","mainEntityOfPage":{"@id":"https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/"},"wordCount":553,"commentCount":0,"image":{"@id":"https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/#primaryimage"},"thumbnailUrl":"https:\/\/asccreative.net\/dev2\/wp-content\/uploads\/Artboard-2-1280x720-1.png","articleSection":["Product"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/","url":"https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/","name":"The Importance of NLP in Conversational Chatbots | ASC Creative Ltd.","isPartOf":{"@id":"https:\/\/asccreative.net\/dev2\/#website"},"primaryImageOfPage":{"@id":"https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/#primaryimage"},"image":{"@id":"https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/#primaryimage"},"thumbnailUrl":"https:\/\/asccreative.net\/dev2\/wp-content\/uploads\/Artboard-2-1280x720-1.png","datePublished":"2020-03-14T17:48:19+00:00","dateModified":"2020-12-07T09:48:56+00:00","author":{"@id":"https:\/\/asccreative.net\/dev2\/#\/schema\/person\/c1edb0a96d0528296f83dc5425a139f8"},"breadcrumb":{"@id":"https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/#primaryimage","url":"https:\/\/asccreative.net\/dev2\/wp-content\/uploads\/Artboard-2-1280x720-1.png","contentUrl":"https:\/\/asccreative.net\/dev2\/wp-content\/uploads\/Artboard-2-1280x720-1.png","width":1280,"height":502},{"@type":"BreadcrumbList","@id":"https:\/\/asccreative.net\/dev2\/the-importance-of-nlp-in-conversational-chatbots\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/asccreative.net\/dev2\/"},{"@type":"ListItem","position":2,"name":"The Importance of NLP in Conversational Chatbots"}]},{"@type":"WebSite","@id":"https:\/\/asccreative.net\/dev2\/#website","url":"https:\/\/asccreative.net\/dev2\/","name":"ASC Creative Ltd.","description":"Practical Digital Transformation ","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/asccreative.net\/dev2\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/asccreative.net\/dev2\/#\/schema\/person\/c1edb0a96d0528296f83dc5425a139f8","name":"tim.bramwell","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/d04b8754c0cba3cb7d8ac1a8793dba0c3ede7e69ca6c46abad019b5c4560a921?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/d04b8754c0cba3cb7d8ac1a8793dba0c3ede7e69ca6c46abad019b5c4560a921?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d04b8754c0cba3cb7d8ac1a8793dba0c3ede7e69ca6c46abad019b5c4560a921?s=96&d=mm&r=g","caption":"tim.bramwell"},"url":"https:\/\/asccreative.net\/dev2\/author\/tim-bramwell\/"}]}},"_links":{"self":[{"href":"https:\/\/asccreative.net\/dev2\/wp-json\/wp\/v2\/posts\/985","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/asccreative.net\/dev2\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/asccreative.net\/dev2\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/asccreative.net\/dev2\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/asccreative.net\/dev2\/wp-json\/wp\/v2\/comments?post=985"}],"version-history":[{"count":2,"href":"https:\/\/asccreative.net\/dev2\/wp-json\/wp\/v2\/posts\/985\/revisions"}],"predecessor-version":[{"id":987,"href":"https:\/\/asccreative.net\/dev2\/wp-json\/wp\/v2\/posts\/985\/revisions\/987"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/asccreative.net\/dev2\/wp-json\/wp\/v2\/media\/3136"}],"wp:attachment":[{"href":"https:\/\/asccreative.net\/dev2\/wp-json\/wp\/v2\/media?parent=985"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/asccreative.net\/dev2\/wp-json\/wp\/v2\/categories?post=985"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/asccreative.net\/dev2\/wp-json\/wp\/v2\/tags?post=985"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}