La información que los organismos policiales almacenan sobre detenciones o incidentes delictivos, así como los avisos a los departamentos de policía, tienen un valor enorme para resolver futuros casos que se pueden plantear. Analizar manualmente esta gran cantidad de datos en busca de patrones puede llevar mucho tiempo y sus [...] The post Analítica de textos e IA para identificar patrones de trata de seres humanos en la documentación policial appeared first on SAS Blogs ..read more

In today's world, data-driven systems make significant decisions across industries. While these systems can bring many benefits, they can also foster distrust by obscuring how decisions are made. Therefore, transparency within data driven systems is critical to responsible innovation. Transparency requires clear, explainable communication. Since transparency helps people understand how [...] The post The ethics of responsible innovation: Why transparency is key appeared first on SAS Blogs ..read more

SAS' Ali Dixon and Mary Osborne reveal why a BERT-based classifier is now part of our natural language processing capabilities of SAS Viya. The post How natural language processing transformers can provide BERT-based sentiment classification on March Madness appeared first on SAS Blogs ..read more

Editor's note: This article follows Curious about ChatGPT: Exploring the origins of generative AI and natural language processing. As ChatGPT has entered the scene, many fear and uncertainty have been expressed by those working in education at all levels. Educators worry about cheating and rightly so. ChatGPT can do everything [...] The post Curious about ChatGPT: Exploring the use of AI in Education appeared first on SAS Blogs ..read more

SAS' Kirk Swilley and Tom Sabo showcase how you can use perform text analysis on minimal structured narrative data to spot patterns of possible human trafficking. The post Leveraging text analytics and AI to assess police narrative events indicating human trafficking appeared first on SAS Blogs ..read more

ChatGPT from OpenAI has changed how the general public thinks about AI. What does this mean for analytics practitioners? The post ChatGPT brings AI into popular culture appeared first on SAS Blogs ..read more

Imagine trying to dig a useful bit of information out of 50,000 lines of a chat log? Now, imagine if that needle in the haystack was the difference in a criminal being arrested or staying at-large? Thousands of lines of confusing and unreadable chat text are more and more frequently [...] The post Law enforcement needs text analytics on the case to overcome massive data analysis challenge appeared first on SAS Blogs ..read more

Using such features and Natural Language Processing capabilities like text parsing and information extraction in SAS Visual Text Analytics (VTA) helps us uncover emerging trends and unlock the value of unstructured text data.  The post Find similar words in ESG data with Natural Language Processing appeared first on SAS Blogs ..read more

To find exact duplicates, matching all string pairs is the simplest approach, but it is not a very efficient or sufficient technique. Using the MD5 or SHA-1 hash algorithms can get us a correct outcome with a faster speed, yet near-duplicates would still not be on the radar. Text similarity is useful for finding files that look alike. There are various approaches to this and each of them has its own way to define documents that are considered duplicates. Furthermore, the definition of duplicate documents has implications for the type of processing and the results produced. Below are some of th ..read more

Data scientists in Cameroon joined forces to form team LangTech as a part of the SAS Global Hackathon. In the face of rapid digitalization and modernization, they sought a way to preserve indigenous African languages. There are over 1,000 African languages, but those with fewer than 100,000 speakers are considered "lost". Cameroon [...] The post Preserving indigenous African cultures using natural language processing appeared first on SAS Blogs ..read more