Customer care organizations are facing the disruptions of an AI-enabled future, and gen AI is already impacting customer care organizations across use cases like agent co-pilots, summarizing calls and deriving insights, creating chatbots and more. In this blog post, we dive deep into these use cases and their business and operational impact. Then we show a demo of a call center app based on gen AI that you can follow along. For more details on this topic, you can watch the webinar this blog post is based on. Oana Cheta, Partner and Lead Gen AI Service Ops for North America at McKinsey & Co ..read more

GPU as a Service (GPUaaS) serves as a cost-effective solution for organizations who need more GPUs for their ML and gen AI operations. By optimizing the use of existing resources, GPUaaS allows organizations to build and deploy their applications, without waiting for new hardware. In this blog post, we explain how GPUaaS as a service works, how it can close the GPU shortage gap, when to use GPUaaS and how it fits with gen AI. How Companies are Dealing with the GPU Shortage Organizations need GPUs to be able to process large amounts of data simultaneously, speed up computational tasks and handl ..read more

Gen AI is quickly reshaping industries, and the pace of innovation is incredible to witness. The introduction of ChatGPT, Microsoft Copilot, Midjourney, Stable Diffusion and many more incredible tools have opened up new possibilities we couldn’t have imagined 18 months ago. While building gen AI application pilots is fairly straightforward, scaling them to production-ready, customer-facing implementations is a novel challenge for enterprises, and especially for the financial services sector. Risk, compliance, data privacy and escalating costs are just a few of the acute concerns that financial ..read more

Data engineers, data scientists and other data professional leaders have been racing to implement gen AI into their engineering efforts. But a successful deployment of LLMs has to go beyond prototyping, which is where LLMOps comes into play. LLMOps is MLOps for LLMs. It’s about ensuring rapid, streamlined, automated and ethical deployment of LLMs to production. This blog post delves into the concepts of LLMOps and MLOps, explaining how and when to use each one. To read more about LLMOps and MLOps, checkout the O’Reilly book “Implementing MLOps in the Enterprise”, authored by Iguazio’s CTO and ..read more

Across the industry, organizations are attempting to find ways to implement generative AI in their business and operations. But doing so requires significant engineering, quality data and overcoming risks. In this blog post, we show all the elements and practices you need to to take to productize LLMs and generative AI. You can watch the full talk this blog post is based on, which took place at ODSC West 2023, here. Definitions: Foundation Models, Gen AI, and LLMs Before diving into the practice of productizing LLMs, let’s review the basic definitions of GenAI elements: Foundation Models (FMs ..read more

Sense is a talent engagement company whose platform improves the recruitment processes with automation, AI and personalization. Since AI is a central pillar of their value offering, Sense has invested heavily in a robust engineering organization including a large number of data and AI professionals. This includes a data team, an analytics team, DevOps, AI/ML, and a data science team. The AI/Ml team is made up of ML engineers, data scientists and backend product engineers. The Challenge Like many organizations, the AI/ML team at Sense was finding it challenging to scale its ML operations. This ..read more

Sense is a talent engagement platform that improves recruitment processes with automation, AI and personalization. Since AI is a central pillar of their value offering, Sense has invested heavily in a robust engineering organization, including a large number of data and data science professionals. This includes a data team, an analytics team, DevOps, AI/ML, and a data science team. The AI/Ml team is made up of ML engineers, data scientists and backend product engineers. The Challenge: Scaling ML Operations Like many organizations, the AI/ML team at Sense was finding it challenging to scale its ..read more

2023 was the year of generative AI, with applications like ChatGPT, Bard and others becoming so mainstream we almost forgot what it was like to live in a world without them. Yet despite its seemingly revolutionary capabilities, it's important to remember that Generative AI is an extension of “traditional AI”, which in itself is a step in the digital transformation revolution. This means that in 2024, we’re likely to see businesses continue to seek ways to adopt generative AI as a way to enhance their operations. But this year, businesses will go beyond the hype. They will focus their resources ..read more

Introducing The New O'Reilly Book: Implementing MLOps in the Enterprise “Implementing MLOps in the Enterprise: A Production-First Approach” is a practical guide, authored by MLOps veterans Yaron Haviv and Noah Gift and published by O’Reilly, which guides leaders of data science, MLOps, ML engineering and data engineering on how to bring data science to life for a variety of real-world MLOps scenarios, including for generative AI. Drawing from their extensive experience in the field, the authors share their strategies, methodologies, tools and best practices for designing and building a contin ..read more

Successfully training AI and ML models relies not only on large quantities of data, but also on the quality of their annotations. Data annotation accuracy directly impacts the accuracy of a model and the reliability of its predictions. This is where human-annotated datasets come into play. Human-annotated datasets offer a level of precision, nuance, and contextual understanding that automated methods struggle to match. In this blog post, we bring the top 23 free human-annotated datasets you can use for your model training and evaluation. To cater to a wide variety of needs, these free datasets ..read more