Last year, we discussed running Hosted Jupyter Notebooks and VS Code (Code Server) on your Kubernetes Clusters. We compared several approaches and existing solutions including renting and managing VMs. We then described our approaches to address usability issues to make the experience nicer and abstract away Kubernetes details. Since then we have received lots of feedback from our customers, primarily the lack of a better development experience for full-fledged apps. While Jupyter Lab is great for interactive notebooks and lightweight editing, pushing it to full IDE capabilities might require ..read more

LLMs have revolutionized the field of machine learning, leveraging the power of GPUs extensively. Many of you may already be familiar with Nvidia A100 or T4 instances, which are commonly used for various benchmarks on fine-tuning and LLM deployment. But do you know which machine type to select for these tasks in your cloud environment? Understanding the plethora of machine types available across different cloud platforms can be quite daunting, not only for Data Scientists but even for DevOps teams. Picking the right machine for your ML work can be tough. But don't worry, cloud providers have ..read more

We are back with another episode of  True ML Talks. In this, we again dive deep into MLOps pipelines and LLMs Applications in enterprises as we are speaking with Sandeep Singh Sandeep is the head of machine learning applied AI at the company called Beans AI. ? Our conversations with Sandeep will cover below aspects: - Revolutionizing Location Intelligence with AI - The Machine Learning Engine Behind Beans.AI - Beyond the Cloud: A Hybrid Machine Learning Workflow - A Deep Dive into the Model Zoo - Managing Large Language Models - Experimentation vs. Cost in Model Hosting Watch the full ..read more

TrueFoundry users can deploy Jupyter Notebooks on their personal cloud accounts, such as AWS, Azure, or GCP. This feature allows them to conduct machine learning experiments and training jobs on their own machines with ease. Initially, notebooks deployed through TrueFoundry were secured using a username-password combination. However, in response to widespread client requests, we have integrated Single Sign-On. This means users can now conveniently access their notebooks with the same login they use for TrueFoundry. This blog post delves into the specifics of how we implemented this feature. L ..read more

We are back with another episode of True ML Talks. In this, we again dive deep into GenAI and LLMs for Sales Outreach at OneShot and we are speaking with Peda Venki Pola Venki is the founder and CTO at OneShot and before this, he worked at Salesforce as a Software Architect. OneShot helps B2B SaaS companies to generate the top of the funnel for their business. ? Our conversations with Venki will cover below aspects: - AI-Powered Sales Outreach - Unique pricing model at OneShot - Tech Stack at OneShot - How OneShot Manages LLMs with Prompts - Full-Stack Goes AI: How LLMs are Redefining Develo ..read more

In the last few months, we have had the opportunity to work with a lean butted team. They have developed a state-of-the-art deep learning model and created partnerships to extremely talen ship it to more than 10 million users. The last missing piece in their impact story was handling the engineering to accomplish this. The model was compute-heavy, and at the scale that they wanted to serve this model to its end users, they needed a reliable and performant infrastructure stack that the 2 of them could manage (1 DevOps Engineer and 1 ML Engineer). Need for Async Deployment The model was built t ..read more

We are back with another episode of  True ML Talks. In this, we dive deep into GenAI and LLMOps strategy in Level AI as we are speaking with Abhimanyu Talwar Abhimanyu is Staff AI Research Engineer at Level AI. Level AI a conversational intelligence company. They use machine learning to get insights out of conversational data. ? Our conversations with Abhimanyu will cover below aspects: - Tackling the Hidden Challenges of Generative AI - Open Source vs. Fine-Tuning - Understanding Agents - Demystifying Contact Center QA with AI - Customer Service AI with GPT-4 - MLOPs Revolutionizing Cu ..read more

If you are in amidst of a compliance or trying to begin its difficult journey, you might find lot of red alerts for the EC2 instances you are spinning up. Moreover, you also start to question the usage of your default Amazon Linux images, whether they are right for your use case? You might be wondering if there is/are custom AMI(s) which might support your containerized workloads, has less overhead to patch and provider better security. Bottlerocket is a purpose-built Linux-based operating system meticulously crafted to serve as an optimal container host. Designed to reduce unnecessary overhe ..read more

We are back with another episode of  True ML Talks. In this, we again dive deep into MLOps pipelines and LLMs Applications in enterprises as we are speaking with Labhesh Patel. Labhesh was a CTO and Chief Scientist at Jumio Corporation, where he worked in leveraging ML / AI in identity verification space. He has held multiple leadership positions, both in engineering and science roles in the past, with leading organizations. ? Our conversations with Labhesh will cover below aspects: - Interesting Research Papers and Patents - Utilizing AI to solve business problems - Building the MLOps ..read more

As 2023 draws to a close, it’s time to reflect on TrueFoundry’s journey over the past year. This reflection isn’t just a celebration of our achievements but also an acknowledgment of the challenges we’ve navigated, appreciation of the opportunities we have been presented with and the learnings we’ve embraced. Instead of focusing on operational details, we will walk you through a chronological journey of learnings and realizations indexed on our thesis on MLOPs- and how things played out in reality.  I am a personally a space enthusiast, so I find the traditional analogy of startups as ro ..read more