Alternatives to VMware virtualization?
Marius Sandbu
by msandbu
1w ago
With all the turmoil around VMware, should you consider moving to an alternative platform? With all the changes happening in VMware, both at the company and licensing changes many are looking towards changing to another virtualization layer. Why? 1: They have gotten a price increase on their license, for many of the smaller customers they will most likely get a price increase in their license. This is because of the product bundles that are changing (VMware by Broadcom Dramatically Simplifies Offer Lineup and Licensing Model – VMware News and Stories) which makes sense for the larger enterpri ..read more
Visit website
The current state of Generative AI and LLMs
Marius Sandbu
by msandbu
1w ago
In preparation for my upcoming session at Experts Live Denmark, I wanted to write a blog post showing the overall state of generative AI and LLMs. There is a lot of development happening here now and therefore I wanted to give a current overview of the different models, support for multi-modality, integrations and give a glimpse into what is going on in terms of autonomous agents. Note, that this is my personal reflection based upon my own experience and based upon knowledge I have built up during the course of the last years. What is Generative AI? Let’s start with the basic part, what is Gen ..read more
Visit website
Running an LLM on Windows or Mac using Ollama
Marius Sandbu
by msandbu
2w ago
One of the easiest ways to get started with running LLMs locally on your own machine is using Ollama. Ollama is an open-source product that provides a local llm inference API that you can interact it. It also provides a CLI tool that you can also use to interact with in real-time. You can also add your own data models, if you for instance have a data set that you need to merge with a base LLM. You can download the tool from here Ollama and it has a set of predefined models that you can download and use –> library (ollama.com) Ollama also supports the same OpenAI compatibility as o ..read more
Visit website
Microsoft Azure Encryption at host – What is it actually?
Marius Sandbu
by msandbu
2w ago
To clear some of the confusion around this new encryption feature in Microsoft Azure called Encryption at host, what does it actually do? When reading the documentation from Microsoft is states the following “When you enable encryption at host, that encryption starts on the VM host itself, the Azure server that your VM is allocated to. The data for your temporary disk and OS/data disk caches are stored on that VM host. After enabling encryption at host, all this data is encrypted at rest and flows encrypted to the Storage service, where it’s persisted. Essentially, encryption at host encrypts ..read more
Visit website
How do you secure an GenAI application or service?
Marius Sandbu
by msandbu
1M ago
While there are many blog posts and articles mentioning WHY you should secure your GenAI services or applications that you are building, almost none of the describe the tools and methods to secure them. Therefore, I decided to write my own blog post on what kind of security risks you can have with building Gen AI tools and how you can secure them. Let’s start with an overview visualization of how many of the regular RAG based services are built and work. This visualization below shows much of the different components involved in a RAG (Retrieval Augmented Generation) application. Where the pur ..read more
Visit website
How Microsoft’s different Copilot offerings ACTUALLY work
Marius Sandbu
by msandbu
2M ago
I have been reading so many bad blog posts lately regarding Microsoft Copilot and how they work that I decided to write a bit more in-depth the inner workings of the different offerings so that you can get some more sense on how they actually work. While I wrote a somewhat intro here –> How do the different Copilot services from Microsoft actually work? – msandbu.org however I wanted to go more in-depth. Firstly, we need to understand the ecosystem. All the different Copilot offerings from Microsoft is using a service underneath called Azure OpenAI (which is a managed service) but for the s ..read more
Visit website
Part two: Infection and lateral movement of Ransomware attack
Marius Sandbu
by msandbu
2M ago
This is a follow-up of my series on Ransomware (Part One: Analyzing the Anatomy of a Ransomware Attack – msandbu.org) the reason why I released this follow-up is that lately we have seen a large increase in Ransomware attacks. The reason behind this is that because lately there have been many critical vulnerabilities related to external services such as VPN, VDI and web based services that have been exploited heavily by the different active ransomware groups. In the first part I focused on the initial attack, on how the attackers get access. In this blog post I want to focus on what happens af ..read more
Visit website
Microsoft debuts Copilot Pro
Marius Sandbu
by msandbu
2M ago
Copilot Pro debuts today, offering a premium subscription at $20 per month. This service includes AI-enhanced functionalities within Office applications such as Word, Excel, and PowerPoint. Additionally, subscribers gain priority access to the newest OpenAI models and the capability to create their personalized Copilot GPT. Similar to what ChatGPT has with ChatGPT Plus. Apart from its integration with Office, Copilot Pro also offers access to the most recent OpenAI models, enhanced capabilities in the Image Creator from Designer (previously known as Bing Image Creator), and the option to devel ..read more
Visit website
Delegate role assignment management with conditions in Microsoft Azure
Marius Sandbu
by msandbu
2M ago
The Owner and User Access Administrator roles let you set up who can do what in your subscription. Basically, if you’re in one of these roles, you can decide who gets to change, see, or delete stuff. Want to hand over these powers to someone else? Just make them an Owner or User Access Administrator. The Delegate role gives someone total access within its scope, which goes against the “least privilege” rule. This can increase your risk because it opens more ways for attacks to happen. A safer approach than giving someone the Owner or User Access Administrator roles is to limit how much power ..read more
Visit website
Private AI and private LLMs
Marius Sandbu
by msandbu
3M ago
With the release of ChatGPT it gave the regular end-user access to generative AI at their fingertips, which then started a domino effect on the development of new generative AI services in the market. All cloud providers are doubling down their development and efforts on building Generative AI capabilities. Microsoft focused on Copilot offerings, Google on Duet and Gemini and AWS on Bedrock and Q which are now new cloud offerings that has been released in the last year. However there are still many scenarios and use-cases where you might need to have private hosted generative AI services, mean ..read more
Visit website

Follow Marius Sandbu on FeedSpot

Continue with Google
Continue with Apple
OR