fix things
Deploy Website / build (push) Successful in 20s Details

This commit is contained in:
James Ravenscroft 2024-09-08 18:06:18 +01:00
parent b449c15174
commit 229870e97d
1 changed files with 10 additions and 5 deletions

View File

@ -1,13 +1,16 @@
---
categories:
- AI and Machine Learning
date: '2024-09-05 14:17:39'
- AI and Machine Learning
date: "2024-09-05 14:17:39"
draft: false
tags:
- AI
- llms
- AI
- llms
title: Running Phi MoE 3.5 on Macbook Pro
type: posts
mp-syndicate-to:
- https://brid.gy/publish/mastodon
- https://brid.gy/publish/twitter
url: /2024/09/05/runing-phi-moe-3-5-on-macbook-pro/
---
@ -96,6 +99,7 @@ cargo install --path mistralrs-server --features metal</pre>
<figure class="wp-block-image size-large"><img src="/media/image-1024x466_2f2e29bd.png" alt="Screenshot of a REST tooling interface. A pane on the left shows a json payload that was sent to the server containing messages to the model telling it to behave as a useful assistant and write a poem.
On the right is the response which contains a message and the beginning of a poem as written by the model." class="wp-image-3999"/></figure>
<!-- /wp:image -->
<!-- wp:paragraph -->
@ -126,6 +130,7 @@ On the right is the response which contains a message and the beginning of a poe
<figure class="wp-block-image size-large"><img src="/media/image-1-1024x674_477cd2fe.png" alt="Screenshot of a REST interface. A pane on the left shows a json payload that was sent to the server containing messages to the model telling it to analyse an image url.
On the right is the response which describes the mountain in the picture that was sent." class="wp-image-4000"/></figure>
<!-- /wp:image -->
<!-- wp:paragraph -->