fix things
Deploy Website / build (push) Successful in 20s
Details
Deploy Website / build (push) Successful in 20s
Details
This commit is contained in:
parent
b449c15174
commit
229870e97d
|
@ -1,13 +1,16 @@
|
||||||
---
|
---
|
||||||
categories:
|
categories:
|
||||||
- AI and Machine Learning
|
- AI and Machine Learning
|
||||||
date: '2024-09-05 14:17:39'
|
date: "2024-09-05 14:17:39"
|
||||||
draft: false
|
draft: false
|
||||||
tags:
|
tags:
|
||||||
- AI
|
- AI
|
||||||
- llms
|
- llms
|
||||||
title: Running Phi MoE 3.5 on Macbook Pro
|
title: Running Phi MoE 3.5 on Macbook Pro
|
||||||
type: posts
|
type: posts
|
||||||
|
mp-syndicate-to:
|
||||||
|
- https://brid.gy/publish/mastodon
|
||||||
|
- https://brid.gy/publish/twitter
|
||||||
url: /2024/09/05/runing-phi-moe-3-5-on-macbook-pro/
|
url: /2024/09/05/runing-phi-moe-3-5-on-macbook-pro/
|
||||||
---
|
---
|
||||||
|
|
||||||
|
@ -96,6 +99,7 @@ cargo install --path mistralrs-server --features metal</pre>
|
||||||
<figure class="wp-block-image size-large"><img src="/media/image-1024x466_2f2e29bd.png" alt="Screenshot of a REST tooling interface. A pane on the left shows a json payload that was sent to the server containing messages to the model telling it to behave as a useful assistant and write a poem.
|
<figure class="wp-block-image size-large"><img src="/media/image-1024x466_2f2e29bd.png" alt="Screenshot of a REST tooling interface. A pane on the left shows a json payload that was sent to the server containing messages to the model telling it to behave as a useful assistant and write a poem.
|
||||||
|
|
||||||
On the right is the response which contains a message and the beginning of a poem as written by the model." class="wp-image-3999"/></figure>
|
On the right is the response which contains a message and the beginning of a poem as written by the model." class="wp-image-3999"/></figure>
|
||||||
|
|
||||||
<!-- /wp:image -->
|
<!-- /wp:image -->
|
||||||
|
|
||||||
<!-- wp:paragraph -->
|
<!-- wp:paragraph -->
|
||||||
|
@ -126,6 +130,7 @@ On the right is the response which contains a message and the beginning of a poe
|
||||||
<figure class="wp-block-image size-large"><img src="/media/image-1-1024x674_477cd2fe.png" alt="Screenshot of a REST interface. A pane on the left shows a json payload that was sent to the server containing messages to the model telling it to analyse an image url.
|
<figure class="wp-block-image size-large"><img src="/media/image-1-1024x674_477cd2fe.png" alt="Screenshot of a REST interface. A pane on the left shows a json payload that was sent to the server containing messages to the model telling it to analyse an image url.
|
||||||
|
|
||||||
On the right is the response which describes the mountain in the picture that was sent." class="wp-image-4000"/></figure>
|
On the right is the response which describes the mountain in the picture that was sent." class="wp-image-4000"/></figure>
|
||||||
|
|
||||||
<!-- /wp:image -->
|
<!-- /wp:image -->
|
||||||
|
|
||||||
<!-- wp:paragraph -->
|
<!-- wp:paragraph -->
|
||||||
|
|
Loading…
Reference in New Issue