diff --git a/brainsteam/content/posts/2024/09/05/Running Phi MoE 3.5 on Macbook Pro.md b/brainsteam/content/posts/2024/09/05/Running Phi MoE 3.5 on Macbook Pro.md index 4c9b8b1..faff5ac 100644 --- a/brainsteam/content/posts/2024/09/05/Running Phi MoE 3.5 on Macbook Pro.md +++ b/brainsteam/content/posts/2024/09/05/Running Phi MoE 3.5 on Macbook Pro.md @@ -1,13 +1,16 @@ --- categories: -- AI and Machine Learning -date: '2024-09-05 14:17:39' + - AI and Machine Learning +date: "2024-09-05 14:17:39" draft: false tags: -- AI -- llms + - AI + - llms title: Running Phi MoE 3.5 on Macbook Pro type: posts +mp-syndicate-to: + - https://brid.gy/publish/mastodon + - https://brid.gy/publish/twitter url: /2024/09/05/runing-phi-moe-3-5-on-macbook-pro/ --- @@ -96,6 +99,7 @@ cargo install --path mistralrs-server --features metal
Screenshot of a REST tooling interface. A pane on the left shows a json payload that was sent to the server containing messages to the model telling it to behave as a useful assistant and write a poem.
 
 On the right is the response which contains a message and the beginning of a poem as written by the model.
+ @@ -126,6 +130,7 @@ On the right is the response which contains a message and the beginning of a poe
Screenshot of a REST interface. A pane on the left shows a json payload that was sent to the server containing messages to the model telling it to analyse an image url.
 
 On the right is the response which describes the mountain in the picture that was sent.
+ @@ -146,4 +151,4 @@ On the right is the response which describes the mountain in the picture that wa

- \ No newline at end of file +