This repository has been archived by the owner on Oct 14, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 8
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #322 from janhq/eckartal-patch-17
Create v0.5.4 changelog post
- Loading branch information
Showing
1 changed file
with
35 additions
and
0 deletions.
There are no files selected for viewing
35 changes: 35 additions & 0 deletions
35
src/pages/changelog/2024-09-17-improved-cpu-performance.mdx
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,35 @@ | ||
--- | ||
title: "Jan is faster now" | ||
version: 0.5.4 | ||
description: "Jan has faster CPU inference." | ||
date: 2024-09-17 | ||
ogImage: "/assets/images/changelog/jan-v0.5.4.jpg" | ||
--- | ||
|
||
import ChangelogHeader from "@/components/Changelog/ChangelogHeader" | ||
|
||
<ChangelogHeader title= "Jan is faster now" date="2024-09-01" ogImage= "/assets/images/changelog/jan-v0.5.4.jpg" /> | ||
|
||
Over the last few weeks, we've been working on improving Jan's stability. Every update helps us make Jan's experience faster and smoother. | ||
With version 0.5.4, you’ll notice AI running quicker on CPU - better performance all around. | ||
|
||
### Model Downloads | ||
You can now download models directly from the model selector in Threads. No more jumping between different tabs – just pick, download, and get started. | ||
|
||
### Fast CPU Inference | ||
We've addressed the slower inference speeds on CPU, so you'll notice faster processing times, especially when using larger models. | ||
|
||
### Model Starts | ||
We tackled the notorious "model can't start / The specified module could not be found" error. | ||
Plus, Phi-3 models are now working smoothly even if you're using an outdated version. | ||
|
||
### Consistent Warnings | ||
Performance warnings are now aligned between Model Hub and Threads, giving you more reliable insights no matter where you're working. | ||
|
||
### Persistent Thread Settings | ||
Switching between threads used to reset your instruction settings. That’s fixed now! Your settings will stay intact as you jump between old and new threads. | ||
|
||
### Minor UI Tweaks & Bug Fixes | ||
We’ve also resolved issues with the input slider on the right panel and tackled several smaller bugs to keep everything running smoothly. | ||
|
||
For more details, see the [GitHub release notes](https://github.com/janhq/jan/releases/tag/v0.5.4). |