-
Notifications
You must be signed in to change notification settings - Fork 13
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
e4319f0
commit 6516c2c
Showing
5 changed files
with
49 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
+++ | ||
title = 'Running DeepSeek on RISC-V with Successful XTheadVector Extension Enablement' | ||
date = 2025-02-15 | ||
|
||
+++ | ||
|
||
At this week's offline exchange event organized by the Institute of Software, Chinese Academy of Sciences, colleagues from the PLCT laboratory testing team demonstrated how to use the toolchain integrated with RuyiSDK to run the DeepSeek R1 Distill model on the Milk-V Pioneer Box equipped with the SG2042 processor, successfully accelerating it using the XTheadVector extension. This indicates that all chip modules/development boards supporting the XTheadVector (including RVV0.7.1) extension (such as TH1520/Milk-V Meles) can more fully utilize hardware computing power when running large models like DeepSeek. | ||
|
||
[Read the full article](https://mp.weixin.qq.com/s/q9SfHv4rlOhXpw8jchX3hA) | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
+++ | ||
title = 'Running DeepSeek on RISC-V with Successful XTheadVector Extension Enablement' | ||
date = 2025-02-15 | ||
|
||
+++ | ||
|
||
At this week's offline exchange event organized by the Institute of Software, Chinese Academy of Sciences, colleagues from the PLCT laboratory testing team demonstrated how to use the toolchain integrated with RuyiSDK to run the DeepSeek R1 Distill model on the Milk-V Pioneer Box equipped with the SG2042 processor, successfully accelerating it using the XTheadVector extension. This indicates that all chip modules/development boards supporting the XTheadVector (including RVV0.7.1) extension (such as TH1520/Milk-V Meles) can more fully utilize hardware computing power when running large models like DeepSeek. | ||
|
||
[Read the full article](https://mp.weixin.qq.com/s/q9SfHv4rlOhXpw8jchX3hA) | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
+++ | ||
title = 'Running DeepSeek on RISC-V with Successful XTheadVector Extension Enablement' | ||
date = 2025-02-15 | ||
|
||
+++ | ||
|
||
At this week's offline exchange event organized by the Institute of Software, Chinese Academy of Sciences, colleagues from the PLCT laboratory testing team demonstrated how to use the toolchain integrated with RuyiSDK to run the DeepSeek R1 Distill model on the Milk-V Pioneer Box equipped with the SG2042 processor, successfully accelerating it using the XTheadVector extension. This indicates that all chip modules/development boards supporting the XTheadVector (including RVV0.7.1) extension (such as TH1520/Milk-V Meles) can more fully utilize hardware computing power when running large models like DeepSeek. | ||
|
||
[Read the full article](https://mp.weixin.qq.com/s/q9SfHv4rlOhXpw8jchX3hA) | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
+++ | ||
title = 'Running DeepSeek on RISC-V with Successful XTheadVector Extension Enablement' | ||
date = 2025-02-15 | ||
|
||
+++ | ||
|
||
At this week's offline exchange event organized by the Institute of Software, Chinese Academy of Sciences, colleagues from the PLCT laboratory testing team demonstrated how to use the toolchain integrated with RuyiSDK to run the DeepSeek R1 Distill model on the Milk-V Pioneer Box equipped with the SG2042 processor, successfully accelerating it using the XTheadVector extension. This indicates that all chip modules/development boards supporting the XTheadVector (including RVV0.7.1) extension (such as TH1520/Milk-V Meles) can more fully utilize hardware computing power when running large models like DeepSeek. | ||
|
||
[Read the full article](https://mp.weixin.qq.com/s/q9SfHv4rlOhXpw8jchX3hA) | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,9 @@ | ||
+++ | ||
title = '在RISC-V上运行DeepSeek并成功启用XTheadVector扩展:RuyiSDK开发者全家桶里还有这种好东西!' | ||
date = 2025-02-15 | ||
|
||
+++ | ||
|
||
本周五在中国科学院软件研究所组织的线下交流活动中,来自 PLCT 实验室测试团队的伙伴们展示了如何使用 RuyiSDK 集成的工具链,在搭载 SG2042 处理器的 Milk-V Pioneer Box 上运行起来 DeepSeek R1 Distill 模型,并且成功利用XTheadVector扩展进行了加速。这也表示所有支持 XTheadVector(含RVV0.7.1) 扩展的芯片模组/开发板(例如 TH1520/Milk-V Meles)在运行 DeepSeek 等大模型时可以更为充分的利用硬件算力。 | ||
|
||
[阅读全文](https://mp.weixin.qq.com/s/q9SfHv4rlOhXpw8jchX3hA) |