10

雲端上面的 GPU 資源費用,以及地端的 GPU 決策圖

 1 year ago
source link: https://blog.gslin.org/archives/2023/05/22/11197/%e9%9b%b2%e7%ab%af%e4%b8%8a%e9%9d%a2%e7%9a%84-gpu-%e8%b3%87%e6%ba%90%e8%b2%bb%e7%94%a8%ef%bc%8c%e4%bb%a5%e5%8f%8a%e5%9c%b0%e7%ab%af%e7%9a%84-gpu-%e6%b1%ba%e7%ad%96%e5%9c%96/
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

雲端上面的 GPU 資源費用,以及地端的 GPU 決策圖

Hacker News 上面看到「Cloud GPU Resources and Pricing (fullstackdeeplearning.com)」這篇,原網頁是「Cloud GPUs - The Full Stack」,裡面有些有用的資源可以拉出來獨立看。

雲端的選擇上,因為 H100 看起來還沒普及,所以用上一代的 A100 (80GB) 來看,可以看到大的雲端跟其他家的差異還是蠻大的:

1684720146-36616a25.png

不過這邊好像沒把 vast.ai 放進來。

地端的資訊主要是直接購買顯示卡時的選擇,可以看到如果除了各系列的旗艦卡外 (4090 & 3090 & 2080),3060 是一張會在考慮到「便宜」而上榜的卡,應該是因為他是一張入門價位的顯卡,卻有 12GB VRAM 的關係:

1684719766-f7ca6327.png

在接下來七月要推出的 4060 會出 16GB VRAM 版本,應該會取代現在 3060 12GB VRAM 的地位...

Related

四個 HDMI 的顯示卡

在 Facebook 上正妹 wens 問是不是用華碩的 GT710-4H-SL-2GD5 這張顯示卡:「The Most Innovative ~$50 Graphics Card For Linux Users」,看了一下是一張蠻有趣的顯示卡,而且價位還蠻有競爭力的,拉一篇出來記錄好了... 我自己是用四螢幕,先前一直都是用 1080 Ti 在接 (2 HDMI + 2 DP),但覺得好像太吃電,後來在網路上弄了一張有四個 miniDP 輸出的 Quadro P600 顯示卡,另外又找了四條 miniDP 轉 DP 的線。 換上去後發現有時候不是那麼順,後來發現是因為常常開一堆 Twitch 反而吃了不少 GPU 資源 (在 Linux 下可以用 nvidia-smi 觀察),而且有時候還是希望跑個 KataGo 分析圍棋棋局,所以還是需要 GPU 計算能力,就換回用 1080 Ti 了...…

October 25, 2020

In "Computer"

DHH 一系列從雲端搬回地端的文章

因為 37signals 陸陸續續把所有的服務從雲端搬回地端,DHH 從去年開始寫了一系列相關的文章,開頭應該是這篇:「Why we're leaving the cloud」。 最近的「Cloud exit pays off in performance too」這篇看到個有趣的東西,提到現在的硬體可以很大台,大到可以直接吃整個 Basecamp 服務: In fact, given that each of our new Dell R7625s have 196 vCPUs, we could actually run the entire Basecamp Classic application, including databases and Redis, on a single such machine! That's just…

May 5, 2023

In "Cloud"

這兩個禮拜爆紅的 Stable Diffusion

Stable Diffusion 是 Stability AI 訓練出來的 model,跟之前提到的 DALL-E 最大的差異就是產生出的圖的限制少很多: Unlike competing models like DALL-E, Stable Diffusion is open source and does not artificially limit the images it produces, though the license prohibits certain harmful use cases. 這也造就了這兩個禮拜整個 Stable Diffusion 的各種應用急速成長。 用 Simon Willison 的「Stable Diffusion is a really big deal」這篇來當作總覽還不錯。…

September 6, 2022

In "Computer"

a611ee8db44c8d03a20edf0bf5a71d80?s=49&d=identicon&r=gAuthor Gea-Suan LinPosted on May 22, 2023Categories Cloud, Computer, Hardware, Murmuring, Network, ServiceTags card, cloud, gpu, graphic, nvidia, video

Leave a Reply

Your email address will not be published. Required fields are marked *

Comment *

Name *

Email *

Website

Notify me of follow-up comments by email.

Notify me of new posts by email.

To respond on your own website, enter the URL of your response which should contain a link to this post's permalink URL. Your response will then appear (possibly after moderation) on this page. Want to update or remove your response? Update or delete your post and re-enter your post's URL again. (Learn More)

Post navigation


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK