2
Modal
source link: https://console.dev/tools/modal
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Intensive cloud functions.
Serverless
Our review
What we like
Serverless access to GPUs for training and inference. Support for pipelining to allow transcriptions & encoding. Access to the latest LLMs and LoRA for fine-tuning. Supports parallel execution, cron jobs, queues. SDK allows easy switching between local and remote calls.
What we don't like
The SDK is Python only. 1s cold start, but you can warm up containers ready to serve traffic.
Reviewed: 2024-02-15
✦ Sponsored
All reviews are editorially independent, and partners must meet our selection criteria.
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK