Democratizing the magic of ChatGPT with open models
source link: https://www.producthunt.com/posts/dolly-4
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Dolly
Democratizing the magic of ChatGPT with open models
Here's why this is cool:
Dolly is a cheap-to-build LLM that exhibits a surprising degree of the instruction following capabilities exhibited by ChatGPT. Whereas the work from the Alpaca team showed that state-of-the-art models could be coaxed into high quality instruction-following behavior, the Databricks team found that even years-old open source models with much earlier architectures exhibit striking behaviors when fine tuned on a small corpus of instruction training data. Dolly works by taking an existing open source 6 billion parameter model from EleutherAI and modifying it ever so slightly to elicit instruction following capabilities such as brainstorming and text generation not present in the original model, using data from Alpaca.
This means that these highly functional LLM patterns can be made available on much older, cheaper to run models, and is likely to continue the trend of democratizing access to generative AI.
This is really great!! Making creating your own Chat-GPT like LLM accesible for anyone, absolutely love it.
Well done ?makers!
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK