Dolly 2.0: A New Open Source Language Model Trained Like ChatGPT

Share on facebook
Share on google
Share on twitter
Share on linkedin

When ChatGPT came into the market, it was a matter of discussion among individuals, and now the same is with Dolly 2.0, similar to ChatGPT. You also heard of Dolly 2.0, an innovation of Databricks. But are you familiar with this technology, and what’s new in this model? This concise writing will give you a deep understanding of Dolly 2.0.

What is Dolly 2.0?

Dolly 2.0 is an open-source large language model that follows up the instructions. It is available on an open-source data set generated by a human being. Databricks releases it for commercial purposes and is a compelling competitor to ChatGPT.

Dolly 2.0

By unleashing Dolly 2.0, the company, i.e., Databricks. It gives organizations access to develop and customize large language models. They can do so without sharing the data with other third parties or paying any fees for accessing API.

Dolly 2.0 is based on EleutherAI’s Pythia model and tweaks the training data that the employees of Databricks enter into it. This calibration gives Dolly 2.0 a higher ability than OpenAI’s ChatGPT. Which can only answer questions and engage with users in a chatbot than the raw LLM.

Release Of Dolly 1.0

The company released the first version of Dolly, i.e., Dolly 1.0. But encountered some limitations regarding its commercial use because the training data is subjected to the terms of service of OpenAI and includes output from the output from ChatGPT. 

The company created another new data set for commercial use to resolve this issue. After various demonstrations and participation, they get their resulting dataset, i.e., Dolly 2.0. The company releases Dolly 2.0 under the Creative Commons license with a fully open-source training code and weights. By doing so, the company enables anyone to use, extend, or modify the data set for their purposes.

Dolly 2.0 vs. ChatGPT and LLaMA

Dolly 2.0 differs from ChatGPT as it is an open-source large language model where users do not need to pay an API fee. But in ChatGPT, users must pay a certain amount of API fees to access the API. And they also adhere to several specific terms of service, limiting the customization option and technology flexibility for organizations and businesses.

chatgpt

Similarly, Meta also developed a technology named LLaMA which was a partial open-source model. Unfortunately, it has offshoots several backslashes. In recent years, it has been so because it does not allow commercial use of the technology, and its weights also leaked.

Conclusion

Dolly 2.0 is one of the exciting technologies with a fine-tuned set of instructions. The most exciting thing about Dolly 2.0 is that it is an open-source LLM with open weights and training codes and has registration with the Creative Commons (CC) license. Also, it could compete with ChatGPT and bring a spark to the wave of open-source large language models.

SEE ALSO: ChatGPT for content and SEO

Sign up for our Newsletter

Talk to Digital Expert Now!