IBM Granite is a series of decoder-only AI foundation models created by IBM. It was announced on September 7, 2023,[3][4] and an initial paper was published 4 days later.[5] Initially intended for use in the IBM's cloud-based data and generative AI platform Watsonx along with other models,[6] IBM opened the source code of some code models.[7] Granite models are trained on datasets curated from Internet, academic publishings, code datasets, legal and finance documents.[8][9][1]
 | |
| Developer(s) | IBM Research[1] |
|---|---|
| Initial release | November 7, 2023 |
| Platform | IBM Watsonx (initially) GitHub Hugging Face RHEL AI |
| Type | |
| License | Proprietary Code models: Open Source (Apache 2.0)[2] |
Foundation models
A foundation model is an AI model trained on broad data at scale such that it can be adapted to a wide range of downstream tasks.[10]
Granite's first foundation models were Granite.13b.instruct and Granite.13b.chat. The "13b" in their name comes from 13 billion, the amount of parameters they have as models, lesser than most of the larger models of the time. Later models vary from 3 to 34 billion parameters.[3][11]
On May 6, 2024, IBM released the source code of four variations of Granite Code Models under Apache 2, an open source permissive license that allows completely free use, modification and sharing of the software, and put them on Hugging Face for public use.[12][13] According to IBM's own report, Granite 8b outperforms Llama 3 on several coding related tasks within similar range of parameters.[14][15]
See also
- Mistral AI, a company that also provides open source models
- GPT
- LLaMA
- Cyc
- Gemini
References
External links
Wikiwand in your browser!
Seamless Wikipedia browsing. On steroids.
Every time you click a link to Wikipedia, Wiktionary or Wikiquote in your browser's search results, it will show the modern Wikiwand interface.
Wikiwand extension is a five stars, simple, with minimum permission required to keep your browsing private, safe and transparent.
