Artificial Intelligence
Out of context: Reply #155
- Started
- Last post
- 1,322 Responses
- imbecile1
https://ai.facebook.com/blog/dem…
Democratizing access to large-scale language models with OPT-175B
Large language models — natural language processing (NLP) systems with more than 100 billion parameters — have transformed NLP and AI research over the last few years. Trained on a massive and varied volume of text, they show surprising new capabilities to generate creative text, solve basic math problems, answer reading comprehension questions, and more. While in some cases the public can interact with these models through paid APIs, full research access is still limited to only a few highly resourced labs. This restricted access has limited researchers' ability to understand how and why these large language models work, hindering progress on efforts to improve their robustness and mitigate known issues such as bias and toxicity.