Access and Feeds

Artificial Intelligence: Google’s Trillion-Parameter Predictive Language Model

By Dick Weisinger

GPT-3 the predictive language model created by OpenAI captured headlines last year when it showed that it could produce text and essays that couldn’t be distinguished from those written by a human.

Sam Altman, CEO of OpenAI, said that “the GPT-3 hype is way too much. It’s impressive (thanks for the nice compliments!) but it still has serious weaknesses and sometimes makes very silly mistakes. AI is going to change the world, but GPT-3 is just a very early glimpse. We have a lot still to figure out.”

In 2021, Google is trying to one-up the GPT-3 model with its own. GPT-3 was trained on a language model that contains 175 billion parameters. Google has announced a 1.6 trillion parameter model. Other than size though, there was no attempt to compare the capabilities of the Google model with those of GPT-3.

It will be interesting to see where AI developments lead this year.

Digg This
Reddit This
Stumble Now!
Buzz This
Vote on DZone
Share on Facebook
Bookmark this on Delicious
Kick It on DotNetKicks.com
Shout it
Share on LinkedIn
Bookmark this on Technorati
Post on Twitter
Google Buzz (aka. Google Reader)

Leave a Reply

Your email address will not be published. Required fields are marked *

*