GPT-3: Writing Buddy or Job Taker?
Back in August, The Hustle Daily had a feature called “Lights, camera… algorithm?” that described how GPT-3 (an artificial intelligence language model created by OpenAI — a company backed by Elon Musk) might replace film directors…and software engineers…and actors. Yeah, pretty much everyone involved in making a film.
That sounds pretty cool. But I can sense you’re a bit upset.
It was actually something else in the article that got my attention — an almost whispered remark about how a college student used GPT-3 to write blog posts that took him to the top of Hacker News (whatever that is…seriously, if you read Hacker News, lmk why).
Notwithstanding the platform, I felt that twinge of uncertainty that General Motors workers must have felt the first time they came face-to-robotic arm with the Industry 3.0 assistant known as My Buddy.
A bot that can do my job? Really? I needed some answers.
OK. So how does GPT-3 work?
First of all, it knows a lot. It has read like the whole internet. And it has a lot of computing power.
But if you’re anything like me, you need a reminder on the difference between artificial intelligence (AI), machine learning (ML), and that dark horse we call deep learning (DL).
Here’s how I understand it:
AI = you can’t have ML or DL without it. It’s the theory that machines can be SMART.
ML = makes AI possible. Otherwise, you have a computer with a lot of information but incapable of learning what to do with it.
DL = takes ML to another level by making artificial intelligence resemble the patterns the human brain uses to learn.
So GPT-3 is capable of turning data (all the poems, blogs, songs — everything it has ever read) and its brainpower — based on an algorithm — into writing that’s dynamic and probably better than what your local reporter could write.
Ahh…the sad plight of the small-town journalist. So, what does the name mean, smartypants?
Generative Pre-trained Transformer 3.
I’m guessing that means there were two versions of this before the current one. And, likely, someday there will be a GPT-4 and -5?
It’s true! GPT-3 didn’t just materialize from the Musk-o-sphere. It also seems that there may be an even better version out by 2023.
This sounds a bit like the Terminator.
I might say that if I really knew what I was talking about. To be honest, I’m in over my head when we get into discussions of billions of params, knowledge distillation, supervised learning. There’s a lot going on that doesn’t cross my desk on a typical day!
I just want to know what a deepfake is.
This article from Will Douglas Heaven (@strwbilly) in the MIT Technology Review explains a lot. Supposedly, GPT-3 can make up a good story, but it’s not obligated to tell the truth. It might, for instance, be able to convince someone of a recent Big Foot sighting, but fail to be able to tell you when Puerto Rico became a U.S. state (it hasn’t).
Another article from CNBC shows some interesting experiments. In one, GPT-3 has a fascinating conversation with Merzmensch Kosmopol (@Merzmensch) about whether God (no relation to Will Douglas Heaven, I don’t think) exists. But, in another, the bot comes off totally inappropriate, irresponsible, and racist on historically sensitive subjects and minorities.
What else?
Let’s see. GPT-3 doesn’t have a long-term memory. It lacks humility. It might not be all that intelligent, really. Although it might be able to write code (that’s a wink to all my code writing friends out there).
Sorta like Roomba — always getting stuck under the chair.
Yeah, sorta. But if you want to talk about AI sweepers, you should look into Diffbot. Here’s how it works according to MIT Technology Review:
“Like GPT-3, Diffbot’s system learns by vacuuming up vast amounts of human-written text found online. But instead of using that data to train a language model, Diffbot turns what it reads into a series of three-part factoids that relate one thing to another: subject, verb, object.”
Who uses Diffbot?
Ever heard of Snapchat? It uses Diffbot to create its news highlights. Or ever wonder how DuckDuckGo can compete with Google?
It always comes back to DuckDuckGo, doesn’t it?
It really does.
Well, what’s the verdict…are you down with GPT-3?
That remains to be seen. I’m just hoping it does less writing and more piloting.
Oh, like going to network on a pilot. Way to bring it back to film.
No, I mean actually piloting. Thanks again to The Hustle Daily for spotlighting the Defense Advanced Research Projects Agency’s recent AI trials that featured a real-life pilot going head-to-head with an AI-driven bot. Spoiler alert: An algorithm created by Heron Systems won all 5 simulations.
So you’re saying that if GPT-3 writes, directs, and stars in Top Gun 3 — it’ll probably be flying Roombas trying to bring down the Red Baron?
Exactly, Iceman. Exactly.
