Announcement: Recording for Computerphile about GPT-3
Added 2020-06-17 10:40:58 +0000 UTCJust thought I should let patrons know that we've had a go at recording Computerphile remotely, talking about OpenAI's new GPT-3 model.
I wanted to include a photo but there's really nothing to show since it's just me at my regular desk with Sean on the phone :/
Anyway hopefully that will be published soon, I'll link it here when it's out!
Comments
Oooh, I want a discussion on scaling, since GPT-3 is mostly just GPT-2 with 100x more parameters. If we had enough money to add even more parameters, how high could you scale it for GPT-4 or 5 and how many parameters until it's human level at text prediction?
GooGhoul
2020-06-19 20:06:49 +0000 UTC"humans love examples". riiiight. Thats exactly what an almost super intelligent AGI would say if it was desperate for more training data. Can we get a captcha feature in here plz?
2020-06-19 14:13:51 +0000 UTCcurious to see please do focus on examples humans love examples
loopuleasa
2020-06-19 07:27:29 +0000 UTC
