This is cool and all but all these AI hype demos always show something extremely simple and overdone in the training data. Reminds me of those ChatGPT videos where someone writes “make me Pong in javascript” and gets surprised that it does despite the fact that it probably trained on 100,000+ Pong in Javascript scripts.
Yes, it made Breakout, very cool. Now ask it to do something new or make a game that’s more complicated than a game that’s been remade a million times. LLMs are very far away from making real games.
Make up some new game - doesn’t have to be good or terribly unique, just novel enough to have negligible prior art - and see if the robot does the thing.
I’m not the one playing ‘AI is whatever hasn’t been done.’
I’m thoroughly familiar with how these technologies work and their present shortcomings. This guy is joking when he says programming is over. But it doesn’t take a diehard fanboy to acknowledge that this was impossible a year ago, and is getting more democratized as it gets more capable, and it is getting more and more capable.
Not like a corpus of published text is big data or privately held.
Not like anyone training porn robots on booru tags gives a shit about copyright.
Not like any model that’s been released can be put back in the bottle.
OpenAI is struggling right now because they’ve realized they can’t afford to be centralized and they can’t compete at being decentralized. If big-iron approaches are truly more capable - they lose to Google. If advancements keep coming from rando engineers dropping whitepapers with stupid acronyms - they lose to everybody.
Personally, I’m betting on a grab-bag of Asian surnames and LLaLLeLLuLLemon.
This is cool and all but all these AI hype demos always show something extremely simple and overdone in the training data. Reminds me of those ChatGPT videos where someone writes “make me Pong in javascript” and gets surprised that it does despite the fact that it probably trained on 100,000+ Pong in Javascript scripts.
Yes, it made Breakout, very cool. Now ask it to do something new or make a game that’s more complicated than a game that’s been remade a million times. LLMs are very far away from making real games.
This is a testable hypothesis.
Make up some new game - doesn’t have to be good or terribly unique, just novel enough to have negligible prior art - and see if the robot does the thing.
Go for it, we’ll wait.
I’m not the one playing ‘AI is whatever hasn’t been done.’
I’m thoroughly familiar with how these technologies work and their present shortcomings. This guy is joking when he says programming is over. But it doesn’t take a diehard fanboy to acknowledge that this was impossible a year ago, and is getting more democratized as it gets more capable, and it is getting more and more capable.
Eh openAI and co would really rather this be regulated very very hard and for all training data to not be accessibly anymore like it was in the past.
They can try.
Not like a corpus of published text is big data or privately held.
Not like anyone training porn robots on booru tags gives a shit about copyright.
Not like any model that’s been released can be put back in the bottle.
OpenAI is struggling right now because they’ve realized they can’t afford to be centralized and they can’t compete at being decentralized. If big-iron approaches are truly more capable - they lose to Google. If advancements keep coming from rando engineers dropping whitepapers with stupid acronyms - they lose to everybody.
Personally, I’m betting on a grab-bag of Asian surnames and LLaLLeLLuLLemon.
Very far away could easily be like two years though.