Recent comments in /f/singularity

acutelychronicpanic t1_jeap8m1 wrote

Yeah, I greatly respect him too. I've been exposed to his ideas for years.

Its not that it wouldn't work if we did what he suggests. Its that we can't do it. It's just too easy to replicate for any group with rather modest resources. There are individual buildings that were more expensive than SOTA LLM models.

The toothpaste is out if the tube with transformers and large language models. I don't think most people, even most researchers had any idea that it would be this "easy" to make this much progress in AI. That's why everyone's guesses were 2050+. I've heard eople with PhDs confidently say "not in this century" within the last 5-10 years.

Heck, Ray Kurzweil looks like a conservative or at least median in this current timeline (I never thought I would type that out).

1

WonderFactory t1_jeap8lf wrote

Reply to comment by genericrich in GPT characters in games by YearZero

I think it can work, I'm trying to get it working in a game I'm developing at the moment. You have to have a mix of randomness and structured story telling. I literally have to say to ChatGPT, the user is saying xyz, reply to the user but try to work this plot point into your reply.

3

WonderFactory t1_jeaotp1 wrote

I'm actually adding ChatGPT NPCs to the Unreal Engine 5 game I'm developing at the moment, it's a rogue like set in a post singularity world, gameplay is similar to Hades so there's plenty of dialogue in the game. at the minute it's difficult to get a model to run on the local PC so I'm using OpenAI's API. There are challenges like latency while you're waiting for the API to return, it's also quite expensive so releasing a free demo of the game is out of the question. It could potentially cost several dollars per user in API fees over the life of the game so that will of course limit your pricing flexibility, you can only reduce the price so much in steam sales etc. I'm hoping though that inference costs will come down by the time the game is finished.

I haven't posted any footage with the GPT dialogue added to the game but I might post it here in a couple of weeks.

28

3z3ki3l t1_jeanw6e wrote

Reply to comment by genericrich in GPT characters in games by YearZero

Eh. Skyrim already has generated side-quests. It creates characters for you to go kill, and items for you to steal. I don’t think a little bit of dialogue, whether it fits perfectly or not, would break that much.

3

sweatierorc t1_jeamh38 wrote

It will probably be funded by billionaire philanthropists and large corporations. I could see Nvidia using this as a way to promote their GP. Musk or Zuck could use it for PR. Even Gates may drop a buck, just to act like he actually cares.

1

Andriyo t1_jeam834 wrote

There is nothing fundamental behind 1+1=2. It's just the language that we use to describe reality as we observe it as humans. And even beyond that, it's cultural: some tribes have "1", "2", "3", "many" math and to them it is as "fundamental" as Integer number system to us. The particular algebra of 1+1=2 was invented by humans (and some other species) because we evolutionary optimized to work with discrete objects to detect threats and such.
I know Plato believed in the existence of numbers or "Ideas" in a realm that transcended the physical world but it's not verifiable so it's just that - a belief.

So children just learn the language of numbers and arithmetic as any other language by training on examples - statistically. There might be some innate training that happened on DNA level so we're predisposition to learn about integers easier but it doesn't make "1+1=2" as something to discover that exists on its own like, say, gravity or fire.

0

el_chaquiste t1_jeam1w6 wrote

Only the priesthood of some ML school of thought will get access, as it's usual with such public organizations, where some preemiment members of some specific clergy rule.

Private companies and hackers with better algorithms will run circles around them, if not threatened with bombing their datacenters or jailed by owning forbidden GPUs, that is.

2