Building a sandbox roleplaying game

I'm working on building a NSFW sandbox roleplaying game. The way it works is the player defines a location (e.g. a hotel lobby) and AI then acts as the game master, narrating the scene and controlling NPC characters. The AI randomly generates characters and scenarios, so the player is essentially going in blind and reacting to whatever the AI has come up with. The player is free to explore, chat and do whatever, and the AI controls how NPCs react and narrates their actions.

I want to use a local AI so I have unlimited responses and no censorship, but I'm limited to 6GB ram. With my current setup the AI isn't powerful enough to keep track of the narrative, player locations and the conversation thread.

My question is what is the best tech setup? I'm using LM studio running Gwen 2.5 3B. Is there a way to use a more powerful AI without hitting limits, and ideally without spending much on subscriptions? And would using something like SillyTavern help the AI keep track of things?

reddit.com
u/Fly-Whales-Fly — 7 days ago

I'm in a very filthy mood and feel like sharing some thoughts. I'm looking for a short back where we send dirty messages. I want to tell you about all the things I'd like to do to you. You're welcome to do the same, to just listen to what I've got to say.

reddit.com
u/Fly-Whales-Fly — 4 months ago