Be advised: this thread is not for serious in-depth discussion of weighty topics (we have a link for that), this thread is not for anything Culture War related. This thread is for Fun. You got jokes? Share 'em. You got silly questions? Ask 'em.
- 204
- 2
Jump in the discussion.
No email address required.
Notes -
I suspect that this has been almost possible since about 2022, but now specifically with a 100k token context length, it's now completely possible if not practical.
With a little effort, I'd reckon you could fit most of the gist of someone's personality, at least the part of it they showed you, in about 50k tokens. Then you'd have about 40k give or take to have a small conversation about how their day has been.
Perhaps a few have done something similar with fine tuning, but now any old Joe could probably do it for $20/mo.
The future may very well be now.
EDIT: Some back-of-the-envelope quick math:
Based on what I've seen from how machine learning tokenizers work, most words take up about 2-3 tokens. That means that 50k tokens might be about 20k words, which is I guess is about 1000 sentences. Given that "write this in the style of that" has been something that generative models have been frighteningly good at for years, I imagine that would be well enough data to effect a very convincing pantomime.
Then you could have a fully-contextualized and interactive conversation spanning about a small novella. I don't think this is something you could do with previous models, particularly with their relatively tiny context windows.
It's interesting to think that there may very well be an entirely novel form of gratuitous self-harm at my fingertips that categorically did not exist mere months ago.
More options
Context Copy link