site banner

Small-Scale Question Sunday for June 11, 2023

Do you have a dumb question that you're kind of embarrassed to ask in the main thread? Is there something you're just not sure about?

This is your opportunity to ask questions. No question too simple or too silly.

Culture war topics are accepted, and proposals for a better intro post are appreciated.

3
Jump in the discussion.

No email address required.

I'm no expert but have some familiarity. The LLMs have a limited context window (gpt4 is 8000 tokens) so it can't hold all of that data at once. Probably the easiest way to get it to chew through that much is to ask it for code to do the things you want (directing it to write some pygraph or R code or something). It could plausibly do it inline if you asked it to summarize chunks of data, then fed the previous summary in with the next chunk. The code would act as a much more auditable and probably accurate tool though.