site banner

Small-Scale Question Sunday for July 9, 2023

Do you have a dumb question that you're kind of embarrassed to ask in the main thread? Is there something you're just not sure about?

This is your opportunity to ask questions. No question too simple or too silly.

Culture war topics are accepted, and proposals for a better intro post are appreciated.

5
Jump in the discussion.

No email address required.

I'll be honest, GPT-4 is a better doctor than me.

Can you provide a good prompt template and the set of hyperparameters (temperature, top p, etc) to make gpt-4 play doctor?

If you're using ChatGPT 4, I heard it's being rather reticent on giving medical advice.

The only relevant parameter I personally changed was temperature, and even then it was at the standard 0.5 as far as I can recall. I didn't see top-P being exposed, though I know what it is from fucking around in the OAI Playground.

The system prompt was usually bog standard, checking the version I use right now, it just says "You are a helpful assistant".

Keep in mind that most of my exposure to it was through rather bootleg techniques and fly-by-night discord bots. God knows what they're being prompted with, but the best and most consistent one seems to use absolutely standard settings as far as I can tell.

I didn't need any prompt engineering techniques at all, but if you want a rough idea of my usual prompting:

I am junior doctor-

trying to understand concept X, please explain it to me.

Seeking to improve my clinical skills, please generate clinical vignettes on topic X, and then grade my response.

Explain guidelines X to me.

Or:

"Discuss and contrast endopthalmitis and TASS"

"I'm a junior doctor wanting to brush up on my clinical skills. Generate a clinical vignette, and I'll attempt to make a diagnosis and tt plan. Grade me on my response and correct any error."

The last two are copied verbatim. They work absolutely fine.

I suspect that telling it I'm a doctor is sufficient for it to avoid dumbing things down, not that it does so from my personal experience.