site banner

Where are the people smarter than us hanging out?

In Paul Fussell’s book on class (I think), he says that people are really worried about differentiating themselves from the class immediately below them, but largely ignorant of the customs and sometimes even existence of the classes above them. When I found SSC, and then The Motte, and stuff like TLP, I was astonished to find a tier of the internet I had had no idea even existed. The quality of discourse here is . . . usually . . . of the kind that “high brow” (by internet standards) websites THINK they are having, but when you see the best stuff here you realize that those clowns are just flattering themselves. My question is, who is rightly saying the same thing about us? Of what intellectual internet class am I ignorant now? Or does onlineness impose some kind of ceiling on things, and the real galaxy brains are at the equivalent of Davos somewhere?

39
Jump in the discussion.

No email address required.

Incredibly annoying nitpick: IQ tests absolutely can be trained, and I'm confident if I or someone else smart took an IQ test now, and then took another after a dozen hours of practice, there'd be a measurable increase.

Of course this doesn't mean the measure doesn't work, there's a reason people here or ssc readers got 130+ despite being selected based on liking blogs, IQ 'working' as a measure is incredibly obvious and impossible to avoid.

And that was ofc the other guy's first response - pick the weakest link and use that to disbelieve the rest

Incredibly annoying nitpick: IQ tests absolutely can be trained, and I'm confident if I or someone else smart took an IQ test now, and then took another after a dozen hours of practice, there'd be a measurable increase.

I didn't factcheck this; I'll quote it in case someone could spot any issues [bolds mine]:

tl;dr: practice effect is a thing, yes, but people here wildly exaggerate it.

"I think some of it has to do with time limit. If there is a strict time limit, I suspect the effect will be larger than otherwise, for obvious reasons (tell me if they aren't obvious).

I do think there is some practice effect in most perceptual reasoning tests in any case as well.

Someone posted a large meta-study on practice effect not too long ago. I'll link it below. I just took a quick look at it.

There was a significant effect, in fact, the MEAN effect was 0,5SD or 7,5 IQ points. This was after 3 prior tests, and there was no significant practice effect after that. HOWEVER, 2/3 of the population was given THE SAME TEST those 3 tries, and only 1/3 was given alternate forms (though not significantly different).

When looking at retest for alternate forms, the effect was 0,15-0,2SD or ~3 IQ points. HOWEVER, the time interval between retests mattered. If a long time had passed, the effect was smaller (in fact, it was -0,0008SD per week, which seems extremely slow, and it indicates to me that the practice effect is mostly a) feeling comfortable/not-anxious with the test, and b) very general logics, i.e. "I have to look for something rotating" etc.).

What's interesting is that the studies that used alternate forms actually had shorter time intervals than those with identical forms. This means that the impact of alternating forms is even larger than the drop of 0,2-0,35SD relative to identical form retest effect, ceteris paribus.

It should be noted, however, that the retesting of different studies was made with very different amounts of time, as far as I could gather. Some within the same week, others after several years. That's honestly quite a big problem for the study...

It should also be noted that the mean time interval was around half a year. Whether a few studies had a disproportional influence I don't know (one had an interval of around 6 years for example). Our retesting is way more often.

Here's the study: https://www.semanticscholar.org/paper/Retest-effects-in-cognitive-ability-tests%3A-A-Scharfen-Peters/048102820f00a77ec242e5459a7c25ce1bccfa62

A last point of notice is that practice effect and training was helping low-IQ people more than high-IQ people (another test linked by the same redditor also showed this. 10.1016/j.intell.2006.07.006).

Edit: thanks for the silver!"

Edit: the comment: https://old.reddit.com/r/cognitiveTesting/comments/r4qrdv/practice_effect/hmkd0f1/?context=3

I tend to think of IQ tests like BMI tests, at least for what I find them useful for. Not a perfect individual measure but averaged over populations is fine.