Etcetera

More Reasons To Be Dis-SAT-isfied With the SAT.

MayorBob.

Posted to Etcetera on Fri Dec 01, 2006 at 09:58:18 AM EST (promoted by port1080). RSS.

Taking the Scholastic Aptitude Test (SAT) is rarely a pleasant chore for the high school students who have to take it.  To spend the better part of a day in a school cafeteria or gym being watched over by test administrators as you take a test which can literally have a dramatic effect on your life is a surefire blood pressure booster.  But, most college admissions committees want to see your SAT scores (and they'd better be high if you're talking elite schools) thus, most high school students willingly put up with this self abuse.  But, when some odd and wrong things happen, it makes you wonder how worthwhile the test is.

The SAT seems to be a criticism magnet.  It's been slammed for being unfairly touted as a valid measure of intelligence.  The score on the essay portion seemed to have more to do with length than with quality.  And, it has been assailed for bias of one sort or the other.  The relative merits of the test aside, one would hope that the tests are at least fairly and competently administered.

Certainly, the experience of about 100 students at Naples High School in Naples, Florida bring into question the competence of Educational Testing Services (ETS) -- designers and administrators of the SAT.  When the SAT was given last month at Naples, somehow close to 100 of the tests disappeared.  Thus began some anxious moments for parents.  Luckily enough the missing exams were found - shipped in error to the wrong location - thus, major catastrophe averted.  However, the experience of the students taking the SAT at Woodrow Wilson High in Washington, DC (one of the largest testing sites in the nation) reflect more troubling aspects of the SAT - aspects that go to the heart both of fairness and competence.

One student, who was taking the exam at Wilson on October 14th, described test conditions as a "debacle."  Apparently, the exam monitors had other things on their minds during the test -- things like catching up on their sleep.  As a result of this some of the students taking the test were allowed to research questions, make cell phone calls, and time themselves using a microwave oven clock.  It gave the impression "the Keystone Kops administer the SAT" according to one critic.  According to ETS, it cancelled exam scores for any of the students who violated procedure and they fired the proctor and associate supervisor at the site.  Okay, so this problem will be pronounced as fixed as ETS insures future test administrators get the "proper training" to do the jobs that pay them between (US)$78 to $145 for a day's worth of test monitoring.  But, even with that, test takers still need to contend with the fact that ETS has experienced problems in correctly scoring  their exam.

So, we have a test that is required to be taken to gain admission to all but about 700 schools in the US.  It is a test which can be attacked for being biased, prone to scoring error, and might be administered unfairly or incompetently.  So, what does the result on the SAT correlate to anyway?  Perhaps, as the results of some previous SAT takers show, there might be a correlation between low SAT scores and promising careers with ETS or the Department of Education.      

Tags: edited by Port1080, SAT, college boards, school, tests, written by MayorBob (all tags)

This story: 17 comments (3 from subqueue)
Post a Comment
2

Re: More Reasons To Be Dis-SAT-isfied With the SAT

rombuu.

Fri Dec 01, 2006 at 10:42:50 AM EST

3.00 (astute)

Wow, that was underwhelming.... some tests were lost but found and there was one bad proctor somewhere in the country.  Amazing.  Let's chuck the whole thing.  Oh, and people who don't do well on a test think its biased?  Well, I've never heard of such a thing.  If it were in college they'd follow that complaint up with "The Professor doesn't like me" and "Well, its not in my major anyway..."

3

^ 2

Re: More Reasons To Be Dis-SAT-isfied With the SAT

Thalia.

Fri Dec 01, 2006 at 07:59:27 PM EST

none

I also think the test is biased, and I did quite well on it.  I've always done very well on standardized tests.

It's biased because it asks irrelevant vocabulary questions, because having college prep classes available in your school gives you a huge bump, and because the biggest correlation to doing well on the SAT is having a high reading speed.  I know quite a few intelligent folks who are slow readers (a few dyslexic, a few with ADA, and a few that just have reading problems).  Their IQ is high, their scores on tests that are not about timing are high, their SAT scores were dismal.  It's also biased because if your parents can afford to send you to a class for it, your score is almost guaranteed to go up by 100+ points.  In other words, being poor hurts on the SATs.

It seems to me that we should be able to devise a test that actually tests knowledge, or even better the ability to learn, instead of reading speed, the quality of your school district, the ability to spend money on prep courses, and whether you are one of those strange people who are amused by learning Latin word roots.

Thalia

4

^ 3

Re: More Reasons To Be Dis-SAT-isfied With the SAT

profwhat.

Fri Dec 01, 2006 at 09:10:14 PM EST

none

it asks irrelevant vocabulary questions, because having college prep classes available in your school gives you a huge bump, and because the biggest correlation to doing well on the SAT is having a high reading speed

This is not a good criticism.  Irrelevant vocabulary and lots of reading pretty much sums up my college experience.  I think the point isn't to pick people with high "IQ" but to pick people who will be good college students.

7

^ 4

Re: More Reasons To Be Dis-SAT-isfied With the SAT

Thalia.

Sat Dec 02, 2006 at 11:06:24 PM EST

none

Well, my college experience was more about learning math and programming than irrelevant vocabulary.  In fact, I do not recall a single vocabulary test in college.  Do you?  I hated every class that required the memorization of obscure vocabulary.  I actually dropped a physiology class because it came down to "memorize the names of all your bones, muscles, tendons & ligaments."  I

The point is to pick people who will do well in college, but why does someone who wants to be a programmer need to know the vocabulary around golf, competitive sailing, or geology?

Thalia

15

^ 7

Res Ipsa Loquitur

marduk.

Mon Dec 04, 2006 at 05:44:42 AM EST

none

I hated every class that required the memorization of obscure vocabulary.  I actually dropped a physiology class because it came down to "memorize the names of all your bones, muscles, tendons & ligaments."

So I guess the SAT predicted your aptitude perfectly.

tnt needs to track moderation. stats page!

16

^ 15

Re: Res Ipsa Loquitur

Steve Urkel.

Mon Dec 04, 2006 at 01:55:20 PM EST

none

She's lucky there's no memorization involved in getting a law degree and passing the bar exam.

17

^ 7

Re: More Reasons To Be Dis-SAT-isfied With the SAT

rombuu.

Mon Dec 04, 2006 at 02:17:39 PM EST

none

The point is to pick people who will do well in college, but why does someone who wants to be a programmer need to know the vocabulary around golf, competitive sailing, or geology?

To be a well-educated person?  Isn't this why we make people do all that liberal arts stuff instead of just sending everyone to trade schools?

5

^ 3

Re: More Reasons To Be Dis-SAT-isfied With the SAT

Steve Urkel.

Sat Dec 02, 2006 at 02:12:39 PM EST

none

Reading fast and having a large vocabulary are associated with intelligence.

Notice all of your complaints are just as true of grades: Slow readers with poor vocabularies have a harder time getting good grades, people with ADD or dyslexia or who are spastics have a hard time getting good grades, wealthy people can get better grades because they can hire math and english tutors, etc. Should we get rid of grades? While wealth gives advantages, isn't poverty a greater obstacle to getting good grades than doing well on a single test? This was more true in the past when the SAT was more g correlated.

Expensive test prep is a waste of time and money, and the notion that "your score is almost guaranteed to go up by 100+ points" is false, see the current Princeton Review guarantee, which only promises to work with you for free if your scores don't "improve":

http://www.princetonreview.com/college/testprep/testprep.asp?TPRPAGE=575&TYPE=SAT-PREPARE

"It seems to me that we should be able to devise a test that actually tests knowledge"

This conflicts with your earlier complaints, as tests which evaluate knowledge over intelligence would favor students with more resources.

"or even better the ability to learn"

Like an IQ test? This contradicts your statement that you want a test that evaluates knowledge. Reading speed and the ability to acquire vocabulary are indicators of an ability to learn, aren't they?

6

^ 5

Re: More Reasons To Be Dis-SAT-isfied With the SAT

Thalia.

Sat Dec 02, 2006 at 11:02:20 PM EST

none

Reading speed is not particularly an indicator of the ability to learn.  It's just an indicator of reading speed.  I am not smarter than my friend who is dyslexic.  My friend who has ADD is actually much smarter than I am (which takes some doing, I must say, since I consider myself pretty darn smart).  They simply have issues that prevent them from reading quickly.

The ability to acquire vocabulary is not what is tested.  The actual useless words you know is tested.  Why exactly is it useful that I know all the names that rivers can be given?  Why is that a reflection of my intelligence, rather than a reflection of the amount of useless data stuffed into my skull?

Actual knowledge is not "the ability to regurgitate memorized vocabulary words," because that is not useful knowledge.  At least not where I live.

You're right, being rich is a huge advantage.  Not only because you get private tutors, but also because your school is almost guaranteed to be better.  Is that fair?  Nope, not particularly.  Is it a huge bias for the rich?  Why, yes, so it is.  So why do people argue that the SATs are not biased?  I don't get it.

Thalia

11

^ 6

Re: More Reasons To Be Dis-SAT-isfied With the SAT

Steve Urkel.

Sun Dec 03, 2006 at 01:35:00 PM EST

none

"My friend who has ADD is actually much smarter than I am"

I'm sure the blind and parapeligiacs have added difficulty taking the SAT as well, but I don't see how, and you haven't given a reason, this invalidates the test for the majority of the population.

"Why is that a reflection of my intelligence, rather than a reflection of the amount of useless data stuffed into my skull?"

Vocabulary correlates strongly and reliably with general IQ.  

 

8

^ 5

Speaking of contradictions...

Lou.

Sat Dec 02, 2006 at 11:29:22 PM EST

none

So, Thalia utters conflicting statement?  Pot...meet kettle.

To wit...

wealthy people can get better grades because they can hire math and english tutors, etc.

and a few lines later...

Expensive test prep is a waste of time and money,

Or...is there a distinction between tutoring and test prep that I am missing?

It's the end of the world as we know it, and I feel fine

12

^ 8

Re: Speaking of contradictions...

Steve Urkel.

Sun Dec 03, 2006 at 01:38:06 PM EST

none

It's not a contradiction to think that working with a geometry tutor can raise a students grade in geometry but taking a test prep class won't raise that same students standardized test score.

I don't understand what it is you and girlfriend want. The SAT was introduced to make college admissions more meritorcratic.

13

^ 12

What I want

Lou.

Sun Dec 03, 2006 at 02:59:19 PM EST

none

What my girlfriend and I want is ground pounding, sweat inducing, exploding heart of a star sex.

I have no idea what Thalia wants.

I agree that the SAT was introduced to make college admissions more meritocratic.  But you know...the Iraq war was introduced to end terrorism in the world.  Funny how things work out, eh?

By the way, Gord...that's for evidence of a direct hit.  You always get personal when someone dings you.

It's the end of the world as we know it, and I feel fine

14

^ 13

Re: What I want

Steve Urkel.

Sun Dec 03, 2006 at 04:01:03 PM EST

none

"get personal"? I didn't realize your relationship with Tahlia was such a sensitive subject.

Seriously, the SAT has made college admissions more meritocratic. You and your non-girlfriend may think things aren't meritorcratic enough, but the changes in the test you both are advocating, i.e. getting rid of g-releated portions like vocabulary, would result in the opposite of what you are complaining about.

9

^ 5

Shooting from the hip

Lou.

Sat Dec 02, 2006 at 11:39:12 PM EST

none

I'm looking up stuff about indicators of ability to learn.  In the meantime, I'll take a stab at this.

Reading speed and the ability to acquire vocabulary are indicators of an ability to learn, aren't they?

I always thought (well, at least as long as I have been a teacher) that problem solving is a better way of gauging learning ability.  While reading speed and vocabulary might  help in reading the written problem, coming up with a solution is a better indicator.

It's the end of the world as we know it, and I feel fine

10

^ 9

Re: Shooting from the hip

Thalia.

Sun Dec 03, 2006 at 03:48:40 AM EST

none

I completely agree.  If they tested problem solving ability, especially problem solving where all data is provided, and what they're testing is how you absorb data, and based on it solve problems would be much more useful.  I found it fascinating that 1/3 of the California Bar Exam is a test that provides you all laws & facts, and asks you to do analysis.  By then, I guess, they figure you should know how to problem solve, not just memorize.

Thalia

1

Re: More Reasons To Be Dis-SAT-isfied With the SAT

Dvandom.

Fri Dec 01, 2006 at 10:07:50 AM EST

none

The biggest problem with the SAT is simply its own success.  There doesn't have to be any incompetence or stupidity or malfeasance involved to get incidents like the ones described above when it seems like everyone in the nation is taking the thing.  99.99% error-free still means that if a million kids take the test, 100 are gonna get hosed.  Unfortunately, ETS's core business is reliability, so four nines isn't enough for them, even though it may be better than anyone else out there in other sectors can manage.

As for correlation with intelligence...well, intelligence is one of those things that can't really be directly measured.  We have trouble even defining it adequately!  So, if the SAT correlates strongly with an IQ test (and 0.80 is VERY strong correlation), all that means is that they take very similar approaches to trying to measure roughly the same definition of intelligence.

FTR, I took the SAT before they added the essay component.  Got 750 Verbal, 750 Math.  I test well, though, and have BS'ed my way to 90+ percentile scores on other standardized tests covering matters about which I knew next to nothing at the time.  :)

---Dave

This is not a signature.

This story: 17 comments (3 from subqueue)
Post a Comment