Testing, testing, testing

by liberal japonicus

[Title should be sung to the tune of Rawhide]

This weekend is the weekend of the Daigaku Nyūshi Sentā Shiken (大学入試センター試験). A page giving a brief explanation is here.

As tenured faculty at a university that is a test site for the senta shiken, I have to proctor the test roughly 3 years out of 4 and this year, I don't have to. I generally agree to do everything that my Japanese colleagues do, but this test is one that if I could, I would pull the foreigner card. Imagine taking the worst trait of every standardized test you have ever taken, be it SAT, ACT, MCAT, LSAT, GRE, GCE, whatever, take out any opportunity for individual expression and then cover it completely with a bureaucratic grit to such an extent that one is constantly reminded of the truth of Foucault's observations in Discipline and Punish.

This article gives some basics about the current state of Japanese exams and makes me think that testing is often simply a reflection of demographic trends.The test itself is supposed to be discontinued in a few years and as a strange coinkidink, Japan is privatizing parts of their testing regime. I used to be more up on this, but as I approach retirement, I've stopped keeping track of it.

And here is a research paper discussing Japan's National testing.

One thing that I didn't realize was that Korea has their own version of the test, the College Scholastic Ability Test, which apparently turns all these dials up to 11. While the Wikipedia page notes that

CSAT has been praised for its efficiency, meritocratic factors, and high international results.

Unfortunately, this is just after this paragraph

On the test day, the stock markets open late and buses and subways are increased to avoid traffic jams that could prevent students from getting to testing sites, and planes are grounded so the noise does not disturb the students. In some cases, students are also escorted by police officers. Younger students and the members of the students' families gather outside testing sites to cheer on the students.

Small wonder that "Pressure to perform well on the CSAT has been linked to stress, psychological depression and suicide."

And about Korea's test
www.theatlantic.com/education/archive/2016/11/south-korean-seniors-have-been-preparing-for-today-since-kindergarten
and
a cheating scandal that gives some insight into the testing culture

Coming back to Japan, there was recently a big scandal about one Japanese medical university systematically increasing the exam scores of male applicants, with this Guardian article giving some other details. This is a bigger issue here because medical education is not post graduate, but requires entering a medical university as an undergraduate and going for a longer period of time. One should note that the only reason the Tokyo Medical University scandal was exposed was because of an investigation into a specific bribery allegation, which led to finding all kinds of dirt. While the Education Minister has said that they well investigate other schools, I wonder if, in typical Japanese fashion, schools that are simply discriminating against women are going to be told to 'correct' their procedures with little or no transparency.

But a thread about testing for all of you.

Comments

[CharlesWT]

Chinese children, almost from the moment they leave the womb, are under the gun to pass the test that will get them into the best universities. Or into any university at all. But, once they enter a university, there's not much they do or don't do that will cause them to fail. Universities view failures as reflecting badly on the university.

"Many of you ask us if they should study at a Chinese university, whether it be for a degree program, or just a year abroad. We talk about Winston's experience as a Chinese learning student, as well as C-Milk's experience as a university teacher."
It's IMPOSSIBLE To Fail College in China (YouTube video blog)

[wj]

I admit to a longstanding low opinion of tests. Not of testing per se -- tests are quite useful for learning which parts of a system need attention. But testing, specifically of human ability, seems seriously deficient.

To take one acknowledged but ignored problem, people who take more tests become "test sophisticated." That means they learn how test creators' minds work, and hence what kinds of answers will be "correct" . . . even if they know nothing of the subject. For example, if you think about it, a multiple choice test will typically have a couple of obviously wrong answers. If you eliminate those, raw guessing will get you 1/3 - 1/2 correct, well above the 20% that designers assume.

Also, lots of tests of people are, if anyone bothered to check, simply not repeatable. Certainly not at the level claimed. Creators of IQ tests will tell you that their accuracy (standard error) is plus or minus 3 points. Multiple test results will be randomly scattered in that narrow vicinity around the true result. But then, I see my results, which a) spread across 40 points, and b) are monotonic increasing rather than random.

And that's before we even look tests of less measurable things, like personality traits or academic potential (which is what the tests in writes of supposedly do).

[liberal japonicus]

Chinese children, almost from the moment they leave the womb, are under the gun to pass the test that will get them into the best universities.

Charles, I don't deny that the testing culture of China (which is not a recent phenomenon, but something going back over a millennia cf.
https://en.wikipedia.org/wiki/Imperial_examination) is problematic and it is exacerbated by the results of the one child policy, your language sounds a bit like 'yellow peril' warnings. 'the moment they leave the womb'? As if the idea of helicopter parents is never found in the US? Failing to understand this as a phenomenon of our age rather than some sort of failing on the part of Chinese parents is a bit narrow-minded...

As for the problem of failing, students CAN fail if they don't pay their tuition, and the rise of for-profit schools has exploited that in a way that Chinese universties have never dreamed of.

https://www.theatlantic.com/education/archive/2015/02/the-downfall-of-for-profit-colleges/385810/

[CharlesWT]

Granted, almost from the moment they leave the womb, is a bit of hyperbole. But, I thought, not entirely out of place on these threads. :)

As for helicopter parenting:

"Supervised, enriching playtime. Frequent conversations about thoughts and feelings. Patient, well-reasoned explanations of household rules. And extracurriculars. Lots and lots of extracurriculars."
‘Intensive’ Parenting Is Now the Norm in America: The style of child-rearing that most aspire to takes a lot of time and money, and many families can’t pull it off.

[liberal japonicus]

The style of child-rearing that most aspire to takes a lot of time and money, and many families can’t pull it off.

Funny how that works out, eh?

https://www.psychologytoday.com/us/blog/nation-wimps/201401/helicopter-parenting-its-worse-you-think

[JanieM]

Entwined with the evolution of helicopter parenting is the ubiquity of the mobile phone.

Most days I would like to throw my phone in the lake.

That is all.

[CharlesWT]

After coddling their children all their lives, I wonder if parents of millennials wonder why a third of them are still living with the parents.

[JanieM]

During the years when I was growing up, several of my aunts or uncles -- spouses and children in tow in some cases -- went back to live with my grandma when things got difficult in one way or another. I spent almost as much time in an extended family context, amongst my tribe of cousins, as I did with my nuclear family at home. This was not unusual in the world in which I grew up. My parents and grandparents weren't helicopter parents in the contemporary sense, but they had an opinion about every goddamned thing you did, and they weren't shy about sharing it with you.

I suspect the # of millennials living at home has no more to do with "coddling" than it does with the staggering cost of housing, crap wages, and student loan debt (let me not get started).

And as for "a third of them" -- Forbes says, in a piece published last June, that it's 23%, based on a study of "the country's 50 largest metros."

[Hartmut]

Most days I would like to throw my phone in the lake.

Personally, I'd start with other people's phones. (And it would not be necessary for me anyway since I do not own or carry a mobile)
;-)

[Nous]

Millennials still live with their parents because we've been busy destroying their ability to earn a living wage without taking on crushing debt and to find affordable housing near the place in which they work.

Our students have not been coddled. We have lied to ourselves about the world we were making for them and they are suffering through the results of our self-delusion.

[sc]

or sometimes millenials live with their parents because their parents need someone to take care of them and they can't afford to hire anyone because their 401k went tits-up at just the wrong moment but at least since they're old enough to be the parents of millenials they bought a home in like 1978 so they own it free and clear

but no it's all because millenials are all coddled weenies