15 Comments
User's avatar
Christopher Harshaw's avatar

Love it. Just wanted to share this book (which I think we discussed last year?) called "Technopoly: The Surrender of Culture to Technology" by Neil Postman [link](https://en.wikipedia.org/wiki/Technopoly) which I really liked. If someone likes this post then they would love this book (if they haven't already read it!). It's from the early 90s -- very prophetic.

Expand full comment
Ben Recht's avatar

It's on my list! But man, I am such a slow reader.

Expand full comment
Christopher Harshaw's avatar

I am also a slow reader! But, I pinky promise that it's worth it :)

Expand full comment
T Coddington's avatar

The post and the title of the Postman book made me think of a podcast (EconTalk) where Russ Roberts interviewed Jerry Muller about his book, "The Tyranny of Metrics". (https://a.co/d/5oqUzE6).. I did not get around to reading the book but feels very related. I am a slow reader too :(

Expand full comment
Maxim Raginsky's avatar

I have read that book a while ago, and it is (a) very related, (b) very good.

Expand full comment
Kate Grace's avatar

..and my reading list continues to grow...thanks, I will get this and read it.

Expand full comment
T Coddington's avatar

"Technocracy applies a veneer of science used to justify the moral positions of those in power."

This may very well go into my file cabinet of pithy wisdom to pull out when needed. I can put it in the same drawer as Sowell, "There are no solutions, only tradeoffs."

Expand full comment
Sarah Dean's avatar

Good rant. However, I want to push back on your point about COMPAS. A perfectly calibrated risk prediction can still be extremely lacking. I find it hard to understand why risk scores far from 0 or 1 are useful when it comes to decision-making. When an outcome is highly variable given observed attributes, shouldn't that tell us that we need to collect more data, or focus our technocratic energy elsewhere? For COMPAS specifically, similarly accurate predictions can be achieved by logistic regression on two features (age and number of prior convictions): https://www.science.org/doi/full/10.1126/sciadv.aao5580

Expand full comment
Ben Recht's avatar

To clarify, I am not arguing in favor calibration! And I'm definitely not in favor of COMPAS. I was trying to use that example to show calibrated models can still be unfair. I should edit the post to highlight your point about how it's not better than that two feature predictor anyway.

All of these complex risk scores are always blurry jpegs of conventional wisdom. I'm against all of them, as I wrote here: https://argmin.substack.com/p/healthcare-and-the-ai-dystopia

Expand full comment
Kate Grace's avatar

A freely swinging pendulum eventually settles into stillness if not re-stimulated. Balance (fairness) comes over a long period of time rather than immediately b/c we have discovered how to jump from wide swings of bias to immediate fairness. Mathematics does not seem to me to be the answer to questions of fixing racism, sexism, and other "isms" of the past. Temporary swings in the other directions create balance in the long run...perhaps that long term view is the only real solution. Chaos Theory and fundamental fractals are at work here, in my opinion, especially when we transfer methods (tools) from one problem to another.

Expand full comment
Berkan Ottlik's avatar

"People who study policy mean well, but they convince themselves that because they spend so much time on it, they know better than everyone else. They then want to leverage their elite status to impose their ideas on everyone else. Technocracy applies a veneer of science used to justify the moral positions of those in power. "

Sometimes I wonder if some of the problems people feel with longtermist/utilitarian movements have a at least a somewhat similar flavor. Maybe it would fit a little better if you replaced "study policy" with "study philosophy, math, and cs".

Expand full comment
Erik's avatar

Newsflash: the world is unfair. The individual handles the real world by doing what is right regardless of there being fair rewards or not. (External) fairness is irrelevant for good character. What would the Stoics think about this algorithmic nonsense? You control the effort not the outcome. But then... is there even free will?

Expand full comment
Kate Grace's avatar

Is the 'world' unfair or is it dynamic?

Expand full comment
Anna Gilbert's avatar

Social problems do not have mathematical or algorithmic solutions.

Expand full comment
Bill Bradford's avatar

Technocrats & transhumanists disagree with you, sometimes violently....

Expand full comment