Cool. Literal Nazi shit, but now with AI 😵💫
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
Basically the slogan for the 2020s
Yeah but it's cool cause some rich white guy taught the computer to be racist for him, so you can't complain.
Cool. Literal Nazi shit, still powered by IBM.
But what if bias was not the reason? What if your face gave genuinely useful clues about your probable performance?
I hate this so much, because spouting statistics is the number one go-to of idiot racists and other bigots trying to justify their prejudices. The whole fucking point is that judging someone's value someone based on physical attributes outside their control, is fucking evil, and increasing the accuracy of your algorithm only makes it all the more insidious.
The Economist has never been shy to post some questionable kneejerk shit in the past, but this is approaching a low even for them. Not only do they give the concept credibility, but they're even going out of their way to dishonestly paint it as some sort of progressive boon for the poor.
But what if bias was not the reason? What if ~~your face gave genuinely useful clues about your probable performance~~ we just agreed to redefine “bias” as something else, despite this fitting the definition of the word perfectly, just so I can claim this isn’t biased?
Actually, what if slavery wasn’t such a bad idea after all? Lmao they never stop trying to resurrect class warfare and gatekeeping.
Yeah, nothing says "this person will repay their loans" like looking at their face and nothing fucking else.
I love how you can just call it capetalismo in portuguese, capeta = devil
Dystopian neutrality in article.
without discriminating on grounds of protected characteristics
AI classification is trained based on supervised (the right answers are predetermined) learning. MechaHitler for the fascist nationalism's sake, will rate Obama's face as a poor employee, and Trump's as the bestest employee.
Open training data sets would be subject to 1. zero competitive advantage to a model, 2. massive complaints about any specific training data.
For some jobs, psycopaths AND loyalty are desirable traits, even though they can be opposite traits. Honesty, integrity, intelligence can be desirable traits, or obstacles to desperate loyalty. My point is that if there are many traits determined by faces, much more training data is needed to detect them, and then human hiring decision based on 10 or 30 traits matching to a (impossibly unique) position, where there direct manager only cares about loyalty, without being too talented, but higher level managers might prefer a candidate with potential to replace their direct manager, but all of them care about race or pregnancy risk, and then post training based on some "illegal characteristics".
A Gattaca situation where, everyone has easy time getting great job, and moving to a greater job, OR being shut out of all jobs, creates a self contradicting prediction on "loyalty/desperation" controlability traits. If job duties are changed to include blow job services, then surely those agreeable make a better employee, despite any facial ticks responding to suggestion.
Human silent "illegal discrimination" is not eliminated/changed, but the new capability, you can use a computer to do the interviewing, and waste more interviewees' time at no human cost to employer is why this will be a success. A warehousing company recently looked at facial expressions to determine attention to safety, and this leads to "The AI punishments to your life will continue until you smile more." Elysium's automated parole incident interviews is a good overview of the dystopia.
A classification problem is correlation vs causation. Sunspots and mini skirts have been correlated with stock market returns to some degree, but it tends to be a tenuous connection not guaranteed to hold up over time, or to actually have any meaningful relevance whatsoever. It's easy to oversell models.
This is so absurd it almost feels like it isn't real. But indeed, the article appears when I look it up
It's very nazi Germany real actually.
I always pity the Germans who don't deserve this but keep this shame since the war, and it's worse since nazis became an international club.
this should be grounds for a prison sentence. open support for Nazism shouldn't be covered by free speech laws.
Bringing back racism and good vibes under "scientific principle."
"If he's black, get him out of here"
I'm not sure we're going to make it y'all.
That image reminds me a meme from "Scientific diagrams that look like shitposts". It was titled something like "Mask of Damascus(?)/Triagones(?) - Acquire it (from a prisoner(?)) with a scimitar!"
Wow. If a black box analysis of arbitrary facial characteristics is more meritocratic than the status quo, that speaks volumes about the nightmare hellscape shitshow of policy, procedure and discretion that resides behind the current set of 'metrics' being used.
Spoken like somebody with the sloping brow of a common criminal.
I really must commend you for overcoming your natural murderous inclinations and managing to become a useful member of society despite the depression in your front lobe. Keep resisting those dark temptations!
Do we lump all the teenagers with acne in the incel category, and put them in prison? I'm just asking questions.
The Unmentionables?
Indeed, I was channeling Captain Swing, well spotted!
Because HR is already using "phrenology".
The gamification of hiring is largely a result of businesses de-institutionalizing Human Resources. If you were hired on at a company like Exxon or IBM in the 1980s, there was an enormous professionalized team dedicated to sourcing prospective hires, vetting them, and negotiating their employment.
Now, we've automated so much of the process and gutted so much of the actual professionalized vetting and onboarding that its a total crap shoot as to whom you're getting. Applicants aren't trying to impress a recruiter, they're just aiming to win the keyword search lottery. Businesses aren't looking to cultivate talent long term, just fill contract positions at below-contractor rates.
So we get an influx of pseudo-science to substitute for what had been a real sociological science of hiring. People promising quick and easy answers to complex and difficult questions, on the premise that they can accelerate the churn of staff without driving up cost of doing business.
"Imagine appearing for a job interview and, without saying a single word, being told that you are not getting the role because your face didn’t fit. You would assume discrimination, and might even contemplate litigation. But what if bias was not the reason?
Uh... guys...
Discrimination: the act, practice, or an instance of unfairly treating a person or group differently from other people or groups on a class or categorical basis
Prejudice: an adverse opinion or leaning formed without just grounds or before sufficient knowledge
Bias: to give a settled and often prejudiced outlook to
Judging someone's ability without knowing them, based solely on their appearance, is, like, kinda the definition of bias, discrimination, and prejudice. I think their stupid angle is "it's not unfair because what if this time it really worked though!" 😅
I know this is the point, but there's no way this could possibly end up with anything other than a lazily written, comically clichéd, Sci Fi future where there's an underclass of like "class gammas" who have gamma face, and then the betas that blah blah. Whereas the alphas are the most perfect ughhhhh. It's not even a huge leap; it's fucking inevitable. That's the outcome of this.
I should watch Gattaca again...
Racial profiling keeps getting reinvented.
Fuck that.
They then used data on these individuals’ labour-market outcomes to see whether the Photo Big Five had any predictive power. The answer, they conclude, is yes: facial analysis has useful things to say about a person’s post-mba earnings and propensity to move jobs, among other things.
Correlation vs causation. More attractive people will be defaulted to better negotiating positions. People with richer backgrounds will probably look healthier. People from high stress environments will show signs of stress through skin wrinkles and resting muscles.
This is going to do nothing but enforce systemic biases, but in a kafkaesque Gattica way.
And then of course you have the garden of forking paths.
These models have zero restraint on their features, so we have an extremely large feature space, and we train the model to pick features predictive of the outcome. Even the process of training, evaluating, then selecting the best model at this scale ends up being essentially P hacking.
I cant imagine a model being trained like this /not/ end up encoding a bunch of features that correlate with race. It will find the white people, then reward its self as the group does statistically better.
Even a genuinely perfect model would immediately skew to bias; the moment some statistical fluke gets incorporated into the training data that becomes self re-enforcing and it'll create and then re-enforce that bias in a feedback loop.
Usually these models are trained on past data, and then applied going forward. So whatever bias was in the past data will be used as a predictive variable. There are plenty of facial feature characteristics that correlate with race, and when the model picks those because the past data is racially biased (because of over-policing, lack of opportunity, poverty, etc), they will be in the model. Guaranteed. These models absolutely do not care that correlation != causation. They are correlation machines.
The problem here is education.
And I'm not just talking about "average joes" who don't know the first thing about statistics. It is mind-boggling how many people with advanced degrees do not understand the difference between correlation and causation, and will argue until they're blue in the face that it doesn't affect results.
AI is not helping. Modern machine learning is basically a correlation engine with no concept of causation. The idea of using it to predict the future is dead on arrival. The idea of using it in any prescriptive role in social sciences is grotesque; it will never be more than a violation of human dignity.
Billions upon billions of dollars are being invested in putting lipstick on that pig. At this point it is more lipstick than pig.
Exactly. It's like saying that since every president has been over 6' tall we should only allow tall people to run for president.
The study claims that they analyzed participants' labor market outcomes, that being earnings and propensity to move jobs, "among other things."
Fun fact, did you know white men tend to get paid more than black men for the same job, with the same experience and education?
Following that logic, if we took a dataset of both black and white men, then used their labor market outcomes to judge which one would be a good fit over another, white men would have higher earnings and be recommended for a job more than black people.
Black workers are also more likely to switch jobs, one of the reasons likely being because you tend to experience higher salary growth when moving jobs every 2-3 years than when you stay with a given company, which is necessary if you're already being paid lower wages than your white counterparts.
By this study's methodology, that person could be deemed "unreliable" because they often switch jobs, and would then not be considered.
Essentially, this is a black box that gets to excuse management saying "fuck all black people, we only want to hire whites" while sounding all smart and fancy.
I remember when stuff like this was used to show how dystopian china is.
Haven't you heard? Palantir CEO Says a Surveillance State Is Preferable to China Winning the AI Race.
Trump's current Science Advisor (who was selected by Peter Thiel) gave an interview back in 2019 where he kept insisting the U.S. was at a disadvantage to China in the AI race bc we didn't have access to the level of surveillance data China had (which it turns out, is possible thanks to a surveillance system we fucking created and sold to them). He also used this point to argue against any regulations for facial recognition tech in the U.S. because again, it would put us at a disadvantage.
But don't worry, because the goal is to have an authoritarian surveillance state with "baked in American values," so we won't have to worry about ending up like China did with the surveillance tools we fucking sold them.
I'm not sure what values he's claiming will be somehow baked into it (because again, we created it and sold it to China). My mind conjures up a scenario of automatic weapons and a speaker playing a screeching bald eagle, but maybe we'll get some star spangled banner thrown in there too.
I haven't heard of academics and/or media from China advocating for applications of phrenology/physiognomy or other related racist pseudosciences. Have you?
This fascist wave is really bringing out all the cockroaches in our society. It's a good thing you can't erase anything on the internet, as this type of evidence will probably be useful in the future.
You'd better get in on a crypto grift, Kelly Shue of the Yale School of Management. I suspect you'll have a hard time finding work within the next 1-3 years.
FYI, it's not a paper, it's a blog post from well connected and presumably highly educated people benefiting from the institutional prestige to see their poorly conducted study be propagated ad eternum without a modicum of relevant peer review.
edit: After a few more minutes, it's an unreliable psychopath detector.
It's petty reliable, it detected the authors to be psychos
I thought phrenology was still a science at the time of the German Reich, only made defunct later. Now I have my doubts.
Social darwinism was disproven in the 1900s and supply-side economics died in the 19th century so it's not like pseudoscience does not spring up like weeds when rich people want to sponsor it.


