How Algorithms and Authoritarianism Created a Corporate Nightmare at United
This is a really worthwhile read about what happened with United Airlines the other day. It holds some important lessons for building human safeguards into our increasingly algorithmic management.
http://globalguerrillas.typepad.com/globalguerrillas/2017/04/algorithmic-dystopia.html
@Euphoria @gideonro Simply following what the computer says to do is too easy these days. Most of us do it to an extent in our personal lives, with things like using our phones for the best directions to get someplace.
Computers have a mystical quality to many people. They don't understand how the decision was arrived at, since the algorithm used is complex. Simply shrugging your shoulders and moving the blame to the computer is an easy decision for most in the moment.
@Euphoria @OberstKrueger Yes, the key is understanding the code behind the code, which, unfortunately had a lot to do with extracting wealth from the stakeholders in the system. Not on all cases, of course. The at plenty of examples where companies tune their systems so as not to do this.
It has been for far too long already, @OberstKrueger
People seriously need to learn that other /people/ are responsible for the computers and what they're programmed for and their output, as well as mandating that employees follow what the computers are telling them. Those following the computers orders *never* forget they're being judged by other humans. Alas, school systems are designed to make us follow blindly without questioning.
@gideonro
@Euphoria Agreed, that's pretty much the point of this piece. Lots of pressure to just blindly automate when profits are the main drive.
What's especially sad about this to me, @gideonro , is that companies seem to forget that without loyal customers there can be no profit, a hard, costly lesson that United should certainly have learned from this situation. I hope others have also learned that raising people to be blindly following automatons is a terrible thing, too and that we need people who will stop to question what's right and go against orders when warranted. It's very sad.
@gideonro I haven't read it but I suspect it had more to do with Authoritarianism than algorithms. When it's all said and done the people running companies must remember that they ARE people and that there are PEOPLE working for them and as their customers. Too much freakin' automation today when good old human interaction and common courtesy should be called for.