> The suddenness with which his and my accounts were canceled, coupled with the complete lack of any sort of appeals process, leads me to believe this is the result of Amazon turning over their account review process to AI.
So all this is speculation.
> Amazon created an AI agent to look at every account and, instead of flagging them for any potential violations, had them canceled outright. I'm not sure what the thinking was on their part.
The speculation is getting strangely specific…
> In theory, with something like this, you would have tested the process by simply running a report before doing anything to actually impact any accounts. But if they did that, they would've gotten tons of obviously false positives
But we don’t know anything about what happened, this is based on a hypothesis, speculating on the mistakes made, and how it should have been done, etc.
> 3. They did test it, saw that it raised more flags than they had the manpower to properly investigate, but said, "We're the 800 pound gorilla in the room here. F--- them!" and rolled the AI agent into production anyway.
> Obviously, I have no particular insight into Amazon's inner workings, but I'm inclined to think it was the last of these options.
Now you’re even suggesting that the players here are being malignant, and no you don’t have insights in the inner workings.
We can speculate all we want about these things, but we don’t even know whether this is related to AI, other than “it happened recently and AI also happened recently”. Yes, it’s plausible, but making any claims more specific inner workings of Amazon and what mistakes were made, never mind suggesting what they should have done otherwise, is just reaching and needs a huge disclaimer.
I can say I have seen a lot of cases where someone who was flagrantly guilty of abuse complained loudly that their account at some big tech company was unfairly canceled. I cannot say that's what is going on here, and I can also say I've seen plenty of cases where it was unfair and there was no due process.
You are absolutely correct in everything you say. However, assumptions are usually correct, and past behavior is a good indication for present behavior.
With how powerful these companies are and the enormous impact on your real world life them capriciously deciding to cancel your account can have, governments need to step in. Good idea to write to my federal member here to be honest, I think there is some appetite for reigning in abuses of power of these tech monopolies where I live.
> The suddenness with which his and my accounts were canceled, coupled with the complete lack of any sort of appeals process, leads me to believe this is the result of Amazon turning over their account review process to AI.
So all this is speculation.
> Amazon created an AI agent to look at every account and, instead of flagging them for any potential violations, had them canceled outright. I'm not sure what the thinking was on their part.
The speculation is getting strangely specific…
> In theory, with something like this, you would have tested the process by simply running a report before doing anything to actually impact any accounts. But if they did that, they would've gotten tons of obviously false positives
But we don’t know anything about what happened, this is based on a hypothesis, speculating on the mistakes made, and how it should have been done, etc.
> 3. They did test it, saw that it raised more flags than they had the manpower to properly investigate, but said, "We're the 800 pound gorilla in the room here. F--- them!" and rolled the AI agent into production anyway.
> Obviously, I have no particular insight into Amazon's inner workings, but I'm inclined to think it was the last of these options.
Now you’re even suggesting that the players here are being malignant, and no you don’t have insights in the inner workings.
We can speculate all we want about these things, but we don’t even know whether this is related to AI, other than “it happened recently and AI also happened recently”. Yes, it’s plausible, but making any claims more specific inner workings of Amazon and what mistakes were made, never mind suggesting what they should have done otherwise, is just reaching and needs a huge disclaimer.
Excellent breakdown. The title seems misleading since we don't even know it's AI. I very much dislike when folks state speculation as fact.
> Amazon created an AI agent to look at every account and, instead of flagging them for any potential violations, had them canceled outright.
“What cannot be known hollows the mind. Fill it not with guesswork.”
I can say I have seen a lot of cases where someone who was flagrantly guilty of abuse complained loudly that their account at some big tech company was unfairly canceled. I cannot say that's what is going on here, and I can also say I've seen plenty of cases where it was unfair and there was no due process.
Post hoc ergo propter hoc strikes again
You are absolutely correct in everything you say. However, assumptions are usually correct, and past behavior is a good indication for present behavior.
With how powerful these companies are and the enormous impact on your real world life them capriciously deciding to cancel your account can have, governments need to step in. Good idea to write to my federal member here to be honest, I think there is some appetite for reigning in abuses of power of these tech monopolies where I live.
I'm sure AWS is horrified