#mturk — Public Fediverse posts

I forgot to share the #mTurk data quality result that got scooped:

“In late 2020…. Participants from the United States were recruited from Amazon Mechanical Turk, -#CloudResearch, #Prolific, and a #university. One participant source yielded up to 18 times as many low-quality respondents as the other three.”

https://doi.org/10.1093/analys/anaf015

#psychology #philosophy #surveyMethods #quantMethods #dataScience #qualityControl

I forgot to share the #mTurk data quality result that got scooped:

“In late 2020…. Participants from the United States were recruited from Amazon Mechanical Turk, -#CloudResearch, #Prolific, and a #university. One participant source yielded up to 18 times as many low-quality respondents as the other three.”

https://doi.org/10.1093/analys/anaf015

#psychology #philosophy #surveyMethods #quantMethods #dataScience #qualityControl

I forgot to share the #mTurk data quality result that got scooped:

“In late 2020…. Participants from the United States were recruited from Amazon Mechanical Turk, -#CloudResearch, #Prolific, and a #university. One participant source yielded up to 18 times as many low-quality respondents as the other three.”

https://doi.org/10.1093/analys/anaf015

#psychology #philosophy #surveyMethods #quantMethods #dataScience #qualityControl

I forgot to share the #mTurk data quality result that got scooped:

“In late 2020…. Participants from the United States were recruited from Amazon Mechanical Turk, -#CloudResearch, #Prolific, and a #university. One participant source yielded up to 18 times as many low-quality respondents as the other three.”

https://doi.org/10.1093/analys/anaf015

#psychology #philosophy #surveyMethods #quantMethods #dataScience #qualityControl

I forgot to share the #mTurk data quality result that got scooped:

“In late 2020…. Participants from the United States were recruited from Amazon Mechanical Turk, -#CloudResearch, #Prolific, and a #university. One participant source yielded up to 18 times as many low-quality respondents as the other three.”

https://doi.org/10.1093/analys/anaf015

#psychology #philosophy #surveyMethods #quantMethods #dataScience #qualityControl

New #surveyMethods paper replicates and extends differences in #dataQuality, attention, naivety, decision style, etc. by
- online #research recruitment platform (#mTurk, #Prolific, #Qualtrics, #Pollfish)
- device (#mobile v. #desktop)
- person's incentive

https://doi.org/10.3758/s13428-025-02618-1

New #surveyMethods paper replicates and extends differences in #dataQuality, attention, naivety, decision style, etc. by
- online #research recruitment platform (#mTurk, #Prolific, #Qualtrics, #Pollfish)
- device (#mobile v. #desktop)
- person's incentive

https://doi.org/10.3758/s13428-025-02618-1

New #surveyMethods paper replicates and extends differences in #dataQuality, attention, naivety, decision style, etc. by
- online #research recruitment platform (#mTurk, #Prolific, #Qualtrics, #Pollfish)
- device (#mobile v. #desktop)
- person's incentive

https://doi.org/10.3758/s13428-025-02618-1

New #surveyMethods paper replicates and extends differences in #dataQuality, attention, naivety, decision style, etc. by
- online #research recruitment platform (#mTurk, #Prolific, #Qualtrics, #Pollfish)
- device (#mobile v. #desktop)
- person's incentive

https://doi.org/10.3758/s13428-025-02618-1

New #surveyMethods paper replicates and extends differences in #dataQuality, attention, naivety, decision style, etc. by
- online #research recruitment platform (#mTurk, #Prolific, #Qualtrics, #Pollfish)
- device (#mobile v. #desktop)
- person's incentive

https://doi.org/10.3758/s13428-025-02618-1

🎉 In press: Reflection-#Philosophy Order Effects & Correlations Across Samples

Thought experiments caused reflective decisions?
Reflection tests didn't change philosophical decisions!
18X more junk data from #mTurk (vs other sources)!

#Preprint + audio: https://byrdnick.com/archives/28438/upon-reflection-ep-13-reflection-philosophy-order-effects-and-correlations-across-samples

🎉 In press: Reflection-#Philosophy Order Effects & Correlations Across Samples

Thought experiments caused reflective decisions?
Reflection tests didn't change philosophical decisions!
18X more junk data from #mTurk (vs other sources)!

#Preprint + audio: https://byrdnick.com/archives/28438/upon-reflection-ep-13-reflection-philosophy-order-effects-and-correlations-across-samples

🎉 In press: Reflection-#Philosophy Order Effects & Correlations Across Samples

Thought experiments caused reflective decisions?
Reflection tests didn't change philosophical decisions!
18X more junk data from #mTurk (vs other sources)!

#Preprint + audio: https://byrdnick.com/archives/28438/upon-reflection-ep-13-reflection-philosophy-order-effects-and-correlations-across-samples

🎉 In press: Reflection-#Philosophy Order Effects & Correlations Across Samples

Thought experiments caused reflective decisions?
Reflection tests didn't change philosophical decisions!
18X more junk data from #mTurk (vs other sources)!

#Preprint + audio: https://byrdnick.com/archives/28438/upon-reflection-ep-13-reflection-philosophy-order-effects-and-correlations-across-samples

🎉 In press: Reflection-#Philosophy Order Effects & Correlations Across Samples

Thought experiments caused reflective decisions?
Reflection tests didn't change philosophical decisions!
18X more junk data from #mTurk (vs other sources)!

#Preprint + audio: https://byrdnick.com/archives/28438/upon-reflection-ep-13-reflection-philosophy-order-effects-and-correlations-across-samples

"Without crowdsourcing, manually reviewing and labeling thousands of images like this would take days or weeks. With #MTurk you can get it done in a few hours."
https://blog.mturk.com/tutorial-how-to-label-thousands-of-images-using-the-crowd-bea164ccbefc

Regardez cette page, ça ressemble à la promotion d'un service informatique comme un autre. Mais contrairement aux autres, c'est du nouvel esclavagisme numérique.

C'est pas nouveau dans l'absolu mais je trouve ça fascinant de cynisme comment une personne lambda peux déclencher un ordre d'exploitation néo coloniale avec un simple clic, tout ça pour tagger ses photos de vacances ou pour des libristes qui voudraient développer des modèles de #llm open source *ha ha je ris jaune*

"Without crowdsourcing, manually reviewing and labeling thousands of images like this would take days or weeks. With #MTurk you can get it done in a few hours."
https://blog.mturk.com/tutorial-how-to-label-thousands-of-images-using-the-crowd-bea164ccbefc

Regardez cette page, ça ressemble à la promotion d'un service informatique comme un autre. Mais contrairement aux autres, c'est du nouvel esclavagisme numérique.

C'est pas nouveau dans l'absolu mais je trouve ça fascinant de cynisme comment une personne lambda peux déclencher un ordre d'exploitation néo coloniale avec un simple clic, tout ça pour tagger ses photos de vacances ou pour des libristes qui voudraient développer des modèles de #llm open source *ha ha je ris jaune*

"Without crowdsourcing, manually reviewing and labeling thousands of images like this would take days or weeks. With #MTurk you can get it done in a few hours."
https://blog.mturk.com/tutorial-how-to-label-thousands-of-images-using-the-crowd-bea164ccbefc

Regardez cette page, ça ressemble à la promotion d'un service informatique comme un autre. Mais contrairement aux autres, c'est du nouvel esclavagisme numérique.

C'est pas nouveau dans l'absolu mais je trouve ça fascinant de cynisme comment une personne lambda peux déclencher un ordre d'exploitation néo coloniale avec un simple clic, tout ça pour tagger ses photos de vacances ou pour des libristes qui voudraient développer des modèles de #llm open source *ha ha je ris jaune*

"Without crowdsourcing, manually reviewing and labeling thousands of images like this would take days or weeks. With #MTurk you can get it done in a few hours."
https://blog.mturk.com/tutorial-how-to-label-thousands-of-images-using-the-crowd-bea164ccbefc

Regardez cette page, ça ressemble à la promotion d'un service informatique comme un autre. Mais contrairement aux autres, c'est du nouvel esclavagisme numérique.

C'est pas nouveau dans l'absolu mais je trouve ça fascinant de cynisme comment une personne lambda peux déclencher un ordre d'exploitation néo coloniale avec un simple clic, tout ça pour tagger ses photos de vacances ou pour des libristes qui voudraient développer des modèles de #llm open source *ha ha je ris jaune*

"Without crowdsourcing, manually reviewing and labeling thousands of images like this would take days or weeks. With #MTurk you can get it done in a few hours."
https://blog.mturk.com/tutorial-how-to-label-thousands-of-images-using-the-crowd-bea164ccbefc

Regardez cette page, ça ressemble à la promotion d'un service informatique comme un autre. Mais contrairement aux autres, c'est du nouvel esclavagisme numérique.

C'est pas nouveau dans l'absolu mais je trouve ça fascinant de cynisme comment une personne lambda peux déclencher un ordre d'exploitation néo coloniale avec un simple clic, tout ça pour tagger ses photos de vacances ou pour des libristes qui voudraient développer des modèles de #llm open source *ha ha je ris jaune*

Excited to share YEARS of research about how to get people to think reflectively and how reflection impacts philosophical judgments at the 2025 #APA in #NewYorkCity (January 8 to 11): https://www.apaonline.org/mpage/2025eastern

Can't make it?
- More about my talk: https://researchgate.net/publication/370132037
- More about my poster: https://researchgate.net/publication/371248872

Thanks to the #APA, James Beebe, and the Experimental Philosophy Society for the opportunity!

#decisionScience #philosophy #xPhi #epistemology #bioethics #cognitiveScience #mTurk #Prolific #UniversityParticipants #surveyMethods #DualProcessTheory

Excited to share YEARS of research about how to get people to think reflectively and how reflection impacts philosophical judgments at the 2025 #APA in #NewYorkCity (January 8 to 11): https://www.apaonline.org/mpage/2025eastern

Can't make it?
- More about my talk: https://researchgate.net/publication/370132037
- More about my poster: https://researchgate.net/publication/371248872

Thanks to the #APA, James Beebe, and the Experimental Philosophy Society for the opportunity!

#decisionScience #philosophy #xPhi #epistemology #bioethics #cognitiveScience #mTurk #Prolific #UniversityParticipants #surveyMethods #DualProcessTheory

Excited to share YEARS of research about how to get people to think reflectively and how reflection impacts philosophical judgments at the 2025 #APA in #NewYorkCity (January 8 to 11): https://www.apaonline.org/mpage/2025eastern

Can't make it?
- More about my talk: https://researchgate.net/publication/370132037
- More about my poster: https://researchgate.net/publication/371248872

Thanks to the #APA, James Beebe, and the Experimental Philosophy Society for the opportunity!

#decisionScience #philosophy #xPhi #epistemology #bioethics #cognitiveScience #mTurk #Prolific #UniversityParticipants #surveyMethods #DualProcessTheory

Excited to share YEARS of research about how to get people to think reflectively and how reflection impacts philosophical judgments at the 2025 #APA in #NewYorkCity (January 8 to 11): https://www.apaonline.org/mpage/2025eastern

Can't make it?
- More about my talk: https://researchgate.net/publication/370132037
- More about my poster: https://researchgate.net/publication/371248872

Thanks to the #APA, James Beebe, and the Experimental Philosophy Society for the opportunity!

#decisionScience #philosophy #xPhi #epistemology #bioethics #cognitiveScience #mTurk #Prolific #UniversityParticipants #surveyMethods #DualProcessTheory

Excited to share YEARS of research about how to get people to think reflectively and how reflection impacts philosophical judgments at the 2025 #APA in #NewYorkCity (January 8 to 11): https://www.apaonline.org/mpage/2025eastern

Can't make it?
- More about my talk: https://researchgate.net/publication/370132037
- More about my poster: https://researchgate.net/publication/371248872

Thanks to the #APA, James Beebe, and the Experimental Philosophy Society for the opportunity!

#decisionScience #philosophy #xPhi #epistemology #bioethics #cognitiveScience #mTurk #Prolific #UniversityParticipants #surveyMethods #DualProcessTheory

2️⃣ Ethical Dilemmas in Conducting Human Subjects Research on Amazon Mechanical Turk (MTurk)

https://ssrn.com/abstract=4419210

#MTurk #MechanicalTurk #Dehumanization #techworker #techworkerrights #amazonmechanicalturk #clickworker #AIEthics #aws #amazon

2️⃣ Ethical Dilemmas in Conducting Human Subjects Research on Amazon Mechanical Turk (MTurk)

https://ssrn.com/abstract=4419210

#MTurk #MechanicalTurk #Dehumanization #techworker #techworkerrights #amazonmechanicalturk #clickworker #AIEthics #aws #amazon

2️⃣ Ethical Dilemmas in Conducting Human Subjects Research on Amazon Mechanical Turk (MTurk)

https://ssrn.com/abstract=4419210

#MTurk #MechanicalTurk #Dehumanization #techworker #techworkerrights #amazonmechanicalturk #clickworker #AIEthics #aws #amazon

2️⃣ Ethical Dilemmas in Conducting Human Subjects Research on Amazon Mechanical Turk (MTurk)

https://ssrn.com/abstract=4419210

#MTurk #MechanicalTurk #Dehumanization #techworker #techworkerrights #amazonmechanicalturk #clickworker #AIEthics #aws #amazon

2️⃣ Ethical Dilemmas in Conducting Human Subjects Research on Amazon Mechanical Turk (MTurk)

https://ssrn.com/abstract=4419210

#MTurk #MechanicalTurk #Dehumanization #techworker #techworkerrights #amazonmechanicalturk #clickworker #AIEthics #aws #amazon

Are moral decisions impacted by economic environment?

Perhaps! “…in low-income nations, tournament-based compensation increased deontological commitments [but] in higher-income nations, the effect on deontological commitments reversed …consistent with the historical development of the doux commerce thesis.”

A fun #economics paper that reminds me of the early days of #xPhi: https://doi.org/10.1093/jleo/ewae016

#philosophy #psychology #policy #history #ethics #development #decisionScience #mTurk

Are moral decisions impacted by economic environment?

Perhaps! “…in low-income nations, tournament-based compensation increased deontological commitments [but] in higher-income nations, the effect on deontological commitments reversed …consistent with the historical development of the doux commerce thesis.”

A fun #economics paper that reminds me of the early days of #xPhi: https://doi.org/10.1093/jleo/ewae016

#philosophy #psychology #policy #history #ethics #development #decisionScience #mTurk

Are moral decisions impacted by economic environment?

Perhaps! “…in low-income nations, tournament-based compensation increased deontological commitments [but] in higher-income nations, the effect on deontological commitments reversed …consistent with the historical development of the doux commerce thesis.”

A fun #economics paper that reminds me of the early days of #xPhi: https://doi.org/10.1093/jleo/ewae016

#philosophy #psychology #policy #history #ethics #development #decisionScience #mTurk

Are moral decisions impacted by economic environment?

Perhaps! “…in low-income nations, tournament-based compensation increased deontological commitments [but] in higher-income nations, the effect on deontological commitments reversed …consistent with the historical development of the doux commerce thesis.”

A fun #economics paper that reminds me of the early days of #xPhi: https://doi.org/10.1093/jleo/ewae016

#philosophy #psychology #policy #history #ethics #development #decisionScience #mTurk

Are moral decisions impacted by economic environment?

Perhaps! “…in low-income nations, tournament-based compensation increased deontological commitments [but] in higher-income nations, the effect on deontological commitments reversed …consistent with the historical development of the doux commerce thesis.”

A fun #economics paper that reminds me of the early days of #xPhi: https://doi.org/10.1093/jleo/ewae016

#philosophy #psychology #policy #history #ethics #development #decisionScience #mTurk

Could it be that letting respondents choose their own rating scale might reduce the occurrence of #ResponseStyles?

https://link.springer.com/article/10.3758/s13428-024-02429-w

#Psychometrics #MTurk

Could it be that letting respondents choose their own rating scale might reduce the occurrence of #ResponseStyles?

https://link.springer.com/article/10.3758/s13428-024-02429-w

#Psychometrics #MTurk

Could it be that letting respondents choose their own rating scale might reduce the occurrence of #ResponseStyles?

https://link.springer.com/article/10.3758/s13428-024-02429-w

#Psychometrics #MTurk

"The performance of the workers who animate the artifice is obscured by the spectacle of the machine" -- Ayhan Aytes

#Fauxtomation #MTurk

"The performance of the workers who animate the artifice is obscured by the spectacle of the machine" -- Ayhan Aytes

#Fauxtomation #MTurk

"The performance of the workers who animate the artifice is obscured by the spectacle of the machine" -- Ayhan Aytes

#Fauxtomation #MTurk

"The performance of the workers who animate the artifice is obscured by the spectacle of the machine" -- Ayhan Aytes

#Fauxtomation #MTurk

"The performance of the workers who animate the artifice is obscured by the spectacle of the machine" -- Ayhan Aytes

#Fauxtomation #MTurk

👩‍💻 “Professionals, purpose-seekers, and passers-through: How microworkers reconcile alienation and platform commitment through identity work”

💡 The paper by Eliane Bucher, Christian Fieseler, Alexander Buhmann and me is out in the January 2024 New Media & Society issue: https://doi.org/10.1177/14614448211056863

Drawing on quantitative and qualitative data, we show the presence of #alienation in #crowdwork and the role of #identity work in addressing it

#microwork #platform #work #mturk #digitallabour #digital

👩‍💻 “Professionals, purpose-seekers, and passers-through: How microworkers reconcile alienation and platform commitment through identity work”

💡 The paper by Eliane Bucher, Christian Fieseler, Alexander Buhmann and me is out in the January 2024 New Media & Society issue: https://doi.org/10.1177/14614448211056863

Drawing on quantitative and qualitative data, we show the presence of #alienation in #crowdwork and the role of #identity work in addressing it

#microwork #platform #work #mturk #digitallabour #digital

👩‍💻 “Professionals, purpose-seekers, and passers-through: How microworkers reconcile alienation and platform commitment through identity work”

💡 The paper by Eliane Bucher, Christian Fieseler, Alexander Buhmann and me is out in the January 2024 New Media & Society issue: https://doi.org/10.1177/14614448211056863

Drawing on quantitative and qualitative data, we show the presence of #alienation in #crowdwork and the role of #identity work in addressing it

#microwork #platform #work #mturk #digitallabour #digital

A question for the #HCI folks (please repost for more reach):

Since the #LLM cat is definitely out of the bag now, do you feel that #Prolific, #MTurk, etc. are still a reliable source of survey participants and consequently, survey data?

A question for the #HCI folks (please repost for more reach):

Since the #LLM cat is definitely out of the bag now, do you feel that #Prolific, #MTurk, etc. are still a reliable source of survey participants and consequently, survey data?

A question for the #HCI folks (please repost for more reach):

Since the #LLM cat is definitely out of the bag now, do you feel that #Prolific, #MTurk, etc. are still a reliable source of survey participants and consequently, survey data?

A question for the #HCI folks (please repost for more reach):

Since the #LLM cat is definitely out of the bag now, do you feel that #Prolific, #MTurk, etc. are still a reliable source of survey participants and consequently, survey data?