#cloudresearch — Public Fediverse posts

I forgot to share the #mTurk data quality result that got scooped:

“In late 2020…. Participants from the United States were recruited from Amazon Mechanical Turk, -#CloudResearch, #Prolific, and a #university. One participant source yielded up to 18 times as many low-quality respondents as the other three.”

https://doi.org/10.1093/analys/anaf015

#psychology #philosophy #surveyMethods #quantMethods #dataScience #qualityControl

What conclusion do you draw, if any, when all (and only) the people who wrote in "non-binary" to the question, "What is your gender?" failed a survey's attention check?

Why would someone who puts in the effort to write a (vs. select a pre-written) response have been inattentive earlier in the survey?

I doubt that people reporting non-binary gender are generally less attentive on surveys.

So was it most likely a fluke?

#mTurk #CloudResearch #researchMethods #demographics #dataQuality