home.social

#prolific — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #prolific, aggregated by home.social.

  1. I forgot to share the #mTurk data quality result that got scooped:

    “In late 2020…. Participants from the United States were recruited from Amazon Mechanical Turk, -#CloudResearch, #Prolific, and a #university. One participant source yielded up to 18 times as many low-quality respondents as the other three.”

    doi.org/10.1093/analys/anaf015

    #psychology #philosophy #surveyMethods #quantMethods #dataScience #qualityControl

  2. I forgot to share the #mTurk data quality result that got scooped:

    “In late 2020…. Participants from the United States were recruited from Amazon Mechanical Turk, -#CloudResearch, #Prolific, and a #university. One participant source yielded up to 18 times as many low-quality respondents as the other three.”

    doi.org/10.1093/analys/anaf015

    #psychology #philosophy #surveyMethods #quantMethods #dataScience #qualityControl

  3. I forgot to share the #mTurk data quality result that got scooped:

    “In late 2020…. Participants from the United States were recruited from Amazon Mechanical Turk, -#CloudResearch, #Prolific, and a #university. One participant source yielded up to 18 times as many low-quality respondents as the other three.”

    doi.org/10.1093/analys/anaf015

    #psychology #philosophy #surveyMethods #quantMethods #dataScience #qualityControl

  4. I forgot to share the #mTurk data quality result that got scooped:

    “In late 2020…. Participants from the United States were recruited from Amazon Mechanical Turk, -#CloudResearch, #Prolific, and a #university. One participant source yielded up to 18 times as many low-quality respondents as the other three.”

    doi.org/10.1093/analys/anaf015

    #psychology #philosophy #surveyMethods #quantMethods #dataScience #qualityControl

  5. I forgot to share the #mTurk data quality result that got scooped:

    “In late 2020…. Participants from the United States were recruited from Amazon Mechanical Turk, -#CloudResearch, #Prolific, and a #university. One participant source yielded up to 18 times as many low-quality respondents as the other three.”

    doi.org/10.1093/analys/anaf015

    #psychology #philosophy #surveyMethods #quantMethods #dataScience #qualityControl

  6. I do academic surveys a bit at #Prolific, and it's interesting to see trends that go through them.

    One aspect of these surveys is the attention check. To prevent people answering randomly, or bots from completing their surveys, they ask the occasional question with a definite, specific answer.

    Often it's done like this:
    There are many issues that concern us in the world today. It is also important to follow directions. To show that you're paying attention, please ignore the below question and just answer Green.
    What is your favorite color?
    (multiple choices)

    Sometimes they do this more humorously:
    Have you ever been to the planet Mars?
    ◯ Yes
    ◯ No

    Have you ever attended your own funeral?
    ◯ Yes
    ◯ No

  7. New #surveyMethods paper replicates and extends differences in #dataQuality, attention, naivety, decision style, etc. by
    - online #research recruitment platform (#mTurk, #Prolific, #Qualtrics, #Pollfish)
    - device (#mobile v. #desktop)
    - person's incentive

    doi.org/10.3758/s13428-025-026

  8. New #surveyMethods paper replicates and extends differences in #dataQuality, attention, naivety, decision style, etc. by
    - online #research recruitment platform (#mTurk, #Prolific, #Qualtrics, #Pollfish)
    - device (#mobile v. #desktop)
    - person's incentive

    doi.org/10.3758/s13428-025-026

  9. New #surveyMethods paper replicates and extends differences in #dataQuality, attention, naivety, decision style, etc. by
    - online #research recruitment platform (#mTurk, #Prolific, #Qualtrics, #Pollfish)
    - device (#mobile v. #desktop)
    - person's incentive

    doi.org/10.3758/s13428-025-026

  10. New #surveyMethods paper replicates and extends differences in #dataQuality, attention, naivety, decision style, etc. by
    - online #research recruitment platform (#mTurk, #Prolific, #Qualtrics, #Pollfish)
    - device (#mobile v. #desktop)
    - person's incentive

    doi.org/10.3758/s13428-025-026

  11. New #surveyMethods paper replicates and extends differences in #dataQuality, attention, naivety, decision style, etc. by
    - online #research recruitment platform (#mTurk, #Prolific, #Qualtrics, #Pollfish)
    - device (#mobile v. #desktop)
    - person's incentive

    doi.org/10.3758/s13428-025-026

  12. Doing #research on #crowdsourcing platforms is the closest thing to working in #customer #service as an academic. You reject a submission for failing attention checks, speeding through a 20-minute study in 90 seconds, and submitting absolute nonsense? Now they’re in your inbox demanding payment, insisting they “definitely read everything”, and arguing that your study is “literally broken” (you do realise I can see your data, right?).

    Bestie, I’m an unpaid #PhD #student working with carefully budgeted research funding. I do not have the energy to fight over £1,50. I just want to wrap up this study, analyse my depressing data, and go home to lie face down on the floor for an unspecified amount of time. Please, leave me alone. #Prolific #SundayRant

  13. Excited to share YEARS of research about how to get people to think reflectively and how reflection impacts philosophical judgments at the 2025 #APA in #NewYorkCity (January 8 to 11): apaonline.org/mpage/2025easter

    Can't make it?
    - More about my talk: researchgate.net/publication/3
    - More about my poster: researchgate.net/publication/3

    Thanks to the #APA, James Beebe, and the Experimental Philosophy Society for the opportunity!

    #decisionScience #philosophy #xPhi #epistemology #bioethics #cognitiveScience #mTurk #Prolific #UniversityParticipants #surveyMethods #DualProcessTheory

  14. Excited to share YEARS of research about how to get people to think reflectively and how reflection impacts philosophical judgments at the 2025 #APA in #NewYorkCity (January 8 to 11): apaonline.org/mpage/2025easter

    Can't make it?
    - More about my talk: researchgate.net/publication/3
    - More about my poster: researchgate.net/publication/3

    Thanks to the #APA, James Beebe, and the Experimental Philosophy Society for the opportunity!

    #decisionScience #philosophy #xPhi #epistemology #bioethics #cognitiveScience #mTurk #Prolific #UniversityParticipants #surveyMethods #DualProcessTheory

  15. Excited to share YEARS of research about how to get people to think reflectively and how reflection impacts philosophical judgments at the 2025 #APA in #NewYorkCity (January 8 to 11): apaonline.org/mpage/2025easter

    Can't make it?
    - More about my talk: researchgate.net/publication/3
    - More about my poster: researchgate.net/publication/3

    Thanks to the #APA, James Beebe, and the Experimental Philosophy Society for the opportunity!

    #decisionScience #philosophy #xPhi #epistemology #bioethics #cognitiveScience #mTurk #Prolific #UniversityParticipants #surveyMethods #DualProcessTheory

  16. Excited to share YEARS of research about how to get people to think reflectively and how reflection impacts philosophical judgments at the 2025 #APA in #NewYorkCity (January 8 to 11): apaonline.org/mpage/2025easter

    Can't make it?
    - More about my talk: researchgate.net/publication/3
    - More about my poster: researchgate.net/publication/3

    Thanks to the #APA, James Beebe, and the Experimental Philosophy Society for the opportunity!

    #decisionScience #philosophy #xPhi #epistemology #bioethics #cognitiveScience #mTurk #Prolific #UniversityParticipants #surveyMethods #DualProcessTheory

  17. Excited to share YEARS of research about how to get people to think reflectively and how reflection impacts philosophical judgments at the 2025 #APA in #NewYorkCity (January 8 to 11): apaonline.org/mpage/2025easter

    Can't make it?
    - More about my talk: researchgate.net/publication/3
    - More about my poster: researchgate.net/publication/3

    Thanks to the #APA, James Beebe, and the Experimental Philosophy Society for the opportunity!

    #decisionScience #philosophy #xPhi #epistemology #bioethics #cognitiveScience #mTurk #Prolific #UniversityParticipants #surveyMethods #DualProcessTheory

  18. A question for the #HCI folks (please repost for more reach):

    Since the #LLM cat is definitely out of the bag now, do you feel that #Prolific, #MTurk, etc. are still a reliable source of survey participants and consequently, survey data?

  19. A question for the #HCI folks (please repost for more reach):

    Since the #LLM cat is definitely out of the bag now, do you feel that #Prolific, #MTurk, etc. are still a reliable source of survey participants and consequently, survey data?

  20. A question for the #HCI folks (please repost for more reach):

    Since the #LLM cat is definitely out of the bag now, do you feel that #Prolific, #MTurk, etc. are still a reliable source of survey participants and consequently, survey data?

  21. A question for the #HCI folks (please repost for more reach):

    Since the #LLM cat is definitely out of the bag now, do you feel that #Prolific, #MTurk, etc. are still a reliable source of survey participants and consequently, survey data?

  22. A question for the #HCI folks (please repost for more reach):

    Since the #LLM cat is definitely out of the bag now, do you feel that #Prolific, #MTurk, etc. are still a reliable source of survey participants and consequently, survey data?

  23. Next Wednesday I'll give a #prolific webinar series talk.

    "Open Science and Reproducibility in Online Research"

    It is a topic I will try my best to do justice! But one that will always benefit from discussion #openscience

    You can register here: prolific.co/webinars

  24. On #WindowsUpdate there's a #Prolific driver update Really reluctant to install it because they've been known to issue new drivers specifically to disable their own old hardware. Really scummy behaviour. I think I won't bother.