#surveyresearch — Public Fediverse posts

Is #Amazon going to sunset #mTurk?

As of July 30 2026, #AWS will no longer accept new customers (requestors).

"Existing customers can continue to use the service as normal."

https://docs.aws.amazon.com/sagemaker/latest/dg/sms-workforce-management-public.html

#cogSci #psychology #xPhi #AI #tech #news #crowdWork #gigWork #surveyResearch

RE: https://things.uk/@eclectech/116640432702265723

These are some of the worst-written choices for a survey question I’ve ever seen. It seems like the person who wrote this doesn’t know how to write survey questions but also wanted to be deliberately misleading so they can get the kind of answers they want.

#SurveyDesign #FormDesign #SurveyResearch #research

#callforpapers #cfp #SurveyResearch
Who Produces #Knowledge? #AI Intervention in Survey Research between Paradigmatic Reaction and Epistemological Drift
When AI systems generate items, simulate respondents, or classify open-ended responses, measurement itself is shaped by interpretative operations embedded within the model. In relation to this interest, we are inviting contributors to this HSR special issue.

Important date: May 17, 2026: Submission of extended abstracts

https://www.gesis.org/hsr/ueber-hsr/detailanzeige-hsr-news/article/cfp-who-produces-knowledge-ai-intervention-in-survey-research-between-paradigmatic-reaction-and-epistemological-drift

@guyjantic If this question is the only thing you have, it is difficult to make an argument to support ordered categories.

In #SurveyResearch you could do it via previous qualitative work, e.g., cognitive interviews; or quantitative work (e.g., ask people to indicate the order of such terms). If you have specific rating scale anchors (I doubt it exists for the ones you gave as examples 😂 ), you could look for published work on them and at least argue that others have found these to be ordered.

https://winbuzzer.com/2025/11/24/study-shows-how-ai-agents-break-online-surveys-and-polling-posing-existential-threat-to-data-science-xcxwbn

Study Shows How AI Agents Break Online Surveys and Polling, Posing Existential Threat to Data Science

#AI #AIAgents #Cybersecurity #DataScience #AIResearch #AISafety #Polling #ElectionIntegrity #GenerativeAI #SurveyResearch

#jobs #stellenangebote #GESISjobs #jobfairy #SocialScienceJobs #PhDPosition #SurveyResearch #AcademicJobs

🎓 GESIS is hiring a Research Associate (PhD Candidate) in Questionnaire Development to join the Family Surveys team in Mannheim or Cologne, starting 01.09.2025.

Work on the FReDA panel and write your PhD in survey methodology or family sociology.

📅 Apply by 24.07.2025
🔗 https://www.gesis.org/en/institute/career/jobs/details/research-associate-in-data-preparation-phd-candidate

Have 15-20 minutes to think about gender? Participate in my lab’s latest #surveyResearch on gender expression across contexts to help develop new, better assessments of ✨ diverse gender experiences ✨ https://illinois.qualtrics.com/jfe/form/SV_5tHUpQzMeXbICmq please boost for reach, thank you!

#request - does anyone know of any panel services that are affordable? I need some survey participants (200 would be lovely) and quick, because of [swear words while thinking of why]. I'm looking into #mechanicalturk but I don't know if I can get this to happen quickly enough; I have one week.

I need young adults, English speaking (native fluency). North American would be fine, but European is great, too. Maybe near East (e.g., India, Pakistan) if the language fluency is there. Region/nation is less important than the age range and the language ability.

I'd be paying for this out of pocket, and I don't have much money, so hoping I can find inexpensive services somewhere (<<$500 USD? Maybe closer to $200? realizing this might not be possible because I've never looked into this until now). Qualtrics has panels but they're far too expensive for me. I'm googling, but asking here first.

#Recommendations?

#research #survey #surveyresearch #panel #participants #help #lastminute

Matthias Roth (@rothm) and I published a new paper on survey data harmonization.

"One harmonization fits all? – Impact of missing population invariance on harmonization error when harmonizing social science survey questions with equating"

The paper again corroborates that observed score equating outperforms linear stretching on average. However, it also shows that it is better to derive a harmonization solution for single-item measures from a sample that is drawn from a similar population to the population you are interested in researching.

https://doi.org/10.1080/13645579.2025.2481112

#surveyresearch #surveymethods #harmonization

#Microsoft's viral paper about *correlations* between #AI use and #criticalThinking also has "impact" in the title (despite admitting "Our analysis does not establish #causation"). 🤦‍♂️

#Confidence in #GenAI predicted LESS critical thinking.

SELF-confidence predicted MORE critical thinking.

PREDICTED ≠ CAUSED

https://www.microsoft.com/en-us/research/publication/the-impact-of-generative-ai-on-critical-thinking-self-reported-reductions-in-cognitive-effort-and-confidence-effects-from-a-survey-of-knowledge-workers/

#computerScience #LLMs #work #decisionScience #psychology #surveyResearch #management #logic

🗳️ Do Russians Really Support the War in Ukraine?

https://www.newyorker.com/news/a-reporter-at-large/do-russians-really-support-the-war-in-ukraine

archive link: https://archive.ph/indZg

#russia #war #ukraine #publicoption #socialscience #surveyresearch #focusgroup #interviewing

📊 New research finds minimal evidence that using a smartphone for surveys leads to lower data quality. Regardless of device, respondents provided consistent results.

#SurveyResearch #DataQuality #MobileSurveys https://www.surveypractice.org/article/127306-smartphone-or-laptop-device-type-choice-and-data-quality-in-surveys-of-commercial-and-residential-utility-customers

Conincidentally, this is actually how much of #SurveyResearch works #PoorlyDrawnLines

In a new paper, I simulate the consequences of combining survey data without proper harmonization techniques.

I demonstrate that there is a plausible risk of biased correlative analyses based on the integrated data, if we do not harmonize measurement units across different survey sources and instruments first.

#surveyresearch #surveymethods #harmonization

https://doi.org/10.5964/miss.11217

Recently, I've been exploring the nonprobsvy package (https://ncn-foreigners.github.io/nonprobsvy/) in R and am curious if anyone has experience working with it, particularly in combining probability and non-probability samples. I'd love to hear your insights or recommendations! #rstats #SurveyResearch #DataScience

People designing questionnaires for a German sample will find the just published new version of the "Demographische Standards" helpful. It offers guidance on how to collect varios socio-demographic variables (e.g., education, citizenship, employment) in a comprehensive manner.

https://doi.org/10.21241/ssoar.94099

#surveymethods #surveyresearch

Together with Cornelia Neuert and Tenko Raykov, I looked into "Assessing conceptual comparability of single-item survey instruments with a mixed-methods approach".
Innovations are using a confirmatory factor analysis on a collection of single item instruments and comparing it with qualitative findings from probing questions.

To illustrate the approach, we assessed the comparability of social (dis-)trust questions.

#surveyresearch #harmonization

https://doi.org/10.1007/s11135-023-01801-w

Well, @#$%. I'm going to have to learn some serious JSON skills (I'll try to use R packages to make it easier) to create #surveys in #Qualtrics from text files of hundreds of items.

I wish there was an easier way, I really do. Qualtrics is already a pretty amazing platform, so it feels greedy to want this, too, but I do want it.

Once again, $@#%.

#qualtrics #surveyresearch #Rstats

@pgmj #Rstats packages such as #catR #mstR (https://link.springer.com/book/10.1007/978-3-319-69218-0) #mirt and other such infrastructure have moved the field on the #Psychometrics side.

But there is no way to integrate them into the systems I have been using so far to collect for example online #SurveyData with.

Another hurdle:
The field of #SurveyResearch being disconnected from #LatentVariable Theory and related test developments. Something I re-visit each time I deliver training to deliver tests, items, interviews.

@gavintlbrown Thanks for making me aware. There are a number of good applications, especially in mental health and #HRQL research.

I think the problem lies more with what @pgmj points out in their response to this:
The lack of availability of tools/ systems to implement and collect data in this manner. And especially in Europe: to be able to tailor them to the specific security requirements.

#SurveyResearch