#surveyresearch — Public Fediverse posts

#callforpapers #cfp #SurveyResearch
Who Produces #Knowledge? #AI Intervention in Survey Research between Paradigmatic Reaction and Epistemological Drift
When AI systems generate items, simulate respondents, or classify open-ended responses, measurement itself is shaped by interpretative operations embedded within the model. In relation to this interest, we are inviting contributors to this HSR special issue.

Important date: May 17, 2026: Submission of extended abstracts

https://www.gesis.org/hsr/ueber-hsr/detailanzeige-hsr-news/article/cfp-who-produces-knowledge-ai-intervention-in-survey-research-between-paradigmatic-reaction-and-epistemological-drift

📊 At this year’s #ESRA conference, exciting findings based on #FReDA were presented – among others by Dr. Andreas Ette (BiB) and Dr. Detlev Lück (BiB). Many thanks for the great exchange! 🤝

#SurveyResearch #ESRA2025
@bib_bund

Matthias Roth (@rothm) and I published a new paper on survey data harmonization.

"One harmonization fits all? – Impact of missing population invariance on harmonization error when harmonizing social science survey questions with equating"

The paper again corroborates that observed score equating outperforms linear stretching on average. However, it also shows that it is better to derive a harmonization solution for single-item measures from a sample that is drawn from a similar population to the population you are interested in researching.

https://doi.org/10.1080/13645579.2025.2481112

#surveyresearch #surveymethods #harmonization

#Microsoft's viral paper about *correlations* between #AI use and #criticalThinking also has "impact" in the title (despite admitting "Our analysis does not establish #causation"). 🤦‍♂️

#Confidence in #GenAI predicted LESS critical thinking.

SELF-confidence predicted MORE critical thinking.

PREDICTED ≠ CAUSED

https://www.microsoft.com/en-us/research/publication/the-impact-of-generative-ai-on-critical-thinking-self-reported-reductions-in-cognitive-effort-and-confidence-effects-from-a-survey-of-knowledge-workers/

#computerScience #LLMs #work #decisionScience #psychology #surveyResearch #management #logic

🗳️ Do Russians Really Support the War in Ukraine?

https://www.newyorker.com/news/a-reporter-at-large/do-russians-really-support-the-war-in-ukraine

archive link: https://archive.ph/indZg

#russia #war #ukraine #publicoption #socialscience #surveyresearch #focusgroup #interviewing

Conincidentally, this is actually how much of #SurveyResearch works #PoorlyDrawnLines

In a new paper, I simulate the consequences of combining survey data without proper harmonization techniques.

I demonstrate that there is a plausible risk of biased correlative analyses based on the integrated data, if we do not harmonize measurement units across different survey sources and instruments first.

#surveyresearch #surveymethods #harmonization

https://doi.org/10.5964/miss.11217

People designing questionnaires for a German sample will find the just published new version of the "Demographische Standards" helpful. It offers guidance on how to collect varios socio-demographic variables (e.g., education, citizenship, employment) in a comprehensive manner.

https://doi.org/10.21241/ssoar.94099

#surveymethods #surveyresearch

Together with Cornelia Neuert and Tenko Raykov, I looked into "Assessing conceptual comparability of single-item survey instruments with a mixed-methods approach".
Innovations are using a confirmatory factor analysis on a collection of single item instruments and comparing it with qualitative findings from probing questions.

To illustrate the approach, we assessed the comparability of social (dis-)trust questions.

#surveyresearch #harmonization

https://doi.org/10.1007/s11135-023-01801-w

Well, @#$%. I'm going to have to learn some serious JSON skills (I'll try to use R packages to make it easier) to create #surveys in #Qualtrics from text files of hundreds of items.

I wish there was an easier way, I really do. Qualtrics is already a pretty amazing platform, so it feels greedy to want this, too, but I do want it.

Once again, $@#%.

#qualtrics #surveyresearch #Rstats

@pgmj #Rstats packages such as #catR #mstR (https://link.springer.com/book/10.1007/978-3-319-69218-0) #mirt and other such infrastructure have moved the field on the #Psychometrics side.

But there is no way to integrate them into the systems I have been using so far to collect for example online #SurveyData with.

Another hurdle:
The field of #SurveyResearch being disconnected from #LatentVariable Theory and related test developments. Something I re-visit each time I deliver training to deliver tests, items, interviews.

Fellow #HigherEd data nerds: there's an opening for a one-year fellowship based within ED's National Center for Education Statistics to work on #data modernization for IPEDS.

Salary is $180,000 (plus $2000 monthly allowance). The position is remote with occasional travel to DC.

See the full ad at https://federation-of-american-scientists.rippling-ats.com/job/552779/data-modernization-specialist-impact-fellow

#HigherEducation #EducationResearch #EdResearch #DataScience #QuantMethods #SQL #DataGovernance #AltAc #SocialScience #EconTwitter #SurveyResearch #FullStack

The #ASA / #NSF / #BLS Senior Research Fellowship Program is searching for two fellows. One position is focused on #statistics, #economics, or #BehavioralScience research, and the other is focused on #DataScience. Applicants must work at a college/university or a 501(c)(3) #nonprofit.

Applications are due January 9, 2023. See the full details at https://www.bls.gov/osmr/asa_nsf_bls_fellowship_info.htm

#SurveyResearch #SocialScience #SurveyMethods #surveys #sampling #fellowship #QuantMethods