#psychometrics — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #psychometrics, aggregated by home.social.
-
New Jamovi module functionality to determine appropriate model fit cutoffs for confirmatory factor analysis now available in easyRasch2jmv v0.4.0. Install/update from Jamovi Library within the app.
-
I've made a Jamovi module for modern psychometric analysis using Rasch Measurement Theory, "easyRasch2jmv", that is available in Jamovi's library. The module implements simulation-based (dynamic) cutoff values for conditional item fit and residual correlations, amongst other things. #psychometrics
The "easyRasch2jmv" module currently contains only 5 of the functions from my package. I prioritized these functions to enable analysis of the 4 basic psychometric criteria:
- unidimensionality
- local independence of items
- ordered response category thresholds (monotonicity)
- invariance (no DIF)Afaik, simulation-based cutoffs for Rasch model fit metrics is not available in any other software, except my github-only R-package easyRasch. Some more details on the topic: https://pgmj.github.io/rasch_itemfit/ and https://pgmj.github.io/simcutoffs.html
If you are new to Rasch psychometrics, you will find a fair amount of resources and analysis examples here:
https://pgmj.github.io/raschrvignette/RaschRvign.htmlThis module is built using R packages such as eRm, mirt, and iarm.
-
The 2025 Trevor Levere Best Paper Prize goes to the team of the paper "The drop and the metric system: how an unruly unit survived revolutions"
https://www.tandfonline.com/doi/full/10.1080/00033790.2026.2636886This is really great news and is for an excellent paper that I highly recommend reading!
Working myself in an area that has at best non-standard measurement units (at worst, some people would argue, is not measurement at all), I found this very interesting.
-
Join today's free webinar about "moral measurement"! I'm talking #psychometrics and data quality in the era of online experiments and AI. I review two problems, two solutions, and two resources.
Register at https://ssri.psu.edu/news/moral-measures-workshop-be-held-march-23
Thanks to Penn State for hosting!
-
Pluralistic: Daily links from Cory Doctorow – No trackers, no ads. Black type, white background. Privacy policy: we don't collect or retain any data at all ever period. [Unofficial] @[email protected] ·Pluralistic: Love of corporate bullshit is correlated with bad judgment (19 Mar 2026)
https://web.brid.gy/r/https://pluralistic.net/2026/03/19/jargon-watch/
-
This paper suggests that the #HoNOS has limited utility for capturing psychopathology or monitoring progress in forensic outpatient settings
https://www.tandfonline.com/doi/full/10.1080/24732850.2026.2636142
Some items differentiated btw diagnostic groups, but limited evidence for use of 1 (to 3) summary scoresI admit having limited love for the instrument since our work on its use in secondary #MentalHealth care https://link.springer.com/article/10.1007/s10488-019-00958-7
More details, CHE working paper 137, pdf
https://www.york.ac.uk/media/che/documents/papers/researchpapers/CHERP137_mental_health_data_episodic_payment.pdf -
This paper suggests that the #HoNOS has limited utility for capturing psychopathology or monitoring progress in forensic outpatient settings
https://www.tandfonline.com/doi/full/10.1080/24732850.2026.2636142
Some items differentiated btw diagnostic groups, but limited evidence for use of 1 (to 3) summary scoresI admit having limited love for the instrument since our work on its use in secondary #MentalHealth care https://link.springer.com/article/10.1007/s10488-019-00958-7
More details, CHE working paper 137, pdf
https://www.york.ac.uk/media/che/documents/papers/researchpapers/CHERP137_mental_health_data_episodic_payment.pdf -
This paper suggests that the #HoNOS has limited utility for capturing psychopathology or monitoring progress in forensic outpatient settings
https://www.tandfonline.com/doi/full/10.1080/24732850.2026.2636142
Some items differentiated btw diagnostic groups, but limited evidence for use of 1 (to 3) summary scoresI admit having limited love for the instrument since our work on its use in secondary #MentalHealth care https://link.springer.com/article/10.1007/s10488-019-00958-7
More details, CHE working paper 137, pdf
https://www.york.ac.uk/media/che/documents/papers/researchpapers/CHERP137_mental_health_data_episodic_payment.pdf -
This paper suggests that the #HoNOS has limited utility for capturing psychopathology or monitoring progress in forensic outpatient settings
https://www.tandfonline.com/doi/full/10.1080/24732850.2026.2636142
Some items differentiated btw diagnostic groups, but limited evidence for use of 1 (to 3) summary scoresI admit having limited love for the instrument since our work on its use in secondary #MentalHealth care https://link.springer.com/article/10.1007/s10488-019-00958-7
More details, CHE working paper 137, pdf
https://www.york.ac.uk/media/che/documents/papers/researchpapers/CHERP137_mental_health_data_episodic_payment.pdf -
This paper suggests that the #HoNOS has limited utility for capturing psychopathology or monitoring progress in forensic outpatient settings
https://www.tandfonline.com/doi/full/10.1080/24732850.2026.2636142
Some items differentiated btw diagnostic groups, but limited evidence for use of 1 (to 3) summary scoresI admit having limited love for the instrument since our work on its use in secondary #MentalHealth care https://link.springer.com/article/10.1007/s10488-019-00958-7
More details, CHE working paper 137, pdf
https://www.york.ac.uk/media/che/documents/papers/researchpapers/CHERP137_mental_health_data_episodic_payment.pdf -
Beaufort’s Wind Scale makes me want to add Likert levels.
Rate your agreement with “…”:
⚪️ slightly agree
⚪️ moderately agree
⚪️ FRESH agree
⚪️ strongly agree
⚪️ GALE FORCE agree
⚪️ VIOLENTLY agree
🔘 HURRICANE Agree -
Just came across this blast from the past (2013):
https://rdcu.be/e7TDY
- daily assessments
- ordinal data multilevel #measurement
- DIF analysisCouched as a preliminary investigation and pilot study, the analytic approach still sets a bar reached rarely by studies with such data.
-
#jobs #stellenangebote #GESISjobs #psychometrics #Doctoralstudent
Pursue your scientific career at GESIS!
https://youtu.be/zMY2zqYFIMgWe offer a job as a Research Associate (Doctoral student) focus on psychometrics
(Salary group 13 TV-L, working time 75 %, limited to 4 years):https://gesis.jobs.personio.de/job/2560025?language=de&display=en
-
RE: https://flipboard.com/@wsj/business-b1985f4jz/-/a-T6_YAnIFSTSuzZdNlac-EA%3Aa%3A248213600-%2F0
“Instead of paying humans to join focus groups and complete surveys, #Auru uses thousands of #AI agents, or bots, to simulate human responses. It feeds #demographic and psychographic information into its models to create human profiles that match clients’ needs, and the results those bots spit out are being used for product #development, #pricing, identifying new customers and political #polling.”
Researchers have warned about the inaccuracies of treating #LLMs as human proxies (https://doi.org/10.1007/s10462-025-11297-5), but I wouldn’t be surprised #languageModels beat #qualitative interpretation of non-representative focus groups.
#marketing #psychometrics #statistics #quantMethods #philSci #metascience #business
-
A #SysReview exploring impacts of community-based interventions for adults with #multimorbidity on clinical and patient-reported outcomes (25 studies):
https://bmjpublichealth.bmj.com/content/4/1/e004156Quick comparison of identified outcomes with the two central #CoreOutcomeSets 👇
-
Having seen many (and done some) of these proof-of-concept studies myself, let's me wonder:
Are there still too few well-developed systems available?
Maybe someone reads this and feels we can get a collection of these together so that others can read up on them?
-
A recent post the @Mental_Elf picks up and explains a study on computerized adaptive testing, which is quite cool!
https://www.nationalelfservice.net/treatment/digital-health/measuring-paranoid-beliefs-can-adaptive-testing-support-routine-clinical-care/Psychometricians, what is your favourite application or study in the field of computerized adaptive testing with health-related constructs?
-
Interesting paper about the impact of missed cases on the accuracy of screening tools, likely of interest beyond autism research and practice communities.
I enjoyed in particular, that "[t]he strengths and benefits of blending epidemiology and psychometric perspectives to identify screening tools that are weaker than expected are discussed."
-
Upcoming event at the Institute for #MedicalHumanities in Durham, UK:
#Measurement Heretics Workshop
Being, Meaning, and Measuring Well
https://www.durham.ac.uk/research/institutes-and-centres/medical-humanities/events/measurement-heretics-workshop-being-meaning-and-measuring-well/
11.-13.03.2026Day 1 #hybrid keynote:
A fluid history of measurement: The drop in the metric revolution
Armel Cornu and Sarah Hijmans
[Day2-3 in-person] -
Quality Assessment of Diagnostic Test Accuracy Studies
QUADAS-3 published:
https://pubmed.ncbi.nlm.nih.gov/41698208/__Key changes from QUADAS-2__
introduction of an 'ideal test accuracy trial'
assessment at the estimate rather than study level
"Flow and Timing" domain replaced with an "Analysis" domain
sections on the rationale for judgments
introduction of a judgment of #RiskOfBias and concerns regarding applicability
-
I have made an R package for test equating using the Leunbach method. Thanks to the gracious sharing of DIGRAM source code by Svend Kreiner and some assistance of Claude Opus 4.5, the package `leunbachR` is now available on GitHub: https://pgmj.github.io/leunbachR/
#rstats #psychometrics -
Core outcome sets are a strong tool to improve quality of and communication about research, but especially to align PRACTICE and research. A #COS for #depression has the potential to move the dial considerably:
https://www.jclinepi.com/article/S0895-4356(25)00452-4/fulltext
#GlobalHealth #GlobalMentalHealthThe PROCEED study identified outcomes for #depression that matter to patients, caregivers, #healthcare professionals, an excellent read:
https://pubmed.ncbi.nlm.nih.gov/32711710/#Psychometrics #ContentValidity #Validity @philosophy
@eikofried -
Can #AI reasoning models infer people's underlying reasons in unstructured chat data from group decisions?
Across multiple prompting steps, #GTP5 usually did NOT select the same underlying reason as a human rater: https://doi.org/10.48550/arXiv.2601.05582
-
Can #AI reasoning models infer people's underlying reasons in unstructured chat data from group decisions?
Across multiple prompting steps, #GTP5 usually did NOT select the same underlying reason as a human rater: https://doi.org/10.48550/arXiv.2601.05582
-
Can #AI reasoning models infer people's underlying reasons in unstructured chat data from group decisions?
Across multiple prompting steps, #GTP5 usually did NOT select the same underlying reason as a human rater: https://doi.org/10.48550/arXiv.2601.05582
-
Can #AI reasoning models infer people's underlying reasons in unstructured chat data from group decisions?
Across multiple prompting steps, #GTP5 usually did NOT select the same underlying reason as a human rater: https://doi.org/10.48550/arXiv.2601.05582
-
Can #AI reasoning models infer people's underlying reasons in unstructured chat data from group decisions?
Across multiple prompting steps, #GTP5 usually did NOT select the same underlying reason as a human rater: https://doi.org/10.48550/arXiv.2601.05582
-
Looking for a #WeekendRead?
How about my colleague's umbrella concept analysis of #loneliness identifying one necessary and sufficient characteristic:
https://www.tandfonline.com/doi/full/10.1080/17437199.2025.2528822Brief comment from me on LinkedIn:
https://www.linkedin.com/feed/update/urn:li:activity:7416424211079995394/Press release from #DundeeUni
https://www.dundee.ac.uk/press-release/loneliness-definition-could-transform-support-millions -
I have been following and used #JASP on and off over the years and I liked it a lot.
This tutorial makes it really interesting!
"Measurement Invariance with Moderated (Non-)Linear Factor Analysis in JASP"
https://osf.io/preprints/psyarxiv/6ftqg_v1I hope I can trial it soon!
-
I really enjoy reading the expanding literature on #invariance of #ValueSets. Two interesting papers and a taxonomy regarding #obsolescence
1- https://link.springer.com/article/10.1007/s11136-024-03770-5
2- https://www.sciencedirect.com/science/article/pii/S1098301525062072
3- https://link.springer.com/article/10.1007/s40273-025-01476-1
"As time and methods advance, the bedrock of applied valuation research naturally becomes increasingly unreliable, and, as a field, we need to consider how to approach this challenge."
-
@guyjantic If you have not only one, but multiple questions, several item response models extend this logic by assuming a latent continuous variable:
they evaluate whether the responses to the questions can be reconstructed as ordered responses - and ordered in this case meaning 'with reference to this latent variable' (e.g., does being more in favour of rights for pregnant people consistently align with choosing higher categories in the individual question responses). -
Great article reviewing and testing the accuracy of a range of direct measures (i.e., bogus items, requiring the respondent to choose a specific answer) and indirect measures (i.e., unobtrusive post hoc indices) for detecting careless responses in online surveys.
Excellent overview tables and very practical conclusions!
Open Access: https://doi.org/10.3758/s13428-024-02484-3
#psychologicalassessment #psychometrics #researchmethods #psychology #quantitativepsychology
-
Kuni Saffana recently joined the team as a PhD student, having received funding by the Indonesia Endowment Fund for Education Agency (LPDP) Scholarship.
Her research will aim to advance the use of #psychometrics in #environmentalpsychology in order to promote conscious and responsible consumption
-
Publication proposing a 'Comprehensibility Continuum' method to demonstrate #PatientReported outcome measure comprehensibility systematically and consistently from interview data:
https://link.springer.com/article/10.1007/s11136-024-03858-y -
RE: https://mastodon.acm.org/@neilernst/115607469843033537
😳 The #AI survey taker "rendered [attention quality] checks [ACQs] effectively obsolete. Across 6,000 total trials..., [it] committed only 10 errors, achieving an overall pass rate of 99.8% and scoring perfectly on 18 of the 20 ACQ types."
#surveyMethods #psychometrics #psychology #tech #psychology #philSci #SciComm #dataQuality
-
Senior Psychometrician
Gap InternationalGap International, a leading global management consulting firm, is looking for an experienced and innovative Senior Psychometrician.
See the full job description on jobRxiv: https://jobrxiv.org/job/gap-international-27778-senior-psychometrician/
#phd #psychometrics #Python #r #sas #spss #ScienceJobs #hiring #research
https://jobrxiv.org/job/gap-international-27778-senior-psychometrician/?fsp_sid=6108 -
The new paper is part of the ongoing #CallForPapers by the journal "Quality of Life Research"
"Quality of life in people with #MentalDisorder – beyond global scores"
https://link.springer.com/journal/11136/updates/27711536Linked editorial:
https://rdcu.be/eNtXG -
We* investigated how QoL/ #HRQoL instruments were used as outcome measures in substance and behavioural addictions. We found similar issues as this team regarding wide variety of measures, lack of theory, and issues around methodological quality:
https://onlinelibrary.wiley.com/doi/10.1111/dar.13717 -
Great to see @hudsongolino.bsky.social presenting on AI-GENIE at #ISOQOL
Firstly, the community hears and uses the words "the #PrePrint is out" too rarely, and here it is:
https://osf.io/preprints/psyarxiv/fgbj4_v2Second, it is great to see the strong theoretical underpinnings of exploratory graph analysis making their way into promising applications
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0174035 -
Senior Psychometrician
Gap InternationalGap International, a leading global management consulting firm, is looking for an experienced and innovative Senior Psychometrician.
See the full job description on jobRxiv: https://jobrxiv.org/job/gap-international-27778-senior-psychometrician/
#phd #psychometrics #Python #r #sas #spss #ScienceJobs #hiring #research
https://jobrxiv.org/job/gap-international-27778-senior-psychometrician/?fsp_sid=4022 -
Is solipsism measurable?
Seven studies developed a self-report scale of how much one doubts that others exist (beyond one's own mind).
It correlated with loneliness, social disconnection, aggression, and problematic gaming.
-
Senior Psychometrician
Gap InternationalGap International, a leading global management consulting firm, is looking for an experienced and innovative Senior Psychometrician.
See the full job description on jobRxiv: https://jobrxiv.org/job/gap-international-27778-senior-psychometrician/
#phd #psychometrics #Python #r #sas #spss #ScienceJobs #hiring #research
https://jobrxiv.org/job/gap-international-27778-senior-psychometrician/?fsp_sid=3490 -
Senior Psychometrician
Gap InternationalGap International, a leading global management consulting firm, is looking for an experienced and innovative Senior Psychometrician.
See the full job description on jobRxiv: https://jobrxiv.org/job/gap-international-27778-senior-psychometrician/
#phd #psychometrics #Python #r #sas #spss #ScienceJobs #hiring #research
https://jobrxiv.org/job/gap-international-27778-senior-psychometrician/?fsp_sid=3315 -
Do reflection test solutions actually involve reflection?
Our think-aloud studies found they usually do (https://doi.org/10.14264/0f12c1c), but Ryan Jesson found that solution-prompting insight is often unconscious or spontaneous.
-
Do reflection test solutions actually involve reflection?
Our think-aloud studies found they usually do (https://doi.org/10.14264/0f12c1c), but Ryan Jesson found that solution-prompting insight is often unconscious or spontaneous.
-
Do reflection test solutions actually involve reflection?
Our think-aloud studies found they usually do (https://doi.org/10.14264/0f12c1c), but Ryan Jesson found that solution-prompting insight is often unconscious or spontaneous.
-
Do reflection test solutions actually involve reflection?
Our think-aloud studies found they usually do (https://doi.org/10.14264/0f12c1c), but Ryan Jesson found that solution-prompting insight is often unconscious or spontaneous.
-
Do reflection test solutions actually involve reflection?
Our think-aloud studies found they usually do (https://doi.org/10.14264/0f12c1c), but Ryan Jesson found that solution-prompting insight is often unconscious or spontaneous.
-
Speaking about #MentalHealth assessment in #YoungPeople, @neilhumphrey.bsky.social summarises:
"A lot of the measures that are around there, including the most widely used measures, are actually not very good."