#psychometrics — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #psychometrics, aggregated by home.social.
-
Your AI Doesn’t Have a Personality (But a Crowd of Them Does)
Been doing some research on AI and personality. Check it out.
https://ataary.com/your-ai-doesnt-have-a-personality-but-a-crowd-of-them-does/
-
Your AI Doesn’t Have a Personality (But a Crowd of Them Does)
Been doing some research on AI and personality. Check it out.
https://ataary.com/your-ai-doesnt-have-a-personality-but-a-crowd-of-them-does/
-
Our latest study on work addiction has now been published in the journal Assessment. Congratulations to Stephanie Towch and thanks to Dr. Paweł Atroszko for the collaboration!
Full study available from here: https://doi.org/10.1177/10731911261447068
-
Our latest study on work addiction has now been published in the journal Assessment. Congratulations to Stephanie Towch and thanks to Dr. Paweł Atroszko for the collaboration!
Full study available from here: https://doi.org/10.1177/10731911261447068
-
RE: https://mastodon.social/@jrboehnke/115258021970867970
Message from jobs.ac.uk
"Hi Jan,
There have been no new jobs matching search your chosen criteria within the last 3 months."Alert criteria
#Psychometric OR
#Psychometrics OR
#PsychologicalAssessment
in #ScotlandI am not sure how many years ago I set the alert up, but this is the only advert I ever received through it.
-
RE: https://mastodon.social/@jrboehnke/115258021970867970
Message from jobs.ac.uk
"Hi Jan,
There have been no new jobs matching search your chosen criteria within the last 3 months."Alert criteria
#Psychometric OR
#Psychometrics OR
#PsychologicalAssessment
in #ScotlandI am not sure how many years ago I set the alert up, but this is the only advert I ever received through it.
-
New Jamovi module functionality to determine appropriate model fit cutoffs for confirmatory factor analysis now available in easyRasch2jmv v0.4.0. Install/update from Jamovi Library within the app.
-
New Jamovi module functionality to determine appropriate model fit cutoffs for confirmatory factor analysis now available in easyRasch2jmv v0.4.0. Install/update from Jamovi Library within the app.
-
I've made a Jamovi module for modern psychometric analysis using Rasch Measurement Theory, "easyRasch2jmv", that is available in Jamovi's library. The module implements simulation-based (dynamic) cutoff values for conditional item fit and residual correlations, amongst other things. #psychometrics
The "easyRasch2jmv" module currently contains only 5 of the functions from my package. I prioritized these functions to enable analysis of the 4 basic psychometric criteria:
- unidimensionality
- local independence of items
- ordered response category thresholds (monotonicity)
- invariance (no DIF)Afaik, simulation-based cutoffs for Rasch model fit metrics is not available in any other software, except my github-only R-package easyRasch. Some more details on the topic: https://pgmj.github.io/rasch_itemfit/ and https://pgmj.github.io/simcutoffs.html
If you are new to Rasch psychometrics, you will find a fair amount of resources and analysis examples here:
https://pgmj.github.io/raschrvignette/RaschRvign.htmlThis module is built using R packages such as eRm, mirt, and iarm.
-
I've made a Jamovi module for modern psychometric analysis using Rasch Measurement Theory, "easyRasch2jmv", that is available in Jamovi's library. The module implements simulation-based (dynamic) cutoff values for conditional item fit and residual correlations, amongst other things. #psychometrics
The "easyRasch2jmv" module currently contains only 5 of the functions from my package. I prioritized these functions to enable analysis of the 4 basic psychometric criteria:
- unidimensionality
- local independence of items
- ordered response category thresholds (monotonicity)
- invariance (no DIF)Afaik, simulation-based cutoffs for Rasch model fit metrics is not available in any other software, except my github-only R-package easyRasch. Some more details on the topic: https://pgmj.github.io/rasch_itemfit/ and https://pgmj.github.io/simcutoffs.html
If you are new to Rasch psychometrics, you will find a fair amount of resources and analysis examples here:
https://pgmj.github.io/raschrvignette/RaschRvign.htmlThis module is built using R packages such as eRm, mirt, and iarm.
-
The 2025 Trevor Levere Best Paper Prize goes to the team of the paper "The drop and the metric system: how an unruly unit survived revolutions"
https://www.tandfonline.com/doi/full/10.1080/00033790.2026.2636886This is really great news and is for an excellent paper that I highly recommend reading!
Working myself in an area that has at best non-standard measurement units (at worst, some people would argue, is not measurement at all), I found this very interesting.
-
The 2025 Trevor Levere Best Paper Prize goes to the team of the paper "The drop and the metric system: how an unruly unit survived revolutions"
https://www.tandfonline.com/doi/full/10.1080/00033790.2026.2636886This is really great news and is for an excellent paper that I highly recommend reading!
Working myself in an area that has at best non-standard measurement units (at worst, some people would argue, is not measurement at all), I found this very interesting.
-
Join today's free webinar about "moral measurement"! I'm talking #psychometrics and data quality in the era of online experiments and AI. I review two problems, two solutions, and two resources.
Register at https://ssri.psu.edu/news/moral-measures-workshop-be-held-march-23
Thanks to Penn State for hosting!
-
Join today's free webinar about "moral measurement"! I'm talking #psychometrics and data quality in the era of online experiments and AI. I review two problems, two solutions, and two resources.
Register at https://ssri.psu.edu/news/moral-measures-workshop-be-held-march-23
Thanks to Penn State for hosting!
-
Pluralistic: Daily links from Cory Doctorow – No trackers, no ads. Black type, white background. Privacy policy: we don't collect or retain any data at all ever period. [Unofficial] @[email protected] ·Pluralistic: Love of corporate bullshit is correlated with bad judgment (19 Mar 2026)
https://web.brid.gy/r/https://pluralistic.net/2026/03/19/jargon-watch/
-
Pluralistic: Daily links from Cory Doctorow – No trackers, no ads. Black type, white background. Privacy policy: we don't collect or retain any data at all ever period. [Unofficial] @[email protected] ·Pluralistic: Love of corporate bullshit is correlated with bad judgment (19 Mar 2026)
https://web.brid.gy/r/https://pluralistic.net/2026/03/19/jargon-watch/
-
This paper suggests that the #HoNOS has limited utility for capturing psychopathology or monitoring progress in forensic outpatient settings
https://www.tandfonline.com/doi/full/10.1080/24732850.2026.2636142
Some items differentiated btw diagnostic groups, but limited evidence for use of 1 (to 3) summary scoresI admit having limited love for the instrument since our work on its use in secondary #MentalHealth care https://link.springer.com/article/10.1007/s10488-019-00958-7
More details, CHE working paper 137, pdf
https://www.york.ac.uk/media/che/documents/papers/researchpapers/CHERP137_mental_health_data_episodic_payment.pdf -
This paper suggests that the #HoNOS has limited utility for capturing psychopathology or monitoring progress in forensic outpatient settings
https://www.tandfonline.com/doi/full/10.1080/24732850.2026.2636142
Some items differentiated btw diagnostic groups, but limited evidence for use of 1 (to 3) summary scoresI admit having limited love for the instrument since our work on its use in secondary #MentalHealth care https://link.springer.com/article/10.1007/s10488-019-00958-7
More details, CHE working paper 137, pdf
https://www.york.ac.uk/media/che/documents/papers/researchpapers/CHERP137_mental_health_data_episodic_payment.pdf -
Beaufort’s Wind Scale makes me want to add Likert levels.
Rate your agreement with “…”:
⚪️ slightly agree
⚪️ moderately agree
⚪️ FRESH agree
⚪️ strongly agree
⚪️ GALE FORCE agree
⚪️ VIOLENTLY agree
🔘 HURRICANE Agree -
Beaufort’s Wind Scale makes me want to add Likert levels.
Rate your agreement with “…”:
⚪️ slightly agree
⚪️ moderately agree
⚪️ FRESH agree
⚪️ strongly agree
⚪️ GALE FORCE agree
⚪️ VIOLENTLY agree
🔘 HURRICANE Agree -
Just came across this blast from the past (2013):
https://rdcu.be/e7TDY
- daily assessments
- ordinal data multilevel #measurement
- DIF analysisCouched as a preliminary investigation and pilot study, the analytic approach still sets a bar reached rarely by studies with such data.
-
Just came across this blast from the past (2013):
https://rdcu.be/e7TDY
- daily assessments
- ordinal data multilevel #measurement
- DIF analysisCouched as a preliminary investigation and pilot study, the analytic approach still sets a bar reached rarely by studies with such data.
-
#jobs #stellenangebote #GESISjobs #psychometrics #Doctoralstudent
Pursue your scientific career at GESIS!
https://youtu.be/zMY2zqYFIMgWe offer a job as a Research Associate (Doctoral student) focus on psychometrics
(Salary group 13 TV-L, working time 75 %, limited to 4 years):https://gesis.jobs.personio.de/job/2560025?language=de&display=en
-
#jobs #stellenangebote #GESISjobs #psychometrics #Doctoralstudent
Pursue your scientific career at GESIS!
https://youtu.be/zMY2zqYFIMgWe offer a job as a Research Associate (Doctoral student) focus on psychometrics
(Salary group 13 TV-L, working time 75 %, limited to 4 years):https://gesis.jobs.personio.de/job/2560025?language=de&display=en
-
RE: https://flipboard.com/@wsj/business-b1985f4jz/-/a-T6_YAnIFSTSuzZdNlac-EA%3Aa%3A248213600-%2F0
“Instead of paying humans to join focus groups and complete surveys, #Auru uses thousands of #AI agents, or bots, to simulate human responses. It feeds #demographic and psychographic information into its models to create human profiles that match clients’ needs, and the results those bots spit out are being used for product #development, #pricing, identifying new customers and political #polling.”
Researchers have warned about the inaccuracies of treating #LLMs as human proxies (https://doi.org/10.1007/s10462-025-11297-5), but I wouldn’t be surprised #languageModels beat #qualitative interpretation of non-representative focus groups.
#marketing #psychometrics #statistics #quantMethods #philSci #metascience #business
-
RE: https://flipboard.com/@wsj/business-b1985f4jz/-/a-T6_YAnIFSTSuzZdNlac-EA%3Aa%3A248213600-%2F0
“Instead of paying humans to join focus groups and complete surveys, #Auru uses thousands of #AI agents, or bots, to simulate human responses. It feeds #demographic and psychographic information into its models to create human profiles that match clients’ needs, and the results those bots spit out are being used for product #development, #pricing, identifying new customers and political #polling.”
Researchers have warned about the inaccuracies of treating #LLMs as human proxies (https://doi.org/10.1007/s10462-025-11297-5), but I wouldn’t be surprised #languageModels beat #qualitative interpretation of non-representative focus groups.
#marketing #psychometrics #statistics #quantMethods #philSci #metascience #business
-
A #SysReview exploring impacts of community-based interventions for adults with #multimorbidity on clinical and patient-reported outcomes (25 studies):
https://bmjpublichealth.bmj.com/content/4/1/e004156Quick comparison of identified outcomes with the two central #CoreOutcomeSets 👇
-
A #SysReview exploring impacts of community-based interventions for adults with #multimorbidity on clinical and patient-reported outcomes (25 studies):
https://bmjpublichealth.bmj.com/content/4/1/e004156Quick comparison of identified outcomes with the two central #CoreOutcomeSets 👇
-
Having seen many (and done some) of these proof-of-concept studies myself, let's me wonder:
Are there still too few well-developed systems available?
Maybe someone reads this and feels we can get a collection of these together so that others can read up on them?
-
Having seen many (and done some) of these proof-of-concept studies myself, let's me wonder:
Are there still too few well-developed systems available?
Maybe someone reads this and feels we can get a collection of these together so that others can read up on them?
-
A recent post the @Mental_Elf picks up and explains a study on computerized adaptive testing, which is quite cool!
https://www.nationalelfservice.net/treatment/digital-health/measuring-paranoid-beliefs-can-adaptive-testing-support-routine-clinical-care/Psychometricians, what is your favourite application or study in the field of computerized adaptive testing with health-related constructs?
-
A recent post the @Mental_Elf picks up and explains a study on computerized adaptive testing, which is quite cool!
https://www.nationalelfservice.net/treatment/digital-health/measuring-paranoid-beliefs-can-adaptive-testing-support-routine-clinical-care/Psychometricians, what is your favourite application or study in the field of computerized adaptive testing with health-related constructs?
-
Interesting paper about the impact of missed cases on the accuracy of screening tools, likely of interest beyond autism research and practice communities.
I enjoyed in particular, that "[t]he strengths and benefits of blending epidemiology and psychometric perspectives to identify screening tools that are weaker than expected are discussed."
-
Interesting paper about the impact of missed cases on the accuracy of screening tools, likely of interest beyond autism research and practice communities.
I enjoyed in particular, that "[t]he strengths and benefits of blending epidemiology and psychometric perspectives to identify screening tools that are weaker than expected are discussed."
-
Upcoming event at the Institute for #MedicalHumanities in Durham, UK:
#Measurement Heretics Workshop
Being, Meaning, and Measuring Well
https://www.durham.ac.uk/research/institutes-and-centres/medical-humanities/events/measurement-heretics-workshop-being-meaning-and-measuring-well/
11.-13.03.2026Day 1 #hybrid keynote:
A fluid history of measurement: The drop in the metric revolution
Armel Cornu and Sarah Hijmans
[Day2-3 in-person] -
Upcoming event at the Institute for #MedicalHumanities in Durham, UK:
#Measurement Heretics Workshop
Being, Meaning, and Measuring Well
https://www.durham.ac.uk/research/institutes-and-centres/medical-humanities/events/measurement-heretics-workshop-being-meaning-and-measuring-well/
11.-13.03.2026Day 1 #hybrid keynote:
A fluid history of measurement: The drop in the metric revolution
Armel Cornu and Sarah Hijmans
[Day2-3 in-person] -
Quality Assessment of Diagnostic Test Accuracy Studies
QUADAS-3 published:
https://pubmed.ncbi.nlm.nih.gov/41698208/__Key changes from QUADAS-2__
introduction of an 'ideal test accuracy trial'
assessment at the estimate rather than study level
"Flow and Timing" domain replaced with an "Analysis" domain
sections on the rationale for judgments
introduction of a judgment of #RiskOfBias and concerns regarding applicability
-
Quality Assessment of Diagnostic Test Accuracy Studies
QUADAS-3 published:
https://pubmed.ncbi.nlm.nih.gov/41698208/__Key changes from QUADAS-2__
introduction of an 'ideal test accuracy trial'
assessment at the estimate rather than study level
"Flow and Timing" domain replaced with an "Analysis" domain
sections on the rationale for judgments
introduction of a judgment of #RiskOfBias and concerns regarding applicability
-
I have made an R package for test equating using the Leunbach method. Thanks to the gracious sharing of DIGRAM source code by Svend Kreiner and some assistance of Claude Opus 4.5, the package `leunbachR` is now available on GitHub: https://pgmj.github.io/leunbachR/
#rstats #psychometrics -
I have made an R package for test equating using the Leunbach method. Thanks to the gracious sharing of DIGRAM source code by Svend Kreiner and some assistance of Claude Opus 4.5, the package `leunbachR` is now available on GitHub: https://pgmj.github.io/leunbachR/
#rstats #psychometrics -
Core outcome sets are a strong tool to improve quality of and communication about research, but especially to align PRACTICE and research. A #COS for #depression has the potential to move the dial considerably:
https://www.jclinepi.com/article/S0895-4356(25)00452-4/fulltext
#GlobalHealth #GlobalMentalHealthThe PROCEED study identified outcomes for #depression that matter to patients, caregivers, #healthcare professionals, an excellent read:
https://pubmed.ncbi.nlm.nih.gov/32711710/#Psychometrics #ContentValidity #Validity @philosophy
@eikofried -
Core outcome sets are a strong tool to improve quality of and communication about research, but especially to align PRACTICE and research. A #COS for #depression has the potential to move the dial considerably:
https://www.jclinepi.com/article/S0895-4356(25)00452-4/fulltext
#GlobalHealth #GlobalMentalHealthThe PROCEED study identified outcomes for #depression that matter to patients, caregivers, #healthcare professionals, an excellent read:
https://pubmed.ncbi.nlm.nih.gov/32711710/#Psychometrics #ContentValidity #Validity @philosophy
@eikofried -
Can #AI reasoning models infer people's underlying reasons in unstructured chat data from group decisions?
Across multiple prompting steps, #GTP5 usually did NOT select the same underlying reason as a human rater: https://doi.org/10.48550/arXiv.2601.05582
-
Can #AI reasoning models infer people's underlying reasons in unstructured chat data from group decisions?
Across multiple prompting steps, #GTP5 usually did NOT select the same underlying reason as a human rater: https://doi.org/10.48550/arXiv.2601.05582
-
Looking for a #WeekendRead?
How about my colleague's umbrella concept analysis of #loneliness identifying one necessary and sufficient characteristic:
https://www.tandfonline.com/doi/full/10.1080/17437199.2025.2528822Brief comment from me on LinkedIn:
https://www.linkedin.com/feed/update/urn:li:activity:7416424211079995394/Press release from #DundeeUni
https://www.dundee.ac.uk/press-release/loneliness-definition-could-transform-support-millions -
Looking for a #WeekendRead?
How about my colleague's umbrella concept analysis of #loneliness identifying one necessary and sufficient characteristic:
https://www.tandfonline.com/doi/full/10.1080/17437199.2025.2528822Brief comment from me on LinkedIn:
https://www.linkedin.com/feed/update/urn:li:activity:7416424211079995394/Press release from #DundeeUni
https://www.dundee.ac.uk/press-release/loneliness-definition-could-transform-support-millions -
I have been following and used #JASP on and off over the years and I liked it a lot.
This tutorial makes it really interesting!
"Measurement Invariance with Moderated (Non-)Linear Factor Analysis in JASP"
https://osf.io/preprints/psyarxiv/6ftqg_v1I hope I can trial it soon!
-
I have been following and used #JASP on and off over the years and I liked it a lot.
This tutorial makes it really interesting!
"Measurement Invariance with Moderated (Non-)Linear Factor Analysis in JASP"
https://osf.io/preprints/psyarxiv/6ftqg_v1I hope I can trial it soon!
-
I really enjoy reading the expanding literature on #invariance of #ValueSets. Two interesting papers and a taxonomy regarding #obsolescence
1- https://link.springer.com/article/10.1007/s11136-024-03770-5
2- https://www.sciencedirect.com/science/article/pii/S1098301525062072
3- https://link.springer.com/article/10.1007/s40273-025-01476-1
"As time and methods advance, the bedrock of applied valuation research naturally becomes increasingly unreliable, and, as a field, we need to consider how to approach this challenge."
-
I really enjoy reading the expanding literature on #invariance of #ValueSets. Two interesting papers and a taxonomy regarding #obsolescence
1- https://link.springer.com/article/10.1007/s11136-024-03770-5
2- https://www.sciencedirect.com/science/article/pii/S1098301525062072
3- https://link.springer.com/article/10.1007/s40273-025-01476-1
"As time and methods advance, the bedrock of applied valuation research naturally becomes increasingly unreliable, and, as a field, we need to consider how to approach this challenge."