#nightshifteditor — Public Fediverse posts

Interesting pointer from a #JEDI thread:
Description of a process to integrate evaluation of computational reproducibility into #PeerReview:
https://f1000research.com/articles/10-253/v2

I also like the ethos and wonder whether #PeerReview in general could learn from this?

1. Codecheckers record but don’t investigate or fix.
2. Communication between humans is key
3. Credit is given to codecheckers.
4. Computational workflows must be auditable.
5. Open by default and transitional by disposition.

#NightshiftEditor

Great @EASE seminar yesterday
https://www.youtube.com/watch?v=mjYWGlatYZQ

Really good content also for authors, PIs, #PeerReview -ers & people who consider #RCT methodology for future work.

The discussion was lively and covered some advanced topics.

One key moment:
the broader landscape of registrations, and within that the specific trial requirements, is often not covered well in the literature and such talks - for more, check in at 6:24min

#Registration #PreRegistration #RCT #NightshiftEditor #AcademicWriting

Touching on trials, reporting guidelines, and journal publishing/ editing - this
@EASE science webinar on 30.09. sounds very promising:
https://ease.org.uk/event/ease-germany-webinar-clinical-trial-transparency-from-registration-to-results-reporting/

#NightshiftEditor #AcademicPublishing #RCTs

Brittany Lapin and I edited* the joint publication of the PRISMA-COSMIN guidelines for Outcome Measurement Instruments 2024 in four journals last year:
https://pubmed.ncbi.nlm.nih.gov/38980635/

It is great to see that this is now also accompanied by table templates for communication of results
https://link.springer.com/article/10.1007/s11136-025-04058-y

#NightshiftEditor #ReportingGuidelines #AcademicPublishing #SysReview #Psychometrics
* https://osf.io/preprints/osf/ukw93_v1

Brittany Lapin and I edited* the joint publication of the PRISMA-COSMIN guidelines for Outcome Measurement Instruments 2024 in four journals last year:
https://pubmed.ncbi.nlm.nih.gov/38980635/

It is great to see that this is now also accompanied by table templates for communication of results
https://link.springer.com/article/10.1007/s11136-025-04058-y

#NightshiftEditor #ReportingGuidelines #AcademicPublishing #SysReview #Psychometrics
* https://osf.io/preprints/osf/ukw93_v1

New #AcademicYear - New #introduction

I am a researcher at #DundeeUni and interested in health-related quality of life
#HRQoL #Psychometrics

I teach #ResearchMethodology and #ResearchMethods with a focus on #Quantitative methods.

I worked for 7yrs as a #NightshiftEditor and I am still mulling over roles in and sense of #AcademicPublishing

This is mainly a work account, but I also post #Dundee stuff such as #DunDeCofaidh and occasional #Deutsch #Svenska #Gaidhlig (👉 pure work account at BSky)

Having worked with such data, #PeerReview-ed such submissions, as well as been the editor of such papers, I think papers reporting results based on data collected in routine monitoring come with ethical issues. And the above is a core selection of what needs to be clarified when manuscripts are submitted to journals.

#PublicationEthics #NightshiftEditor

#ISOQOL

#1/
Excellent talk by Kevin Weinfurt in #Plenary1 discussing multiple types of measures (go also to #Plenary4 for that!), increased use of high-intensity longitudinal data, and generative AI for assessments.

Start reading his work:
https://rdcu.be/dWXSz
#HRQL #Psychometrics

#2/
Not sure this is what the #ISOQOL_NewInvestigators wanted when asking me to talk about advice for manuscript writing, but this is the slide people talked to me about 👇
#NightshiftEditor #ScientificPublishing

#1/ First day of #ISOQOL started with an interesting symposium on progress when optimizing the collection of patient-reported outcomes in clinical trials.

Part of the discussion were desirable changes to the publication system when publishing expert consensus and guidance documents:

1) What does #PeerReview for such a document look like?

2) Static journal publications may not be the best format for such documents.

Both seem solvable, no?
#HTD

#NightshiftEditor #RCT #ScientificPublishing

A #ScopingReview on #MissingData reporting in observational studies that use #MultipleImputation for causal effect estimation:
https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-024-02302-6

Informative read beyond the particular application.

As a #NightshiftEditor I am still working more on the problem that most studies do not even report their sampling and take it for granted that complete-data only analyses are fine.

As noted before 😉
https://mastodon.social/deck/@jrboehnke/111153230472611135

New #AcademicYear - New #introduction

I am interested in health-related quality of life
#HRQL #Psychometrics

I teach #ResearchMethods modules in the #DundeeUni #ProfDoc
#Interdisciplinary #RD62001 #RD62002

I convene our School's #ResearchEthics committee

My terms as academic editor of 'Quality of Life Research' come to an end, and I am mulling over roles and sense in #AcademicPublishing
#NightshiftEditor

There may be some occasional #Deutsch #Svenska #Gaidhlig and local stuff in my feed.

Recommendations for conduct and write-up of observational studies from my #NightshiftEditor threads got some attention on #LinkedIn
https://www.linkedin.com/feed/update/urn:li:activity:7229141904678887424/

The five suggested papers in brief:

1) STROBE
https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.0040297

2) Confounder selection
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6447501/

3) DAG tutorial
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8821727/

4) Table 2 Fallacy
https://academic.oup.com/aje/article/177/4/292/147738?login=false

5) Prediction vs causation
https://academic.oup.com/ije/article/49/6/2074/5831974?login=false

#AcademicWriting #Epidemiology #StudyDesign

Reflecting that I started using #NightshiftEditor 2+ years ago:
https://www.linkedin.com/feed/update/urn:li:activity:7224353965084217344/

Main point of my first post then was that there are tools to help avoiding unwanted references to retracted papers such as the #RetractionWatch data base
https://retractionwatch.com/retraction-watch-database-user-guide/

and you can link tools such as @zotero https://www.zotero.org/blog/retracted-item-notifications/
or since last year even #Endnote:
https://support.clarivate.com/Endnote/s/article/EndNote-20-Retraction-Alerts?language=en_US

#PaperWriting #Retraction #ResearchIntegrity

Quality of Life Research 05-2024

https://link.springer.com/journal/11136/volumes-and-issues/33-5

#ISOQOL

#HRQL of people w heart failure in #LMICs

https://rdcu.be/dF2sX

#SysReview

#QOL of people living w mental illness in Africa

https://link.springer.com/article/10.1007/s11136-023-03525-8

#SysReview #SMI #Multimorbidity

#NightshiftEditor seven issues to go...

Just my usual #NightshiftEditor reminder that when you are currently working on the (secondary) analysis of a data set and thinking of applying some regression modelling, here are some good resources:

#STROBE for reporting
https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.0040297

Thinking about confounders
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6447501/

Prediction vs causation
https://academic.oup.com/ije/article/49/6/2074/5831974

And avoiding the #Table2Fallacy
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3626058/

#HRQL

"The Kaiser-Meyer-Olkin value was 0.94, which means that the sample size is adequate for #FactorAnalysis."

#PeerReview #NightshiftEditor #Psychometrics

Newsletter reporting Quality of Life Research awards and statistics from 2022
https://www.isoqol.org/news-from-quality-of-life-research-2024/

We (+ Brittany Lapin, Richard Skolasky) are immensely grateful to all authors submitting, our team of associate editors, and everyone else supporting the journal (e.g., peer-review, language editing)!

#QualityTALK #ISOQOL #HRQL #NightshiftEditor

It has not been a secret for a while, but now it is official:

My two terms as CoEiC come to an end in Dec 2024, and the deadline for applications has been made public:
🔥 06.05.2024

More information on our parent society's pages here:
https://www.isoqol.org/isoqol-seeks-co-editor-in-chief-qlr-2024/

#NightshiftEditor #HRQL #AcademicPublishing #AcademicEditing

Signed. And featured in my #PeerReview seminar yesterday.

I don't think that this is only about #PreRegistration.

One of our #RCTs received this year a 2.5k word review which did not refer to the #registration, statistical analysis plan, protocol, nor submitted appendices 🤦🤷

Also extrapolating from the style of that review:
How much anger and frustration that person could have avoided.

Edit: Link (Google Doc):
https://docs.google.com/document/d/1Y9Y4ilH06xvcKKreZnZE7pf_6kd6GHuRI6u6U45f3vs/edit?pli=1

#NightshiftEditor #PublicationEthics #ResearchIntegrity

Preparing presentations on #PeerReview of research papers, and I find myself wondering again, is there an equivalent for #QualitativeMethods to this book?

Hancock, G. R., & Mueller, R. O. (Eds.). (2010). The reviewer’s guide to quantitative methods in the social sciences. Routledge.

#NightshiftEditor

I have mentioned these sources before, but after two very intensive months of #AcademicEditing and #PeerReview of observational research I feel compelled to share them again:

1) STROBE Elaboration document to guide writeup:
https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.0040297

2) Tutorial on Directed Acyclic Graphs
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8821727/

3) Principles of confounder selection
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6447501/

4) Table 2 Fallacy
https://academic.oup.com/aje/article/177/4/292/147738

5) Prognosis vs intervention
https://academic.oup.com/ije/article/49/6/2074/5831974

#NightshiftEditor

Less than two weeks to go #ISOQOL

Looking forward to be once again part of the pre-#conference workshops, this time with my esteemed colleague Claudia Rutherford (U Sydney)!

Find out about other conference workshops here:
https://www.isoqol.org/events/30th-annual-conference/program/

#NightshiftEditor #Publishing #ResearchDesign #HRQL

The lessons from the experience of SPIRIT* protocol editors published in "Trials" make for good reading and training materials:
https://trialsjournal.biomedcentral.com/articles/10.1186/s13063-022-06316-7

*Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT)

#RCT #PeerReview #NightshiftEditor #ReportingGuidelines #ScienceEditing

"The paper is reported in line with STROBE guidelines." 😅

You wand to know more about STROBE? Go check it out:
https://www.strobe-statement.org/

#NightshiftEditor #PeerReview #ReportingGuideline #ResearchWriting #MissingData #Sampling #Survey

One of the most problematic areas in the submission we get and papers I review are the sections on #SampleSize justifications.

See for example @lakens' excellent paper on the topic:
https://psyarxiv.com/9d3yf/
It now comes with a process guide in a #ShinyApp, which is an excellent support:
https://shiny.ieis.tue.nl/sample_size_justification/
#Rstats

For #HRQL researchers:
https://rdcu.be/dnfO4

And many people teach this stuff, e.g., ☺️
https://www.researchgate.net/publication/335813329_Estimating_sample_sizes_based_on_required_precision_for_surveys_and_epidemiological_research

#StudyDesign #NightshiftEditor
[edit: typo in hashtag]

New academic year - new #introduction

I am interested in health-related quality of life
#HRQL #Psychometrics
and my account mainly reflects what I work on, e.g. also

#ResearchMethods modules in the #DundeeUni #ProfDoc
#Interdisciplinary #RD62001 #RD62002

I convene our school's #ResearchEthics committee

My role as academic editor of 'Quality of Life Research' is coming to an end, and I am mulling over whether I am looking for a new role in #AcademicPublishing replacing it
#NightshiftEditor

Some #SysReviews make me wonder where the efforts of the "critical appraisal" modules go. And what we generally assume about #ScienceEditing and #PeerReview:

"For this study we only considered studies published in Q1 and Q2 journals in [ranking system], in order to guarantee intra-rater convergence."
[redacted from original]

#NightshiftEditor #ResearchAssessment

Reflections on this week's #NightshiftEditor sessions:

1) Suggestions to limit potential misunderstandings when presenting multiple effect estimates
https://academic.oup.com/aje/article/177/4/292/147738
#Table2Fallacy

2) From the instant classic "on the 12th day of Christmas, a statistician sent to me":
(i) "Do not dichotomise continuous variables"
(ii) "Carefully account for missing data" #STROBE
https://www.bmj.com/content/379/bmj-2022-072883

3) We all can work on asking better research questions
https://rdcu.be/diEEb

#HRQL #ScienceEditing

Quick #ResearchMethods reminder from the #NightshiftEditor desk:

"In randomised trials, rather than comparing randomised groups directly some researchers carry out a significance test comparing a baseline with a final measurement separately in each group."

"This approach is biased and invalid, producing conclusions which are, potentially, highly misleading."

https://trialsjournal.biomedcentral.com/articles/10.1186/1745-6215-12-264

#RCTs #HRQL #CONSORT

I continue to chew away at the #PsychotherapyResearch & #OpenAccess topic*

Recently opposing articles draw in their arguments on this #PlanS #NoFreeLunch paper:
https://doi.org/10.1056/NEJMms1900864

There is a lot in there, but for now I am focus on the following:

Do you at least read the table of contents of EACH issue of (at least) one particular journal?

#AcademicEditor #Publishing #NightshiftEditor
* #SPRDublin2023 https://mastodon.social/@jrboehnke/110598366184232625

Weekend #NightshiftEditor session, summary:

#ReportingGuidlines are helpful tools for REPORTING (obvs 😂 ) but also PLANNING of research. They offer a minimal baseline what to think about when conducting a study. They do NOT prescribe a solution.

Examples for #HRQL researchers:

#STROBE https://www.strobe-statement.org/checklists/

#CONSORT-PRO https://jamanetwork.com/journals/jama/fullarticle/1656259
and TRACT https://researchintegrityjournal.biomedcentral.com/articles/10.1186/s41073-023-00130-8

For translations of instruments #ITC Guidelines https://pubmed.ncbi.nlm.nih.gov/32711675/

#COREQ https://pubmed.ncbi.nlm.nih.gov/17872937/

The "Meet the editors" of #PsychotherapyResearch at #SPRDublin2023 last week was very interesting.

The audience wanted to know more about the differentiation between:
- inquiries about fit;
- #PreRegistration;
- #RegisteredReports
(see my response below for more).

And another topic that was raised were questions around whether journals
- should recommend the use of reporting guidelines
- or make them even mandatory.

Thoughts?

#NightshiftEditor

Complete either sentence:

#OpenAccess publications will lead to the salvation of #Psychotherapy,...

Open Access publications will be the doom of Psychotherapy,...

#SPRDublin2023 @SPRtweets & @SPR_EU_Youngs folks in particular 😊

Looking forward to the panel discussion!

#PsychotherapyResearch #NightshiftEditor #PeerReview

Already widely shared, but this article from the BMJ Christmas issue has a lot of content we have been discussing in our editorial board meetings:
https://www.bmj.com/content/379/bmj-2022-072883

Submissions to QLR are screened for good use of reporting guidelines.

Our #HRQL #ResearchWaste special issue touches on a number of these issues:
https://psyarxiv.com/879xp/

eg. research questions:
https://rdcu.be/c2nJv

and appropriate sample size planning:
https://rdcu.be/c2nJy

#NightshiftEditor