#icssi — Public Fediverse posts

Simon Porter will be at #ICSSI this week showcasing a significant step forward in ORCID data accessibility! His poster, "Enhancing the Accessibility of ORCID Public Data via Google BigQuery," introduces a new way to access our public data file. Exploratory data analysis is easier than ever. This beta service, generously sponsored by Digital Science, opens up innovative use cases. If you're at #ICSSI, stop by Simon's poster or download it here:

https://orcid.filecamp.com/s/d/zXA9Up5rvHVvkNBs

Simon Porter will be at #ICSSI this week showcasing a significant step forward in ORCID data accessibility! His poster, "Enhancing the Accessibility of ORCID Public Data via Google BigQuery," introduces a new way to access our public data file. Exploratory data analysis is easier than ever. This beta service, generously sponsored by Digital Science, opens up innovative use cases. If you're at #ICSSI, stop by Simon's poster or download it here:

https://orcid.filecamp.com/s/d/zXA9Up5rvHVvkNBs

I am at the International Conference on the Science of Science and Innovation in Copenhagen

Good schedule! https://icssi.org/schedule/

#ICSSI

I am at the International Conference on the Science of Science and Innovation in Copenhagen

Good schedule! https://icssi.org/schedule/

#ICSSI

I didn't manage to take slides of @mollymking's ICSSI talk as I was backlogged with slides from other lightning talks, but I liked her talk on 'mesearch' - research on yourself. Molly has done mesearch, so this was meta-mesearch. The finding that some demographics get a citation boost for certain kinds of mesearch, but others don't, was intriguing.

#ICSSI #ScienceofScience #Mesearch #DEIA

I didn't manage to take slides of @mollymking's ICSSI talk as I was backlogged with slides from other lightning talks, but I liked her talk on 'mesearch' - research on yourself. Molly has done mesearch, so this was meta-mesearch. The finding that some demographics get a citation boost for certain kinds of mesearch, but others don't, was intriguing.

#ICSSI #ScienceofScience #Mesearch #DEIA

"Elite" peer review was studied by Daniel Larremore and colleagues using an anonymised dataset from AAAS of 112,000 papers submitted to Science and Science Advances. A few more desk rejects for women authors, but no difference in peer review. Clear preference for work from prestigious institutions: biased or just better? Big teams also do better.
#ICSSI #ScienceofScience #PeerReview #ScienceMagazine #ScienceAdvances #DanielLarremore #AAAS

"Elite" peer review was studied by Daniel Larremore and colleagues using an anonymised dataset from AAAS of 112,000 papers submitted to Science and Science Advances. A few more desk rejects for women authors, but no difference in peer review. Clear preference for work from prestigious institutions: biased or just better? Big teams also do better.
#ICSSI #ScienceofScience #PeerReview #ScienceMagazine #ScienceAdvances #DanielLarremore #AAAS

How do different values affect peer review and how do these influence editorial decisions, asks Daniel Scott Smith? Very different reviews can make decisions uncertain.

Across STEM, they find accuracy and novelty are the most important values in peer review reports, social factors (biases) have little effect, and dissensus increases editorial gatekeeping. It doesn't matter if reviewers disagree.

#ICSSI #ScienceofScience #PeerReview #Values #DecisionMaking #JournalEditing

How do different values affect peer review and how do these influence editorial decisions, asks Daniel Scott Smith? Very different reviews can make decisions uncertain.

Across STEM, they find accuracy and novelty are the most important values in peer review reports, social factors (biases) have little effect, and dissensus increases editorial gatekeeping. It doesn't matter if reviewers disagree.

#ICSSI #ScienceofScience #PeerReview #Values #DecisionMaking #JournalEditing

Breakaway and Zombie journals: what happens after mass editorial board resignations. @KyleSiler looks into what happens when a journal and its community separate.

Glossa vs Lingua & QSS vs Journal of Informetrics. Lingua suffered, JoI didn't - but both 'Zombies' published more Chinese studies whereas the European and North American researchers moved to the OA breakaways.

#ICSSI #ScienceofScience #JournalPublication #EditorialIndependence #OpenAccess

Breakaway and Zombie journals: what happens after mass editorial board resignations. @KyleSiler looks into what happens when a journal and its community separate.

Glossa vs Lingua & QSS vs Journal of Informetrics. Lingua suffered, JoI didn't - but both 'Zombies' published more Chinese studies whereas the European and North American researchers moved to the OA breakaways.

#ICSSI #ScienceofScience #JournalPublication #EditorialIndependence #OpenAccess

Juan Mateos-Garcia of Google DeepMind wants equitable use of their tools like AlphaFold. They solved protein structure prediction in 2020 and this is helpful for drug discovery, but researchers in LMIC have barriers to adoption.

Used OpenAlex & PDB to study 20.6K papers citing AlphaFold. LMIC researchers are underrepresented, but study of diseases affecting LMICs is overrepresented - esp. work on natural products.

#ICSSI #ScienceofScience #AItools #DeepMind #AlphaFold #StructuralBiology

Juan Mateos-Garcia of Google DeepMind wants equitable use of their tools like AlphaFold. They solved protein structure prediction in 2020 and this is helpful for drug discovery, but researchers in LMIC have barriers to adoption.

Used OpenAlex & PDB to study 20.6K papers citing AlphaFold. LMIC researchers are underrepresented, but study of diseases affecting LMICs is overrepresented - esp. work on natural products.

#ICSSI #ScienceofScience #AItools #DeepMind #AlphaFold #StructuralBiology

Corporate research is dominating AI science, says Nur Ahmed, but they're not engaging with responsible AI research. They're choosing speed over safety.

They used supervised machine learning on 6 million papers and found few firms were working on responsible AI. A handful attended responsible AI conferences vs hundreds at other AI conferences.

When they do engage, it's on explainability not societal impacts and human rights.

#ICSSI #ScienceofScience #AItools #CorporateScience #ResponsibleAI

Corporate research is dominating AI science, says Nur Ahmed, but they're not engaging with responsible AI research. They're choosing speed over safety.

They used supervised machine learning on 6 million papers and found few firms were working on responsible AI. A handful attended responsible AI conferences vs hundreds at other AI conferences.

When they do engage, it's on explainability not societal impacts and human rights.

#ICSSI #ScienceofScience #AItools #CorporateScience #ResponsibleAI

Sai Koneru says rapid growth of the literature makes it hard to keep up with relevant work. Can LLMs discern the hypotheses reported in abstracts? No - currently it's tough for natural language models to do this.

#ICSSI #ScienceofScience #AItools #LLMs #LiteratureReviewTips

Sai Koneru says rapid growth of the literature makes it hard to keep up with relevant work. Can LLMs discern the hypotheses reported in abstracts? No - currently it's tough for natural language models to do this.

#ICSSI #ScienceofScience #AItools #LLMs #LiteratureReviewTips

"Let's *delve* into this topic..."

Science of AI-mediated science - Shahan Ali Memon gave a very engaging talk on how AI is being used in science, how it changes how we do and think about science, and how these AI tools are different to those we've used before.

He was too modest to advise a representative of the UK government in the audience on how much of his metascience budget should pivot to AI.

#ICSSI #ScienceofScience #AItools

"Let's *delve* into this topic..."

Science of AI-mediated science - Shahan Ali Memon gave a very engaging talk on how AI is being used in science, how it changes how we do and think about science, and how these AI tools are different to those we've used before.

He was too modest to advise a representative of the UK government in the audience on how much of his metascience budget should pivot to AI.

#ICSSI #ScienceofScience #AItools

Elle O'Brien at UMich says there are barriers to data science in academia. Does generative AI break this down?

Many researchers are using LLMs for tips on using software even when good documentation exists. They're not software literate.

They wrongly think chatbots do web search, can code, have databases, can calculate, and give faithful explanations. Does that make their use more risky?

#ICSSI #DataScience #LLMs #AItools #CoPilot #ResearchCode #ScienceofScience #ChatGPT #InformationLiteracy

Elle O'Brien at UMich says there are barriers to data science in academia. Does generative AI break this down?

Many researchers are using LLMs for tips on using software even when good documentation exists. They're not software literate.

They wrongly think chatbots do web search, can code, have databases, can calculate, and give faithful explanations. Does that make their use more risky?

#ICSSI #DataScience #LLMs #AItools #CoPilot #ResearchCode #ScienceofScience #ChatGPT #InformationLiteracy

The real reason I attend conferences is the swag. Here's a box of sprinkle-covered Oreos I received as thanks for being a panel speaker at ICSSI (icssi.org).

#ConferenceSwag #ICSSI #SprinkleCookies

The real reason I attend conferences is the swag. Here's a box of sprinkle-covered Oreos I received as thanks for being a panel speaker at ICSSI (icssi.org).

#ConferenceSwag #ICSSI #SprinkleCookies

I really enjoyed speaking on the ICSSI conference panel (icssi.org) on junk, fraud, retractions, and paper mills; we got lots of great questions and could have kept going all morning! Thanks to Daniel Larremore for the invite and especially Daniel Acuna for organising and chairing.

🧵

#PaperMills #ICSSI #ScienceofScience #PublicationEthics #JournalPublication #ScientificFraud #AcademicPublishing #Retractions

I really enjoyed speaking on the ICSSI conference panel (icssi.org) on junk, fraud, retractions, and paper mills; we got lots of great questions and could have kept going all morning! Thanks to Daniel Larremore for the invite and especially Daniel Acuna for organising and chairing.

🧵

#PaperMills #ICSSI #ScienceofScience #PublicationEthics #JournalPublication #ScientificFraud #AcademicPublishing #Retractions

Here's slides for my plenary talk "Imagining the space of knowledge" at #ICSSI

https://yongyeol.com/slides/20240701_ICSSI_yyahn.pdf

Here's slides for my plenary talk "Imagining the space of knowledge" at #ICSSI

https://yongyeol.com/slides/20240701_ICSSI_yyahn.pdf

The choice of chariots of fire as the lightning session bell is genius 😂 #icssi

The choice of chariots of fire as the lightning session bell is genius 😂 #icssi

A study of "beauty bias" in scientific careers presented at #ICSSI made me uneasy. Scraping faces from Google Scholar, business school websites, and job applicants and using machine learning to rate attractiveness without their consent seems disrespectful, esp. as the names of the "beautiful" institutions (which correlates with school ranking) are released. A small business school might not appreciate being labelled as ugly! 🧵
#ScienceofScience #Attractiveness #CareerProgression #ScienceCareers

A study of "beauty bias" in scientific careers presented at #ICSSI made me uneasy. Scraping faces from Google Scholar, business school websites, and job applicants and using machine learning to rate attractiveness without their consent seems disrespectful, esp. as the names of the "beautiful" institutions (which correlates with school ranking) are released. A small business school might not appreciate being labelled as ugly! 🧵
#ScienceofScience #Attractiveness #CareerProgression #ScienceCareers

There's a class gap in career progression in US academia, find Anna Stansbury and Kyra Rodriguez of MIT. #ICSSI #ScienceofScience #ClassDisparities #ClassDivide

There's a class gap in career progression in US academia, find Anna Stansbury and Kyra Rodriguez of MIT. #ICSSI #ScienceofScience #ClassDisparities #ClassDivide

Here's an ICSSI talk close to my interests: @sjcporter of @digitalscience explains how to find networks of faking by authorship selling schemes.

They're sold on Telegram and Facebook etc. Shout out to @nickwizzo who keeps track of these adverts and the final published papers.

🧵

#Authorship #PublicationEthics #ScientificFraud #PaperMills #ICSSI #ScienceofScience

Here's an ICSSI talk close to my interests: @sjcporter of @digitalscience explains how to find networks of faking by authorship selling schemes.

They're sold on Telegram and Facebook etc. Shout out to @nickwizzo who keeps track of these adverts and the final published papers.

🧵

#Authorship #PublicationEthics #ScientificFraud #PaperMills #ICSSI #ScienceofScience

How does industry shape academic science? Hongyuan Xia used a natural experiment to compare scientists in places that narrowly miss getting big industrial plants (like Amazon) built vs those that get them. Used citation of patents by the companies to define relevant fields.

Industry presence increases impact, number of papers in the field, and commercialisation. Why? Funding, collaboration, and researchers shifting focus.

#ICSSI #ScienceofScience #AcademicIndustrialComplex #SciencePolicy

How does industry shape academic science? Hongyuan Xia used a natural experiment to compare scientists in places that narrowly miss getting big industrial plants (like Amazon) built vs those that get them. Used citation of patents by the companies to define relevant fields.

Industry presence increases impact, number of papers in the field, and commercialisation. Why? Funding, collaboration, and researchers shifting focus.

#ICSSI #ScienceofScience #AcademicIndustrialComplex #SciencePolicy

China's rising leadership in global science: Christopher Esposito and UCLA colleagues studied leadership using author contribution statements. Extracted items were clumped using K-means clustering. They then trained a neural net to predict leadership among international collaborations in a large sample of papers.

In US-China collaborations, comparing 2010-12 vs 2020-23 shows a drop in US leaders and a rise in Chinese leaders.

#ICSSI #ScienceofScience #ChineseScience #InternationalCollaboration

China's rising leadership in global science: Christopher Esposito and UCLA colleagues studied leadership using author contribution statements. Extracted items were clumped using K-means clustering. They then trained a neural net to predict leadership among international collaborations in a large sample of papers.

In US-China collaborations, comparing 2010-12 vs 2020-23 shows a drop in US leaders and a rise in Chinese leaders.

#ICSSI #ScienceofScience #ChineseScience #InternationalCollaboration

"Helicopter science" and datasets: Sarah Bratt and colleagues studied the use of Global South (GS) data by Global North researchers (in 3200 Scientific Data papers) , using OpenAlex and an LLM, ReFinEd, to identify entities in Geonames.

The % of GS authors on GS data papers has risen, but on papers using GS data only 35% have a GS researcher as 1st or last author.

p.s. Saying "ding" instead of "next slide" was new to me!

#ICSSI #ScienceofScience #HelicopterScience #ScientificData #GlobalSouth

"Helicopter science" and datasets: Sarah Bratt and colleagues studied the use of Global South (GS) data by Global North researchers (in 3200 Scientific Data papers) , using OpenAlex and an LLM, ReFinEd, to identify entities in Geonames.

The % of GS authors on GS data papers has risen, but on papers using GS data only 35% have a GS researcher as 1st or last author.

p.s. Saying "ding" instead of "next slide" was new to me!

#ICSSI #ScienceofScience #HelicopterScience #ScientificData #GlobalSouth

Imagining the Space of Knowledge - plenary by @yy at ICSSI 2024.

What new measures can advance the science of science? Deep learning can uncover links.

Ahn uses models of citations to understand networks of knowledge production and predict future citation impact, including for "sleeping beauties" that are ahead of their time and take a long time to gain recognition.

#ICSSI #ScienceofScience #YYAhn #Citations #Bibliometrics #Scientometrics #Conference2024

Imagining the Space of Knowledge - plenary by @yy at ICSSI 2024.

What new measures can advance the science of science? Deep learning can uncover links.

Ahn uses models of citations to understand networks of knowledge production and predict future citation impact, including for "sleeping beauties" that are ahead of their time and take a long time to gain recognition.

#ICSSI #ScienceofScience #YYAhn #Citations #Bibliometrics #Scientometrics #Conference2024

Data science can drive innovation, says Abhishek Nagaraj speaking at ICSSI 2024 (icssi.org). For Duracell, a researcher screened 100K compounds to generate a list of 200 candidates for breakthrough battery components.

He dubs these high-value discoverers the "new cartographers", but does science benefit and who benefits?

#ICSSI #ScientificInnovation #AbhishekNagaraj #DataRevolution #ScienceOfScience #BigData #DataScience

Data science can drive innovation, says Abhishek Nagaraj speaking at ICSSI 2024 (icssi.org). For Duracell, a researcher screened 100K compounds to generate a list of 200 candidates for breakthrough battery components.

He dubs these high-value discoverers the "new cartographers", but does science benefit and who benefits?

#ICSSI #ScientificInnovation #AbhishekNagaraj #DataRevolution #ScienceOfScience #BigData #DataScience

Patent quality might be measured by being dissimilar to what came before... but similar to what came after.

Adam Jaffe speaking at ICSSI (icssi.org) highlights this suggestion of Kelly et al. (2021).
https://www.aeaweb.org/articles?id=10.1257/aeri.20190499

#ScienceOfScience #ICSSI #AdamJaffe #Patents #ResearchQuality

Patent quality might be measured by being dissimilar to what came before... but similar to what came after.

Adam Jaffe speaking at ICSSI (icssi.org) highlights this suggestion of Kelly et al. (2021).
https://www.aeaweb.org/articles?id=10.1257/aeri.20190499

#ScienceOfScience #ICSSI #AdamJaffe #Patents #ResearchQuality

Arati Prabhakar, Director of the US Office of Science and Technology Policy (OSTP) and Chief Advisor for Science and Technology to President Biden, admits that though biomedical research funding has increased 5 X in real terms, US life expectancy has plateaued and then declined. The success of American research isn't translating into better health for Americans due to inequalities.

#ICSSI #OSTP #AratiPrabhakar #BiomedicalResearch #Inequality #LifeExpectancy #ScienceOfScience #SciencePolicy

Arati Prabhakar, Director of the US Office of Science and Technology Policy (OSTP) and Chief Advisor for Science and Technology to President Biden, admits that though biomedical research funding has increased 5 X in real terms, US life expectancy has plateaued and then declined. The success of American research isn't translating into better health for Americans due to inequalities.

#ICSSI #OSTP #AratiPrabhakar #BiomedicalResearch #Inequality #LifeExpectancy #ScienceOfScience #SciencePolicy

It’s fascinating to hear from OSTP Director Arati Prabhakar about the story of how DARPA funded mRNA vaccine research in 2012. #icssi (and oh boy I miss the old Twitter when attending a conference)

It’s fascinating to hear from OSTP Director Arati Prabhakar about the story of how DARPA funded mRNA vaccine research in 2012. #icssi (and oh boy I miss the old Twitter when attending a conference)

"The right to search for truth also implies a duty: one must not conceal any part of what one has recognized to be true."

The Einstein memorial at the National Academies in Washington D.C. has a good reminder for all us of in science, apt for the International Conference on Science of Science and Innovation (ICSSI 2024), which starts today.

#ICSSI #ScienceofScience #SciencePolicy #EinsteinQuotes #OpenScience #ResearchIntegrity #Transparency #EinsteinMemorial #Conference2024

"The right to search for truth also implies a duty: one must not conceal any part of what one has recognized to be true."

The Einstein memorial at the National Academies in Washington D.C. has a good reminder for all us of in science, apt for the International Conference on Science of Science and Innovation (ICSSI 2024), which starts today.

#ICSSI #ScienceofScience #SciencePolicy #EinsteinQuotes #OpenScience #ResearchIntegrity #Transparency #EinsteinMemorial #Conference2024

I'm off to Washington D.C. for the 2024 International Conference
on Science of Science and Innovation (ICSSI), hosted by The National Academies of Sciences, Engineering, and Medicine.

I'm speaking on a panel on Tuesday morning about fraud, paper mills, and retractions in the stellar company of Ivan Oransky, Stephanie M. Lee, and Anna Abalkina, chaired by Daniel Acuna.

https://www.icssi.org

#Conference2024 #PaperMills #PublicationEthics #Retractions #ScienceOfScience #ICSSI

I'm off to Washington D.C. for the 2024 International Conference
on Science of Science and Innovation (ICSSI), hosted by The National Academies of Sciences, Engineering, and Medicine.

I'm speaking on a panel on Tuesday morning about fraud, paper mills, and retractions in the stellar company of Ivan Oransky, Stephanie M. Lee, and Anna Abalkina, chaired by Daniel Acuna.

https://www.icssi.org

#Conference2024 #PaperMills #PublicationEthics #Retractions #ScienceOfScience #ICSSI