#textanalysis — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #textanalysis, aggregated by home.social.
-
Ahead of Print in BFP: New article on ethical dimensions of automated text analysis. Scheffer & Islam revisit AI-based text analysis in light of large language models and propose an Aristotelian framework for balance. #AI #ethics #LLM #textanalysis
-
Ahead of Print in BFP: New article on ethical dimensions of automated text analysis. Scheffer & Islam revisit AI-based text analysis in light of large language models and propose an Aristotelian framework for balance. #AI #ethics #LLM #textanalysis
-
🚨 Breaking News: Yet another attempt to identify LLM-generated texts with classical ML techniques! 🤯 Spoiler: it’s like using a magnifying glass to find a needle in a haystack. 🔍⚠️ Enjoy the #TLDR, because who needs 10 useless subheadings just to say "we're still guessing"? 😂
https://blog.lyc8503.net/en/post/llm-classifier/ #BreakingNews #LLM #TextAnalysis #MLtechniques #AIresearch #HackerNews #ngated -
🚨 Breaking News: Yet another attempt to identify LLM-generated texts with classical ML techniques! 🤯 Spoiler: it’s like using a magnifying glass to find a needle in a haystack. 🔍⚠️ Enjoy the #TLDR, because who needs 10 useless subheadings just to say "we're still guessing"? 😂
https://blog.lyc8503.net/en/post/llm-classifier/ #BreakingNews #LLM #TextAnalysis #MLtechniques #AIresearch #HackerNews #ngated -
Detecting LLM-Generated Texts with "Classical" Machine Learning
https://blog.lyc8503.net/en/post/llm-classifier/
Comments: https://news.ycombinator.com/item?id=48936880
#HackerNews #LLMDetection #MachineLearning #TextAnalysis #AIResearch
-
Detecting LLM-Generated Texts with "Classical" Machine Learning
https://blog.lyc8503.net/en/post/llm-classifier/
Comments: https://news.ycombinator.com/item?id=48936880
#HackerNews #LLMDetection #MachineLearning #TextAnalysis #AIResearch
-
This AntConc software is pretty rad and there's apparently a large community of users. I'm watching some videos of how different people use it and learning more about collocation, n-grams, etc.
-
This AntConc software is pretty rad and there's apparently a large community of users. I'm watching some videos of how different people use it and learning more about collocation, n-grams, etc.
-
Published at #IRRJ: "Much Ado about Accessibility: An Exploration of Online Content Accessibility from an Autism-Informed Perspective" by Hrishita Chakrabarti and Maria Soledad Pera. #TextAnalysis, #Autism, #WebAccessibility, #SearchEngines, #LLMs
-
Published at #IRRJ: "Much Ado about Accessibility: An Exploration of Online Content Accessibility from an Autism-Informed Perspective" by Hrishita Chakrabarti and Maria Soledad Pera. #TextAnalysis, #Autism, #WebAccessibility, #SearchEngines, #LLMs
-
Poking around with sentiment analysis on the public domain copy of Pride and Prejudice by Jane Austen.
I extracted the speech, did a strict attribution, and ran sentiment analysis for different speakers based off chunks sampled from the text.
Elizabeth is neutral with a 28% confidence level, Jane is joyful at a 57% confidence. Darcy is sad with 94% confidence and Mrs Bennet is joyful at 95% confidence.
Those aren't the emotions I get from reading the text. Again, I'm learning more about the sentiment analysis than the text.
https://www.kaggle.com/code/alisonhawke/pride-and-prejudice#DataScience #Python #Literature #TextAnalysis #SentimentAnalysis
-
Poking around with sentiment analysis on the public domain copy of Pride and Prejudice by Jane Austen.
I extracted the speech, did a strict attribution, and ran sentiment analysis for different speakers based off chunks sampled from the text.
Elizabeth is neutral with a 28% confidence level, Jane is joyful at a 57% confidence. Darcy is sad with 94% confidence and Mrs Bennet is joyful at 95% confidence.
Those aren't the emotions I get from reading the text. Again, I'm learning more about the sentiment analysis than the text.
https://www.kaggle.com/code/alisonhawke/pride-and-prejudice#DataScience #Python #Literature #TextAnalysis #SentimentAnalysis
-
Spent some time doing data analysis on the Project Gutenberg text of Pride and Prejudice.
Pulling out all the speech, the library I used said it was "emotionally neutral" in sentiment. Which is interesting because when you read it, the speech is absolutely not that. There's a lot in the subtleties of the speech that makes it very pointed.
The confidence on the emotional rating was 57%, which seems low to me. Doing analysis on a book I'm familiar with and recently read is telling me as much about the means of evaluating the text as the text itself.
#DataScience #TextAnalysis #SentimentAnalysis -
Spent some time doing data analysis on the Project Gutenberg text of Pride and Prejudice.
Pulling out all the speech, the library I used said it was "emotionally neutral" in sentiment. Which is interesting because when you read it, the speech is absolutely not that. There's a lot in the subtleties of the speech that makes it very pointed.
The confidence on the emotional rating was 57%, which seems low to me. Doing analysis on a book I'm familiar with and recently read is telling me as much about the means of evaluating the text as the text itself.
#DataScience #TextAnalysis #SentimentAnalysis -
Why do politicians always talk about "middle class," "immigrants," or "families"?
New research funded by @fwf and @dfg_public led by Dr. Lena Maria Huber (https://lenamariahuber.eu/, MZES, University of Mannheim) and Dr. Hauke Licht (University of Innsbruck), explores how politicians talk about social groups in campaign platforms and parliamentary speeches across 8 Western European countries.
🔗https://haukelicht.github.io/projects/gaepd/
#PoliticalCommunication #ComputationalSocialScience #Democracy #TextAnalysis
-
Why do politicians always talk about "middle class," "immigrants," or "families"?
New research funded by @fwf and @dfg_public led by Dr. Lena Maria Huber (https://lenamariahuber.eu/, MZES, University of Mannheim) and Dr. Hauke Licht (University of Innsbruck), explores how politicians talk about social groups in campaign platforms and parliamentary speeches across 8 Western European countries.
🔗https://haukelicht.github.io/projects/gaepd/
#PoliticalCommunication #ComputationalSocialScience #Democracy #TextAnalysis
-
Can #AI reasoning models infer people's underlying reasons in unstructured chat data from group decisions?
Across multiple prompting steps, #GTP5 usually did NOT select the same underlying reason as a human rater: https://doi.org/10.48550/arXiv.2601.05582
-
Can #AI reasoning models infer people's underlying reasons in unstructured chat data from group decisions?
Across multiple prompting steps, #GTP5 usually did NOT select the same underlying reason as a human rater: https://doi.org/10.48550/arXiv.2601.05582
-
Fast Concordance: Instant concordance on a corpus of >1,200 books
https://iafisher.com/concordance/
#HackerNews #FastConcordance #InstantConcordance #Books #Corpus #TextAnalysis #LiteratureTech
-
Fast Concordance: Instant concordance on a corpus of >1,200 books
https://iafisher.com/concordance/
#HackerNews #FastConcordance #InstantConcordance #Books #Corpus #TextAnalysis #LiteratureTech
-
Ive been digging around for text analysis OS apps and found AntConc via a Reddit thread. This app is very good from what I can see in early quick testing. Im looking at term frequency across relevant papers, and some 'concordance' context but AntConc will do a lot more. Together with Taguette you have all you need for a lot of analysis.
Im running portable on Windows but Mac and Linux also work.
https://www.laurenceanthony.net/software/antconc/#AntConc #textanalysis #research #academia #academicchatter #linguistics
-
Ive been digging around for text analysis OS apps and found AntConc via a Reddit thread. This app is very good from what I can see in early quick testing. Im looking at term frequency across relevant papers, and some 'concordance' context but AntConc will do a lot more. Together with Taguette you have all you need for a lot of analysis.
Im running portable on Windows but Mac and Linux also work.
https://www.laurenceanthony.net/software/antconc/#AntConc #textanalysis #research #academia #academicchatter #linguistics
-
Recs for text analysis tools, without any or only minimal genai - Taguette, QDA Miner, what else? Bulk document (around 50 papers) common word analysis is what Im mainly looking for, as well as individual document labelling. Open source, free, Windows 10.
#QualitativeData #textanalysis #software #research #academia #academicchatter #opensource -
Recs for text analysis tools, without any or only minimal genai - Taguette, QDA Miner, what else? Bulk document (around 50 papers) common word analysis is what Im mainly looking for, as well as individual document labelling. Open source, free, Windows 10.
#QualitativeData #textanalysis #software #research #academia #academicchatter #opensource -
New article in #JCLS 4(1)! 🎉
@dudarjulia & @christof introduce a method for evaluating measures of #distinctiveness ( #keyness ) using synthetically generated, fully controlled text data.
#CLS #TextAnalysis #Evaluation #NLP #NLG #LiteraryComputing #CCLS25
https://jcls.io/issue/118/info/ -
New article in #JCLS 4(1)! 🎉
@dudarjulia & @christof introduce a method for evaluating measures of #distinctiveness ( #keyness ) using synthetically generated, fully controlled text data.
#CLS #TextAnalysis #Evaluation #NLP #NLG #LiteraryComputing #CCLS25
https://jcls.io/issue/118/info/ -
Charting Twain: Building a Character Interaction Graph with Quarkus, OpenNLP, and a local Ollama Model. Uncover hidden dynamics in Huckleberry Finn using Java, sentiment analysis, and modern NLP.
https://myfear.substack.com/p/text-analytics-quarkus-opennlp-huckleberry-finn
#Java #Quarkus #OpenLNP #TextAnalysis -
Charting Twain: Building a Character Interaction Graph with Quarkus, OpenNLP, and a local Ollama Model. Uncover hidden dynamics in Huckleberry Finn using Java, sentiment analysis, and modern NLP.
https://myfear.substack.com/p/text-analytics-quarkus-opennlp-huckleberry-finn
#Java #Quarkus #OpenLNP #TextAnalysis -
Ah, the groundbreaking revelation that #LLMs don't handle more words as well as they handle fewer. 🤯 Who knew that feeding a massive text blob would confuse a glorified autocomplete? 😂 Next week: water is wet! 🌊
https://research.trychroma.com/context-rot #textanalysis #AIhumor #technews #revelations #HackerNews #ngated -
Ah, the groundbreaking revelation that #LLMs don't handle more words as well as they handle fewer. 🤯 Who knew that feeding a massive text blob would confuse a glorified autocomplete? 😂 Next week: water is wet! 🌊
https://research.trychroma.com/context-rot #textanalysis #AIhumor #technews #revelations #HackerNews #ngated -
Wow! #QualiService could be a great resource!
It wasn't obvious to me how to find the transcripts for these doctor-patient interaction data from 4 countries, but if such transcripts are accessible, that's GREAT!
-
Wow! #QualiService could be a great resource!
It wasn't obvious to me how to find the transcripts for these doctor-patient interaction data from 4 countries, but if such transcripts are accessible, that's GREAT!
-
🇪🇺 Want to analyze text from the EU public consultations? EU public consultations are a way in which the EU invites the broader public to publicly comment on upcoming legislation.
📦 :python: I just published a first version of a Python package {eu-consultations} to scrape and extract text from the EU website:
https://github.com/marioangst/eu_consultations- download consultation data as displayed on the EU's frontend into a validated form
- download associated files (this is the hard part about analysing this data - lots of feedback is in .docx and .pdf files)
- extract text from the files using docling and attach to feedbackYou get all data in validated form and possibly stored in huge (sorry for that) JSON files ;).
This package is part of an analysis project on feedback the EU has received via the public consultation process on digital policy we plan to present later this year, but I thought let's make some of the tools we use open source way earlier already.
-
🇪🇺 Want to analyze text from the EU public consultations? EU public consultations are a way in which the EU invites the broader public to publicly comment on upcoming legislation.
📦 :python: I just published a first version of a Python package {eu-consultations} to scrape and extract text from the EU website:
https://github.com/marioangst/eu_consultations- download consultation data as displayed on the EU's frontend into a validated form
- download associated files (this is the hard part about analysing this data - lots of feedback is in .docx and .pdf files)
- extract text from the files using docling and attach to feedbackYou get all data in validated form and possibly stored in huge (sorry for that) JSON files ;).
This package is part of an analysis project on feedback the EU has received via the public consultation process on digital policy we plan to present later this year, but I thought let's make some of the tools we use open source way earlier already.
-
Like we found in “Your Health vs. My Liberty” (https://doi.org/10.1016/j.cognition.2021.104649) Yael Rozenblum et al. found that compliance with #publicHealth guidance correlated with indicators of the perceived threat of a viral pandemic.
Also, relying on #misinformation correlated with reliance on simple (vs. complex) #reasoning.
The free paper: https://doi.org/10.1002/tea.21975
#medicine #health #education #psychology #epistemology #logic #textAnalysis
-
Like we found in “Your Health vs. My Liberty” (https://doi.org/10.1016/j.cognition.2021.104649) Yael Rozenblum et al. found that compliance with #publicHealth guidance correlated with indicators of the perceived threat of a viral pandemic.
Also, relying on #misinformation correlated with reliance on simple (vs. complex) #reasoning.
The free paper: https://doi.org/10.1002/tea.21975
#medicine #health #education #psychology #epistemology #logic #textAnalysis
-
Have you ever wanted to use a #LLM as one step in a workflow?
We integrated #GPT into the open-source analysis platform #useGalaxy, where you can link GPT to several thousand other tools, add more attachments for analysis and make your research reproducible.
https://galaxyproject.org/news/2024-09-02-chat-gpt/
In our example, we uploaded an audio file and used #Whisper to convert it into text, cut out the moderation, and prompted chatGPT to translate it into German.
-
Have you ever wanted to use a #LLM as one step in a workflow?
We integrated #GPT into the open-source analysis platform #useGalaxy, where you can link GPT to several thousand other tools, add more attachments for analysis and make your research reproducible.
https://galaxyproject.org/news/2024-09-02-chat-gpt/
In our example, we uploaded an audio file and used #Whisper to convert it into text, cut out the moderation, and prompted chatGPT to translate it into German.
-
📚🇮🇹 New working paper: "Evaluating Embedding Models for Clustering Italian Political News"
This study compares embedding models for unsupervised clustering of Italian political news shared on Facebook before the 2018 and 2022 elections, aiming to advance NLP methods for political text analysis in non-English languages.
Paper: https://osf.io/preprints/osf/2j9ed
Code & data: https://github.com/fabiogiglietto/Semantic-Clustering-Italian-News
Feedback welcome!
-
📚🇮🇹 New working paper: "Evaluating Embedding Models for Clustering Italian Political News"
This study compares embedding models for unsupervised clustering of Italian political news shared on Facebook before the 2018 and 2022 elections, aiming to advance NLP methods for political text analysis in non-English languages.
Paper: https://osf.io/preprints/osf/2j9ed
Code & data: https://github.com/fabiogiglietto/Semantic-Clustering-Italian-News
Feedback welcome!
-
🎯 Potential terrorists can be identified from social media posts, new research shows
https://phys.org/news/2024-08-potential-terrorists-social-media.html
-
🎯 Potential terrorists can be identified from social media posts, new research shows
https://phys.org/news/2024-08-potential-terrorists-social-media.html
-
The Digital Humanities Team at the University of Vienna and the Ottoman Nature in Travelogues (ONiT) project are hosting a #hackathon focused on analyzing texts, images, and multimodal sources.
Thursday, November 14, 9:00 CET to Friday, November 15, 15:00 CET
https://dh.univie.ac.at/hackathon/
#DigitalHumanities #ComputationalHumanities #TextAnalysis #ImageAnalysis -
It was also a methodologically fun paper, combining digitized archival text, Census & survey data, NLP, and panel models.
Email or dm me for a copy! #sociology #textanalysis #rstats
3/3
-
😓 An NLP-Based System for Detecting Depression Levels through User Comments on Twitter (X)
https://www.mdpi.com/2227-7390/12/13/1926
#mentalhealth #depression #nlp #ai #socialmedia #textanalysis #privacy