#smalldata — Public Fediverse posts

New paper:
"Data Management for Sustainable Development: Case Analyses of Small Island Developing States (SIDS)"
https://doi.org/10.1111/dpr.70017

#island #islands #IslandStudies #SmallIslands #IslandStates #sustainable #development #Islandness #SustainableDevelopment #BigData #SmallData

Europäischer Polizeikongress: Ermittler brauchen KI und "#SmallData" | heise online https://www.heise.de/news/Europaeischer-Polizeikongress-Ermittler-brauchen-KI-und-Small-Data-10392501.html #BigData #ArtificialIntelligence #Datenschutz #privacy #Überwachung #surveillance #Chatkontrolle #ChatControl #Gesichtserkennung #FacialRecognition #Biometrie #biometrics #ArtificialIntelligenceAct #AIA #AIact

🍗 Oh, the endless saga of "Small Data": where a 2012 MacBook Pro is dusted off to solve the mysteries of the universe! 🤔 Apparently, we've been too busy dreaming of Big Data, only to find out our datasets are about as exciting as watching grass grow in real-time. 🌱✨
https://duckdb.org/2025/05/19/the-lost-decade-of-small-data.html #SmallData #MacBookPro #BigData #MysteriesOfTheUniverse #DataAnalysis #HackerNews #ngated

The Lost Decade of Small Data?

https://duckdb.org/2025/05/19/the-lost-decade-of-small-data.html

#HackerNews #LostDecade #SmallData #DataAnalysis #DataTrends #DuckDB #Insights

Big Data, Hochleistungsrechner, KI – diese Themen erhalten derzeit viel Aufmerksamkeit. Aber wie gehen Wissenschaftler*innen Probleme an, wenn die verfügbaren Datenmengen gering sind? Im Sonderforschungsbereich (SFB) „Small Data“ entwickeln Forscher*innen Methoden für solche Small-Data-Anwendungen.
Im Interview sprechen die Doktorand*innen Maren Hackenberg, Lennart Purucker und Esma Secen über ihre Promotionsprojekte im Bereich Small Data, ihre Erfahrungen mit interdisziplinärer Zusammenarbeit und die erhoffte Wirkung des Sonderforschungsbereichs.
Zum Interview: https://uni-freiburg.link/small-data

#unifreiburg #smalldata #ki #ai #sfb #promotion

Just caught up with the recent Delta Lake webinar,

> Revolutionizing Delta Lake workflows on AWS Lambda with Polars, DuckDB, Daft & Rust

Some interesting hints there regarding lightweight processing of big-ish data. Easy to relate to any other framework instead of Lambda, e.g. #ApacheAirflow tasks

https://youtu.be/BR9oFD0QMAs

#dataengineering #datascience #duckdb #daft #polars #pandas #python #spark #deltalake #databricks #airflow #bigdata #smalldata

Small Data: Artisanal information collection in Brooklyn, NY
https://www.youtube.com/watch?v=eDr6_cMtfdA
#documentary #smalldata #parody #krazam #funny #data #+

#SmallData Symposium 2024 am 7.&8.10. zeigt, wie KI auch mit wenig Daten möglich ist.

Für Pressevertreter*innen besteht am 7.10. um 12:30 Uhr die Möglichkeit, an einem Pressegespräch mit den Vortragenden des ersten Blocks teilzunehmen, um ein tieferes Verständnis der behandelten Themen zu ermöglichen.

https://uni-freiburg.de/smalldata-symposium-2024/

https://medium.com/ai-in-plain-english/small-and-soft-data-key-for-a-better-understanding-of-yourself-with-ai-extended-brain-8fddd08b9109

#smalldata could be used as a curated data set to tune more precise and specialized models. It is open the door to a #personalai and #privateai

#smalldata is not new, but #softdata in a #smalldata set is relatively new.

Your ideas, journals, and emotions is are key to the explainability of your hard data points

"While suggesting that there is individual work to be done often gets derided as ‘neoliberal’, it’s often the personal connections we can make and the way we can use data to show people how climate crisis affects their lives that can help us mobilise for broader forms of advocacy at structural levels." (@roopikarisam)

#ClimateDiary #SmallData

Finally had the time to rent this book (yeah for the orders open to all at the University of Luxembourg!).

That's what I like about research, the space to explore different ways of communicating and discussing results.

#SmallData #Academia

"Institutional capacity, useability of data, and evidence-based decision-making for sustainable development in Small Island Developing States"
A new working paper with Kalim Shah to input into the #SIDS4 meeting via ODI.
https://odi.org/en/publications/data-and-evidence-based-decision-making-for-sustainable-development
 
#IslandStudies #SmallIslands #BigData #SmallData #SustainableDevelopment #Islands

On the occasion of today's #release, here's a late #introduction ! This is the Mastodon account of the Mégra :megra_wavetable: language, a LISP-y DSL developed by @parkellipsen to make sound and music. It's built around Markov chains and notions of #smalldata . Also, it's a standalone program (implemented in Rust) that comes with its own editor and synthesizer/sampler.

I took this #patternuary as an opportunity to showcase some of its central features: https://pixelfed.de/c/649550360133621284

Version 0.0.12 has been released today!

If anyone wants to try:
Docs: https://megra-doc.readthedocs.io/en/latest/
Code: https://github.com/the-drunk-coder/megra.rs
Latest release: https://github.com/the-drunk-coder/megra.rs/releases/tag/v0.0.12

I'd be happy to receive some feedback :)

https://volodymyrpavlyshyn.medium.com/small-and-soft-data-key-for-a-better-understanding-of-yourself-with-ai-extended-brain-8fddd08b9109 #smalldata #softdata

https://youtu.be/NXOIpL8Eakg?si=GSpYFCmK6A9acGtW #ai #extended #brain and #smalldata

https://youtu.be/0T_imbxX5Zg?si=-uXBwjPKamfP7L6L

#smalldata and #personal #knowledgegraphs bring an enterprise tech closer to human and brain-friendly system design

#smalldata - is not about #bigtech is more about #human and personal #knowledge. Curated sets of ideas, thoughts, personal data that focus on values and are value itself. Human brain-friendly data that are in a #context . #AI will help you create a #bridge between #smalldata and the ocean of information and big data in a digestible and human-friendly way. We desperately need the next generation of #ToolsForThought

This weekend, I came up with the thought that we need another 2 hashtags: #MessyWeekends and #MedianData. Here's why:

The inspiration for #MessyWeekends came from seeing some folks regularly having fun with #TidyTuesday. However, since my Tuesdays usually are pretty tight, I will have to find some time on the weekends to play with #Data, #Python, #pandas, #PyData, #DataScience, etc. With a 4.75YO at home, weekends tend to be messy anyway. So that's that.

As for #MedianData, it is literally between #SmallData and #BigData, and I think a lot can be learned by pouring over it and trying out different kinds of #DataTools.

What do you think? 😎

Super excited to be at #biohack23 looking forward to connecting #smalldata with big combining chemistry and biology. In any case it's going to be #sparqling.

As co-chair, I'm excited about this 💥 all the individual livestream talks from Citus Con: An Event for Postgres 2023 have published on YouTube 📺

Including some phenomenal talks 💡 by @simon & @cyberdemn & @tmunro - and others not yet on Mastodon

Enjoy the playlist of 37 talks & pls tell your friends

https://aka.ms/cituscon-playlist

#CitusCon #PostgreSQL #Citus #SmallData #OpenSource #Patroni #YouTube #DistributedPostgreSQL #HammerDB

https://mastodon.ie/@Castlebridge/110184593314965686 Sometimes it needs to be all about the #SmallData if you want to avoid #IQTrainwreck*

*#IQTrainWreck is a #DataQuality or #InformationQuality problem that causes an embarrassing but avoidable headline or results in significant impacts on people or organisations. I coined the term back in 2005. See http://iqtrainwrecks.info for some classic examples or check the hashtag over on the bird site as well.

In my personal experience, smart use of smaller data sets yielded most benefits (kind like 20-80 rule). Often, the cost was in tackling the large information space embedded in small data sets via better features. #bigdata #smalldata https://motherduck.com/blog/big-data-is-dead/

#introduction
I am an open data access (#ODBC, #JDBC, and #HTTP), integration (#DataVirtualization), and data management (#DBMS and/or #KnowledgeGraph) technologist, enthusiast, and entrepreneur.

I am passionate about open standards for #GenAI, #AI, #Identity #Authenticity, #SocialMedia (#ActivityPub & #ActivityStreams), and data de-silo-fication initiatives (e.g. #SemanticWeb, #LODCloud, #LinkedData, #RWW, and #SmallData).

I don't like any kind of silo!

For #SmallData projects (where small is honestly pretty big these days!) I can't recommend this pattern enough: dump EVERYTHING into a #SQLite file - raw data, intermediate representations, final product. This way you get all the advantages of a flat file: transportable, backupable, versionable.

Then, if/when it comes time to publish the data, all you need to do is copy the file, drop tables you don't need, and ship it!