#visidata — Public Fediverse posts

Built a little script to download a JSON dump of all my followers, and now I can use #VisiData to ask questions like "On which instances do most of my followers live?"

If you're curious: It's 600 instances in total, which I think is pretty good.

Built a little script to download a JSON dump of all my followers, and now I can use #VisiData to ask questions like "On which instances do most of my followers live?"

If you're curious: It's 600 instances in total, which I think is pretty good.

When you request a dump of your personal data from #Deezer, they provide you with a single XLSX file with multiple sheets, and frankly, I don't hate it.

It's easy enough to work with using open source tools, has built-in compression, and is more strict than just getting a garbage truck full of JSON objects dumped in your homedir.

Some screenshots of the sheet in #Visidata.

When you request a dump of your personal data from #Deezer, they provide you with a single XLSX file with multiple sheets, and frankly, I don't hate it.

It's easy enough to work with using open source tools, has built-in compression, and is more strict than just getting a garbage truck full of JSON objects dumped in your homedir.

Some screenshots of the sheet in #Visidata.

Przyszło Wam kiedyś do głowy, aby przeglądać pliki CSV w terminalu? Niektórym przyszło i prezentują do tego narzędzie #Visidata.

https://python.plainenglish.io/error-analysis-from-your-terminal-using-visidata-68cb92fc9043

@cbjr77 Thanks I did not know about that #GUI tool. Will see how it compares with #visidata (https://www.visidata.org) which is my go-to tool for #CSV #CLI exploration.

@cbjr77 Thanks I did not know about that #GUI tool. Will see how it compares with #visidata (https://www.visidata.org) which is my go-to tool for #CSV #CLI exploration.

I love #VisiData.

So I have this TSV (tab-separated) file of my YouTube history, including two columns that I wanted to make more readable.

Import Python's datetime module:
g Ctrl-X datetime

Move to the "duration" column, mark it as integer ("#" key) and create a derived, formatted column:
=datetime.timedelta(seconds=curcol)

Mark view_count as int (# again), open columns sheet (Shift-C), move to "fmtstr", hit e to edit, enter "{:,.0f}", hit q to close column sheet.

https://jsvine.github.io/intro-to-visidata/

I love #VisiData.

So I have this TSV (tab-separated) file of my YouTube history, including two columns that I wanted to make more readable.

Import Python's datetime module:
g Ctrl-X datetime

Move to the "duration" column, mark it as integer ("#" key) and create a derived, formatted column:
=datetime.timedelta(seconds=curcol)

Mark view_count as int (# again), open columns sheet (Shift-C), move to "fmtstr", hit e to edit, enter "{:,.0f}", hit q to close column sheet.

https://jsvine.github.io/intro-to-visidata/

@ricci it's amazing how much quick and simple and correct analysis you can already do with tools like #visidata

@ricci it's amazing how much quick and simple and correct analysis you can already do with tools like #visidata

#VisiData is such an amazing #openSource command line spreadsheet-like tool!

Great at browsing/filtering/wrangling CSV files, for example.

https://jsvine.github.io/intro-to-visidata/

@mattly I guess https://www.visidata.org/ is what you are looking for.
#visidata #csv #tools #data

@mattly I guess https://www.visidata.org/ is what you are looking for.
#visidata #csv #tools #data

CTRL+C'd a spreadsheet clipboard and pasted it into #visidata to see what happened

entertaining result to watch as visidata executed the contents as a series of commands

CTRL+C'd a spreadsheet clipboard and pasted it into #visidata to see what happened

entertaining result to watch as visidata executed the contents as a series of commands

finally went "ugh" at the idea of launching the other regular spreadsheet app and tried #visidata. it's good!

finally went "ugh" at the idea of launching the other regular spreadsheet app and tried #visidata. it's good!

@aborruso #VisiData, che capolavoro!

@aborruso #VisiData, che capolavoro!

@aborruso mi hai appena fatto scoprire #VisiData. Pazzesco

@aborruso mi hai appena fatto scoprire #VisiData. Pazzesco

Let me express gratitude for #visidata. It's a super cool #CLI data exploration tool for working with spreadsheet-type data (think CSVs, parquet, sqlite). You can do all kinds of cool stuff with a few keystrokes. Calculate new columns, do aggregations using some key columns, plot and more. If you need to do some quick data exploration look no further. https://jsvine.github.io/intro-to-visidata/index.html

Sweet Jesus! Visidata is the utility spreadsheet I’ve always dreamed of, but didn’t know existed! I mean, I knew there were command line spreadsheets, but the couple I’ve tried [admittedly, very briefly] felt too opaque for me to just get going with.

I’ll suffer through archaea for fun any day of the week, but for things I actually intend to use to get shit done, the only way I know how to learn is by doing, so I don’t want to read a man page to figure out how to add two numbers together (as much as I would love to be the kind of person who would).

Obviously, it’s not going to replace Excel or WPS (which is impressive, but also awful, in case you were wondering), but for those times where I just need to do some calculations on the fly, or extract metadata from 1000 badly formed filenames for a CSV import (current task), sometimes those are big fancy distractions as much as indispensable tools.

The fact that the expression syntax is just Python means that I don’t really have to learn anything new and exotic (or archaic).

And woah! They might actually be human readable!? Fuck yeah! (You know that thing where someone will expend 10x the effort to take the groceries in the house in one trip, rather than two or three manageable ones? Yeah, I have that illness with Excel formulae. HELPER COLUMNS ARE FOR THE WEAK [with the good sense to think about future maintenance/modification])

I’m in love.

#spreadsheets #visidata #excel

@hrbrmstr Cool, one more #CLI tool to check and try.
I've using for quite some time #visidata (Python based tool), and, of course the amazing #duckdb. Need to check this out now.

@hrbrmstr Cool, one more #CLI tool to check and try.
I've using for quite some time #visidata (Python based tool), and, of course the amazing #duckdb. Need to check this out now.

Something wonderful happened today: I met @saulpw the inventor of @visidata , I met Anja Kefala, who takes care of VisiData, and I met @reagle a member of the beautiful community of visidata.
Thank you, you are beautiful people

#visidata

Something wonderful happened today: I met @saulpw the inventor of @visidata , I met Anja Kefala, who takes care of VisiData, and I met @reagle a member of the beautiful community of visidata.
Thank you, you are beautiful people

#visidata

How could I miss out on #VisiData for so long? This might become my new favorite #CLI tool.

If you do _anything_ with data and enjoy working in the terminal, check it out. It can

• provide a #TUI for viewing and editing data in #CSV, #Excel, #SQLite, #JSON, #YAML & #XML files and quite a few more
• sort, filter, join and edit that data, across files and across formats
• convert between the formats (interactively or not)
• record & play macros
• be scripted in #Python

https://www.visidata.org/

How could I miss out on #VisiData for so long? This might become my new favorite #CLI tool.

If you do _anything_ with data and enjoy working in the terminal, check it out. It can

• provide a #TUI for viewing and editing data in #CSV, #Excel, #SQLite, #JSON, #YAML & #XML files and quite a few more
• sort, filter, join and edit that data, across files and across formats
• convert between the formats (interactively or not)
• record & play macros
• be scripted in #Python

https://www.visidata.org/

@saulpw I've learned a ton and met some super nice folks thanks to #VisiData. It's very cool to pause a moment and reflect on that ♥️

https://github.com/saulpw/visidata/issues/333
https://github.com/saulpw/visidata/commit/7ddffcc5c1a4f3142f10e14bb23f6885b83ad594

@saulpw I've learned a ton and met some super nice folks thanks to #VisiData. It's very cool to pause a moment and reflect on that ♥️

https://github.com/saulpw/visidata/issues/333
https://github.com/saulpw/visidata/commit/7ddffcc5c1a4f3142f10e14bb23f6885b83ad594

Back in 2019 I fell in love with a tool called #VisiData. I loved how it seemed to open anything I threw at it, but was curious to see if I could use it to read files in S3.

That inspired some local experiments that became the "vds3" plugin. Yesterday @saulpw helped migrate that logic into VisiData core as the S3 loader :).

Back in 2019 I fell in love with a tool called #VisiData. I loved how it seemed to open anything I threw at it, but was curious to see if I could use it to read files in S3.

That inspired some local experiments that became the "vds3" plugin. Yesterday @saulpw helped migrate that logic into VisiData core as the S3 loader :).

Herramientas varias:

#ApacheSpark: https://mastodon.social/@crscardellino/110140924338634660

#BASH: https://mastodon.social/@crscardellino/110141082434636197

#Python: https://mastodon.social/@crscardellino/110141128806934670

#Hydra y #MLFLow: https://mastodon.social/@crscardellino/110141141659418012

#Visidata: https://mastodon.social/@crscardellino/110141216770947712

Oh, seems you only need to

`pip install pyodf`

and everything works out of the box. #VisiData

Oh, seems you only need to

`pip install pyodf`

and everything works out of the box. #VisiData

Although #VisiData has #ods support since version 2.7 and I'm using version 2.11, I can't open #ods spreadsheets. I just get the error:

`ModuleNotFoundError: No module named 'odf'`

Notice that #VisiData complains about 'odf', not 'ods'. Any advice?

Although #VisiData has #ods support since version 2.7 and I'm using version 2.11, I can't open #ods spreadsheets. I just get the error:

`ModuleNotFoundError: No module named 'odf'`

Notice that #VisiData complains about 'odf', not 'ods'. Any advice?

@tylermorganwall

That will be cool, something like what you can do in #vim using 'mechatroner/rainbow_csv' (https://github.com/mechatroner/rainbow_csv). Or better yet, something like #visidata with the "rainbow-cols" command (ref: https://github.com/saulpw/visidata/discussions/1205#discussioncomment-1743215)

@tylermorganwall

That will be cool, something like what you can do in #vim using 'mechatroner/rainbow_csv' (https://github.com/mechatroner/rainbow_csv). Or better yet, something like #visidata with the "rainbow-cols" command (ref: https://github.com/saulpw/visidata/discussions/1205#discussioncomment-1743215)

Sweet pair of talks today from #PyLadies Dublin.

Kudos to @whykay for making it happen and running the show, and to the speakers for sharing neat stuff:

Nabanita Roy (showcasing a buffet of methods for scraping/analyzing text data) & @micktwomey (fun exploring various data sets with #VisiData).

https://github.com/pyladiesdublin/feb-talks-2023

Sweet pair of talks today from #PyLadies Dublin.

Kudos to @whykay for making it happen and running the show, and to the speakers for sharing neat stuff:

Nabanita Roy (showcasing a buffet of methods for scraping/analyzing text data) & @micktwomey (fun exploring various data sets with #VisiData).

https://github.com/pyladiesdublin/feb-talks-2023

I haven't been able to open CSVs in VisiData from my browser since I switched to the Firefox flatpak app. It wasn't _that_ big a deal, but I finally spent the time to fix it.

I think this is only interesting if you happen to use the firefox flatpak app _and_ want it to open CSVs with #visidata in a new tmux window... which feels pretty damn specific 😅

https://dev.to/ajkerrigan/today-i-learned-opening-csvs-with-visidata-in-tmux-from-the-firefox-flatpak-app-4m07

I haven't been able to open CSVs in VisiData from my browser since I switched to the Firefox flatpak app. It wasn't _that_ big a deal, but I finally spent the time to fix it.

I think this is only interesting if you happen to use the firefox flatpak app _and_ want it to open CSVs with #visidata in a new tmux window... which feels pretty damn specific 😅

https://dev.to/ajkerrigan/today-i-learned-opening-csvs-with-visidata-in-tmux-from-the-firefox-flatpak-app-4m07

Opening the #sqlite history file in #VisiData reveals some more joy:

#didYouKnow about #visidata <https://www.visidata.org/>?
This is an impressive tool for the command-line visualization and manipulation of tabular data from/to a variety of formats.

(It's still somewhat clumsy to use for multi-level structured data (XML and JSON files, for example), though.)

#sapevatelo

Reflecting on #HanukkahOfData with a post about the first puzzle (https://dev.to/ajkerrigan/hanukkah-of-data-2022-puzzle-1-5eb2).

On the first day I was still getting a feel for the data set, and stuck with #VisiData . I didn't yet realize that I'd lean so hard on #Datasette and #pandas in the following days...

Reflecting on #HanukkahOfData with a post about the first puzzle (https://dev.to/ajkerrigan/hanukkah-of-data-2022-puzzle-1-5eb2).

On the first day I was still getting a feel for the data set, and stuck with #VisiData . I didn't yet realize that I'd lean so hard on #Datasette and #pandas in the following days...

@zx I'd 💯 recommend it! I usually Ctrl-C to interrupt #VisiData data-loading once I have ~10-100k rows (any more and it's super slow), but it's truly an excellent tool for rough analyses or quick explorations.

For me, the killer feature is that it can connect directly to #Postgres (and a bunch of other databases!) which allows me to explore all tables in a schema interactively.

https://www.visidata.org/docs/formats/