#datatools — Public Fediverse posts

DuckDB – Data power tools for your laptop, now in Clojure (2023)

https://techascent.com/blog/just-ducking-around.html

Comments: https://news.ycombinator.com/item?id=49175924

#HackerNews #DuckDB #DataTools #Clojure #TechNews #DataAnalytics

DuckDB – Data power tools for your laptop, now in Clojure (2023)

https://techascent.com/blog/just-ducking-around.html

Comments: https://news.ycombinator.com/item?id=49175924

#HackerNews #DuckDB #DataTools #Clojure #TechNews #DataAnalytics

The Commodification of Visual Logic: Browser-Based Graphing as Infrastructure

Are you using Graph Maker or LiveGap for charts? Learn how these browser tools are changing how people turn raw data into visuals as of May 2026.

#datavisualization, #graphmaker, #livegap, #datatools, #techtrends

https://newsletter.tf/browser-based-graphing-tools-may-2026/

Data tools like Graph Maker and LiveGap are now used by more people than ever to make charts. This is a big change from using complex statistical software.

#datavisualization, #graphmaker, #livegap, #datatools, #techtrends
https://newsletter.tf/browser-based-graphing-tools-may-2026/

🎉 Milestone Unlocked: Finished the Data Engineering Zoomcamp!

In 10 weeks, I moved from scripting to architecting systems. We built real production-grade infrastructure using Spark, Kafka, Airflow, and Kestra—not just hobby projects.

Capstone: A Storage Hard Drive Dashboard using real failure data from Backblaze
Stack: Terraform + Docker infra, Airflow orchestration, dbt modeling, Streamlit viz.

Key Lessons:
✅️ "It works on my laptop" isn't a strategy.
✅ Need IaC, partitioning, clustering, and strict error handling.
✅ dbt ensures reproducible, tested models.
✅ Infra is invisible work—if it breaks, your code fails.

Take the leap! It’s challenging but by week 10, pieces click into place. Seeing my pipeline run autonomously felt like crossing the finish line. 🏁

Thanks Data Talks Club team! On to the next challenge!

My project: https://github.com/ammartin8/hard_drive_analytics_dashboard

#mastodon #fediverse #data #spark #dataengineering #ai #technology #datatools #datapipelines #fedihire #thursday #sql #observability #etl #python #github

🎉 Milestone Unlocked: Finished the Data Engineering Zoomcamp!

In 10 weeks, I moved from scripting to architecting systems. We built real production-grade infrastructure using Spark, Kafka, Airflow, and Kestra—not just hobby projects.

Capstone: A Storage Hard Drive Dashboard using real failure data from Backblaze
Stack: Terraform + Docker infra, Airflow orchestration, dbt modeling, Streamlit viz.

Key Lessons:
✅️ "It works on my laptop" isn't a strategy.
✅ Need IaC, partitioning, clustering, and strict error handling.
✅ dbt ensures reproducible, tested models.
✅ Infra is invisible work—if it breaks, your code fails.

Take the leap! It’s challenging but by week 10, pieces click into place. Seeing my pipeline run autonomously felt like crossing the finish line. 🏁

Thanks Data Talks Club team! On to the next challenge!

My project: https://github.com/ammartin8/hard_drive_analytics_dashboard

#mastodon #fediverse #data #spark #dataengineering #ai #technology #datatools #datapipelines #fedihire #thursday #sql #observability #etl #python #github

Diving deep into Spark batch processing!⚡️

Learned how to:
✅ Optimize data pipelines with filtering, repartitioning & grouping
✅ Design efficient ETL pipelines with Spark
✅ Understanding when and how to use partitioning strategies
✅ Use Google Cloud Storage (GCS) as a data source for Spark applications and configuring Spark to read Parquet or other formats from GCS
✅ Visualize execution plans for efficient coding
✅ Review the Spark UI for performance monitoring

💡 Key takeaway: One thing that amazes me about distributed computing is how we've transformed from struggling with massive datasets to generating insights in near real-time. As an analyst who has dealt with long wait times in processing data, spark saves so much time in getting results faster and make data-driven decisions more quickly.

Review my work here: https://github.com/ammartin8/data_engineering_zoom_camp/blob/main/modules/module_6/project_06/README.md

#mastodon #fediverse #data #spark #dataengineering #ai #technology #opensource #datatools #datapipelines #fedihire #wednesday #sql #observability #etl #python

Need to shrink or extract data quickly?

Explore Compress & Decompress Tools that help you reduce file size, encode data efficiently, and unpack compressed content with ease. Fast, simple utilities designed for developers and anyone working with data online.

🔗 https://99tools.net/category/compress-decompress-tools

#Compression #DeveloperTools #WebDevelopment #CodingTools #DataTools #Programming #DevUtilities #OnlineTools #TechTools #99Tools

FYI: 3 days left: Amazon is locking the door on the data tools sellers depended on: With Amazon's BSA Agent Policy taking effect in 3 days, an industry expert argues the review cap and new rules are closing the third-party AI data pipeline for good. https://ppc.land/3-days-left-amazon-is-locking-the-door-on-the-data-tools-sellers-depended-on/ #Amazon #DataTools #Ecommerce #BSAAgentPolicy #AIdatapipeline

Just completed a project building an end-to-end data pipeline for NYC taxi data using dlt 🚕📊! What a ride! 😅 The REST API extraction was particularly fun (in a challenging way) but dlt's modular design made it manageable. Here’s what I learned:

✅ Full life cycle: From REST API extraction to DuckDB loading, all in one framework
✅ Reproducibility: Tracked every transformation with dlt's lineage features
✅ Modular design: Defined reusable components for extracting and normalizing data
✅ Handles complexity: Seamlessly handled pagination from the API
Big takeaway: dlt isn't just tooling, it's a framework for thinking about data pipelines that emphasizes transparency and reproducibility which is essential for any modern data stack

#dlt #dataengineering #datapiplines #etl #fediverse #mastodon #opensource #oss #ai #data #linux #technology #duckdb #datatools

ICYMI: 3 days left: Amazon is locking the door on the data tools sellers depended on: With Amazon's BSA Agent Policy taking effect in 3 days, an industry expert argues the review cap and new rules are closing the third-party AI data pipeline for good. https://ppc.land/3-days-left-amazon-is-locking-the-door-on-the-data-tools-sellers-depended-on/ #Amazon #DataTools #BSAAgentPolicy #ThirdParty #AIData

Building a Simple Tech Stack: Avoid Costly Mistakes and Boost Efficiency! #data #datatools

How to should you choose be best data tools to make an efficient stack? Keep it simple! source

https://quadexcel.com/wp/building-a-simple-tech-stack-avoid-costly-mistakes-and-boost-efficiency-data-datatools/

Building a Simple Tech Stack: Avoid Costly Mistakes and Boost Efficiency! #data #datatools

How to should you choose be best data tools to make an efficient stack? Keep it simple! source

https://quadexcel.com/wp/building-a-simple-tech-stack-avoid-costly-mistakes-and-boost-efficiency-data-datatools/

📰 Open Source 2026: Why OpenTofu, Biome, and Ollama Change Everything

Explore the seismic shifts in open source for 2026. From Rust-powered toolchains to local LLMs, discover why OpenTofu, Biome, and Ollama are the new standards.

#opensource #datatools #github #news

🌍 Also in: 🇪🇸 🇫🇷 🇩🇪 🇧🇷 🇮🇹

🔗 https://dataformathub.com/blog/open-source-2026-why-opentofu-biome-and-ollama-change-everything-lwu?utm_source=mastodon&utm_medium=social&utm_campaign=blog

Parqeye – A CLI tool to visualize and inspect Parquet files

https://github.com/kaushiksrini/parqeye

#HackerNews #Parqeye #Parquet #CLI #DataVisualization #DataTools #OpenSource

Parqeye – A CLI tool to visualize and inspect Parquet files

https://github.com/kaushiksrini/parqeye

#HackerNews #Parqeye #Parquet #CLI #DataVisualization #DataTools #OpenSource

🪿 When AI gets confused by geese - call DotDotGoose!

It’s a super cute open-source tool for counting things on images by hand.
Just click around and mark birds, bugs, butterflies - whatever you need 🐥🦋

Made by the American Museum of Natural History for real science -
but honestly, it’s so cozy I just wanna sit and count little geese all day 🤍

🔗 https://github.com/persts/DotDotGoose

#GooseGang #Python #OpenSource #DevGirl #DataTools

🪿 When AI gets confused by geese - call DotDotGoose!

It’s a super cute open-source tool for counting things on images by hand.
Just click around and mark birds, bugs, butterflies - whatever you need 🐥🦋

Made by the American Museum of Natural History for real science -
but honestly, it’s so cozy I just wanna sit and count little geese all day 🤍

🔗 https://github.com/persts/DotDotGoose

#GooseGang #Python #OpenSource #DevGirl #DataTools

Need better insights from your data?
Talk to @eazyBI — they're at #BalticRuby in red shirts and ready to help! 📊
Thanks to our Bronze Sponsor for supporting the Ruby community with tools and good vibes! https://eazybi.com/

#eazyBI #RubyOnRails #RubyConference #DataTools

Need better insights from your data?
Talk to @eazyBI — they're at #BalticRuby in red shirts and ready to help! 📊
Thanks to our Bronze Sponsor for supporting the Ruby community with tools and good vibes! https://eazybi.com/

#eazyBI #RubyOnRails #RubyConference #DataTools

SQL Workbench – Republicans not welcome

https://www.sql-workbench.eu/

#HackerNews #SQLWorkbench #RepublicansNotWelcome #TechNews #SQLCommunity #DataTools

SQL Workbench – Republicans not welcome

https://www.sql-workbench.eu/

#HackerNews #SQLWorkbench #RepublicansNotWelcome #TechNews #SQLCommunity #DataTools

Democratizing AI access is our mission! That's why we've integrated Ollama with our (Un)Perplexed Spready software. See our comparison of which model—Mistral 7B or OLMo2 7B—might work best for your use case. https://matasoft.hr/qtrendcontrol/index.php/un-perplexed-spready/un-perplexed-spready-various-articles/146-comparative-analysis-of-mistral-7b-and-olmo2-7b-on-the-ollama-platform #AIForAll #Ollama #DataTools

Democratizing AI access is our mission! That's why we've integrated Ollama with our (Un)Perplexed Spready software. See our comparison of which model—Mistral 7B or OLMo2 7B—might work best for your use case. https://matasoft.hr/qtrendcontrol/index.php/un-perplexed-spready/un-perplexed-spready-various-articles/146-comparative-analysis-of-mistral-7b-and-olmo2-7b-on-the-ollama-platform #AIForAll #Ollama #DataTools

🐤 Wow, just what we needed—a "lightweight" data framework that’s built on top of #DuckDB 🦆 and #3FS 🔧, because clearly, our data didn’t have enough buzzword sauces on it already. 🍛 But hey, at least now we have another tool to sit idly in our #GitHub repos, collecting digital dust while we pretend it’s the magic bullet for all data woes. 🎯✨
https://github.com/deepseek-ai/smallpond #lightweightdata #datatools #HackerNews #ngated

🐤 Wow, just what we needed—a "lightweight" data framework that’s built on top of #DuckDB 🦆 and #3FS 🔧, because clearly, our data didn’t have enough buzzword sauces on it already. 🍛 But hey, at least now we have another tool to sit idly in our #GitHub repos, collecting digital dust while we pretend it’s the magic bullet for all data woes. 🎯✨
https://github.com/deepseek-ai/smallpond #lightweightdata #datatools #HackerNews #ngated

📣 Published new free and public #DuckDB #SQLTools Preview v1.6.0 for VS Code IDE with DuckDB v0.10.2 support.

📥 https://marketplace.visualstudio.com/items?itemName=RandomFractalsInc.duckdb-sql-tools

See our #ProDataTools repo for advanced #DuckDBPro schema, commands, and new features updates:

📰 https://github.com/RandomFractals/pro-data-tools/blob/main/duckdb-tools.md#pro-data-tools

#VSCode #DataTools 🛠️ 🧙‍♂️ ...

📣 Published new free and public #DuckDB #SQLTools Preview v1.6.0 for VS Code IDE with DuckDB v0.10.2 support.

📥 https://marketplace.visualstudio.com/items?itemName=RandomFractalsInc.duckdb-sql-tools

See our #ProDataTools repo for advanced #DuckDBPro schema, commands, and new features updates:

📰 https://github.com/RandomFractals/pro-data-tools/blob/main/duckdb-tools.md#pro-data-tools

#VSCode #DataTools 🛠️ 🧙‍♂️ ...

Announcing SSMS 20.2 ... and getting feedback for SSMS 21.

#sqlserver #ssms #database #data #datatools #azuresql
https://techcommunity.microsoft.com/t5/sql-server-blog/announcing-ssms-20-2-and-getting-feedback-for-ssms-21/ba-p/4187034

Announcing SSMS 20.2 ... and getting feedback for SSMS 21.

#sqlserver #ssms #database #data #datatools #azuresql
https://techcommunity.microsoft.com/t5/sql-server-blog/announcing-ssms-20-2-and-getting-feedback-for-ssms-21/ba-p/4187034

I am so happy with the first own web application 🎉 I have developed: Tris, a simple and free web crawler 🕸️ 🕷️ !

You can try it for free online: https://tris.fly.dev, limited to 3 parallel crawls and 100 links of path depth of 3.

Next thing I will add will be a text input to set a target domain hhh, now I am making it hard! 🙈

#node #nodejs #web #webcrawler #crawler #seo #datatools #webscraper #scraping #seotools #seotool #tris #triswebcrawler #webapp #indie #indiedev

I am so happy with the first own web application 🎉 I have developed: Tris, a simple and free web crawler 🕸️ 🕷️ !

You can try it for free online: https://tris.fly.dev, limited to 3 parallel crawls and 100 links of path depth of 3.

Next thing I will add will be a text input to set a target domain hhh, now I am making it hard! 🙈

#node #nodejs #web #webcrawler #crawler #seo #datatools #webscraper #scraping #seotools #seotool #tris #triswebcrawler #webapp #indie #indiedev

Our #DataPreview 🈸 extension recently crossed 500,000 installs in Visual Studio Code Marketplace.

We plan to release Data Preview Pro version with large data files support, new Prospective Data Viewer and better support of Arrow and Parquet data files next year for our Pro Sponsors on GitHub.

Meanwhile, try our older open source version from GitHub or VS Code Marketplace:

📰 https://github.com/RandomFractals/vscode-data-preview

📥 https://marketplace.visualstudio.com/items?itemName=RandomFractalsInc.vscode-data-preview

#VSCode #DataTools 🛠️ / #ProDataTools 🧙 ...

Our #DataPreview 🈸 extension recently crossed 500,000 installs in Visual Studio Code Marketplace.

We plan to release Data Preview Pro version with large data files support, new Prospective Data Viewer and better support of Arrow and Parquet data files next year for our Pro Sponsors on GitHub.

Meanwhile, try our older open source version from GitHub or VS Code Marketplace:

📰 https://github.com/RandomFractals/vscode-data-preview

📥 https://marketplace.visualstudio.com/items?itemName=RandomFractalsInc.vscode-data-preview

#VSCode #DataTools 🛠️ / #ProDataTools 🧙 ...

Started working on new #PGSqlTools plugin this month.

Similar to our #DuckDBPro and #SQLitePro #DataTools 🛠️ this extension will display all #Postgres DB objects in Connections Explorer, provide information schema, system catalogs and other standard PG view shortcut commands for Postgres, Cockroach and many other #pgwire compatible databases.

Aiming to support most of the popular PostgreSQL flavor databases from this list: https://wiki.postgresql.org/wiki/PostgreSQL_derived_databases

#VSCode #PostgreSQL #SQLTools #ProDataTools 🧙

Started working on new #PGSqlTools plugin this month.

Similar to our #DuckDBPro and #SQLitePro #DataTools 🛠️ this extension will display all #Postgres DB objects in Connections Explorer, provide information schema, system catalogs and other standard PG view shortcut commands for Postgres, Cockroach and many other #pgwire compatible databases.

Aiming to support most of the popular PostgreSQL flavor databases from this list: https://wiki.postgresql.org/wiki/PostgreSQL_derived_databases

#VSCode #PostgreSQL #SQLTools #ProDataTools 🧙

Proposed this for new #SQLTools feature in #VSCode today:

#SQL / #DataTools 🛠️ ...

https://github.com/mtxr/vscode-sqltools/issues/1239

Proposed this for new #SQLTools feature in #VSCode today:

#SQL / #DataTools 🛠️ ...

https://github.com/mtxr/vscode-sqltools/issues/1239

📢 We just released #DuckDBSqlTools v1.3.0 for #VSCode IDE with the latest #DuckDB v0.9.1 support.

📥 https://marketplace.visualstudio.com/items?itemName=RandomFractalsInc.duckdb-sql-tools

#SQL / #DataTools 🛠️

📢 We just released #DuckDBSqlTools v1.3.0 for #VSCode IDE with the latest #DuckDB v0.9.1 support.

📥 https://marketplace.visualstudio.com/items?itemName=RandomFractalsInc.duckdb-sql-tools

#SQL / #DataTools 🛠️

#DuckDB devs & users, we just hit 5K installs & over 7.6K downloads of our free & public #DuckDBSQLTools extension for #VSCode IDE.

DuckDB Labs & co. should just buy that extension to get more traction in the #DataTools field with #SQLTools devs, data scientists, data analysts, and other users using & exploring their DB in Code 😉

📥 https://marketplace.visualstudio.com/items?itemName=RandomFractalsInc.duckdb-sql-tools

#DuckDBTools 🛠️ #ProDataTools 🧙‍♀️ ...

#DuckDB devs & users, we just hit 5K installs & over 7.6K downloads of our free & public #DuckDBSQLTools extension for #VSCode IDE.

DuckDB Labs & co. should just buy that extension to get more traction in the #DataTools field with #SQLTools devs, data scientists, data analysts, and other users using & exploring their DB in Code 😉

📥 https://marketplace.visualstudio.com/items?itemName=RandomFractalsInc.duckdb-sql-tools

#DuckDBTools 🛠️ #ProDataTools 🧙‍♀️ ...

Next up in #DataTools for #VSCode IDE ... #QuestDB? TBD 🤔

Next up in #DataTools for #VSCode IDE ... #QuestDB? TBD 🤔

Our #DataTableRenderers 🈸 / 🈷️ for #VSCode Notebooks 📚 recently crossed 67K installs and 100K downloads. Thanks to all the devs and data scientists using them to view tabular data outputs and data summaries in Jupyter notebooks! 🤗

📥 https://marketplace.visualstudio.com/items?itemName=RandomFractalsInc.vscode-data-table

Sponsor our #DataTools 🛠️ work on GitHub, and sign up for our Pro sponsor tier to get notified about new #DataNotebook 📓 Pro Tools coming to VS Code IDE soon:

✍️ https://github.com/RandomFractals/pro-data-tools#data-notebook-pro-tools

#DataTable 中 / #DataNotebooks 📚 / #ProDataTools 🧙 ...

Our #DataTableRenderers 🈸 / 🈷️ for #VSCode Notebooks 📚 recently crossed 67K installs and 100K downloads. Thanks to all the devs and data scientists using them to view tabular data outputs and data summaries in Jupyter notebooks! 🤗

📥 https://marketplace.visualstudio.com/items?itemName=RandomFractalsInc.vscode-data-table

Sponsor our #DataTools 🛠️ work on GitHub, and sign up for our Pro sponsor tier to get notified about new #DataNotebook 📓 Pro Tools coming to VS Code IDE soon:

✍️ https://github.com/RandomFractals/pro-data-tools#data-notebook-pro-tools

#DataTable 中 / #DataNotebooks 📚 / #ProDataTools 🧙 ...

If you are still looking for some good simple #DataViewers to use in #VSCode IDE, try our #RandomFractalsInc viewers and #DataTools 🛠️ from the top row of tiles and extensions in VS Code marketplace search results for #DataViewer:

📰 https://marketplace.visualstudio.com/search?term=data%20viewer&target=VSCode&category=All%20categories&sortBy=Relevance

Use them for local and remote data preview 🈸, maps 🗺️, graphs 📈📊, tabular data display of flat data files and dataframes in Jupyter notebooks 📚.

#ProDataTools 🧙‍♂️ ...

If you are still looking for some good simple #DataViewers to use in #VSCode IDE, try our #RandomFractalsInc viewers and #DataTools 🛠️ from the top row of tiles and extensions in VS Code marketplace search results for #DataViewer:

📰 https://marketplace.visualstudio.com/search?term=data%20viewer&target=VSCode&category=All%20categories&sortBy=Relevance

Use them for local and remote data preview 🈸, maps 🗺️, graphs 📈📊, tabular data display of flat data files and dataframes in Jupyter notebooks 📚.

#ProDataTools 🧙‍♂️ ...

For all the brave devs & #devCrews into building nifty #dataTools 🛠️ out there 😉 ...

Our #RandomFractalsInc works on @github circa October 2023 🤗

💖 https://github.com/RandomFractals

#RandomFractals #dataTools 🧙‍♂️ ...

For all the brave devs & #devCrews into building nifty #dataTools 🛠️ out there 😉 ...

Our #RandomFractalsInc works on @github circa October 2023 🤗

💖 https://github.com/RandomFractals

#RandomFractals #dataTools 🧙‍♂️ ...

We also wonder why 🤫. Maybe @OpenAtMicrosoft should open source their #DataWrangler if they want to compete with our dated OSS #dataTools 🛠️ in #VSCode and other 3rd party extensions that outrank them 🤗

🧐 https://github.com/microsoft/vscode-data-wrangler/issues/92

Gonna try to wrap up and release #DataNotebookPro 📓 #VSCode / #SQLTools extension this month for our #ProDataTools 🛠️ sponsors on GitHub ...

📰 https://github.com/RandomFractals/pro-data-tools#data-notebook-pro-tools

#DataNotebooks 📚 / #DataTools 🧙‍♂️ ...

A few remaining #ObservableJS 📓 to #Quarto doc conversion & docs tickets in our old Observable #DataTools 🛠️ repo to guide data analysts and data scientists exploring that space and tools ecosystem on how to use them in #VSCode IDE ...

📰 https://github.com/RandomFractals/observable-data-tools/issues

#DataNotebooks 📚