#chicagocrimes — Public Fediverse posts

Quick demo of our new #DuckDBSqlTools vscode extension loading and querying 7,687,725 #ChicagoCrimes recorded in 2001 through the end of November 2022 from a large 1.68 GB CSV data file in seconds ... See demo gif at:

📰 https://github.com/RandomFractals/chicago-crimes#with-duckdb-sql-tools

#DuckDB #SqlTools #VSCode #DataTools 💎💎💎

📢 New 2022 #ChicagoCrimes #MalloyData #Fiddle app you can run in a browser to learn Malloy model and query semantics, nesting, and simple charting 📊📈 options:

📰 https://randomfractals.github.io/chicago-crimes/apps/malloy-fiddle

📓 https://github.com/RandomFractals/chicago-crimes#with-malloy-fiddle

🧐 https://github.com/RandomFractals/chicago-crimes/blob/main/docs/images/chicago-crime-reports-malloy-fiddle-app.gif

#DAX #dataApps #dataTools 🔬 ...

Our #DataPreview 🈸 for #vscode now has over 350,000 installs. You can load large CSV files, sort & graph results with aggregate functions, and much more.

See an example of loading 48MB of #ChicagoCrimes CSV data: https://twitter.com/TarasNovak/status/1600439658810585088

Note: change data.preview.theme to light. See: https://github.com/RandomFractals/vscode-data-preview#configuration

📥 https://marketplace.visualstudio.com/items?itemName=RandomFractalsInc.vscode-data-preview

#dataViz 📊📈 #dataTools 🛠️ for #dataScientists ...

2001-2022 #ChicagoCrimes data loaded from a #parquet file and summarized with #pandas #dataFrames and simple #Altair charts 📊📈 in a #JupyterNotebook:

👀 https://github.com/RandomFractals/chicago-crimes/blob/main/docs/images/chicago-crimes-altair-charts-ipynb.gif

📓 https://github.com/RandomFractals/chicago-crimes/blob/main/notebooks/chicago-crimes-altair.ipynb

#dataNotebooks 📚 ...

Hey #dataNerds 🤓, good news:

#DuckDB v0.6.0 brings reading #CSV data on par with #PyArrow & #Polars and loads 1.66 GB of #ChicagoCrimes data in 1.9s with 12 cores/24 threads when experimental parallel CSV reader & unordered insertion are enabled.

🧐 https://github.com/RandomFractals/chicago-crimes#with-duckdb

#dataTools 🔬 ...

Updated #ChicagoCrimes with #MalloyData tools example & more info in docs:

🧐 https://github.com/RandomFractals/chicago-crimes#with-malloy-data

Clone that data repo & install Malloy #vscode extension to try it out:

📥 https://marketplace.visualstudio.com/items?itemName=malloydata.malloy-vscode

#dataTools 🔬 ...

I've decided to try #MalloyData today.

Here is a quick example of loading #ChicagoCrimes 2022 #parquetData with #DuckDB and Malloy queries for some rough counts and data summaries:

https://github.com/RandomFractals/chicago-crimes/issues/24

#dataTools 🛠️ ...