#kedro — Public Fediverse posts

kedro 0.19.11 adds `KedroDataCatalog.to_config()` that converts the catalog instance into a configuration format suitable for serialization, improves the performance of OmegaConfigLoader, and ships many bug fixes and quality-of-life improvements. #kedro #python #pydata #pipelines

New releases fresh from the oven, and some important announcements! 🔶 tl;dr: kedro 0.19.11, vscode-kedro 0.3.0, and kedro-viz 10.2.0 are out! And native Experiment Tracking is deprecated in favor of kedro-mlflow ⚠️ Read on 👇 #kedro #python #pydata #pipelines

vscode-kedro 0.3.0 adds support for custom project paths, ships smarter catalog validation using the LSP, and enables some toolbar controls in the Viz webview. #kedro #python #pydata #pipelines #vscode

In the coming days there will be 3️⃣ presentations about #Kedro from the team at QuantumBlack, AI by McKinsey: 👇 #python #mlops #pydata

New blog post ✍️ In the pipeline: October 2024! We cover the latest releases in the ecosystem (Kedro, our VS Code extension, Kedro-Viz), the talks Merel Theisen and Elena Khaustova, from QuantumBlack, have given recently, #Hacktoberfest 🎃 kedro.org/blog/in-the-... #kedro #mlops #pydata #python

In the pipeline: October 2024 ...

New video just dropped! 🎥 Watch how you can slice your Kedro pipeline on the CLI, but also with the new visual pipeline slice functionality of Kedro-Viz 10.0, released a few days ago 🔥 www.youtube.com/watch?v=NtqE... Remember to subscribe to our YouTube channel and hit the bell! 🔔 #kedro #mlops

Slice your Kedro pipelines fro...

It's that time of the year 🎃 become a Kedroid for #Hacktoberfest! 🔶 Get digital badges for your pull requests during the month of October. Read this issue for more information github.com/kedro-org/ke... and happy hacking! #kedro #hacktoberfest #opensource #python #mlops

Introducing a Kedro extension for VS Code! 🔶

We're excited to announce a Kedro extension for VS Code, which integrates Kedro projects with Visual Studio Code. It's designed to streamline your workflow and enhance your productivity with features such as enhanced code navigation and autocompletion.

Do you want to learn more? Watch Nok, the engineer who led the implementation, explain how it works:

https://youtu.be/hz17QtZCLMM

#python #kedro #mlops #vscode

@python_es Analizar datos con #Polars 🐻‍❄️ y #Kedro 🔶 https://github.com/astrojuanlu/kedro-pypi-monitor

In the pipeline: July 2024 edition! 🔶

This month we review the latest releases across the Kedro ecosystem, celebrate the PyData London workshop delivered by two TSC members, and much more.

Will you be at EuroPython in Prague next week? Don't miss Juan Luis' workshop about MLOps! (And follow @europython)

Full blog post:

https://kedro.org/blog/in-the-pipeline-kedro-news-07-24

#kedro #python #pydata #datascience #mlops #kedroviz #datapipelines #europython #EuroPython2024

Just delivered alongside my colleague Deepyaman a workshop on Ibis + Kedro 🔥

Materials here: https://github.com/ibis-project/kedro-ibis-tutorial

Also follow @kedro on Mastodon 🔶

#python #PyData #PyDataLondon #PyDataLondon2024 #kedro #ibis #duckdb

Just delivered alongside my colleague Deepyaman a workshop on Ibis + Kedro 🔥

Materials here: https://github.com/ibis-project/kedro-ibis-tutorial

Also follow @kedro on Mastodon 🔶

#python #PyData #PyDataLondon #PyDataLondon2024 #kedro #ibis #duckdb

Just delivered alongside my colleague Deepyaman a workshop on Ibis + Kedro 🔥

Materials here: https://github.com/ibis-project/kedro-ibis-tutorial

Also follow @kedro on Mastodon 🔶

#python #PyData #PyDataLondon #PyDataLondon2024 #kedro #ibis #duckdb

Just delivered alongside my colleague Deepyaman a workshop on Ibis + Kedro 🔥

Materials here: https://github.com/ibis-project/kedro-ibis-tutorial

Also follow @kedro on Mastodon 🔶

#python #PyData #PyDataLondon #PyDataLondon2024 #kedro #ibis #duckdb

Just delivered alongside my colleague Deepyaman a workshop on Ibis + Kedro 🔥

Materials here: https://github.com/ibis-project/kedro-ibis-tutorial

Also follow @kedro on Mastodon 🔶

#python #PyData #PyDataLondon #PyDataLondon2024 #kedro #ibis #duckdb

Today we're celebrating 🎂 5 years 🎂 as an open source project 🔶

#opensource #kedro #python #pydata #datascience

In the pipeline: May 2024 edition! 🔶

This month we published several releases across the Kedro ecosystem, got featured in O'Reilly's new book "Software Engineering for Data Scientists", published more videos in our YouTube channel, and got accepted at several Python conferences.

Are you at @pycon? Don't miss Juliana Ferreira's talk about Kedro!

Full blog post:

https://kedro.org/blog/in-the-pipeline-kedro-news-05-24

#kedro #python #pydata #datascience #mlops #kedroviz #datapipelines

New video! 🎬 Using the Kedro catalog like a pro https://youtu.be/4x-QOYf_ZsE

Like, subscribe, and hit the bell 🔔

#kedro #python #pydata #mlops

Get ready for #AMLDEPFL2024 ! 🔥

Join other AI & ML experts to find out the latest in the application of these technologies. We'll be hosting a workshop titled "Who Needs ChatGPT? Rock Solid AI Pipelines with Hugging Face and Kedro" 🔶 more info at ➡️

https://2024.appliedmldays.org/programme-live-1?coday=2024-03-24&embed=&dtFormat=d/m

And follow @amld!

#AMLD2024 #Kedro #python #mlops

"In the pipeline", March 2024 edition https://kedro.org/blog/in-the-pipeline-kedro-news-03-24

#kedro #kedroviz #python #pydata #datascience #mlops

New edition of our monthly "In the pipeline" post 🔶

From the latest news to upcoming events and interesting topics, “In the Pipeline” is overflowing with updates for the Kedro community.

This month we look back on our recent releases, spread the news about our upcoming workshop at #AMLDEPFL2024, and share with you a new video by @astrojuanlu that covers what's new in Kedro 0.19 🔥

https://youtu.be/f_KSUBLO3a4?si=6H8efy8LjAeM5irx

(Link to blog post in thread)

#kedro #kedroviz #python #pydata #datascience #mlops

This version also includes other improvements such as a reworked mechanism for adding previews to your datasets, compatibility with Pydantic V2, and
a number of bug fixes.

Let us know what you think!

#kedro #kedroviz #python #pydata #datascience #mlops

More releases: Kedro-Viz 8.0 is out! 🔶

The new version adds more officially supported platforms for our Publish & Share functionality, this time Azure and Google Cloud Platform. This feature enables you to hare your pipeline visualisation with other users, without the need for them to install Kedro-Viz. Detailed instructions are available in our documentation:

https://docs.kedro.org/projects/kedro-viz/en/stable/share_kedro_viz.html

#kedro #python #pydata #kedroviz #datascience #mlops

In addition, we also shipped a new MatlabDataset which uses SciPy to load and save .mat files, preview functionality for matplotlib, Plotly, and tracking datasets, support for additional parameters for sqlalchemy when using SQL datasets, and a number of bug fixes.

There is more cool stuff we want to tell you about in the coming days 🥁 Stay tuned!

#kedro

This has been release week for lots of Kedro packages 🎉 Including Kedro 0.19.3 and kedro-datasets 2.1.0! 📣

The main addition is the new %load_node line magic to load and debug nodes, compatible with IPython, Jupyter, VSCode, and Databricks. This means you can now prototype Kedro nodes faster in the notebook platform of your choice!

#kedro #python #pydata #datascience #mlops

It's release week 🥁 Stay tuned! #python #kedro

In the Pipeline: February 2024 edition! 🔶

This month: Recap on 0.19 releases, news from the TSC, talks at PyData Milan, and more!

https://kedro.org/blog/in-the-pipeline-kedro-news-02-24

#kedro #python #pydata #mlops

We're thrilled to announce that Kedro has been featured in DataCamp's list of top MLOps tools for 2023! 🌟 This recognition underscores Kedro's value as a vital workflow tool for data scientists, data engineers, and machine-learning engineers. A huge thank you to DataCamp for the recognition and to our vibrant community for your continued support and contributions!

https://www.datacamp.com/blog/top-mlops-tools

#Kedro #MLOps #DataScience #MachineLearning #DataCamp #python

New blog post: Building scalable data pipelines with Kedro and Ibis 🔶

Learn how to roll together the flexibility and familiarity of Python, the scale and performance of modern SQL, and software engineering best-practice using Kedro pipelines.

This blog post was written by Deepyaman Datta from Voltron Data.

https://kedro.org/blog/building-scalable-data-pipelines-with-kedro-and-ibis

#python #pydata #kedro #ibis #datascience

Kedro will be present at @amld! Check out the workshop "Who Needs ChatGPT? Rock Solid AI Pipelines with Hugging Face and Kedro" 🔶

#python #kedro #ai #huggingface #AMLDEPFL2024
#AMLD2024
#AI
#Innovation
#AMLDCommunity
#TechConference
#MachineLearning

https://mastodon.social/@amld/111766414359669472

New blog post: Exploring our new release: Kedro 0.19 🔶

We recently unleashed a new major release of Kedro containing a host of new features, bug fixes, and documentation improvements.

Check out our blog post about Kedro 0.19 to find out more about recent enhancements and improvements to Kedro. We’ll walk you through changes to configuration management, dataset loading and more.

Read on: https://kedro.org/blog/explore-kedro-0-19

#opensource #kedro #datascience #dataengineering #mlops #pydata #python

And remember, you can now watch our new video course to learn more about Kedro!

https://www.youtube.com/playlist?list=PL-JJgymPjK5LddZXbIzp9LWurkLGgB-nY

#kedro

Today Juan Luis Cano Rodríguez from QuantumBlack, AI by McKinsey will give a workshop at PyData Global titled "Who needs ChatGPT? Rock solid AI pipelines with Hugging Face and Kedro" in which attendees will learn how to create a complex AI pipeline using Hugging Face transformers and turn it into a Kedro project that cleanly separates code from configuration and data.

Tune in at 16:00 UTC! https://global2023.pydata.org/cfp/talk/NFZDPN/

#python #pydata #pydataglobal #pydataglobal2023 #kedro #huggingface #aipipelines

Big announcement: our 3 hour video introduction to Kedro is live! 🔥 https://youtube.com/playlist?list=PL-JJgymPjK5LddZXbIzp9LWurkLGgB-nY&si=EED0GXyBPxP5osUT

The course covers an introduction to what Kedro is, a walkthrough of the Spaceflights tutorial using both Jupyter Notebook and VSCode, new stuff in Kedro 0.18 like dataset factories and the OmegaConfigLoader, how to use S3 and MinIO for your filepaths, and how to deploy Kedro to a Docker image or Airflow.

We hope you enjoy it! 🔶

#python #pydata #datascience #datapipelines #kedro #kedroviz

Kedro-Viz 6.7.0 is out! 🔶

This release allows you to run Kedro-Viz on a URL subpath and anticipates a breaking change in the CLI by adding a deprecation warning. We also fixed a couple of bugs related to experiment tracking and the shareable URL modal.

Install Kedro-Viz now with pip or conda:

```
pip install kedro-viz==6.6.0
conda install -c conda-forge kedro-viz=6.6.0
```

#kedro #kedroviz #dataviz #pydata #datascience

In the Pipeline: November 2023 edition! 🔶

This month: New releases across the board, upcoming removals in Kedro 0.19, a successful #Hacktoberfest, meet our Kedroid of the month, Kedro at #PyConES23 and #UbuntuSummit2023, and more!

https://kedro.org/blog/in-the-pipeline-kedro-news-11-23

#kedro #python #pydata #datascience

Kedro-Viz 6.6.1 is out! 🔶

Optional plugins are now skipped when running Kedro-Viz, and we fixed a couple of compatibility bugs.

Install Kedro-Viz now with pip or conda:

```
pip install kedro-viz==6.6.0
conda install -c conda-forge kedro-viz=6.6.0
```

#kedro #kedroviz #dataviz #pydata #datascience

Our colleague Nero Okwa has recorded some videos on how to get started with Kedro Viz 🔶

Check them out! https://youtu.be/08MvSbw75us?si=yC7QcwlNFI5-25h8

#kedro #kedroviz #dataviz #datapipelines #datascience #python #pydata

Kedro-Viz 6.6.0 is out! 🔶

You can now publish and share your Kedro-Viz project on Amazon S3! Check out the docs at https://docs.kedro.org/en/latest/visualisation/share_kedro_viz.html

Install Kedro-Viz now with pip or conda:

```
pip install kedro-viz==6.6.0
conda install -c conda-forge kedro-viz=6.6.0
```

#kedro #kedroviz #dataviz #pydata #datascience

As the shadows of Halloween draw near, Kedro is calling you to join us in celebrating Hacktoberfest! We need your help to vanquish some ghastly bugs, compose some spine-chilling documentation and create some eerie examples.

Take a look at https://github.com/kedro-org/kedro/issues/3130 to learn how you can contribute and become a Kedroid. Let's get coding and make this Halloween one to remember!

#hacktoberfest #hacktoberfest23 #hacktoberfest2023 #kedro #python #opensource #pydata #datascience

Kedro is participating in Hacktoberfest 2023! Prepare your pull requests 👩‍💻

#kedro #python #pydata #hacktoberfest #hacktoberfest23 #hacktoberfest2023 cc @hacktoberfest

More exciting news today!

`kedro-pandera` is a new community plugin that brings data validation to your Kedro projects 🔶

With it, you can

📝 declare data schemas to your kedro datasets
🧪 add data tests
🤡 run test pipeline with fake data

and more!

Install it with `pip install kedro-pandera` and give the repository a star ⭐️

https://github.com/Galileo-Galilei/kedro-pandera

Thanks @Galileo-Galilei for creating it!

#kedro #pandera #pydata #python #data #datascience

And one more release! Kedro-Viz 6.5.0 is available 🔶 and adds official Python 3.11 support as well, along with some small bug fixes.

Install Kedro-Viz now with pip or conda:

```
pip install kedro-viz==6.5.0
conda install -c conda-forge kedro-viz=6.5.0
```

#kedro #kedroviz #dataviz #pydata #datascience

New blog post: How to integrate Kedro and Databricks Connect 🔶

In this blog post, our colleague Diego Lira explains how to use Databricks Connect with Kedro for a development experience that works completely inside an IDE.

https://kedro.org/blog/how-to-integrate-kedro-and-databricks-connect

Install it with

```
pip install databricks-connect
```

#kedro #python #pydata #datascience #databricks #dbx #spark #pyspark

Our colleague @astrojuanlu will be at #PyConEstonia2023 in September leading a workshop titled "Refactor your Jupyter notebooks into maintainable data science code with Kedro"

Don't miss it! https://pycon.ee/

#python #kedro #pydata #datascience #jupyter

Kedro-Viz 6.3.2 is out! 🔶

We added support for dataset previews and validation for layers in transcoding datasets. In addition, Viz now shows original node input and output names in the metadata panel, and we fixed a number of small issues.

Install it now for Python or JavaScript:

```
pip install kedro-viz==6.3.2
npm install @quantumblack/kedro-viz@latest
```

And check out the online demo! https://demo.kedro.org/

#kedro #kedroviz #pydata #python #datascience #machinelearning #dataviz

New blog post: How to build a custom Kedro runner 🔶

In this post our colleague Nok Lam Chan explains how to write an efficient custom Kedro pipeline runner that continues executing a set of nodes after encountering non-catastrophic failure points.

https://kedro.org/blog/build-a-custom-kedro-runner

#kedro #kedroviz #MachineLearning #datapipelines #python #PyData

This week we're celebrating our 4th anniversary as an open source project! 🥳🎂4️⃣

In this blog post we go over the history of the project, from its inception as an internal library at QuantumBlack, AI by McKinsey , to its open sourcing in June 2019, then its donation to LF AI & Data Foundation in January 2022, and finally its new branding just a few weeks ago in June 2023.

https://kedro.org/blog/kedro-celebrates-4-years-open-source?utm_medium=referral&utm_source=mastodon

#kedro #kedroviz #python #datascience #opensource #pydata

Kedro 0.18.10 is out, along with a new branding!

We kept the iconic diamond shape but made it bolder and simpler. The Kedro logotype is bold and recognisable and, in lower case, is informal and friendly.

In the new release we have added variable interpolation in the catalog with the `OmegaConfigLoader`.

Read more about our new brand in our blog https://kedro.org/blog/a-striking-new-look-for-kedro

#kedro #kedroviz #python #pydata #datascience

New blog post: Collaborative experiment tracking in Kedro-Viz 🔶

This tutorial explains how to configure and use collaborative experiment tracking in Kedro-Viz 6.2.0 if your team needs to log and compare each others' experiments.

https://kedro.org/blog/collaborative-experiment-tracking-in-kedro-viz

#kedro #kedroviz #MachineLearning #experimenttracking