#kedro — Public Fediverse posts

In the pipeline: July 2024 edition! 🔶

This month we review the latest releases across the Kedro ecosystem, celebrate the PyData London workshop delivered by two TSC members, and much more.

Will you be at EuroPython in Prague next week? Don't miss Juan Luis' workshop about MLOps! (And follow @europython)

Full blog post:

https://kedro.org/blog/in-the-pipeline-kedro-news-07-24

#kedro #python #pydata #datascience #mlops #kedroviz #datapipelines #europython #EuroPython2024

In the pipeline: July 2024 edition! 🔶

This month we review the latest releases across the Kedro ecosystem, celebrate the PyData London workshop delivered by two TSC members, and much more.

Will you be at EuroPython in Prague next week? Don't miss Juan Luis' workshop about MLOps! (And follow @europython)

Full blog post:

https://kedro.org/blog/in-the-pipeline-kedro-news-07-24

#kedro #python #pydata #datascience #mlops #kedroviz #datapipelines #europython #EuroPython2024

In the pipeline: May 2024 edition! 🔶

This month we published several releases across the Kedro ecosystem, got featured in O'Reilly's new book "Software Engineering for Data Scientists", published more videos in our YouTube channel, and got accepted at several Python conferences.

Are you at @pycon? Don't miss Juliana Ferreira's talk about Kedro!

Full blog post:

https://kedro.org/blog/in-the-pipeline-kedro-news-05-24

#kedro #python #pydata #datascience #mlops #kedroviz #datapipelines

In the pipeline: May 2024 edition! 🔶

This month we published several releases across the Kedro ecosystem, got featured in O'Reilly's new book "Software Engineering for Data Scientists", published more videos in our YouTube channel, and got accepted at several Python conferences.

Are you at @pycon? Don't miss Juliana Ferreira's talk about Kedro!

Full blog post:

https://kedro.org/blog/in-the-pipeline-kedro-news-05-24

#kedro #python #pydata #datascience #mlops #kedroviz #datapipelines

"In the pipeline", March 2024 edition https://kedro.org/blog/in-the-pipeline-kedro-news-03-24

#kedro #kedroviz #python #pydata #datascience #mlops

"In the pipeline", March 2024 edition https://kedro.org/blog/in-the-pipeline-kedro-news-03-24

#kedro #kedroviz #python #pydata #datascience #mlops

New edition of our monthly "In the pipeline" post 🔶

From the latest news to upcoming events and interesting topics, “In the Pipeline” is overflowing with updates for the Kedro community.

This month we look back on our recent releases, spread the news about our upcoming workshop at #AMLDEPFL2024, and share with you a new video by @astrojuanlu that covers what's new in Kedro 0.19 🔥

https://youtu.be/f_KSUBLO3a4?si=6H8efy8LjAeM5irx

(Link to blog post in thread)

#kedro #kedroviz #python #pydata #datascience #mlops

New edition of our monthly "In the pipeline" post 🔶

From the latest news to upcoming events and interesting topics, “In the Pipeline” is overflowing with updates for the Kedro community.

This month we look back on our recent releases, spread the news about our upcoming workshop at #AMLDEPFL2024, and share with you a new video by @astrojuanlu that covers what's new in Kedro 0.19 🔥

https://youtu.be/f_KSUBLO3a4?si=6H8efy8LjAeM5irx

(Link to blog post in thread)

#kedro #kedroviz #python #pydata #datascience #mlops

This version also includes other improvements such as a reworked mechanism for adding previews to your datasets, compatibility with Pydantic V2, and
a number of bug fixes.

Let us know what you think!

#kedro #kedroviz #python #pydata #datascience #mlops

This version also includes other improvements such as a reworked mechanism for adding previews to your datasets, compatibility with Pydantic V2, and
a number of bug fixes.

Let us know what you think!

#kedro #kedroviz #python #pydata #datascience #mlops

More releases: Kedro-Viz 8.0 is out! 🔶

The new version adds more officially supported platforms for our Publish & Share functionality, this time Azure and Google Cloud Platform. This feature enables you to hare your pipeline visualisation with other users, without the need for them to install Kedro-Viz. Detailed instructions are available in our documentation:

https://docs.kedro.org/projects/kedro-viz/en/stable/share_kedro_viz.html

#kedro #python #pydata #kedroviz #datascience #mlops

More releases: Kedro-Viz 8.0 is out! 🔶

The new version adds more officially supported platforms for our Publish & Share functionality, this time Azure and Google Cloud Platform. This feature enables you to hare your pipeline visualisation with other users, without the need for them to install Kedro-Viz. Detailed instructions are available in our documentation:

https://docs.kedro.org/projects/kedro-viz/en/stable/share_kedro_viz.html

#kedro #python #pydata #kedroviz #datascience #mlops

Today Juan Luis Cano Rodríguez from QuantumBlack, AI by McKinsey will give a workshop at PyData Global titled "Who needs ChatGPT? Rock solid AI pipelines with Hugging Face and Kedro" in which attendees will learn how to create a complex AI pipeline using Hugging Face transformers and turn it into a Kedro project that cleanly separates code from configuration and data.

Tune in at 16:00 UTC! https://global2023.pydata.org/cfp/talk/NFZDPN/

#python #pydata #pydataglobal #pydataglobal2023 #kedro #huggingface #aipipelines

Today Juan Luis Cano Rodríguez from QuantumBlack, AI by McKinsey will give a workshop at PyData Global titled "Who needs ChatGPT? Rock solid AI pipelines with Hugging Face and Kedro" in which attendees will learn how to create a complex AI pipeline using Hugging Face transformers and turn it into a Kedro project that cleanly separates code from configuration and data.

Tune in at 16:00 UTC! https://global2023.pydata.org/cfp/talk/NFZDPN/

#python #pydata #pydataglobal #pydataglobal2023 #kedro #huggingface #aipipelines

Today Juan Luis Cano Rodríguez from QuantumBlack, AI by McKinsey will give a workshop at PyData Global titled "Who needs ChatGPT? Rock solid AI pipelines with Hugging Face and Kedro" in which attendees will learn how to create a complex AI pipeline using Hugging Face transformers and turn it into a Kedro project that cleanly separates code from configuration and data.

Tune in at 16:00 UTC! https://global2023.pydata.org/cfp/talk/NFZDPN/

#python #pydata #pydataglobal #pydataglobal2023 #kedro #huggingface #aipipelines

Today Juan Luis Cano Rodríguez from QuantumBlack, AI by McKinsey will give a workshop at PyData Global titled "Who needs ChatGPT? Rock solid AI pipelines with Hugging Face and Kedro" in which attendees will learn how to create a complex AI pipeline using Hugging Face transformers and turn it into a Kedro project that cleanly separates code from configuration and data.

Tune in at 16:00 UTC! https://global2023.pydata.org/cfp/talk/NFZDPN/

#python #pydata #pydataglobal #pydataglobal2023 #kedro #huggingface #aipipelines

Today Juan Luis Cano Rodríguez from QuantumBlack, AI by McKinsey will give a workshop at PyData Global titled "Who needs ChatGPT? Rock solid AI pipelines with Hugging Face and Kedro" in which attendees will learn how to create a complex AI pipeline using Hugging Face transformers and turn it into a Kedro project that cleanly separates code from configuration and data.

Tune in at 16:00 UTC! https://global2023.pydata.org/cfp/talk/NFZDPN/

#python #pydata #pydataglobal #pydataglobal2023 #kedro #huggingface #aipipelines

Big announcement: our 3 hour video introduction to Kedro is live! 🔥 https://youtube.com/playlist?list=PL-JJgymPjK5LddZXbIzp9LWurkLGgB-nY&si=EED0GXyBPxP5osUT

The course covers an introduction to what Kedro is, a walkthrough of the Spaceflights tutorial using both Jupyter Notebook and VSCode, new stuff in Kedro 0.18 like dataset factories and the OmegaConfigLoader, how to use S3 and MinIO for your filepaths, and how to deploy Kedro to a Docker image or Airflow.

We hope you enjoy it! 🔶

#python #pydata #datascience #datapipelines #kedro #kedroviz

Big announcement: our 3 hour video introduction to Kedro is live! 🔥 https://youtube.com/playlist?list=PL-JJgymPjK5LddZXbIzp9LWurkLGgB-nY&si=EED0GXyBPxP5osUT

The course covers an introduction to what Kedro is, a walkthrough of the Spaceflights tutorial using both Jupyter Notebook and VSCode, new stuff in Kedro 0.18 like dataset factories and the OmegaConfigLoader, how to use S3 and MinIO for your filepaths, and how to deploy Kedro to a Docker image or Airflow.

We hope you enjoy it! 🔶

#python #pydata #datascience #datapipelines #kedro #kedroviz

Kedro-Viz 6.7.0 is out! 🔶

This release allows you to run Kedro-Viz on a URL subpath and anticipates a breaking change in the CLI by adding a deprecation warning. We also fixed a couple of bugs related to experiment tracking and the shareable URL modal.

Install Kedro-Viz now with pip or conda:

```
pip install kedro-viz==6.6.0
conda install -c conda-forge kedro-viz=6.6.0
```

#kedro #kedroviz #dataviz #pydata #datascience

Kedro-Viz 6.7.0 is out! 🔶

This release allows you to run Kedro-Viz on a URL subpath and anticipates a breaking change in the CLI by adding a deprecation warning. We also fixed a couple of bugs related to experiment tracking and the shareable URL modal.

Install Kedro-Viz now with pip or conda:

```
pip install kedro-viz==6.6.0
conda install -c conda-forge kedro-viz=6.6.0
```

#kedro #kedroviz #dataviz #pydata #datascience

In the Pipeline: November 2023 edition! 🔶

This month: New releases across the board, upcoming removals in Kedro 0.19, a successful #Hacktoberfest, meet our Kedroid of the month, Kedro at #PyConES23 and #UbuntuSummit2023, and more!

https://kedro.org/blog/in-the-pipeline-kedro-news-11-23

#kedro #python #pydata #datascience

In the Pipeline: November 2023 edition! 🔶

This month: New releases across the board, upcoming removals in Kedro 0.19, a successful #Hacktoberfest, meet our Kedroid of the month, Kedro at #PyConES23 and #UbuntuSummit2023, and more!

https://kedro.org/blog/in-the-pipeline-kedro-news-11-23

#kedro #python #pydata #datascience

Kedro-Viz 6.6.1 is out! 🔶

Optional plugins are now skipped when running Kedro-Viz, and we fixed a couple of compatibility bugs.

Install Kedro-Viz now with pip or conda:

```
pip install kedro-viz==6.6.0
conda install -c conda-forge kedro-viz=6.6.0
```

#kedro #kedroviz #dataviz #pydata #datascience

Kedro-Viz 6.6.1 is out! 🔶

Optional plugins are now skipped when running Kedro-Viz, and we fixed a couple of compatibility bugs.

Install Kedro-Viz now with pip or conda:

```
pip install kedro-viz==6.6.0
conda install -c conda-forge kedro-viz=6.6.0
```

#kedro #kedroviz #dataviz #pydata #datascience

Our colleague Nero Okwa has recorded some videos on how to get started with Kedro Viz 🔶

Check them out! https://youtu.be/08MvSbw75us?si=yC7QcwlNFI5-25h8

#kedro #kedroviz #dataviz #datapipelines #datascience #python #pydata

Our colleague Nero Okwa has recorded some videos on how to get started with Kedro Viz 🔶

Check them out! https://youtu.be/08MvSbw75us?si=yC7QcwlNFI5-25h8

#kedro #kedroviz #dataviz #datapipelines #datascience #python #pydata

Kedro-Viz 6.6.0 is out! 🔶

You can now publish and share your Kedro-Viz project on Amazon S3! Check out the docs at https://docs.kedro.org/en/latest/visualisation/share_kedro_viz.html

Install Kedro-Viz now with pip or conda:

```
pip install kedro-viz==6.6.0
conda install -c conda-forge kedro-viz=6.6.0
```

#kedro #kedroviz #dataviz #pydata #datascience

Kedro-Viz 6.6.0 is out! 🔶

You can now publish and share your Kedro-Viz project on Amazon S3! Check out the docs at https://docs.kedro.org/en/latest/visualisation/share_kedro_viz.html

Install Kedro-Viz now with pip or conda:

```
pip install kedro-viz==6.6.0
conda install -c conda-forge kedro-viz=6.6.0
```

#kedro #kedroviz #dataviz #pydata #datascience

As the shadows of Halloween draw near, Kedro is calling you to join us in celebrating Hacktoberfest! We need your help to vanquish some ghastly bugs, compose some spine-chilling documentation and create some eerie examples.

Take a look at https://github.com/kedro-org/kedro/issues/3130 to learn how you can contribute and become a Kedroid. Let's get coding and make this Halloween one to remember!

#hacktoberfest #hacktoberfest23 #hacktoberfest2023 #kedro #python #opensource #pydata #datascience

As the shadows of Halloween draw near, Kedro is calling you to join us in celebrating Hacktoberfest! We need your help to vanquish some ghastly bugs, compose some spine-chilling documentation and create some eerie examples.

Take a look at https://github.com/kedro-org/kedro/issues/3130 to learn how you can contribute and become a Kedroid. Let's get coding and make this Halloween one to remember!

#hacktoberfest #hacktoberfest23 #hacktoberfest2023 #kedro #python #opensource #pydata #datascience

Kedro is participating in Hacktoberfest 2023! Prepare your pull requests 👩‍💻

#kedro #python #pydata #hacktoberfest #hacktoberfest23 #hacktoberfest2023 cc @hacktoberfest

Kedro is participating in Hacktoberfest 2023! Prepare your pull requests 👩‍💻

#kedro #python #pydata #hacktoberfest #hacktoberfest23 #hacktoberfest2023 cc @hacktoberfest

More exciting news today!

`kedro-pandera` is a new community plugin that brings data validation to your Kedro projects 🔶

With it, you can

📝 declare data schemas to your kedro datasets
🧪 add data tests
🤡 run test pipeline with fake data

and more!

Install it with `pip install kedro-pandera` and give the repository a star ⭐️

https://github.com/Galileo-Galilei/kedro-pandera

Thanks @Galileo-Galilei for creating it!

#kedro #pandera #pydata #python #data #datascience

More exciting news today!

`kedro-pandera` is a new community plugin that brings data validation to your Kedro projects 🔶

With it, you can

📝 declare data schemas to your kedro datasets
🧪 add data tests
🤡 run test pipeline with fake data

and more!

Install it with `pip install kedro-pandera` and give the repository a star ⭐️

https://github.com/Galileo-Galilei/kedro-pandera

Thanks @Galileo-Galilei for creating it!

#kedro #pandera #pydata #python #data #datascience

And one more release! Kedro-Viz 6.5.0 is available 🔶 and adds official Python 3.11 support as well, along with some small bug fixes.

Install Kedro-Viz now with pip or conda:

```
pip install kedro-viz==6.5.0
conda install -c conda-forge kedro-viz=6.5.0
```

#kedro #kedroviz #dataviz #pydata #datascience

And one more release! Kedro-Viz 6.5.0 is available 🔶 and adds official Python 3.11 support as well, along with some small bug fixes.

Install Kedro-Viz now with pip or conda:

```
pip install kedro-viz==6.5.0
conda install -c conda-forge kedro-viz=6.5.0
```

#kedro #kedroviz #dataviz #pydata #datascience

New blog post: How to integrate Kedro and Databricks Connect 🔶

In this blog post, our colleague Diego Lira explains how to use Databricks Connect with Kedro for a development experience that works completely inside an IDE.

https://kedro.org/blog/how-to-integrate-kedro-and-databricks-connect

Install it with

```
pip install databricks-connect
```

#kedro #python #pydata #datascience #databricks #dbx #spark #pyspark

New blog post: How to integrate Kedro and Databricks Connect 🔶

In this blog post, our colleague Diego Lira explains how to use Databricks Connect with Kedro for a development experience that works completely inside an IDE.

https://kedro.org/blog/how-to-integrate-kedro-and-databricks-connect

Install it with

```
pip install databricks-connect
```

#kedro #python #pydata #datascience #databricks #dbx #spark #pyspark

Our colleague @astrojuanlu will be at #PyConEstonia2023 in September leading a workshop titled "Refactor your Jupyter notebooks into maintainable data science code with Kedro"

Don't miss it! https://pycon.ee/

#python #kedro #pydata #datascience #jupyter

Our colleague @astrojuanlu will be at #PyConEstonia2023 in September leading a workshop titled "Refactor your Jupyter notebooks into maintainable data science code with Kedro"

Don't miss it! https://pycon.ee/

#python #kedro #pydata #datascience #jupyter

Kedro-Viz 6.3.2 is out! 🔶

We added support for dataset previews and validation for layers in transcoding datasets. In addition, Viz now shows original node input and output names in the metadata panel, and we fixed a number of small issues.

Install it now for Python or JavaScript:

```
pip install kedro-viz==6.3.2
npm install @quantumblack/kedro-viz@latest
```

And check out the online demo! https://demo.kedro.org/

#kedro #kedroviz #pydata #python #datascience #machinelearning #dataviz

Kedro-Viz 6.3.2 is out! 🔶

We added support for dataset previews and validation for layers in transcoding datasets. In addition, Viz now shows original node input and output names in the metadata panel, and we fixed a number of small issues.

Install it now for Python or JavaScript:

```
pip install kedro-viz==6.3.2
npm install @quantumblack/kedro-viz@latest
```

And check out the online demo! https://demo.kedro.org/

#kedro #kedroviz #pydata #python #datascience #machinelearning #dataviz

New blog post: How to build a custom Kedro runner 🔶

In this post our colleague Nok Lam Chan explains how to write an efficient custom Kedro pipeline runner that continues executing a set of nodes after encountering non-catastrophic failure points.

https://kedro.org/blog/build-a-custom-kedro-runner

#kedro #kedroviz #MachineLearning #datapipelines #python #PyData

New blog post: How to build a custom Kedro runner 🔶

In this post our colleague Nok Lam Chan explains how to write an efficient custom Kedro pipeline runner that continues executing a set of nodes after encountering non-catastrophic failure points.

https://kedro.org/blog/build-a-custom-kedro-runner

#kedro #kedroviz #MachineLearning #datapipelines #python #PyData

This week we're celebrating our 4th anniversary as an open source project! 🥳🎂4️⃣

In this blog post we go over the history of the project, from its inception as an internal library at QuantumBlack, AI by McKinsey , to its open sourcing in June 2019, then its donation to LF AI & Data Foundation in January 2022, and finally its new branding just a few weeks ago in June 2023.

https://kedro.org/blog/kedro-celebrates-4-years-open-source?utm_medium=referral&utm_source=mastodon

#kedro #kedroviz #python #datascience #opensource #pydata

This week we're celebrating our 4th anniversary as an open source project! 🥳🎂4️⃣

In this blog post we go over the history of the project, from its inception as an internal library at QuantumBlack, AI by McKinsey , to its open sourcing in June 2019, then its donation to LF AI & Data Foundation in January 2022, and finally its new branding just a few weeks ago in June 2023.

https://kedro.org/blog/kedro-celebrates-4-years-open-source?utm_medium=referral&utm_source=mastodon

#kedro #kedroviz #python #datascience #opensource #pydata

Kedro 0.18.10 is out, along with a new branding!

We kept the iconic diamond shape but made it bolder and simpler. The Kedro logotype is bold and recognisable and, in lower case, is informal and friendly.

In the new release we have added variable interpolation in the catalog with the `OmegaConfigLoader`.

Read more about our new brand in our blog https://kedro.org/blog/a-striking-new-look-for-kedro

#kedro #kedroviz #python #pydata #datascience

Kedro 0.18.10 is out, along with a new branding!

We kept the iconic diamond shape but made it bolder and simpler. The Kedro logotype is bold and recognisable and, in lower case, is informal and friendly.

In the new release we have added variable interpolation in the catalog with the `OmegaConfigLoader`.

Read more about our new brand in our blog https://kedro.org/blog/a-striking-new-look-for-kedro

#kedro #kedroviz #python #pydata #datascience

New blog post: Collaborative experiment tracking in Kedro-Viz 🔶

This tutorial explains how to configure and use collaborative experiment tracking in Kedro-Viz 6.2.0 if your team needs to log and compare each others' experiments.

https://kedro.org/blog/collaborative-experiment-tracking-in-kedro-viz

#kedro #kedroviz #MachineLearning #experimenttracking