#opendal — Public Fediverse posts

New Blog Post Published.

How to Condense 800 Integration Tests into 80, Losslessly?

In this post, I'll share how I condense the extensive integration test matrix in #OpenDAL from `O(T * S * C)` into a linear `O(T + S + C)` without losing any coverage.

https://xuanwo.io/2024/03-how-to-condense-800-integration-tests-into-80-losslessly/

New Blog Post Published.

Why SQL hang for exactly 940s? TCP and Async Rust!

I debugged an issue that Databend SQL could hang for 940s during #OpenDAL reads. I gained a lot of insight into TCP and Async Rust in the process. Feel free to take a look!

https://xuanwo.io/2024/01-why-sql-hang-for-exactly-940s/

We've adjusted the schedule of #OpenDAL Community Sync to include two sessions:

- one at 9:00 AM UTC+8 on Friday
- another at 7:00 PM UTC+8 on Friday.

I expect this will make it more convenient for contributors to attend at least every six weeks.

@zhenboli The GHA Cache logic is implemented in #OpenDAL, but it stores each cache separately to better comply with GitHub's rate limit. I'm not sure if it suitable for big cache.

@zhenboli The GHA Cache logic is implemented in #OpenDAL, but it stores each cache separately to better comply with GitHub's rate limit. I'm not sure if it suitable for big cache.

@xuanwo

I have a question about your work #sccache and #OpenDAL.

To determine if the file is cached in GitHub Action[1], the logic is implemented in sccache or opendal?

My X Problem[2]: I want to cache #Nix within #GitHubAction. AFAIK, current solutions (https://github.com/nix-community/cache-nix-action) will consider `/nix` as a whole object, causing "Caches are isolated between branches". Besides, the cost of downloading a big cache is not negligible.

[1]: https://xuanwo.io/reports/2023-04/sccache.png
[2]: https://en.wikipedia.org/wiki/XY_problem

@xuanwo

I have a question about your work #sccache and #OpenDAL.

To determine if the file is cached in GitHub Action[1], the logic is implemented in sccache or opendal?

My X Problem[2]: I want to cache #Nix within #GitHubAction. AFAIK, current solutions (https://github.com/nix-community/cache-nix-action) will consider `/nix` as a whole object, causing "Caches are isolated between branches". Besides, the cost of downloading a big cache is not negligible.

[1]: https://xuanwo.io/reports/2023-04/sccache.png
[2]: https://en.wikipedia.org/wiki/XY_problem

#OpenDAL Community Sync (testing) is scheduled for 2:00 PM on September 1st, UTC+8

I'm very excited about this meeting and I hope to see you there!

More details: https://lists.apache.org/thread/1vgoq71nw73qxhh05j7tsb2dg36v0d80

I feel incredibly happy when my project #OpenDAL been acknowledged.

I'm building somthing interesting like #OpenDAL + #postgresql

If you have a #Rust project and want to develop bindings for other languages but don't know how to get started, take a look at how #OpenDAL did it. The community's black hands have already reached out to #OCaml 🤣

https://github.com/apache/incubator-opendal/pull/2757

#OpenDAL is currently working on a Fuzzing Test led by @dqhl76. This test is very impressive and will greatly improve the stability of OpenDAL.

We plan to first add it in OpenDAL and then integrate it with OSS-Fuzz for continuous fuzzing. Stay tuned!

https://github.com/apache/incubator-opendal/pull/2710

#OpenDAL now has #etcd support! I don't know the use case yet, but it seems interesting 🤣

https://github.com/apache/incubator-opendal/pull/2672

I learned a lot from the #Iceberg community about maintaining an open source community. I hope to improve some aspects of the #OpenDAL community!

@ownclouders All of them are using #OpenDAL WebDAV service support.

#OpenDAL has established integration tests with @ownclouders, providing our users with increased confidence when connecting to #OwnCloud. 😘

https://github.com/apache/incubator-opendal/pull/2659

#OpenDAL now includes integration tests for the #WebDAV service with @Nextclouders which means that our users can confidently use OpenDAL to access data stored in Nextcloud.🥰

https://github.com/apache/incubator-opendal/pull/2631

I'm happy that #OpenDAL will soon have a new committer! 🤩

#OpenDAL setup a new integration tests with #Kvrocks 🤣

https://github.com/apache/incubator-opendal/pull/2613

#Azure is too enterprise-level.

In order to figure out how to set up an App for #OpenDAL test, I registered four or five Apps just to debug different parameters. During this process, I encountered various strange problems such as "Tenant does not have a SPO license".

It is interesting to see that #OpenDAL can read and write data in #Dropbox.