#stormcrawler — Public Fediverse posts

And the vote is open for #StormCrawler #ApacheStormCrawler 3.2.0!

Many thanks to Richard Zowalla and team for helping me through the release process!

https://lists.apache.org/thread/2ftf254mdwks4llogxfb8w0qx5fj1qgh

And the vote is open for #StormCrawler #ApacheStormCrawler 3.2.0!

Many thanks to Richard Zowalla and team for helping me through the release process!

https://lists.apache.org/thread/2ftf254mdwks4llogxfb8w0qx5fj1qgh

And the vote is open for #StormCrawler #ApacheStormCrawler 3.2.0!

Many thanks to Richard Zowalla and team for helping me through the release process!

https://lists.apache.org/thread/2ftf254mdwks4llogxfb8w0qx5fj1qgh

And the vote is open for #StormCrawler #ApacheStormCrawler 3.2.0!

Many thanks to Richard Zowalla and team for helping me through the release process!

https://lists.apache.org/thread/2ftf254mdwks4llogxfb8w0qx5fj1qgh

And the vote is open for #StormCrawler #ApacheStormCrawler 3.2.0!

Many thanks to Richard Zowalla and team for helping me through the release process!

https://lists.apache.org/thread/2ftf254mdwks4llogxfb8w0qx5fj1qgh

#stormcrawler has now left the DigitalPebble organisation on GitHub on its way to Apache.
I am not going to lie, I am feeling something: I created SC more than 10 years ago and it became the focal point of my professional activities since.
I am also 100% convinced that it is the right move, at the right time and hope that being an ASF project will help its adoption by users and new contributors

#stormcrawler has now left the DigitalPebble organisation on GitHub on its way to Apache.
I am not going to lie, I am feeling something: I created SC more than 10 years ago and it became the focal point of my professional activities since.
I am also 100% convinced that it is the right move, at the right time and hope that being an ASF project will help its adoption by users and new contributors

#StormCrawler 2.11 is out!

https://github.com/DigitalPebble/storm-crawler/releases/tag/2.11

#StormCrawler 2.11 is out!

https://github.com/DigitalPebble/storm-crawler/releases/tag/2.11

#StormCrawler 2.11 is out!

https://github.com/DigitalPebble/storm-crawler/releases/tag/2.11

#StormCrawler 2.11 is out!

https://github.com/DigitalPebble/storm-crawler/releases/tag/2.11

#StormCrawler 2.11 is out!

https://github.com/DigitalPebble/storm-crawler/releases/tag/2.11

@jhy thanks! I'll give it a try and upgrade to it before releasing the next version of #StormCrawler

@jhy thanks! I'll give it a try and upgrade to it before releasing the next version of #StormCrawler

@jhy thanks! I'll give it a try and upgrade to it before releasing the next version of #StormCrawler

@jhy thanks! I'll give it a try and upgrade to it before releasing the next version of #StormCrawler

Meet the #StormCrawler users is back on our blog! We are delighted to share this Q&A with members of the OpenWebSearch.eu team. Come and read about their project and how they use both #StormCrawler and #URLFrontier to help deliver a truly open, transparent and legally compliant alternative to the big search engines.

#opensource #openwebsearch #opendata #innovation

https://digitalpebble.blogspot.com/2023/11/meet-stormcrawler-users-q-with-open-web.html

@openwebsearcheu

Meet the #StormCrawler users is back on our blog! We are delighted to share this Q&A with members of the OpenWebSearch.eu team. Come and read about their project and how they use both #StormCrawler and #URLFrontier to help deliver a truly open, transparent and legally compliant alternative to the big search engines.

#opensource #openwebsearch #opendata #innovation

https://digitalpebble.blogspot.com/2023/11/meet-stormcrawler-users-q-with-open-web.html

@openwebsearcheu

Meet the #StormCrawler users is back on our blog! We are delighted to share this Q&A with members of the OpenWebSearch.eu team. Come and read about their project and how they use both #StormCrawler and #URLFrontier to help deliver a truly open, transparent and legally compliant alternative to the big search engines.

#opensource #openwebsearch #opendata #innovation

https://digitalpebble.blogspot.com/2023/11/meet-stormcrawler-users-q-with-open-web.html

@openwebsearcheu

Meet the #StormCrawler users is back on our blog! We are delighted to share this Q&A with members of the OpenWebSearch.eu team. Come and read about their project and how they use both #StormCrawler and #URLFrontier to help deliver a truly open, transparent and legally compliant alternative to the big search engines.

#opensource #openwebsearch #opendata #innovation

https://digitalpebble.blogspot.com/2023/11/meet-stormcrawler-users-q-with-open-web.html

@openwebsearcheu

Meet the #StormCrawler users is back on our blog! We are delighted to share this Q&A with members of the OpenWebSearch.eu team. Come and read about their project and how they use both #StormCrawler and #URLFrontier to help deliver a truly open, transparent and legally compliant alternative to the big search engines.

#opensource #openwebsearch #opendata #innovation

https://digitalpebble.blogspot.com/2023/11/meet-stormcrawler-users-q-with-open-web.html

@openwebsearcheu

#StormCrawler 2.10 is out!

https://github.com/DigitalPebble/storm-crawler/releases/tag/2.10

We have also written a short blog detailing the improvements to the protocol implementations

https://digitalpebble.blogspot.com/2023/10/focus-on-protocol-improvements-in.html

#OpenSource #webcrawling

#StormCrawler 2.10 is out!

https://github.com/DigitalPebble/storm-crawler/releases/tag/2.10

We have also written a short blog detailing the improvements to the protocol implementations

https://digitalpebble.blogspot.com/2023/10/focus-on-protocol-improvements-in.html

#OpenSource #webcrawling

#StormCrawler 2.10 is out!

https://github.com/DigitalPebble/storm-crawler/releases/tag/2.10

We have also written a short blog detailing the improvements to the protocol implementations

https://digitalpebble.blogspot.com/2023/10/focus-on-protocol-improvements-in.html

#OpenSource #webcrawling

#StormCrawler 2.10 is out!

https://github.com/DigitalPebble/storm-crawler/releases/tag/2.10

We have also written a short blog detailing the improvements to the protocol implementations

https://digitalpebble.blogspot.com/2023/10/focus-on-protocol-improvements-in.html

#OpenSource #webcrawling

#StormCrawler 2.10 is out!

https://github.com/DigitalPebble/storm-crawler/releases/tag/2.10

We have also written a short blog detailing the improvements to the protocol implementations

https://digitalpebble.blogspot.com/2023/10/focus-on-protocol-improvements-in.html

#OpenSource #webcrawling

Really proud to see both #stormcrawler and #URLFrontier used by OWLer
#OSSYM23

Really proud to see both #stormcrawler and #URLFrontier used by OWLer
#OSSYM23

If you use #StormCrawler, it makes you an #ApacheStorm user.
Please help the project by filling the survey on https://terminplaner4.dfn.de/EYNJzD9U64UFGOGq

If you use #StormCrawler, it makes you an #ApacheStorm user.
Please help the project by filling the survey on https://terminplaner4.dfn.de/EYNJzD9U64UFGOGq

If you use #StormCrawler, it makes you an #ApacheStorm user.
Please help the project by filling the survey on https://terminplaner4.dfn.de/EYNJzD9U64UFGOGq

If you use #StormCrawler, it makes you an #ApacheStorm user.
Please help the project by filling the survey on https://terminplaner4.dfn.de/EYNJzD9U64UFGOGq

If you use #StormCrawler, it makes you an #ApacheStorm user.
Please help the project by filling the survey on https://terminplaner4.dfn.de/EYNJzD9U64UFGOGq

@tallison @OpenSearchProject
Or just use #StormCrawler ? :mastoinnocent:

@tallison @OpenSearchProject
Or just use #StormCrawler ? :mastoinnocent:

@tallison @OpenSearchProject
Or just use #StormCrawler ? :mastoinnocent:

@tallison @OpenSearchProject
Or just use #StormCrawler ? :mastoinnocent:

@digitalpebble sadly homegrown one off: https://github.com/tballison/file-observatory/tree/main/commoncrawl-fetcher

If I were to do it again, I’d use #ApacheNutch or #StormCrawler

@digitalpebble sadly homegrown one off: https://github.com/tballison/file-observatory/tree/main/commoncrawl-fetcher

If I were to do it again, I’d use #ApacheNutch or #StormCrawler

@digitalpebble sadly homegrown one off: https://github.com/tballison/file-observatory/tree/main/commoncrawl-fetcher

If I were to do it again, I’d use #ApacheNutch or #StormCrawler

@digitalpebble sadly homegrown one off: https://github.com/tballison/file-observatory/tree/main/commoncrawl-fetcher

If I were to do it again, I’d use #ApacheNutch or #StormCrawler

Have added test coverage for #StormCrawler

https://coveralls.io/github/DigitalPebble/storm-crawler?branch=master

As expected pretty low on average, partly explained by the fact that writing tests for Bolts is not trivial but at least we can now see where new tests should be added.

BTW #tests are great #opensource #contributions

Have added test coverage for #StormCrawler

https://coveralls.io/github/DigitalPebble/storm-crawler?branch=master

As expected pretty low on average, partly explained by the fact that writing tests for Bolts is not trivial but at least we can now see where new tests should be added.

BTW #tests are great #opensource #contributions

Have added test coverage for #StormCrawler

https://coveralls.io/github/DigitalPebble/storm-crawler?branch=master

As expected pretty low on average, partly explained by the fact that writing tests for Bolts is not trivial but at least we can now see where new tests should be added.

BTW #tests are great #opensource #contributions

Have added test coverage for #StormCrawler

https://coveralls.io/github/DigitalPebble/storm-crawler?branch=master

As expected pretty low on average, partly explained by the fact that writing tests for Bolts is not trivial but at least we can now see where new tests should be added.

BTW #tests are great #opensource #contributions

Have added test coverage for #StormCrawler

https://coveralls.io/github/DigitalPebble/storm-crawler?branch=master

As expected pretty low on average, partly explained by the fact that writing tests for Bolts is not trivial but at least we can now see where new tests should be added.

BTW #tests are great #opensource #contributions

Hoping to benchmark #StormCrawler + #opensearch with segment replication

Hoping to benchmark #StormCrawler + #opensearch with segment replication

@krisfreedain
2.7.0 now used in #stormcrawler

https://github.com/DigitalPebble/storm-crawler/pull/1064

@krisfreedain
2.7.0 now used in #stormcrawler

https://github.com/DigitalPebble/storm-crawler/pull/1064