#apachetika — Public Fediverse posts

Porting SafeText and analyzing digital content with Apache Tika

Last year I wrote about pitfalls in modern journalism, especially with regards to receiving documents and information from whistleblowers without offering them adequate protection.

The tl;dr is that you, as a whistleblower, need to protect yourself; and you, as an editor or journalist, need to protect your whistleblowers.

Steganographic fingerprints might be one method adopted to detect someone leaking information. Steganographic characters replace common textual characters with unusual but hard to detect variants, e.g. they look the same to the human eye, or are actually invisible. Using a tool called SafeText by David Jacobson we can identify these hidden fingerprints in the content that you share.

I firmly believe we can find clues about what is important to preserve, or learn to preserve, when we analyse the content of the digital record and not just the (file) format of the digital record.

A file can contain many different features and these are all challenges to their future interpretation, and thus preservation.

I wanted to use SafeText in some of my other non-Python tooling and so I decided to port the code to Golang as a composable module and binary.

By coincidence at the time I started writing this I had also just written about revisiting tikalinkextract and so I thought I would write this small explanation about how you might combine Tika and SafeText to perform some content analysis of your own.

Who knows, maybe we will find a conspiracy. Maybe we’ll find secret codes in our own digital records. Maybe we’ll learn something new about our records…

Lets have a look at putting Tika and SafeText together and see where it goes.

Porting SafeText and analyzing digital content with Apache Tika

Last year I wrote about pitfalls in modern journalism, especially with regards to receiving documents and information from whistleblowers without offering them adequate protection.

The tl;dr is that you, as a whistleblower, need to protect yourself; and you, as an editor or journalist, need to protect your whistleblowers.

Steganographic fingerprints might be one method adopted to detect someone leaking information. Steganographic characters replace common textual characters with unusual but hard to detect variants, e.g. they look the same to the human eye, or are actually invisible. Using a tool called SafeText by David Jacobson we can identify these hidden fingerprints in the content that you share.

I firmly believe we can find clues about what is important to preserve, or learn to preserve, when we analyse the content of the digital record and not just the (file) format of the digital record.

A file can contain many different features and these are all challenges to their future interpretation, and thus preservation.

I wanted to use SafeText in some of my other non-Python tooling and so I decided to port the code to Golang as a composable module and binary.

By coincidence at the time I started writing this I had also just written about revisiting tikalinkextract and so I thought I would write this small explanation about how you might combine Tika and SafeText to perform some content analysis of your own.

Who knows, maybe we will find a conspiracy. Maybe we’ll find secret codes in our own digital records. Maybe we’ll learn something new about our records…

Lets have a look at putting Tika and SafeText together and see where it goes.

Voting is underway for #ApacheTika 4.0.0-alpha-1! 🎉

Started work on the 4.x branch in October 2024. Lots has changed, core principles remain.

Many, many thanks to the community of fellow devs and users!

Onwards towards 4.0.0!

https://lists.apache.org/thread/bjowzh4ssgtrghqjk7g2dtn9hs3qmyrv

Voting is underway for #ApacheTika 4.0.0-alpha-1! 🎉

Started work on the 4.x branch in October 2024. Lots has changed, core principles remain.

Many, many thanks to the community of fellow devs and users!

Onwards towards 4.0.0!

https://lists.apache.org/thread/bjowzh4ssgtrghqjk7g2dtn9hs3qmyrv

Voting is underway for #ApacheTika 4.0.0-alpha-1! 🎉

Started work on the 4.x branch in October 2024. Lots has changed, core principles remain.

Many, many thanks to the community of fellow devs and users!

Onwards towards 4.0.0!

https://lists.apache.org/thread/bjowzh4ssgtrghqjk7g2dtn9hs3qmyrv

Preview revamp of our website for #ApacheTika 4.x is live: https://tika.apache.org/docs/4.0.0-SNAPSHOT/

Let us know what you think and/or open PRs! Please!

Preview revamp of our website for #ApacheTika 4.x is live: https://tika.apache.org/docs/4.0.0-SNAPSHOT/

Let us know what you think and/or open PRs! Please!

Preview revamp of our website for #ApacheTika 4.x is live: https://tika.apache.org/docs/4.0.0-SNAPSHOT/

Let us know what you think and/or open PRs! Please!

Voting is underway for #ApacheTika 3.3.0! Please give it a try and let us know if there are any surprises!

https://lists.apache.org/thread/pq4zjvqf3w5zbm5yoyg14qvr2kpd2by3

Voting is underway for #ApacheTika 3.3.0! Please give it a try and let us know if there are any surprises!

https://lists.apache.org/thread/pq4zjvqf3w5zbm5yoyg14qvr2kpd2by3

Voting is underway for #ApacheTika 3.3.0! Please give it a try and let us know if there are any surprises!

https://lists.apache.org/thread/pq4zjvqf3w5zbm5yoyg14qvr2kpd2by3

On #ApacheTika we're moving entirely to json for configuration in 4.x.

If you use tika-server and are interested in runtime configuration, please take a look and offer feedback:

https://lists.apache.org/thread/jlt8jv47t8tm58dlrnxsrfodxm2d6o0z

Please repost for reach.

On #ApacheTika we're moving entirely to json for configuration in 4.x.

If you use tika-server and are interested in runtime configuration, please take a look and offer feedback:

https://lists.apache.org/thread/jlt8jv47t8tm58dlrnxsrfodxm2d6o0z

Please repost for reach.

On #ApacheTika we're moving entirely to json for configuration in 4.x.

If you use tika-server and are interested in runtime configuration, please take a look and offer feedback:

https://lists.apache.org/thread/jlt8jv47t8tm58dlrnxsrfodxm2d6o0z

Please repost for reach.

Apache Tika Vulnerability Widens Across Multiple Modules, Severity Now 10.0 https://thecyberexpress.com/apache-tika-critical-cve/ #TheCyberExpressNews #Vulnerabilities #TheCyberExpress #FirewallDaily #CVE202554988 #ApacheTika #CyberNews #CVE #XML

Apache Tika Vulnerability Widens Across Multiple Modules, Severity Now 10.0 https://thecyberexpress.com/apache-tika-critical-cve/ #TheCyberExpressNews #Vulnerabilities #TheCyberExpress #FirewallDaily #CVE202554988 #ApacheTika #CyberNews #CVE #XML

Apache Tika Vulnerability Widens Across Multiple Modules, Severity Now 10.0 https://thecyberexpress.com/apache-tika-critical-cve/ #TheCyberExpressNews #Vulnerabilities #TheCyberExpress #FirewallDaily #CVE202554988 #ApacheTika #CyberNews #CVE #XML

⚠️ CRITICAL XXE bug (CVE-2025-66516, CVSS 10.0) in Apache Tika (tika-core, tika-pdf-module, tika-parsers). Exploitation via crafted PDFs can lead to file disclosure & RCE. Upgrade to 3.2.2+ ASAP! https://radar.offseq.com/threat/critical-xxe-bug-cve-2025-66516-cvss-100-hits-apac-d08561e7 #OffSeq #ApacheTika #XXE #Security

⚠️ CRITICAL XXE bug (CVE-2025-66516, CVSS 10.0) in Apache Tika (tika-core, tika-pdf-module, tika-parsers). Exploitation via crafted PDFs can lead to file disclosure & RCE. Upgrade to 3.2.2+ ASAP! https://radar.offseq.com/threat/critical-xxe-bug-cve-2025-66516-cvss-100-hits-apac-d08561e7 #OffSeq #ApacheTika #XXE #Security

🚨 CVE-2025-66516 CRITICAL: XXE in Apache Tika core (v1.13–3.2.1), tika-pdf-module, tika-parsers. Exploitable via crafted PDF XFA files — risks data exfil & DoS. Patch to 3.2.2+ now! https://radar.offseq.com/threat/cve-2025-66516-cwe-611-improper-restriction-of-xml-fa601313 #OffSeq #ApacheTika #XXE #Vuln

🚨 CVE-2025-66516 CRITICAL: XXE in Apache Tika core (v1.13–3.2.1), tika-pdf-module, tika-parsers. Exploitable via crafted PDF XFA files — risks data exfil & DoS. Patch to 3.2.2+ now! https://radar.offseq.com/threat/cve-2025-66516-cwe-611-improper-restriction-of-xml-fa601313 #OffSeq #ApacheTika #XXE #Vuln

RE: https://mastodon.social/@tallison/115452030199746498

Please join me tomorrow, November 13 at noon EST to chat #ApacheTika.

Please dm me for the connection info.

RE: https://mastodon.social/@tallison/115452030199746498

Please join me tomorrow, November 13 at noon EST to chat #ApacheTika.

Please dm me for the connection info.

RE: https://mastodon.social/@tallison/115452030199746498

Please join me tomorrow, November 13 at noon EST to chat #ApacheTika.

Please dm me for the connection info.

LOL.. given that I'm going to be a remote presenter, I taped my Digital Preservation Bake-off talk last night in case I have wifi-problems during the session.

I really wish conferences would require 3 or 4 videos of the talk before I'm allowed to speak.

#ipres2025 #digipresBakeoff #ApacheTika

LOL.. given that I'm going to be a remote presenter, I taped my Digital Preservation Bake-off talk last night in case I have wifi-problems during the session.

I really wish conferences would require 3 or 4 videos of the talk before I'm allowed to speak.

#ipres2025 #digipresBakeoff #ApacheTika

LOL.. given that I'm going to be a remote presenter, I taped my Digital Preservation Bake-off talk last night in case I have wifi-problems during the session.

I really wish conferences would require 3 or 4 videos of the talk before I'm allowed to speak.

#ipres2025 #digipresBakeoff #ApacheTika

In belated celebration of World Digital Preservation Day, I'm throwing a "What's new with Apache Tika/Office hours" meetup at noon on November 13 EST.

This is intended for anyone interested in files from search to digital preservation to file forensics/reverse engineering folks.

https://www.meetup.com/apache-tika-community/events/311746184

#wdpd2025 #ApacheTika

In belated celebration of World Digital Preservation Day, I'm throwing a "What's new with Apache Tika/Office hours" meetup at noon on November 13 EST.

This is intended for anyone interested in files from search to digital preservation to file forensics/reverse engineering folks.

https://www.meetup.com/apache-tika-community/events/311746184

#wdpd2025 #ApacheTika

In belated celebration of World Digital Preservation Day, I'm throwing a "What's new with Apache Tika/Office hours" meetup at noon on November 13 EST.

This is intended for anyone interested in files from search to digital preservation to file forensics/reverse engineering folks.

https://www.meetup.com/apache-tika-community/events/311746184

#wdpd2025 #ApacheTika

If I hosted an #ApacheTika demo/office hours on Thursday, Nov 6 at noon EST, would that time work?

#wdpd2025

If I hosted an #ApacheTika demo/office hours on Thursday, Nov 6 at noon EST, would that time work?

#wdpd2025

If I hosted an #ApacheTika demo/office hours on Thursday, Nov 6 at noon EST, would that time work?

#wdpd2025

@mutanthumb

Maybe I should throw a demo/office hours for #ApacheTika on #wdpd2025?

@mutanthumb

Maybe I should throw a demo/office hours for #ApacheTika on #wdpd2025?

@mutanthumb

Maybe I should throw a demo/office hours for #ApacheTika on #wdpd2025?

@mutanthumb

Y, #ApacheTika will extract what the PDF alleges it is.

These are some of the fields that I'll focus on in the #digipresBakeoff #ipres2025 #ipresBakeOff

These include pdf/a and pdf/x. hasMarkedContent suggests PDF/UA.

@mutanthumb

Y, #ApacheTika will extract what the PDF alleges it is.

These are some of the fields that I'll focus on in the #digipresBakeoff #ipres2025 #ipresBakeOff

These include pdf/a and pdf/x. hasMarkedContent suggests PDF/UA.

@mutanthumb

Y, #ApacheTika will extract what the PDF alleges it is.

These are some of the fields that I'll focus on in the #digipresBakeoff #ipres2025 #ipresBakeOff

These include pdf/a and pdf/x. hasMarkedContent suggests PDF/UA.

I recently added fully recursive extraction of embedded files to Apache Tika's commandline.

This will also extract earlier versions of PDFs available through incremental updates.

This feature is still in beta. Let us know what you think.

Details in next toot.

#fileforensics #districtcon #ipres2025
#helpwanted #digipres #fileformatology #ApacheTika

I recently added fully recursive extraction of embedded files to Apache Tika's commandline.

This will also extract earlier versions of PDFs available through incremental updates.

This feature is still in beta. Let us know what you think.

Details in next toot.

#fileforensics #districtcon #ipres2025
#helpwanted #digipres #fileformatology #ApacheTika

I recently added fully recursive extraction of embedded files to Apache Tika's commandline.

This will also extract earlier versions of PDFs available through incremental updates.

This feature is still in beta. Let us know what you think.

Details in next toot.

#fileforensics #districtcon #ipres2025
#helpwanted #digipres #fileformatology #ApacheTika

@Thorsted @mickylindlar

Thank you for sharing! I confirmed that #ApacheTika is correctly throwing an EncryptedDocumentException on that file. 🎉

@Thorsted @mickylindlar

Thank you for sharing! I confirmed that #ApacheTika is correctly throwing an EncryptedDocumentException on that file. 🎉

@Thorsted @mickylindlar

Thank you for sharing! I confirmed that #ApacheTika is correctly throwing an EncryptedDocumentException on that file. 🎉

@Thorsted @mickylindlar

If different enough from our IRM unit test, would you mind sharing with me, too? :D

I want to make sure that we're correcty flagging these in #ApacheTika
https://github.com/apache/tika/blob/main/tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-pdf-module/src/test/resources/test-documents/testMicrosoftIRMServices.pdf

@Thorsted @mickylindlar

If different enough from our IRM unit test, would you mind sharing with me, too? :D

I want to make sure that we're correcty flagging these in #ApacheTika
https://github.com/apache/tika/blob/main/tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-pdf-module/src/test/resources/test-documents/testMicrosoftIRMServices.pdf

@Thorsted @mickylindlar

If different enough from our IRM unit test, would you mind sharing with me, too? :D

I want to make sure that we're correcty flagging these in #ApacheTika
https://github.com/apache/tika/blob/main/tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-pdf-module/src/test/resources/test-documents/testMicrosoftIRMServices.pdf

🧠 Open-source & still evolving:
https://github.com/JohannesRabauer/quanta

What would you add next, smarter summaries, multi-agent explorers, or something wild?
#LangChain4j #Quarkus #Ollama #pgvector #ApacheTika #AI #Java #LLaMA3

Took the day "off" and made some progress on this for #ApacheTika

Files changed: 220 🤣

I think this is the last major change for Tika 4.x.

Took the day "off" and made some progress on this for #ApacheTika

Files changed: 220 🤣

I think this is the last major change for Tika 4.x.

Took the day "off" and made some progress on this for #ApacheTika

Files changed: 220 🤣

I think this is the last major change for Tika 4.x.

Moving tika-pipes out of tika-core in #ApacheTika 4.x.

Please take a look and let me know what you think:

https://github.com/apache/tika/pull/2339

Ref: https://issues.apache.org/jira/browse/TIKA-4334

Moving tika-pipes out of tika-core in #ApacheTika 4.x.

Please take a look and let me know what you think:

https://github.com/apache/tika/pull/2339

Ref: https://issues.apache.org/jira/browse/TIKA-4334

Moving tika-pipes out of tika-core in #ApacheTika 4.x.

Please take a look and let me know what you think:

https://github.com/apache/tika/pull/2339

Ref: https://issues.apache.org/jira/browse/TIKA-4334

I just noticed there are 1.3 million pulls of tika-server on Docker Hub per month.

That's A LOT of files parsed!

Happy parsing!

#ApacheTika #docker

I just noticed there are 1.3 million pulls of tika-server on Docker Hub per month.

That's A LOT of files parsed!

Happy parsing!

#ApacheTika #docker

I just noticed there are 1.3 million pulls of tika-server on Docker Hub per month.

That's A LOT of files parsed!

Happy parsing!

#ApacheTika #docker

Just submitted an "Intro to #ApacheTika" talk to DistrictCon, Year 1. 🤞

There will be PDFs!🤣

#districtcon @DistrictCon
https://sessionize.com/districtcon/