home.social

#digitalpreservation — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #digitalpreservation, aggregated by home.social.

  1. Nu ik al weer een tijdje bezig ben met een aanbeveling uit mijn eigen doctoraalscriptie (boek)geschiedenis van bijna veertig jaar geleden, vond ik het tijd om die ongepubliceerde scriptie online ter beschikking te stellen. Maar wat een (digital preservation) avontuur was dat.

    #BoekGeschiedenis #BookHistory #DigitalPreservation

    cannedit.org/blog/van-tasword-

  2. Nu ik al weer een tijdje bezig ben met een aanbeveling uit mijn eigen doctoraalscriptie (boek)geschiedenis van bijna veertig jaar geleden, vond ik het tijd om die ongepubliceerde scriptie online ter beschikking te stellen. Maar wat een (digital preservation) avontuur was dat.

    #BoekGeschiedenis #BookHistory #DigitalPreservation

    cannedit.org/blog/van-tasword-

  3. Declarative all the way down: Building PRONOM signatures with JSONID

    by @beet_keeper

    PRONOM signatures are a form of declarative language, you describe the anticipated behavior in PRONOM’s regular expression syntax and tools like DROID, FIDO, and Siegfried will interpret those instructions and attempt to match them against different files to return a file format identification.

    Normally, you will write PRONOM signatures by hand but doing so for file formats based on other file format building blocks can lead to inconsistencies. Bertrand Caron previously also recognized this in the XML formats that are described with PRONOM signatures on Wikidata.

    XML can use single quotes ‘ (hex: 0x27) and double quotes ” (hex: 0x22) for attribute data, and so, do we make a PRONOM signature with multiple sequences anticipating the use of either?

    The answer is more often than not likely to be yes, because the appearance of these values are often helpful for identifying boundaries for strings that we know must exist.

    But the more file formats that we need to add to PRONOM that are based on foundational formats like XML, or JSON, or similar, the more inconsistencies will creep in, such as sequences that are looking specifically for one byte sequence over another.

    The issue extends further if file formats allow data to appear at the beginning of file, or we need to account for a variable amount of white-space, or we want to start thinking about multi-byte character encoding.

    We can, and in the XML issue described by myself and Caron, I think the recommendation is very much to create editorial standards for signatures for file formats based on other baseline, structured data formats like XML, JSON, YAML, and so on.

    And standards are well and good, but what if tooling could help us?

    For JSON this is exactly what I have tried to do in JSONID.

    What does this feature look like? And what does it get us? Let’s take a look.


    #declarativeProgramming #digipres #DigitalPreservation #DROID #FIDO #FileFormatIdentification #FileFormats #JSON #jsonid #JSONL #NTTW #NTTW9 #PRONOM #RDM #ResearchData #siegfried #StructuredData #structuredText #TOML #YAML
  4. Declarative all the way down: Building PRONOM signatures with JSONID

    by @beet_keeper

    PRONOM signatures are a form of declarative language, you describe the anticipated behavior in PRONOM’s regular expression syntax and tools like DROID, FIDO, and Siegfried will interpret those instructions and attempt to match them against different files to return a file format identification.

    Normally, you will write PRONOM signatures by hand but doing so for file formats based on other file format building blocks can lead to inconsistencies. Bertrand Caron previously also recognized this in the XML formats that are described with PRONOM signatures on Wikidata.

    XML can use single quotes ‘ (hex: 0x27) and double quotes ” (hex: 0x22) for attribute data, and so, do we make a PRONOM signature with multiple sequences anticipating the use of either?

    The answer is more often than not likely to be yes, because the appearance of these values are often helpful for identifying boundaries for strings that we know must exist.

    But the more file formats that we need to add to PRONOM that are based on foundational formats like XML, or JSON, or similar, the more inconsistencies will creep in, such as sequences that are looking specifically for one byte sequence over another.

    The issue extends further if file formats allow data to appear at the beginning of file, or we need to account for a variable amount of white-space, or we want to start thinking about multi-byte character encoding.

    We can, and in the XML issue described by myself and Caron, I think the recommendation is very much to create editorial standards for signatures for file formats based on other baseline, structured data formats like XML, JSON, YAML, and so on.

    And standards are well and good, but what if tooling could help us?

    For JSON this is exactly what I have tried to do in JSONID.

    What does this feature look like? And what does it get us? Let’s take a look.


    #declarativeProgramming #digipres #DigitalPreservation #DROID #FIDO #FileFormatIdentification #FileFormats #JSON #jsonid #JSONL #NTTW #NTTW9 #PRONOM #RDM #ResearchData #siegfried #StructuredData #structuredText #TOML #YAML
  5. Declarative all the way down: Building PRONOM signatures with JSONID

    by @beet_keeper

    PRONOM signatures are a form of declarative language, you describe the anticipated behavior in PRONOM’s regular expression syntax and tools like DROID, FIDO, and Siegfried will interpret those instructions and attempt to match them against different files to return a file format identification.

    Normally, you will write PRONOM signatures by hand but doing so for file formats based on other file format building blocks can lead to inconsistencies. Bertrand Caron previously also recognized this in the XML formats that are described with PRONOM signatures on Wikidata.

    XML can use single quotes ' (hex: 0x27) and double quotes " (hex: 0x22) for attribute data, and so, do we make a PRONOM signature with multiple sequences anticipating the use of either?

    The answer is more often than not likely to be yes, because the appearance of these values are often helpful for identifying boundaries for strings that we know must exist.

    But the more file formats that we need to add to PRONOM that are based on foundational formats like XML, or JSON, or similar, the more inconsistencies will creep in, such as sequences that are looking specifically for one byte sequence over another.

    The issue extends further if file formats allow data to appear at the beginning of file, or we need to account for a variable amount of white-space, or we want to start thinking about multi-byte character encoding.

    We can, and in the XML issue described by myself and Caron, I think the recommendation is very much to create editorial standards for signatures for file formats based on other baseline, structured data formats like XML, JSON, YAML, and so on.

    And standards are well and good, but what if tooling could help us?

    For JSON this is exactly what I have tried to do in JSONID.

    What does this feature look like? And what does it get us? Let’s take a look.

    Continue reading “Declarative all the way down: Building PRONOM signatures with JSONID”


    #declarativeProgramming #digipres #DigitalPreservation #DROID #FIDO #FileFormatIdentification #FileFormats #JSON #jsonid #JSONL #NTTW #NTTW9 #PRONOM #RDM #ResearchData #siegfried #StructuredData #structuredText #TOML #YAML
  6. Declarative all the way down: Building PRONOM signatures with JSONID

    by @beet_keeper

    PRONOM signatures are a form of declarative language, you describe the anticipated behavior in PRONOM’s regular expression syntax and tools like DROID, FIDO, and Siegfried will interpret those instructions and attempt to match them against different files to return a file format identification.

    Normally, you will write PRONOM signatures by hand but doing so for file formats based on other file format building blocks can lead to inconsistencies. Bertrand Caron previously also recognized this in the XML formats that are described with PRONOM signatures on Wikidata.

    XML can use single quotes ‘ (hex: 0x27) and double quotes ” (hex: 0x22) for attribute data, and so, do we make a PRONOM signature with multiple sequences anticipating the use of either?

    The answer is more often than not likely to be yes, because the appearance of these values are often helpful for identifying boundaries for strings that we know must exist.

    But the more file formats that we need to add to PRONOM that are based on foundational formats like XML, or JSON, or similar, the more inconsistencies will creep in, such as sequences that are looking specifically for one byte sequence over another.

    The issue extends further if file formats allow data to appear at the beginning of file, or we need to account for a variable amount of white-space, or we want to start thinking about multi-byte character encoding.

    We can, and in the XML issue described by myself and Caron, I think the recommendation is very much to create editorial standards for signatures for file formats based on other baseline, structured data formats like XML, JSON, YAML, and so on.

    And standards are well and good, but what if tooling could help us?

    For JSON this is exactly what I have tried to do in JSONID.

    What does this feature look like? And what does it get us? Let’s take a look.


    #declarativeProgramming #digipres #DigitalPreservation #DROID #FIDO #FileFormatIdentification #FileFormats #JSON #jsonid #JSONL #NTTW #NTTW9 #PRONOM #RDM #ResearchData #siegfried #StructuredData #structuredText #TOML #YAML
  7. Declarative all the way down: Building PRONOM signatures with JSONID

    by @beet_keeper

    PRONOM signatures are a form of declarative language, you describe the anticipated behavior in PRONOM’s regular expression syntax and tools like DROID, FIDO, and Siegfried will interpret those instructions and attempt to match them against different files to return a file format identification.

    Normally, you will write PRONOM signatures by hand but doing so for file formats based on other file format building blocks can lead to inconsistencies. Bertrand Caron previously also recognized this in the XML formats that are described with PRONOM signatures on Wikidata.

    XML can use single quotes ‘ (hex: 0x27) and double quotes ” (hex: 0x22) for attribute data, and so, do we make a PRONOM signature with multiple sequences anticipating the use of either?

    The answer is more often than not likely to be yes, because the appearance of these values are often helpful for identifying boundaries for strings that we know must exist.

    But the more file formats that we need to add to PRONOM that are based on foundational formats like XML, or JSON, or similar, the more inconsistencies will creep in, such as sequences that are looking specifically for one byte sequence over another.

    The issue extends further if file formats allow data to appear at the beginning of file, or we need to account for a variable amount of white-space, or we want to start thinking about multi-byte character encoding.

    We can, and in the XML issue described by myself and Caron, I think the recommendation is very much to create editorial standards for signatures for file formats based on other baseline, structured data formats like XML, JSON, YAML, and so on.

    And standards are well and good, but what if tooling could help us?

    For JSON this is exactly what I have tried to do in JSONID.

    What does this feature look like? And what does it get us? Let’s take a look.


    #declarativeProgramming #digipres #DigitalPreservation #DROID #FIDO #FileFormatIdentification #FileFormats #JSON #jsonid #JSONL #NTTW #NTTW9 #PRONOM #RDM #ResearchData #siegfried #StructuredData #structuredText #TOML #YAML
  8. inFAMOUS 2's UGC shutdown on August 31 means player-created missions disappear forever. The campaign stays, but digital ownership faces a harsh reality. What does this mean for game preservation? mediaboxent.com/infamous-2-ugc

    Published with MBX Flow → mbxflow.com

    #gaming #digitalpreservation #infamous2 #gamepreservation #ugc #MBXFlow

  9. inFAMOUS 2's UGC shutdown on August 31 means player-created missions disappear forever. The campaign stays, but digital ownership faces a harsh reality. What does this mean for game preservation? mediaboxent.com/infamous-2-ugc

    Published with MBX Flow → mbxflow.com

    #gaming #digitalpreservation #infamous2 #gamepreservation #ugc #MBXFlow

  10. inFAMOUS 2's UGC shutdown on August 31 means player-created missions disappear forever. The campaign stays, but digital ownership faces a harsh reality. What does this mean for game preservation? mediaboxent.com/infamous-2-ugc

    Published with MBX Flow → mbxflow.com

    #gaming #digitalpreservation #infamous2 #gamepreservation #ugc #MBXFlow

  11. inFAMOUS 2's UGC shutdown on August 31 means player-created missions disappear forever. The campaign stays, but digital ownership faces a harsh reality. What does this mean for game preservation? mediaboxent.com/infamous-2-ugc

    Published with MBX Flow → mbxflow.com

    #gaming #digitalpreservation #infamous2 #gamepreservation #ugc #MBXFlow

  12. inFAMOUS 2's UGC shutdown on August 31 means player-created missions disappear forever. The campaign stays, but digital ownership faces a harsh reality. What does this mean for game preservation? mediaboxent.com/infamous-2-ugc

    Published with MBX Flow → mbxflow.com

    #gaming #digitalpreservation #infamous2 #gamepreservation #ugc #MBXFlow

  13. Step inside San Francisco's iconic Grace Cathedral like never before – all from your screen! ⛪

    Vincent Woo and team captured this stunning historic landmark using cutting-edge Gaussian splatting technology, rendered smoothly on PlayCanvas. It is digital preservation at its absolute finest. 🖥️✨

    vincentwoo.com/3d/grace_cathed

    #GaussianSplatting #3DGraphics #DigitalPreservation #PlayCanvas #WebGL

  14. Step inside San Francisco's iconic Grace Cathedral like never before – all from your screen! ⛪

    Vincent Woo and team captured this stunning historic landmark using cutting-edge Gaussian splatting technology, rendered smoothly on PlayCanvas. It is digital preservation at its absolute finest. 🖥️✨

    vincentwoo.com/3d/grace_cathed

    #GaussianSplatting #3DGraphics #DigitalPreservation #PlayCanvas #WebGL

  15. Step inside San Francisco's iconic Grace Cathedral like never before – all from your screen! ⛪

    Vincent Woo and team captured this stunning historic landmark using cutting-edge Gaussian splatting technology, rendered smoothly on PlayCanvas. It is digital preservation at its absolute finest. 🖥️✨

    vincentwoo.com/3d/grace_cathed

    #GaussianSplatting #3DGraphics #DigitalPreservation #PlayCanvas #WebGL

  16. Step inside San Francisco's iconic Grace Cathedral like never before – all from your screen! ⛪

    Vincent Woo and team captured this stunning historic landmark using cutting-edge Gaussian splatting technology, rendered smoothly on PlayCanvas. It is digital preservation at its absolute finest. 🖥️✨

    vincentwoo.com/3d/grace_cathed

    #GaussianSplatting #3DGraphics #DigitalPreservation #PlayCanvas #WebGL

  17. "Rescued data has to be collected, and then it has to go somewhere; it has to be validated, described, made findable, and kept accessible."

    The systems that do that work are either assumed to exist… or invisible in the funding picture entirely.

    Our analysis of 87+ data resilience projects: investinopen.org/blog/data-res

    #OpenInfrastructure #DataRescue #DigitalPreservation

  18. "Rescued data has to be collected, and then it has to go somewhere; it has to be validated, described, made findable, and kept accessible."

    The systems that do that work are either assumed to exist… or invisible in the funding picture entirely.

    Our analysis of 87+ data resilience projects: investinopen.org/blog/data-res

    #OpenInfrastructure #DataRescue #DigitalPreservation

  19. "Rescued data has to be collected, and then it has to go somewhere; it has to be validated, described, made findable, and kept accessible."

    The systems that do that work are either assumed to exist… or invisible in the funding picture entirely.

    Our analysis of 87+ data resilience projects: investinopen.org/blog/data-res

    #OpenInfrastructure #DataRescue #DigitalPreservation

  20. "Rescued data has to be collected, and then it has to go somewhere; it has to be validated, described, made findable, and kept accessible."

    The systems that do that work are either assumed to exist… or invisible in the funding picture entirely.

    Our analysis of 87+ data resilience projects: investinopen.org/blog/data-res

    #OpenInfrastructure #DataRescue #DigitalPreservation

  21. "Rescued data has to be collected, and then it has to go somewhere; it has to be validated, described, made findable, and kept accessible."

    The systems that do that work are either assumed to exist… or invisible in the funding picture entirely.

    Our analysis of 87+ data resilience projects: investinopen.org/blog/data-res

    #OpenInfrastructure #DataRescue #DigitalPreservation

  22. 2️⃣/2️⃣ These documents are preserved in LoCALDig, the California Local Government Documents Collection at @UCBerkeley, a digital archive created in partnership with @internetarchive.

    From CEQA planning and BART studies to housing reports and fiscal analyses, the collection preserves the public record that helps explain how California arrived where it is today.

    Dig through LoCALDig on the Internet Archive ⤵️
    archive.org/details/instituteo

    #Environment #PublicPolicy #DigitalPreservation

  23. 2️⃣/2️⃣ These documents are preserved in LoCALDig, the California Local Government Documents Collection at @UCBerkeley, a digital archive created in partnership with @internetarchive.

    From CEQA planning and BART studies to housing reports and fiscal analyses, the collection preserves the public record that helps explain how California arrived where it is today.

    Dig through LoCALDig on the Internet Archive ⤵️
    archive.org/details/instituteo

    #Environment #PublicPolicy #DigitalPreservation

  24. 2️⃣/2️⃣ These documents are preserved in LoCALDig, the California Local Government Documents Collection at @UCBerkeley, a digital archive created in partnership with @internetarchive.

    From CEQA planning and BART studies to housing reports and fiscal analyses, the collection preserves the public record that helps explain how California arrived where it is today.

    Dig through LoCALDig on the Internet Archive ⤵️
    archive.org/details/instituteo

    #Environment #PublicPolicy #DigitalPreservation

  25. 2️⃣/2️⃣ These documents are preserved in LoCALDig, the California Local Government Documents Collection at @UCBerkeley, a digital archive created in partnership with @internetarchive.

    From CEQA planning and BART studies to housing reports and fiscal analyses, the collection preserves the public record that helps explain how California arrived where it is today.

    Dig through LoCALDig on the Internet Archive ⤵️
    archive.org/details/instituteo

    #Environment #PublicPolicy #DigitalPreservation

  26. 2️⃣/2️⃣ These documents are preserved in LoCALDig, the California Local Government Documents Collection at @UCBerkeley, a digital archive created in partnership with @internetarchive.

    From CEQA planning and BART studies to housing reports and fiscal analyses, the collection preserves the public record that helps explain how California arrived where it is today.

    Dig through LoCALDig on the Internet Archive ⤵️
    archive.org/details/instituteo

    #Environment #PublicPolicy #DigitalPreservation

  27. 📢 New #DPClinic!

    🌍 How can humanitarian organisations create sustainable digital archives?

    Join Flora Chatt (University of Manchester) and the #DPC on 23 July, 14:00–15:00 UTC for an introduction to the new Digital Humanitarian Archives Toolkit.

    💬 Explore the toolkit, hear why it was developed, and help shape it with your feedback.

    🎟️ Free registration:
    dpconline.org/events/eventdeta

    #DigitalPreservation #Coalition #DPC #Archives #Humanitarian #DPClinic #digipres #community #JoinUs

  28. 📢 New #DPClinic!

    🌍 How can humanitarian organisations create sustainable digital archives?

    Join Flora Chatt (University of Manchester) and the #DPC on 23 July, 14:00–15:00 UTC for an introduction to the new Digital Humanitarian Archives Toolkit.

    💬 Explore the toolkit, hear why it was developed, and help shape it with your feedback.

    🎟️ Free registration:
    dpconline.org/events/eventdeta

    #DigitalPreservation #Coalition #DPC #Archives #Humanitarian #DPClinic #digipres #community #JoinUs

  29. 📢 New #DPClinic!

    🌍 How can humanitarian organisations create sustainable digital archives?

    Join Flora Chatt (University of Manchester) and the #DPC on 23 July, 14:00–15:00 UTC for an introduction to the new Digital Humanitarian Archives Toolkit.

    💬 Explore the toolkit, hear why it was developed, and help shape it with your feedback.

    🎟️ Free registration:
    dpconline.org/events/eventdeta

    #DigitalPreservation #Coalition #DPC #Archives #Humanitarian #DPClinic #digipres #community #JoinUs

  30. 📢 New #DPClinic!

    🌍 How can humanitarian organisations create sustainable digital archives?

    Join Flora Chatt (University of Manchester) and the #DPC on 23 July, 14:00–15:00 UTC for an introduction to the new Digital Humanitarian Archives Toolkit.

    💬 Explore the toolkit, hear why it was developed, and help shape it with your feedback.

    🎟️ Free registration:
    dpconline.org/events/eventdeta

    #DigitalPreservation #Coalition #DPC #Archives #Humanitarian #DPClinic #digipres #community #JoinUs

  31. Anyone got thoughts/recommendations on the feasibility of setting up 120k URL redirects (301 Moved Permanently) as part of an institutional repository migration?

    #DigitalPreservation #WebArchiving

  32. Anyone got thoughts/recommendations on the feasibility of setting up 120k URL redirects (301 Moved Permanently) as part of an institutional repository migration?

    #DigitalPreservation #WebArchiving

  33. Anyone got thoughts/recommendations on the feasibility of setting up 120k URL redirects (301 Moved Permanently) as part of an institutional repository migration?

    #DigitalPreservation #WebArchiving

  34. Anyone got thoughts/recommendations on the feasibility of setting up 120k URL redirects (301 Moved Permanently) as part of an institutional repository migration?

    #DigitalPreservation #WebArchiving

  35. Anyone got thoughts/recommendations on the feasibility of setting up 120k URL redirects (301 Moved Permanently) as part of an institutional repository migration?

    #DigitalPreservation #WebArchiving

  36. 📖 New on the DPC Blog: What's new in DART 3?

    @ntallman from APTrust explores the latest release of DART 3, introducing new community-requested features that support digital preservation workflows, including expanded packaging options, S3 downloads, upload-only jobs, and an easier migration path from DART 2.

    Read the guest blog here 👉🏽 dpconline.org/blog/blog-dart-3

    #DigitalPreservation #Coalition #DPC #Community #APTrust #DART #BagIt #OpenSource

  37. 📖 New on the DPC Blog: What's new in DART 3?

    @ntallman from APTrust explores the latest release of DART 3, introducing new community-requested features that support digital preservation workflows, including expanded packaging options, S3 downloads, upload-only jobs, and an easier migration path from DART 2.

    Read the guest blog here 👉🏽 dpconline.org/blog/blog-dart-3

    #DigitalPreservation #Coalition #DPC #Community #APTrust #DART #BagIt #OpenSource

  38. 📖 New on the DPC Blog: What's new in DART 3?

    @ntallman from APTrust explores the latest release of DART 3, introducing new community-requested features that support digital preservation workflows, including expanded packaging options, S3 downloads, upload-only jobs, and an easier migration path from DART 2.

    Read the guest blog here 👉🏽 dpconline.org/blog/blog-dart-3

    #DigitalPreservation #Coalition #DPC #Community #APTrust #DART #BagIt #OpenSource

  39. 📖 New on the DPC Blog: What's new in DART 3?

    @ntallman from APTrust explores the latest release of DART 3, introducing new community-requested features that support digital preservation workflows, including expanded packaging options, S3 downloads, upload-only jobs, and an easier migration path from DART 2.

    Read the guest blog here 👉🏽 dpconline.org/blog/blog-dart-3

    #DigitalPreservation #Coalition #DPC #Community #APTrust #DART #BagIt #OpenSource

  40. Booksprint mode: activated 📚

    DPC's staff William, Garth, Amy and Karyn are spending three days together at the #DPC's Glasgow office working on the next update of the #DigitalPreservation Handbook!

    The Handbook brings together good practice and practical tools to help create, manage and preserve digital materials. This Booksprint is a key milestone in its year-long revision.

    We can't wait to share what's coming next! dpconline.org/handbook