#governmentdatasets — Public Fediverse posts

Radio New Zealand: Massive ‘old and clunky’ government database gets $60m upgrade. “A massive database that pulls together information from across government agencies, Stats NZ surveys and non-government organisations, is set to receive a nearly $60 million tune-up. Over the next three years, the Integrated Data Infrastructure (IDI) will see current systems replaced with faster and more […]

Harvard Libraries: Harvard Library Guide to Public Data Conservation. “Public data collected and maintained by federal, state, and municipal governments is a critical resource for the Harvard community. Harvard Library is committed to helping researchers maintain access to the information they rely on. This guide provides resources and recommended pathways for researchers concerned about […]

https://rbfirehose.com/2025/04/10/harvard-libraries-harvard-library-guide-to-public-data-conservation/

Online Journalism Blog: How do I get data if my country doesn’t publish any?. “In many countries public data is limited, and access to data is either restricted, or information provided by the authorities is not credible. So how do you obtain data for a story? Here are some techniques used by reporters around the world.”

https://rbfirehose.com/2025/03/31/online-journalism-blog-how-do-i-get-data-if-my-country-doesnt-publish-any/

Ars Technica: Internet Archive played crucial role in tracking shady CDC data removals. “When thousands of pages started disappearing from the Centers for Disease Control and Prevention (CDC) website late last week, public health researchers quickly moved to archive deleted public health data. Soon, researchers discovered that the Internet Archive (IA) offers one of the most effective ways to […]

https://rbfirehose.com/2025/02/15/ars-technica-internet-archive-played-crucial-role-in-tracking-shady-cdc-data-removals/

The Journalist’s Resource: As the US government removes health websites and data, here’s a list of non-government data alternatives and archives. “To help journalists with their continued reporting, we have curated a list of non-government websites that have health data, although some use government data to create their reports. We’ll continue to update this list. If you have a suggestion […]

https://rbfirehose.com/2025/02/11/the-journalists-resource-as-the-us-government-removes-health-websites-and-data-heres-a-list-of-non-government-data-alternatives-and-archives/

Asking for assistance from folks who can save #data rapidly #disappearing off .gov sites in the US - #climate data is almost all scrubbed - I have located one cache of datasets here that are critical and currently still accessible https://hifld-geoplatform.hub.arcgis.com/ The datasets are managed off of DHS servers so have not been wiped yet. #censorship #DHS #scholarship #research #ClimateCrisis #weather #governmentDatasets #geospatial

All U.S. federal government websites are already archived by the End of Term Web Archive https://eotarchive.org/

https://en.wikipedia.org/wiki/End_of_Term_Web_Archive

https://blog.archive.org/2024/05/08/end-of-term-web-archive/

National Archives blog post: https://records-express.blogs.archives.gov/2024/06/24/announcing-the-2024-end-of-term-web-archive-initiative

Library of Congress blog post: https://blogs.loc.gov/thesignal/2024/07/nominations-sought-for-the-2024-2025-u-s-federal-government-domain-end-of-term-web-archive/

GitHub: https://github.com/end-of-term/eot2024
Internet Archive collection page: https://archive.org/details/EndofTermWebCrawls

#bigdata #contentremoval #datasets #digitalimpermanence #governmentdatasets #Politics #trumpadministration

404 Media: Archivists Work to Identify and Save the Thousands of Datasets Disappearing From Data.gov. “As people in the Data Hoarding and archiving communities have pointed out, on January 21, there were 307,854 datasets on data.gov. As of Thursday, there are 305,564 datasets. Many of the deletions happened immediately after Trump was inaugurated, according to snapshots of the website saved […]

https://rbfirehose.com/2025/02/02/404-media-archivists-work-to-identify-and-save-the-thousands-of-datasets-disappearing-from-data-gov/