Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> What I'm missing from this announcement though is any mention of how they intend to secure this "vault" against the current government.

Maybe this?

> In addition to the data collection, we are releasing open source software and documentation for replicating our work and creating similar repositories. With these tools, we aim not only to preserve knowledge ourselves but also to empower others to save and access the data that matters to them.

https://github.com/harvard-lil/data-vault

And since the data lives here: https://source.coop/repositories/harvard-lil/gov-data/descri...

Combined with this:

> To download an individual dataset by name you can construct its URL, such as:

> https://source.coop/harvard-lil/gov-data/collections/data_go...

> https://source.coop/harvard-lil/gov-data/metadata/data_gov/f...

> To download large numbers of files, we recommend the aws or rclone command line tools:

> aws s3 cp s3://us-west-2.opendata.source.coop/harvard-lil/gov-data/collections/data_gov/<name>/v1.zip --no-sign-request

So one could "easily" mirror the whole thing, making it distributed.



And 16 TB isn't what it used to be (though it is a big transfer). I'm hopeful that it's already being mirrored in multiple places including overseas.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: