tor2web: what about mirroring?

It's possible to imagine some hidden Web services becoming quite popular and overloaded or somehow getting shut down. It would be nice if other hidden Web services mirrored their content so that users could still access it. And it would be nice if there was a directory service that would point users to an accessible copy of the content. Here's a proposal for such a system:

  1. You have a bunch of files you'd like to publish. You publish them via HTTP and publish a list at /files.txt mapping their SHA1 to their path on your server.

  2. You register your HTTP server with a directory server. The directory server reads your files.txt and adds it to its index. Now whenever someone asks for a SHA1 you host, it redirects them to it on your server (perhaps using CAW as well).

  3. Someone else asks the directory server for a list of the most popular files. They download a copy, publish them via HTTP, publish a files.txt for them, and notify the directory. Now the directory server can round-robin between the two. (To prevent against directory poisoning, the directory can occasionally spot-check the servers in its index to make sure the files they server match the hash.)

The end result is that you can point users at a URL like:

http://dir.theinfo.org/sha1/ed70c57d7564e994e7d5f6fd6967cea8b347efbc

and be fairly confident that they can get a copy.

Note that such a system need not be limited to tor2web servers proxying for hidden HTTP servers. It could redirect to the file on any Web-accessible system.

info@tor2web.org