Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion AGENTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ Curate useful files that can follow EFS to every chain: games, standards, whitep
- Do not imply EFS owns or relicenses third-party works.
- Use SPDX license ids when possible, such as `CC0-1.0`, `MIT`, and `CC-BY-4.0`.
- Use `NOASSERTION` or `LicenseRef-*` for unclear or nonstandard rights status.
- Treat unclear redistribution rights as not deployable until reviewed.
- Hosting policy (owner decision, 2026-10-27): documents (text, markdown, PDFs such as whitepapers, standards, essays and manifestos) may be hosted when their redistribution rights are unclear; record that as `license: "NOASSERTION"` and keep any rights note. Media (games, images, audio, video) must carry a real licence; the seeder refuses media without one.
- Keep manifests compatible with the current seeder: `dataset`, `anchorPath`, `defaults`, and `files[].path` must keep working.
- Add rich metadata incrementally instead of doing broad rewrites.
- Validate manifests before committing with `npm run validate`.
Expand Down
6 changes: 4 additions & 2 deletions NOTICE.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,5 +22,7 @@ The current datasets were assembled quickly for a visible EFS demo. Some machine
|---|---|
| `web-games` | Mostly CC0-1.0 and MIT single-file games. Preserve MIT notices in the files. |
| `ethereum-eips` | CC0-1.0. EIPs/ERCs are public-domain per the EIP process. |
| `cypherpunk-canon` | Mixed. Three works are included under recorded public-domain or CC BY-SA terms. Eighteen additional works are represented only by CC0 metadata records because their bytes are not cleared for EFS mirroring. |
| `crypto-whitepapers` | Mixed. Some files are freely redistributable, some are academic/public references, and some entries are link-only because rights are unclear. Review per-file notes before broad redistribution. |
| `cypherpunk-canon` | Mixed. Three PDFs are included under recorded public-domain or CC BY-SA terms. Nine short texts (the two manifestos, six classics and b-money) are hosted in full by owner decision with `license: NOASSERTION`. Ten works are represented only by CC0 metadata records. |
| `crypto-whitepapers` | Mixed. Papers are hosted as published by their projects or authors, most with no stated licence (owner decision, 2026-10-27). Each card has a **Rights:** line recording what the paper itself states. |
| `history` | Ethereum Foundation blog posts and essays converted to markdown (no stated licence; hosted by owner decision), EIPs under CC0, and EFS-authored cards. |
| `media` | Public-domain images (NASA, and a public-domain text logo with a trademark note), each with an about-card recording its Commons licence tag. |
14 changes: 8 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,12 +8,14 @@ This repository is the portable content source for EFS demos and chain deploymen

| Dataset | Anchor | Files | Bytes | Description |
|---|---:|---:|---:|---|
| [Web Games](./datasets/web-games/) | `/games` | 15 | 365441 | Single-file HTML5 games, playable in a sandboxed iframe. |
| [Crypto Whitepapers](./datasets/crypto-whitepapers/) | `/whitepapers` | 40 | 14474579 | Major cryptocurrency whitepapers and reference notes. |
| [Ethereum Standards](./datasets/ethereum-eips/) | `/standards` | 10 | 245523 | Landmark EIPs/ERCs, public domain under CC0. |
| [Cypherpunk Canon](./datasets/cypherpunk-canon/) | `/cypherpunk` | 25 | 23391250 | A rights-aware shelf representing 21 works with local files or link-only records. |

`catalog.json` is the machine-readable table of contents. Each dataset folder owns its own `manifest.json`, `README.md`, and source files.
| [Web Games](./datasets/web-games/) | `/games` | 16 | 417483 | Single-file HTML5 games, playable in a sandboxed iframe. |
| [Crypto Whitepapers](./datasets/crypto-whitepapers/) | `/whitepapers` | 43 | 15079829 | Major cryptocurrency whitepapers and reference notes. |
| [Ethereum Standards](./datasets/ethereum-eips/) | `/standards` | 16 | 354321 | Landmark Ethereum standards (EIPs/ERCs), public domain under CC0. |
| [Cypherpunk Canon](./datasets/cypherpunk-canon/) | `/cypherpunk` | 27 | 23476165 | A reading shelf of 22 cypherpunk works: nine short classics in full, three books as PDFs, and links to the rest. |
| [Ethereum History](./datasets/history/) | `/history` | 12 | 114224 | Ethereum's story in its own words: the announcement, Devcon 0, launch, the DAO, the Merge. |
| [Media](./datasets/media/) | `/media` | 7 | 1312174 | Public-domain images about archives that outlast their medium: Pale Blue Dot, the Voyager Golden Record, the Ethereum diamond. |

`catalog.json` is the machine-readable table of contents. Each dataset folder owns its own `manifest.json`, a visitor-facing `README.md` (published as the folder's Overview), curator notes in `CURATION.md`, and its source files.

## Layout

Expand Down
48 changes: 36 additions & 12 deletions catalog.json
Original file line number Diff line number Diff line change
Expand Up @@ -9,8 +9,8 @@
"path": "datasets/web-games",
"manifest": "datasets/web-games/manifest.json",
"anchorPath": "/games",
"fileCount": 15,
"bytes": 365441,
"fileCount": 16,
"bytes": 417483,
"status": "deployable",
"licensePosture": "CC0-1.0 and MIT; preserve in-file MIT notices",
"description": "Single-file HTML5 games, playable in a sandboxed iframe."
Expand All @@ -21,10 +21,10 @@
"path": "datasets/crypto-whitepapers",
"manifest": "datasets/crypto-whitepapers/manifest.json",
"anchorPath": "/whitepapers",
"fileCount": 40,
"bytes": 14474579,
"status": "deployable-with-review",
"licensePosture": "mixed; review per-file markdown and README notes",
"fileCount": 43,
"bytes": 15079829,
"status": "deployable",
"licensePosture": "papers hosted as published by their projects or authors; most carry no licence (owner decision 2026-10-27: no licence field required for documents)",
"description": "Major cryptocurrency whitepapers and reference notes."
},
{
Expand All @@ -33,8 +33,8 @@
"path": "datasets/ethereum-eips",
"manifest": "datasets/ethereum-eips/manifest.json",
"anchorPath": "/standards",
"fileCount": 10,
"bytes": 245523,
"fileCount": 16,
"bytes": 354321,
"status": "deployable",
"licensePosture": "CC0-1.0",
"description": "Landmark Ethereum standards (EIPs/ERCs), public domain under CC0."
Expand All @@ -45,11 +45,35 @@
"path": "datasets/cypherpunk-canon",
"manifest": "datasets/cypherpunk-canon/manifest.json",
"anchorPath": "/cypherpunk",
"fileCount": 25,
"bytes": 23391250,
"fileCount": 27,
"bytes": 23476165,
"status": "deployable-mixed",
"licensePosture": "local payloads are CC0, CC BY-SA, or public domain; linked works are represented by CC0 records and are not mirrored",
"description": "A rights-aware shelf representing 21 cypherpunk works with local reading files or link-only records."
"licensePosture": "local PDFs are CC BY-SA or public domain; the two manifestos are hosted in full (owner decision 2026-10-27); other works are CC0 link-only records",
"description": "A reading shelf of 22 cypherpunk works: nine short classics in full, three books as PDFs, and links to the rest."
},
{
"id": "history",
"title": "Ethereum History",
"path": "datasets/history",
"manifest": "datasets/history/manifest.json",
"anchorPath": "/history",
"fileCount": 12,
"bytes": 114224,
"status": "deployable",
"licensePosture": "Ethereum Foundation blog posts and essays converted to markdown (no stated licence; hosted by owner decision 2026-10-27), EIPs under CC0, and EFS-authored cards (CC0)",
"description": "Ethereum's story in its own words: the announcement, Devcon 0, launch, the DAO, the Merge."
},
{
"id": "media",
"title": "Media",
"path": "datasets/media",
"manifest": "datasets/media/manifest.json",
"anchorPath": "/media",
"fileCount": 7,
"bytes": 1312174,
"status": "deployable",
"licensePosture": "public-domain images (NASA; a public-domain text logo with a trademark note), each with a CC0 about-card",
"description": "Public-domain images about archives that outlast their medium: Pale Blue Dot, the Voyager Golden Record, the Ethereum diamond."
}
]
}
71 changes: 7 additions & 64 deletions datasets/crypto-whitepapers/ADDRESSES.md
Original file line number Diff line number Diff line change
@@ -1,67 +1,10 @@
# Existing IPFS / Arweave Addresses — EFS Mirror Research
# Published content addresses

Companion to `README.md`. Goal: for each whitepaper in this dataset, find whether a
**canonical, publicly-pinned IPFS CID and/or Arweave address already exists**, so EFS can point
a MIRROR at existing content instead of self-hosting.
Content-addressed copies of the papers in this folder that are already published elsewhere. Each address
below serves bytes identical to the local file (same size and SHA-256).

## Method & honesty rules
| Project | File | Address | Size (bytes) | SHA-256 |
|---|---|---|---:|---|
| Bitcoin | `bitcoin.pdf` | `ipfs://QmRA3NWM82ZGynMbYzAgYTSXCVM14Wx1RZ8fKP42G6gjgj` | 184,292 | `b1674191a88ec5cdd733e4240a81803105dc412d6c6708d53ab94fc248f4f553` |

- A CID is only recorded here if it was **found published somewhere** AND I **verified the gateway
actually resolves to the right document** (size / sha256 match against the local PDF where one exists).
- CIDs were **not** computed locally and assumed to match a published one — chunking/CID-version
differences make that unreliable. No guessed CIDs.
- Where nothing verifiable was found, the row is marked **"needs self-pin"** (we pin it ourselves later).
- Confidence reflects how sure I am the address is the *same, correct* whitepaper (not a random re-upload).

Research date: 2026-06-10. Gateways checked: `ipfs.io`, `dweb.link`, `w3s.link`.

## Summary

- **Verified existing IPFS CID: 1** — Bitcoin (byte-identical, very high confidence).
- **Verified existing Arweave address: 0.**
- **Needs self-pin: all others** (~18 documents across ~16 coins with real papers).
- No widely-published, per-document canonical CID/TxID surfaced for any non-Bitcoin paper. Most are
served only from project HTTP sites. (ethereum.org's *whole site* is mirrored to IPFS via the
`ethereum.eth` ENS contenthash, but no canonical per-PDF CID is published — so none is recorded here.)

## Table

| Coin | PDF present | IPFS CID + gateway (verified) | Arweave TxID + URL | Source | Confidence | Notes |
|---|---|---|---|---|---|---|
| **Bitcoin** | y | `QmRA3NWM82ZGynMbYzAgYTSXCVM14Wx1RZ8fKP42G6gjgj` — https://ipfs.io/ipfs/QmRA3NWM82ZGynMbYzAgYTSXCVM14Wx1RZ8fKP42G6gjgj (also resolves on dweb.link, w3s.link) | none found | bitcoin-dot-org/Bitcoin.org GitHub issue #3696; this CID is the well-known one also embedded in macOS | **Very high** | **VERIFIED byte-identical to local `bitcoin.pdf`** (184,292 bytes; sha256 `b1674191…f4f553`) across 3 gateways. Best mirror candidate. |
| Litecoin | no (none exists) | — | — | — | n/a | No whitepaper ever existed (2011 Bitcoin/scrypt fork). Nothing to mirror. |
| Dogecoin | no (none exists) | — | — | — | n/a | No whitepaper ever existed (2013 joke coin). Nothing to mirror. |
| Ethereum | y | needs self-pin | needs self-pin | ethereum.org serves PDF over HTTP only; site is on IPFS via `ethereum.eth` ENS contenthash but no canonical per-PDF CID published | n/a | Did not record a guessed CID. Self-pin the local `ethereum-whitepaper-2014.pdf`. |
| Cardano (Ouroboros) | y | needs self-pin | needs self-pin | IACR ePrint 2016/889 (HTTP) | n/a | Academic preprint; no published CID/TxID found. |
| Solana | y | needs self-pin | needs self-pin | solana.com / allcryptowhitepapers (HTTP) | n/a | No published CID/TxID found. |
| Algorand | y | needs self-pin | needs self-pin | IACR ePrint 2017/454 (HTTP) | n/a | Academic preprint; none found. |
| Tezos (whitepaper + position paper) | y (both) | needs self-pin | needs self-pin | tezos.com (HTTP) | n/a | Two PDFs; none found. |
| Polygon (Matic litepaper) | y | needs self-pin | needs self-pin | github.com/maticnetwork/whitepaper | n/a | None found. |
| Tron | **no — flagged** | — | — | — | n/a | Link-only in dataset (plagiarism controversy, pulled from official site). Do not source/mirror. |
| Monero (CryptoNote v2) | y | needs self-pin | needs self-pin | universally mirrored (web.archive, Zenodo CC-BY copy); no single canonical CID/TxID found | n/a | Many HTTP mirrors but no authoritative pinned CID surfaced. |
| Zcash (Zerocash) | y | needs self-pin | needs self-pin | zerocash-project.org author preprint (HTTP) | n/a | None found. (Local file is the author extended version, per README.) |
| Polkadot | y | needs self-pin | needs self-pin | Web3 Foundation (HTTP) | n/a | None found. |
| Cosmos | y (markdown only) | needs self-pin | needs self-pin | github.com/cosmos/cosmos | n/a | No PDF in dataset; markdown only. Nothing to mirror unless we pin the md. |
| Avalanche (consensus + platform) | y (both) | needs self-pin | needs self-pin | arXiv 1906.08936 + Ava Labs (HTTP) | n/a | None found. |
| Chainlink | y | needs self-pin | needs self-pin | research.chain.link (HTTP) | n/a | None found. |
| Uniswap (v2-core + v3-core) | y (both) | needs self-pin | needs self-pin | uniswap.org (HTTP) | n/a | None found. |
| Filecoin | y | needs self-pin | needs self-pin | filecoin.io/filecoin.pdf (Protocol Labs, CC-BY) | n/a | Ironically IPFS-native project, but no canonical per-PDF CID published/verifiable. Strong self-pin candidate (CC-BY). |
| XRP (Ripple) | y | needs self-pin | needs self-pin | ripple.com (HTTP) | n/a | None found. |
| BNB (Binance) | **no — flagged** | — | — | — | n/a | Link-only in dataset (commercial doc, no open license). Do not source/mirror. |

## Coins with NO real whitepaper

- **Litecoin** — 2011 Bitcoin/scrypt fork; no formal paper.
- **Dogecoin** — 2013 meme coin; no whitepaper ever written.

## Link-only / flagged (do not mirror without James's review)

- **Tron** — whitepaper pulled from official site amid plagiarism controversy; dataset is link+note only.
- **BNB / Binance** — commercial exchange doc, no stated open license; dataset is link+note only.

## Recommendation

Only **Bitcoin** can be mirrored against an existing, verified public pin today. Everything else
should be **self-pinned** by EFS from the local PDFs (the high-value, clearly-licensed ones first:
Bitcoin already covered, then Ethereum CC-BY, Filecoin CC-BY). After self-pinning, the resulting
CIDs can be recorded back into this file.
No other paper in this folder has a published IPFS or Arweave address that matches the local file.
57 changes: 57 additions & 0 deletions datasets/crypto-whitepapers/CURATION.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,57 @@
# Curation notes: Crypto Whitepapers

Notes for maintainers. This file is not part of the published dataset (it is not listed in
`manifest.json`); the visitor-facing overview is `README.md`.

## Structure

- One markdown **About** card per project, plus the paper itself where one exists and can be hosted.
- Files stay flat beside `manifest.json`. Categories are tags, not folders, so one paper can carry several
(`proof-of-stake`, `privacy`, `defi`, `ethereum`, ...). Tags are lowercase and hyphenated.
- Every manifest entry has `path`, `name` (same as `path`), `contentType`, `title`, `description`, `tags`
and `source`. Papers carry `author`/`authors`, `year` and an `aboutCard` pointer; cards carry
`author: "EFS contributors"`, `workAuthor` and `originalYear` where known.
- Paper titles are the papers' own titles; card titles are "About: <Project>".
- Published files must be self-contained: only absolute `https://` links, because the EFS explorer renders
relative links as dead text and relative images as placeholders.

## Sources

Each card's **Canonical source** and **File in this folder** lines record where the hosted copy came from
and whether it is byte-identical to that source. Where a project no longer hosts its paper (CryptoNote,
the Matic litepaper), the card names the archive copy used.

The Ethereum Yellow Paper (`yellowpaper.pdf`) was retrieved on 2026-11-12 from
https://ethereum.github.io/yellowpaper/paper.pdf. It is a valid PDF (version 1.5, 597,589 bytes,
SHA-256 `d67c009c5d5a0542c8288aee3c4d470b3e2dbe6e664f72f00011543608477fa9`). Its first page reads
"Shanghai version efc5f9a – 2025-02-04"; the `gh-pages` commit `f15fa70` records it as built from
`ethereum/yellowpaper` commit `efc5f9a1f356cba376c978eedb63cb0363c2aa85`.

## Rights

Owner decision (2026-10-27): documents (text, markdown, PDFs) need no machine-readable licence field.
Each card still ends its header with a neutral **Rights:** line stating what the paper itself says:

- Most papers are published openly by their projects or authors and state no licence.
- Polkadot's paper states a Creative Commons licence.
- The Ethereum Yellow Paper is CC BY-SA 4.0, per `LICENCE.md` in https://github.com/ethereum/yellowpaper
(checked 2026-11-12) and the repository README.
- Zerocash: the hosted file is the authors' extended version; the IEEE S&P 2014 conference version is
copyrighted by IEEE.
- TRON and BNB Chain whitepapers are linked, not hosted.

EFS does not own or relicense any of these works.

## Content addresses

`ADDRESSES.md` lists published IPFS addresses that serve bytes identical to a local file. A CID is
recorded only when a published address was found and the gateway copy matched the local file's size and
SHA-256; CIDs were not computed locally and assumed to match, because chunking and CID-version differences
make that unreliable.

- Initial survey: 2026-06-10, via the `ipfs.io`, `dweb.link` and `w3s.link` gateways.
- The Bitcoin CID (referenced in bitcoin-dot-org/Bitcoin.org GitHub issue #3696) was re-checked on
2026-10-27 via `gateway.pinata.cloud`, `4everland.io` and `ipfs.filebase.io`.
- ethereum.org is served on IPFS as a whole site via the `ethereum.eth` ENS contenthash, but no per-PDF CID
is published. No verified Arweave addresses were found.
- Every other paper needs to be pinned by EFS; record the resulting CIDs in `ADDRESSES.md`.
Loading