Summa IPFS Book Search Engine

Internet services IPFS
1

Summa is an IPFS-friendly full-text search engine. Summa has good support for IPFS and WASM, and can run both on large servers and in browsers.

Since the index file is too large, the in-browser link below may provide a better experience.

There are currently some bugs; 504 errors are cached indefinitely.

All files except those in the repo and DOI have been uploaded to Filecoin.

repo 20.36T
dois 12.74T

The books can be downloaded, but they have not been uploaded to Filecoin and will take some time. Using a self-hosted IPFS may make downloading the books faster.

image
image834×590 36.4 KB

2

Thanks for providing the information~xhj15

3

What’s New in Summa 2

Summa 2 integrates the existing Rust search engine into the original Summa repository,
and provides a unified namespace across libraries, clients, binaries, deployment configurations, metrics, and documentation.

Packages
Rust: summa-core, summa-proto, summa-server, summa-broker, summa-tool,
summa-mal, and summa-tokenizer.
npm: summa-wasm and summa-client-typescript.
PyPI: summa-client-python and summa-mal (source distribution).
Container: Package summa/summa-server · GitHub, containing
server and broker binaries.
Upgrade
Please upgrade the client, server, and broker together: the RPC service names are now summa
and summa.broker. Update import statements, command names, environment variables,
monitoring configurations, and deployment names. Browser storage and training artifacts use the new namespace.

The search index encoding and TQ fingerprints from the immediately preceding version (1.9.1) have been retained.
Indexes from the original Summa 0.x versions must be rebuilt based on the source documentation.
Please refer to the migration guide.

Documentation
The blog retains its original articles, with factual errors corrected as needed, and adds tutorials on
dense retrieval
and sparse retrieval.