MS MARCO click-translation expansion tables ("poor man's" DSSM) [P]

Overview

TLDR: I made "poor man’s" DSSM (Deep Structured Semantic Model) — the count-based translation table that can enrich the inverted index for full-text search. This trick can improve baseline BM25. So the idea is the following: - You have supervised pairs (query, relevant document), e.g., MS MARCO or click logs. - You tokenize both sides into some units (char n‑grams, wordpieces, words). - You count cross‑pair co‑occurrences: unit u on the document side vs. unit v on the query side (not c

SpinGraph analysis pending — check back after processing.