Appendices

Appendix F: Notation Quick Reference

Complete study edition · View Markdown ↗

On this page

00-START-HERE · 01-READING-ROUTES · A5_annotated_reading_list · A7_glossary This appendix provides a compact, calculation-oriented reference for the source’s symbols, overload rules, and conventions while leaving the extended discussion to the front matter.

TL;DR

  • Preserve case, primes, subscripts, function arguments and units.
  • This reference writes mm for PQ subquantizers and MM for the HNSW neighbor parameter. Libraries may reuse uppercase MM for PQ; map the API’s meaning explicitly.
  • Keep R@kR@k, P@kP@k and PkP_k distinct: recall, precision and segmentation error.
  • Write the logarithm base. Use natural logs for nats/log loss and the stated BM25 form, and log⁡2\log_2 for DCG and code-bit counts.
  • Decimal and binary storage units are different. Vectors are columns unless a derivation explicitly uses row-vector stacking.
  • The d=768d=768, nominal 110110-million-parameter encoder is an illustrative comparison setup, not a universal architecture requirement.

The story

Think of the notation sheet as the control board in a rail yard. Each symbol is a track label. xx brings user input into the yard. q=Φ(x)q=\Phi(x) sends a query toward retrieval. c1,…,ckc_1,\ldots,c_k carries contexts onward, and yy marks the generated answer at the end of the route. Subscripts and primes are track markers. kk and k′k^{\prime} do not stop at the same platform. Uppercase DD, lowercase dd , and primed D′D^{\prime} also lead to different destinations. The overload table is the switch chart. It tells the operator whether dd means a document or dimensionality, whether kk counts contexts or PQ centroids, and whether NN counts vectors or model parameters. The switch chart chooses mm for PQ here and MM for HNSW. That is a local notation policy, not a claim about every paper or library. Faiss, for example, also uses uppercase MM as its PQ subquantizer parameter.[1] The conventions state units, vector orientation and the recurring setup. Logarithm bases must follow the quantity: bits and DCG use base 22, while nats, natural-log BM25 and natural-log losses use base ee. A change of base changes reported numeric values and units. The board works only when the operator reads the local route before interpreting a reused label.

Decoder table

The three blocks below preserve the source layout and all 57 primary symbol-meaning entries.

Block 1: System, retrieval, and index notation

Symbol Meaning Why it matters
θ\theta Generator parameters Locates the trainable or frozen generator state
DD Datastore Names the corpus available to retrieval
D1,…,DmD_1,\ldots,D_m Component stores Separates federated or multimodal stores
xx User input Marks the pipeline input before encoding
q=Φ(x)q=\Phi(x) Query issued to the retriever Connects user input to retrieval geometry
g(x)g(x) Retrieval gate with values {0,1}\{0,1\} Decides whether retrieval runs
RET\mathop{\mathrm{RET}}\nolimits Retriever Names the evidence-selection component
GENθ\mathop{\mathrm{GEN}}\nolimits_{\theta} Generator Names the answer-producing component
c1,…,ckc_1,\ldots,c_k Retrieved contexts Identifies evidence passed downstream
yy Generated answer Marks the pipeline output
kk Contexts reaching the generator Sets the final context depth
k′k^{\prime} Retrieval depth before reranking Separates candidate depth from final depth
NN Vectors in the index Sets index scale
dd Embedding dimension Sets vector width and memory cost
MM HNSW neighbor parameter in this reference A configured slot/connectivity parameter, not every node’s realized out-degree
M0M_0 Base-layer neighbor-slot capacity, often 2M2M A construction/allocation convention, not exact realized degree
ef\mathrm{ef} HNSW search candidate-width parameter Not necessarily graph hops, examined nodes or hardware parallelism
nproben_{\mathrm{probe}} Inverted File (IVF) cells probed Trades search breadth for latency
mm PQ sub-quantizers Splits a vector for compression
kk PQ centroids per subspace Sets the local codebook size
bb Bits per sub-code when k=2bk=2^b; total PQ bits are mbmb Declare total packed bytes ⌈mb/8⌉\lceil mb/8\rceil and padding separately
R@kR@k Recall at a declared retrieval cutoff Distinguish judged-relevance recall, ANN-neighbor recall and full evidence-set coverage

Block 2: Scoring and evaluation notation

Symbol Meaning Why it matters
s(q,d)s(q,d) Relevance score Orders a document for a query
rank(d)\mathop{\mathrm{rank}}\nolimits(d) Position in a ranked list Connects a score to rank-based metrics
ff Term frequency Controls lexical evidence strength
k1,bk_1,b Best Matching 25 (BM25) saturation and length normalization Control repetition and document-length effects
avgdl\mathop{\mathrm{avgdl}}\nolimits Mean document length Anchors BM25 length normalization
EQ,EPE_Q,E_P Query and passage encoders Map both sides into retrieval space
Lq,LpL_q,L_p Query and passage token lengths Set encoder and interaction cost
MaxSim\mathop{\mathrm{MaxSim}}\nolimits Late-interaction operator Aggregates token-level similarity
MRR\mathop{\mathrm{MRR}}\nolimits Mean reciprocal rank of the first relevant hit Permits multiple relevant items; zero when none appears within cutoff
DCG\mathop{\mathrm{DCG}}\nolimits Discounted Cumulative Gain Discounts useful results by rank
nDCG@k\mathop{\mathrm{nDCG}}\nolimits @k Normalized discounted cumulative gain at a declared cutoff State gain, judgment universe, tie and zero-IDCG policies
P@kP@k Precision at kk Measures useful-result density
PkP_k Segmentation error Measures chunk-boundary error rather than precision
IoU\mathop{\mathrm{IoU}}\nolimits Intersection over Union for chunk-span overlap Measures overlap between predicted and reference spans
F1F_1 2PR/(P+R)2PR/(P+R) when P+R>0P+R\gt 0 State zero-denominator and macro/micro averaging policies

Block 3: Training, serving, and graph notation

Symbol Meaning Why it matters
L\mathcal{L} Training loss Defines the optimization target
τ\tau Positive softmax temperature τ>0\tau\gt 0 Relative to fixed scores: smaller sharpens, larger flattens
D′D^{\prime} Retrieved subset in training Separates training evidence from the full store
λ(d,x)\lambda(d,x) Normalized document weight for a stated ensemble Define candidate support and normalization; not every mixture uses this same convention
PRP_R Retriever distribution Describes retrieval preferences
QLMQ_{\mathrm{LM}} Generator preference distribution Describes generator preferences
γ,β\gamma,\beta Retriever and generator temperatures Calibrate the two distributions
rr Low-Rank Adaptation (LoRA) rank Sets adapter capacity
A,BA,B For W∈Rdout×dinW\in\mathbb R^{d_{\mathrm{out}}\times d_{\mathrm{in}}}, A∈Rr×dinA\in\mathbb R^{r\times d_{\mathrm{in}}}, B∈Rdout×rB\in\mathbb R^{d_{\mathrm{out}}\times r} W+(α/r)BAW+(\alpha/r)BA is common; factor order follows the chosen orientation
Eq,EdE_q,E_d Shared-space embeddings Enable cross-modal or shared-space scoring
tit_i Stage latency, distinct from attributable device service time Parallel stages need a critical path; resource cost needs service/capacity allocation
CqC_q Cost per query Connects design choices to serving economics
BB Serving batch size Controls throughput and memory use
ss Tokens in context or answer Sets sequence-dependent serving cost
LL Transformer layers Sets model depth and repeated compute
GG Knowledge graph Names the graph used for grounded retrieval
∣V∣,∣E∣\lvert V\rvert,\lvert E\rvert Entities and edges Quantify graph size
ω\omega Graph grounding operator Maps a query into graph-grounded form
hh Traversal depth in hops Bounds graph search and reasoning depth
θm\theta_m Example modality-specific admission threshold Validate modality/score comparability; no theorem forbids a calibrated global policy

Core mechanics

Purpose and use

The full notation chapter carries the conventions and extended overload discussion. This appendix is the compact version. It gives symbols and meanings for use during a derivation rather than during continuous reading. Read the exact glyph before assigning meaning. Case distinguishes DD from dd. A prime distinguishes D′D^{\prime} from DD and k′k^{\prime} from kk. Subscripts distinguish M0M_0, PRP_R, QLMQ_{\mathrm{LM}}, θm\theta_m, and related symbols from their base letters. Function arguments also establish scope. s(q,d)s(q,d) is a relevance score, while standalone ss counts tokens in a context or answer. The calligraphic symbol L\mathcal{L} is training loss. Plain LL counts Transformer layers.

Overloaded symbols

Symbol Meaning A Meaning B or scope condition
dd A document or chunk Embedding or hidden dimensionality
kk Retrieved contexts PQ centroids per sub-quantizer
mm PQ sub-quantizers Datastore count or modality index
MM HNSW neighbor parameter in this reference Other notations, including Faiss PQ, reuse MM; never translate by case alone
bb BM25 length-normalization parameter Sub-code bits, total code bits and bytes/parameter must be distinguished by scope
NN Vectors in the index Model parameter count
PP Model parameter count Instance price per hour
GG Knowledge graph Use schema(G)\mathop{\mathrm{schema}}\nolimits(G) for its schema where confusion is possible

The overload table is a scope rule. It does not authorize swapping meanings within one derivation. Use the surrounding topic to select the intended meaning.

Conventions

Convention Rule Scope condition
Logarithms Write ln⁡\ln or log⁡2\log_2 as appropriate. Nats/log loss and displayed BM25 use natural logs; DCG and bit counts use base 22.
Storage Use decimal units. 1 gigabyte (GB)=109 bytes1\ \text{gigabyte (GB)}=10^9\ \text{bytes}. This is the default storage convention.
Quoted storage source Preserve binary units. Apply this only when the source is quoted in binary units and the text says so.
Latency Measure in milliseconds. Applies when no different unit is written.
Throughput Measure in queries per second. Applies when no different unit is written.
Cost Measure in United States dollars per query. Applies when no different unit is written.
Vectors and transpose Column vectors by default; T\mathsf T is transpose. A stated row-stacked matrix convention overrides the default; check dimensions.
Recurring default Illustrative d=768d=768 and nominal 110×106110\times10^6 parameters. Model parameter count does not by itself determine embedding dimension or FLOPs.

Scope-sensitive reading sequence

  1. Match exact glyphs, arguments and units.
  2. Define overloaded symbols locally and map any library parameter explicitly.
  3. Check dimensions and vector orientation before multiplying matrices.
  4. State the logarithm base and whether the quantity is in bits or nats.
  5. Separate document count, indexed vector count and model parameters.
  6. Treat d=768d=768 and 110×106110\times10^6 parameters as illustrative inputs, not universal facts.

Distinctions that must survive transcription

Pair or family Required distinction
DD, dd, D′D^{\prime} Datastore, document or dimension by scope, and retrieved training subset
kk, k′k^{\prime}, k1k_1 Context count or PQ centroid count, pre-rerank depth, and BM25 saturation
MM, M0M_0, mm HNSW upper/base slot parameters and this reference’s PQ subquantizer count
bb Distinguish BM25 normalization, bits per sub-code, total code bits and bytes per parameter
P@kP@k, PkP_k, PRP_R, PP Precision at kk, segmentation error, retriever distribution, and an overloaded parameter or price symbol
R@kR@k, MRR\mathop{\mathrm{MRR}}\nolimits, DCG\mathop{\mathrm{DCG}}\nolimits, nDCG@k\mathop{\mathrm{nDCG}}\nolimits @k, F1F_1 Distinct evaluation quantities
s(q,d)s(q,d), ss Relevance score and token count
L\mathcal{L}, LL, LqL_q, LpL_p Training loss, Transformer layer count, and query or passage token lengths
EQE_Q, EPE_P, EqE_q, EdE_d Query and passage encoders versus shared-space embeddings
GG, ∣V∣\lvert V\rvert, ∣E∣\lvert E\rvert, ω\omega, hh Graph, entity count, edge count, grounding operator, and hop depth

Diagrams

The manifest records 0 numbered figures and 0 numbered tables. The source contains two unnumbered reference layouts. The main symbol layout is recreated in the three Decoder table blocks. The overloaded-symbol layout is recreated under Core mechanics. No source number or caption is invented.

Source layout accounting

  1. Main notation layout: 57 symbol-meaning entries across three horizontal blocks.
  2. Overloaded symbols layout: 8 symbols with two meanings or a scope restriction.
  3. Conventions text: 8 rules covering bases, units, orientation, and the recurring default.

Whiteboard pack

What to draw

  1. Draw system flow x→q=Φ(x)→RET→c1:k→GENθ→yx\to q=\Phi(x)\to\mathop{\mathrm{RET}}\nolimits\to c_{1:k}\to\mathop{\mathrm{GEN}}\nolimits_\theta\to y.
  2. Separate index, evaluation, training, serving and graph symbols.
  3. Mark local overloads and library-specific parameter names.
  4. Distinguish PQ sub-code bits from total bits and HNSW slots from realized degree.
  5. Add explicit log bases, storage units, latency versus service time and vector orientation.
  6. State the example dimension and parameter count without claiming a universal setup.

Spoken script

Read the notation sheet by scope, not by a familiar letter alone. Trace input, query transformation, retrieval, contexts and generation. Then separate index sizes from model parameters, first-hit metrics from set coverage, and stage latency from attributable resource time. In this reference, PQ uses mm and HNSW uses MM, but a library can reuse uppercase MM for PQ. Distinguish bits per sub-code from total code bits, and use dimension checks for matrix products. Finish with explicit logarithm bases, decimal or binary units, and the illustrative encoder setup.

Interview traps

1. Are mm and MM interchangeable in product quantization?

Not within one locally defined derivation. This reference uses mm for PQ and MM for HNSW, but this is not universal: Faiss PQ also names its subquantizer parameter MM. Read the API and map it explicitly; HNSW parameters are not exact realized degrees.[1]

2. Does kk always mean the same retrieval depth?

No. kk can mean contexts reaching the generator or PQ centroids per sub-quantizer, while k′k^{\prime} is retrieval depth before reranking. k1k_1 is the BM25 saturation parameter, so the exact mark and local scope choose the meaning.

3. Which metric symbols are easy to collapse incorrectly?

R@kR@k is Recall at kk, while P@kP@k is Precision at kk. PkP_k is segmentation error. MRR\mathop{\mathrm{MRR}}\nolimits, DCG\mathop{\mathrm{DCG}}\nolimits, nDCG@k\mathop{\mathrm{nDCG}}\nolimits @k, IoU\mathop{\mathrm{IoU}}\nolimits, and F1F_1 also retain separate meanings, so similar letters do not make them interchangeable.

4. What defaults apply when a derivation omits units?

Do not repair a missing definition by guessing. State ln⁡\ln for natural-log quantities such as nats and the displayed BM25 IDF, and log⁡2\log_2 for DCG and bit counts. Use explicitly decimal GB\mathrm{GB} or binary GiB\mathrm{GiB}. Milliseconds, QPS and dollars/query are convenient defaults only when dimensionally appropriate; stage wall time is not automatically billable device time.

5. Is d=768d=768 a universal requirement?

No. It is the book’s recurring default with a 110110 million-parameter encoder, and its purpose is to make worked examples comparable without repeating the setup. A written alternative overrides a convention default.

Key numbers

Item Value Meaning
Primary reference entries 57 All symbol-meaning entries in the main layout
Primary source blocks 3 System and index, evaluation, and training or serving or graph notation
Explicit overloaded symbols 8 dd, kk, mm, MM, bb, NN, PP, and GG
Convention rules 8 Base, storage, unit, orientation, and recurring-default rules
Retrieval gate values 22 g(x)g(x) takes values {0,1}\{0,1\}
Default logarithm base 22 Applies unless another base is written
Decimal gigabyte 10910^9 bytes Binary units require an explicit quoted-source exception
Default embedding dimension 768768 Recurring setup for comparable worked examples
Default encoder size 110110 million parameters Paired with d=768d=768 in the recurring setup
Manifest numbered visuals 0 figures, 0 tables The source layouts are unnumbered

00-START-HERE · 01-READING-ROUTES · A5_annotated_reading_list · A7_glossary

Contents

Search the book

Search all 60 pages. Try “chunking”, “latency”, or “evaluation”.