00-START-HERE · 01-READING-ROUTES · A5_annotated_reading_list · A7_glossary This appendix provides a compact, calculation-oriented reference for the source’s symbols, overload rules, and conventions while leaving the extended discussion to the front matter.
TL;DR
- Preserve case, primes, subscripts, function arguments and units.
- This reference writes for PQ subquantizers and for the HNSW neighbor parameter. Libraries may reuse uppercase for PQ; map the API’s meaning explicitly.
- Keep , and distinct: recall, precision and segmentation error.
- Write the logarithm base. Use natural logs for nats/log loss and the stated BM25 form, and for DCG and code-bit counts.
- Decimal and binary storage units are different. Vectors are columns unless a derivation explicitly uses row-vector stacking.
- The , nominal -million-parameter encoder is an illustrative comparison setup, not a universal architecture requirement.
The story
Think of the notation sheet as the control board in a rail yard. Each symbol is a track label. brings user input into the yard. sends a query toward retrieval. carries contexts onward, and marks the generated answer at the end of the route. Subscripts and primes are track markers. and do not stop at the same platform. Uppercase , lowercase , and primed also lead to different destinations. The overload table is the switch chart. It tells the operator whether means a document or dimensionality, whether counts contexts or PQ centroids, and whether counts vectors or model parameters. The switch chart chooses for PQ here and for HNSW. That is a local notation policy, not a claim about every paper or library. Faiss, for example, also uses uppercase as its PQ subquantizer parameter.[1] The conventions state units, vector orientation and the recurring setup. Logarithm bases must follow the quantity: bits and DCG use base , while nats, natural-log BM25 and natural-log losses use base . A change of base changes reported numeric values and units. The board works only when the operator reads the local route before interpreting a reused label.
Decoder table
The three blocks below preserve the source layout and all 57 primary symbol-meaning entries.
Block 1: System, retrieval, and index notation
| Symbol | Meaning | Why it matters |
|---|---|---|
| Generator parameters | Locates the trainable or frozen generator state | |
| Datastore | Names the corpus available to retrieval | |
| Component stores | Separates federated or multimodal stores | |
| User input | Marks the pipeline input before encoding | |
| Query issued to the retriever | Connects user input to retrieval geometry | |
| Retrieval gate with values | Decides whether retrieval runs | |
| Retriever | Names the evidence-selection component | |
| Generator | Names the answer-producing component | |
| Retrieved contexts | Identifies evidence passed downstream | |
| Generated answer | Marks the pipeline output | |
| Contexts reaching the generator | Sets the final context depth | |
| Retrieval depth before reranking | Separates candidate depth from final depth | |
| Vectors in the index | Sets index scale | |
| Embedding dimension | Sets vector width and memory cost | |
| HNSW neighbor parameter in this reference | A configured slot/connectivity parameter, not every node’s realized out-degree | |
| Base-layer neighbor-slot capacity, often | A construction/allocation convention, not exact realized degree | |
| HNSW search candidate-width parameter | Not necessarily graph hops, examined nodes or hardware parallelism | |
| Inverted File (IVF) cells probed | Trades search breadth for latency | |
| PQ sub-quantizers | Splits a vector for compression | |
| PQ centroids per subspace | Sets the local codebook size | |
| Bits per sub-code when ; total PQ bits are | Declare total packed bytes and padding separately | |
| Recall at a declared retrieval cutoff | Distinguish judged-relevance recall, ANN-neighbor recall and full evidence-set coverage |
Block 2: Scoring and evaluation notation
| Symbol | Meaning | Why it matters |
|---|---|---|
| Relevance score | Orders a document for a query | |
| Position in a ranked list | Connects a score to rank-based metrics | |
| Term frequency | Controls lexical evidence strength | |
| Best Matching 25 (BM25) saturation and length normalization | Control repetition and document-length effects | |
| Mean document length | Anchors BM25 length normalization | |
| Query and passage encoders | Map both sides into retrieval space | |
| Query and passage token lengths | Set encoder and interaction cost | |
| Late-interaction operator | Aggregates token-level similarity | |
| Mean reciprocal rank of the first relevant hit | Permits multiple relevant items; zero when none appears within cutoff | |
| Discounted Cumulative Gain | Discounts useful results by rank | |
| Normalized discounted cumulative gain at a declared cutoff | State gain, judgment universe, tie and zero-IDCG policies | |
| Precision at | Measures useful-result density | |
| Segmentation error | Measures chunk-boundary error rather than precision | |
| Intersection over Union for chunk-span overlap | Measures overlap between predicted and reference spans | |
| when | State zero-denominator and macro/micro averaging policies |
Block 3: Training, serving, and graph notation
| Symbol | Meaning | Why it matters |
|---|---|---|
| Training loss | Defines the optimization target | |
| Positive softmax temperature | Relative to fixed scores: smaller sharpens, larger flattens | |
| Retrieved subset in training | Separates training evidence from the full store | |
| Normalized document weight for a stated ensemble | Define candidate support and normalization; not every mixture uses this same convention | |
| Retriever distribution | Describes retrieval preferences | |
| Generator preference distribution | Describes generator preferences | |
| Retriever and generator temperatures | Calibrate the two distributions | |
| Low-Rank Adaptation (LoRA) rank | Sets adapter capacity | |
| For , , | is common; factor order follows the chosen orientation | |
| Shared-space embeddings | Enable cross-modal or shared-space scoring | |
| Stage latency, distinct from attributable device service time | Parallel stages need a critical path; resource cost needs service/capacity allocation | |
| Cost per query | Connects design choices to serving economics | |
| Serving batch size | Controls throughput and memory use | |
| Tokens in context or answer | Sets sequence-dependent serving cost | |
| Transformer layers | Sets model depth and repeated compute | |
| Knowledge graph | Names the graph used for grounded retrieval | |
| Entities and edges | Quantify graph size | |
| Graph grounding operator | Maps a query into graph-grounded form | |
| Traversal depth in hops | Bounds graph search and reasoning depth | |
| Example modality-specific admission threshold | Validate modality/score comparability; no theorem forbids a calibrated global policy |
Core mechanics
Purpose and use
The full notation chapter carries the conventions and extended overload discussion. This appendix is the compact version. It gives symbols and meanings for use during a derivation rather than during continuous reading. Read the exact glyph before assigning meaning. Case distinguishes from . A prime distinguishes from and from . Subscripts distinguish , , , , and related symbols from their base letters. Function arguments also establish scope. is a relevance score, while standalone counts tokens in a context or answer. The calligraphic symbol is training loss. Plain counts Transformer layers.
Overloaded symbols
| Symbol | Meaning A | Meaning B or scope condition |
|---|---|---|
| A document or chunk | Embedding or hidden dimensionality | |
| Retrieved contexts | PQ centroids per sub-quantizer | |
| PQ sub-quantizers | Datastore count or modality index | |
| HNSW neighbor parameter in this reference | Other notations, including Faiss PQ, reuse ; never translate by case alone | |
| BM25 length-normalization parameter | Sub-code bits, total code bits and bytes/parameter must be distinguished by scope | |
| Vectors in the index | Model parameter count | |
| Model parameter count | Instance price per hour | |
| Knowledge graph | Use for its schema where confusion is possible |
The overload table is a scope rule. It does not authorize swapping meanings within one derivation. Use the surrounding topic to select the intended meaning.
Conventions
| Convention | Rule | Scope condition |
|---|---|---|
| Logarithms | Write or as appropriate. | Nats/log loss and displayed BM25 use natural logs; DCG and bit counts use base . |
| Storage | Use decimal units. . | This is the default storage convention. |
| Quoted storage source | Preserve binary units. | Apply this only when the source is quoted in binary units and the text says so. |
| Latency | Measure in milliseconds. | Applies when no different unit is written. |
| Throughput | Measure in queries per second. | Applies when no different unit is written. |
| Cost | Measure in United States dollars per query. | Applies when no different unit is written. |
| Vectors and transpose | Column vectors by default; is transpose. | A stated row-stacked matrix convention overrides the default; check dimensions. |
| Recurring default | Illustrative and nominal parameters. | Model parameter count does not by itself determine embedding dimension or FLOPs. |
Scope-sensitive reading sequence
- Match exact glyphs, arguments and units.
- Define overloaded symbols locally and map any library parameter explicitly.
- Check dimensions and vector orientation before multiplying matrices.
- State the logarithm base and whether the quantity is in bits or nats.
- Separate document count, indexed vector count and model parameters.
- Treat and parameters as illustrative inputs, not universal facts.
Distinctions that must survive transcription
| Pair or family | Required distinction |
|---|---|
| , , | Datastore, document or dimension by scope, and retrieved training subset |
| , , | Context count or PQ centroid count, pre-rerank depth, and BM25 saturation |
| , , | HNSW upper/base slot parameters and this reference’s PQ subquantizer count |
| Distinguish BM25 normalization, bits per sub-code, total code bits and bytes per parameter | |
| , , , | Precision at , segmentation error, retriever distribution, and an overloaded parameter or price symbol |
| , , , , | Distinct evaluation quantities |
| , | Relevance score and token count |
| , , , | Training loss, Transformer layer count, and query or passage token lengths |
| , , , | Query and passage encoders versus shared-space embeddings |
| , , , , | Graph, entity count, edge count, grounding operator, and hop depth |
Diagrams
The manifest records 0 numbered figures and 0 numbered tables. The source contains two unnumbered reference layouts. The main symbol layout is recreated in the three Decoder table blocks. The overloaded-symbol layout is recreated under Core mechanics. No source number or caption is invented.
Source layout accounting
- Main notation layout: 57 symbol-meaning entries across three horizontal blocks.
- Overloaded symbols layout: 8 symbols with two meanings or a scope restriction.
- Conventions text: 8 rules covering bases, units, orientation, and the recurring default.
Whiteboard pack
What to draw
- Draw system flow .
- Separate index, evaluation, training, serving and graph symbols.
- Mark local overloads and library-specific parameter names.
- Distinguish PQ sub-code bits from total bits and HNSW slots from realized degree.
- Add explicit log bases, storage units, latency versus service time and vector orientation.
- State the example dimension and parameter count without claiming a universal setup.
Spoken script
Read the notation sheet by scope, not by a familiar letter alone. Trace input, query transformation, retrieval, contexts and generation. Then separate index sizes from model parameters, first-hit metrics from set coverage, and stage latency from attributable resource time. In this reference, PQ uses and HNSW uses , but a library can reuse uppercase for PQ. Distinguish bits per sub-code from total code bits, and use dimension checks for matrix products. Finish with explicit logarithm bases, decimal or binary units, and the illustrative encoder setup.
Interview traps
1. Are and interchangeable in product quantization?
Not within one locally defined derivation. This reference uses for PQ and for HNSW, but this is not universal: Faiss PQ also names its subquantizer parameter . Read the API and map it explicitly; HNSW parameters are not exact realized degrees.[1]
2. Does always mean the same retrieval depth?
No. can mean contexts reaching the generator or PQ centroids per sub-quantizer, while is retrieval depth before reranking. is the BM25 saturation parameter, so the exact mark and local scope choose the meaning.
3. Which metric symbols are easy to collapse incorrectly?
is Recall at , while is Precision at . is segmentation error. , , , , and also retain separate meanings, so similar letters do not make them interchangeable.
4. What defaults apply when a derivation omits units?
Do not repair a missing definition by guessing. State for natural-log quantities such as nats and the displayed BM25 IDF, and for DCG and bit counts. Use explicitly decimal or binary . Milliseconds, QPS and dollars/query are convenient defaults only when dimensionally appropriate; stage wall time is not automatically billable device time.
5. Is a universal requirement?
No. It is the book’s recurring default with a million-parameter encoder, and its purpose is to make worked examples comparable without repeating the setup. A written alternative overrides a convention default.
Key numbers
| Item | Value | Meaning |
|---|---|---|
| Primary reference entries | 57 | All symbol-meaning entries in the main layout |
| Primary source blocks | 3 | System and index, evaluation, and training or serving or graph notation |
| Explicit overloaded symbols | 8 | , , , , , , , and |
| Convention rules | 8 | Base, storage, unit, orientation, and recurring-default rules |
| Retrieval gate values | takes values | |
| Default logarithm base | Applies unless another base is written | |
| Decimal gigabyte | bytes | Binary units require an explicit quoted-source exception |
| Default embedding dimension | Recurring setup for comparable worked examples | |
| Default encoder size | million parameters | Paired with in the recurring setup |
| Manifest numbered visuals | 0 figures, 0 tables | The source layouts are unnumbered |
00-START-HERE · 01-READING-ROUTES · A5_annotated_reading_list · A7_glossary