megatron.data.realm_index#
Description
Classes
|
Wrapper object for a BlockData which similarity search via FAISS under the hood |
|
Serializable data structure for holding data for blocks -- embeddings and necessary metadata for Retriever |
Functions
|