megatron.data.realm_index#

Description

Classes

FaissMIPSIndex(embed_size[, embed_data, use_gpu])

Wrapper object for a BlockData which similarity search via FAISS under the hood

OpenRetreivalDataStore([embedding_path, ...])

Serializable data structure for holding data for blocks -- embeddings and necessary metadata for Retriever

Functions

detach(tensor)