This page describes how you can manage your corpus for RAG tasks by performing corpus management and file management.
Corpus management
A corpus, also referred to as an index, is a collection of documents or source of information. The corpus can be queried to retrieve relevant contexts for response generation. When creating a corpus for the first time, the process might take an additional minute.
The following corpus operations are supported:
| Operation | Description | Parameters | Examples |
|---|---|---|---|
| Create a RAG corpus. | Create a RAG corpus to import or upload documents. If you're using VPC-SC and it's the first time that you've called |
Create parameters v1beta1 Create parameters v1 |
Create example v1beta1 Create example v1 |
| Update a RAG corpus. | Update a previously-created RAG corpus to import or upload documents. | Update parameters v1beta1 Update parameters v1 |
Update example v1beta1 Update example v1 |
| List a RAG corpus. | List all of the RAG corpora. | List parameters v1beta1 List parameters v1 |
List example v1beta1 List example v1 |
| Get a RAG corpus. | Get the metadata describing the RAG corpus. | Get parameters v1beta1 Get parameters v1 |
Get example v1beta1 Get example v1 |
| Delete a RAG corpus. | Delete the RAG corpus. | Delete parameters v1beta1 Delete parameters v1 |
Delete example v1beta1 Delete example v1 |
Concurrent operations on corpora aren't supported. For more information, see the RAG API reference for v1beta1 or RAG API reference for v1.
File management
The following file operations are supported:
| Operation | Description | Parameters | Examples |
|---|---|---|---|
| Upload a RAG file. | Upload a file from local storage with additional information that provides context to the LLM to generate more accurate responses. | Upload parameters v1beta1 Upload parameters v1 |
Upload example v1beta1 Upload example v1 |
| Import RAG files. | Import a set of files from some other storage into a storage location. | Import parameters v1beta1 Import parameters v1 |
Import example v1beta1 Import example v1 |
| List RAG files. | List all of the files in the RAG corpus. | List parameters v1beta1 List parameters v1 |
List example v1beta1 List example v1 |
| Get a RAG file. | Get details about a RAG file for use by the LLM. | Get parameters v1beta1 Get parameters v1 |
Get example v1beta1 Get example v1 |
| Delete a RAG file. | Delete a file from the RAG corpus. | Delete parameters v1beta1 Delete parameters v1 |
Delete example v1beta1 Delete example v1 |
For more information, see the RAG API reference for v1beta1 or RAG API reference for v1.