Milvus

Milvus Embedding Store

yaml
type: "io.kestra.plugin.ai.embeddings.Milvus"

Examples

Ingest documents into a Milvus embedding store

yaml
id: document_ingestion
namespace: company.ai

tasks:
  - id: ingest
    type: io.kestra.plugin.ai.rag.IngestDocument
    provider:
      type: io.kestra.plugin.ai.provider.GoogleGemini
      modelName: gemini-embedding-exp-03-07
      apiKey: "{{ kv('GEMINI_API_KEY') }}"
    embeddings:
      type: io.kestra.plugin.ai.embeddings.Milvus
      # Use either `uri` or `host`/`port`:
      # For gRPC (typical): milvus://localhost:19530
      # For HTTP: http://localhost:9091
      uri: "http://localhost:19200"
      token: "{{ kv('MILVUS_TOKEN') }}"  # omit if auth is disabled
      collectionName: embeddings
    fromExternalURLs:
      - https://raw.githubusercontent.com/kestra-io/docs/refs/heads/main/content/blogs/release-0-24.md

Properties

token *string

Token

Milvus auth token. Required if authentication is enabled; omit for local deployments without auth.

autoFlushOnDelete booleanstring

Auto flush on delete

If true, flush after delete operations.

autoFlushOnInsert booleanstring

Auto flush on insert

If true, flush after insert operations. Setting it to false can improve throughput.

collectionName string

Collection name

Target collection. Created automatically if it does not exist. Default: "default".

consistencyLevel string

Consistency level

Read/write consistency level. Common values include STRONG, BOUNDED, or EVENTUALLY (depends on client/version).

databaseName string

Database name

Logical database to use. If not provided, the default database is used.

host string

Host

Milvus host name (used when uri is not set). Default: "localhost".

idFieldName string

ID field name

Field name for document IDs. Default depends on collection schema.

indexType string

Index type

Vector index type (e.g., IVF_FLAT, IVF_SQ8, HNSW). Depends on Milvus deployment and dataset.

metadataFieldName string

Metadata field name

Field name for metadata. Default depends on collection schema.

metricType string

Metric type

Similarity metric (e.g., L2, IP, COSINE). Should match the embedding provider’s expected metric.

password string

Password

Required when authentication/TLS is enabled. See https://milvus.io/docs/authenticate.md

port integerstring

Port

Milvus port (used when uri is not set). Typical: 19530 (gRPC) or 9091 (HTTP). Default: 19530.

retrieveEmbeddingsOnSearch booleanstring

Retrieve embeddings on search

If true, return stored embeddings along with matches. Default: false.

textFieldName string

Text field name

Field name for original text. Default depends on collection schema.

uri string

URI

Connection URI. Use either uri OR host/port (not both). Examples:

gRPC (typical): "milvus://host: 19530"
HTTP: "http://host: 9091"

username string

Username

Required when authentication/TLS is enabled. See https://milvus.io/docs/authenticate.md

vectorFieldName string

Vector field name

Field name for the embedding vector. Must match the index definition and embedding dimensionality.

​Milvus

Milvus