This page shows you how to install AlloyDB Omni and integrate
AlloyDB AI.
AlloyDB AI
is a suite of features included with AlloyDB Omni that let you
build enterprise generative AI applications. For more information about the
AI/ML functionality of AlloyDB, see
Build generative AI applications.
AlloyDB Omni with AlloyDB AI lets you query remote ML models to work with online predictions and text embeddings generated from ML models. AlloyDB Omni with AlloyDB AI can also process vector embeddings from other content such as an image, for example, if you use the google_ml.predict_row interface and do the translation yourself in the query.
Based on where you want to install AlloyDB Omni with AlloyDB AI, select one of the following options:
Verify AlloyDB Omni with AlloyDB AI installation
To verify your installation is successful and uses model prediction, enter the following:
In the previous query, the embedding() call generates embeddings for the input text AlloyDB AI.
array_dims returns the dimensions of the array returned by embedding().
Since the text-embedding-005 model returns an output with 768 dimensions, the output is [768].
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-08-25 UTC."],[[["\u003cp\u003eAlloyDB Omni includes AlloyDB AI, a suite of features for building enterprise generative AI applications.\u003c/p\u003e\n"],["\u003cp\u003eAlloyDB Omni with AlloyDB AI enables querying remote ML models for online predictions and text embeddings.\u003c/p\u003e\n"],["\u003cp\u003eYou can install AlloyDB Omni with AlloyDB AI on a single-server Kubernetes GDC air-gapped setup.\u003c/p\u003e\n"],["\u003cp\u003eInstallation verification involves creating the \u003ccode\u003egoogle_ml_integration\u003c/code\u003e extension and using the \u003ccode\u003eembedding()\u003c/code\u003e function to test model predictions.\u003c/p\u003e\n"],["\u003cp\u003eThe \u003ccode\u003eembedding()\u003c/code\u003e function generates vector embeddings for input text, with the output array dimensions reflecting the model's specifications, like \u003ccode\u003etext-embedding-005\u003c/code\u003e returning 768 dimensions.\u003c/p\u003e\n"]]],[],null,["# Install AlloyDB AI in AlloyDB Omni\n\nSelect a documentation version: 15.7.1keyboard_arrow_down\n\n- [Current (16.8.0)](/alloydb/omni/current/docs/install-with-alloydb-ai)\n- [16.8.0](/alloydb/omni/16.8.0/docs/install-with-alloydb-ai)\n- [16.3.0](/alloydb/omni/16.3.0/docs/install-with-alloydb-ai)\n- [15.12.0](/alloydb/omni/15.12.0/docs/install-with-alloydb-ai)\n- [15.7.1](/alloydb/omni/15.7.1/docs/install-with-alloydb-ai)\n- [15.7.0](/alloydb/omni/15.7.0/docs/install-with-alloydb-ai)\n- [15.5.5](/alloydb/omni/15.5.5/docs/install-with-alloydb-ai)\n- [15.5.4](/alloydb/omni/15.5.4/docs/install-with-alloydb-ai)\n- [15.5.2](/alloydb/omni/15.5.2/docs/install-with-alloydb-ai)\n\n\u003cbr /\u003e\n\nThis page shows you how to install AlloyDB Omni and integrate\nAlloyDB AI.\n\n[AlloyDB AI](https://cloud.google.com/alloydb/ai)\nis a suite of features included with AlloyDB Omni that let you\nbuild enterprise generative AI applications. For more information about the\nAI/ML functionality of AlloyDB, see\n[Build generative AI applications](/alloydb/omni/15.7.1/docs/ai/overview-ai).\n\nAlloyDB Omni with AlloyDB AI lets you query remote ML models to work with online predictions and text embeddings generated from ML models. AlloyDB Omni with AlloyDB AI can also process vector embeddings from other content such as an image, for example, if you use the `google_ml.predict_row` interface and do the translation yourself in the query.\n\nBased on where you want to install AlloyDB Omni with AlloyDB AI, select one of the following options: \nSingle-server Kubernetes GDC air-gapped\n\nVerify AlloyDB Omni with AlloyDB AI installation\n------------------------------------------------\n\nTo verify your installation is successful and uses model prediction, enter the following: \n\n CREATE EXTENSION IF NOT EXISTS google_ml_integration CASCADE;\n\n SELECT array_dims(embedding('text-embedding-005', 'AlloyDB AI')::real[]);\n\nThe output looks similar to the following: \n\n array_dims\n ------------\n [1:768]\n (1 row) \n\n| **Note:** Vertex AI model support is governed by Vertex AI model versioning and lifecycle guidelines. For more information about stable versions, see [Model versions and lifecycle](/vertex-ai/generative-ai/docs/learn/model-versions).\n\nIn the previous query, the `embedding()` call generates embeddings for the input text `AlloyDB AI`.\n`array_dims` returns the dimensions of the array returned by `embedding()`.\nSince the `text-embedding-005` model returns an output with 768 dimensions, the output is `[768]`.\n\nWhat's next\n-----------\n\n- [Run and connect to AlloyDB Omni](/alloydb/omni/15.7.1/docs/run-connect)\n- [Manage AlloyDB Omni](/alloydb/omni/15.7.1/docs/manage)\n- [Build generative AI applications using AlloyDB AI](/alloydb/omni/15.7.1/docs/ai/overview-ai)\n- [Register and call remote AI models](/alloydb/omni/15.7.1/docs/ai/register-model-endpoint)"]]