1. Catalog
  2. Code
  3. ML Models
  • Home
  • What is TileDB?
  • Get Started
  • Explore Content
  • Accounts
    • Individual Accounts
      • Apply for the Free Tier
      • Profile
        • Overview
        • Cloud Credentials
        • Storage Paths
        • REST API Tokens
        • Credits
    • Organization Admins
      • Create an Organization
      • Profile
        • Overview
        • Members
        • Cloud Credentials
        • Storage Paths
        • Billing
      • API Tokens
    • Organization Members
      • Organization Invitations
      • Profile
        • Overview
        • Members
        • Cloud Credentials
        • Storage Paths
        • Billing
      • API Tokens
  • Catalog
    • Introduction
    • Data
      • Arrays
      • Tables
      • Single-Cell (SOMA)
      • Genomics (VCF)
      • Biomedical Imaging
      • Vector Search
      • Files
    • Code
      • Notebooks
      • Dashboards
      • User-Defined Functions
      • Task Graphs
      • ML Models
    • Groups
    • Marketplace
    • Search
  • Collaborate
    • Introduction
    • Organizations
    • Access Control
      • Introduction
      • Share Assets
      • Asset Permissions
      • Public Assets
    • Logging
    • Marketplace
  • Analyze
    • Introduction
    • Slice Data
    • Multi-Region Redirection
    • Notebooks
      • Launch a Notebook
      • Usage
      • Widgets
      • Notebook Image Dependencies
    • Dashboards
      • Dashboards
      • Streamlit
    • Preview
    • User-Defined Functions
    • Task Graphs
    • Serverless SQL
    • Monitor
      • Task Log
      • Task Graph Log
  • Scale
    • Introduction
    • Task Graphs
    • API Usage
  • Structure
    • Why Structure Is Important
    • Arrays
      • Introduction
      • Quickstart
      • Foundation
        • Array Data Model
        • Key Concepts
          • Storage
            • Arrays
            • Dimensions
            • Attributes
            • Cells
            • Domain
            • Tiles
            • Data Layout
            • Compression
            • Encryption
            • Tile Filters
            • Array Schema
            • Schema Evolution
            • Fragments
            • Fragment Metadata
            • Commits
            • Indexing
            • Array Metadata
            • Datetimes
            • Groups
            • Object Stores
          • Compute
            • Writes
            • Deletions
            • Consolidation
            • Vacuuming
            • Time Traveling
            • Reads
            • Query Conditions
            • Aggregates
            • User-Defined Functions
            • Distributed Compute
            • Concurrency
            • Parallelism
        • Storage Format Spec
      • Tutorials
        • Basics
          • Basic Dense Array
          • Basic Sparse Array
          • Array Metadata
          • Compression
          • Encryption
          • Data Layout
          • Tile Filters
          • Datetimes
          • Multiple Attributes
          • Variable-Length Attributes
          • String Dimensions
          • Nullable Attributes
          • Multi-Range Reads
          • Query Conditions
          • Aggregates
          • Deletions
          • Catching Errors
          • Configuration
          • Basic S3 Example
          • Basic TileDB Cloud
          • fromDataFrame
          • Palmer Penguins
        • Advanced
          • Schema Evolution
          • Advanced Writes
            • Write at a Timestamp
            • Get Fragment Info
            • Consolidation
              • Fragments
              • Fragment List
              • Consolidation Plan
              • Commits
              • Fragment Metadata
              • Array Metadata
            • Vacuuming
              • Fragments
              • Commits
              • Fragment Metadata
              • Array Metadata
          • Advanced Reads
            • Get Fragment Info
            • Time Traveling
              • Introduction
              • Fragments
              • Array Metadata
              • Schema Evolution
          • Array Upgrade
          • Backends
            • Amazon S3
            • Azure Blob Storage
            • Google Cloud Storage
            • MinIO
            • Lustre
          • Virtual Filesystem
          • User-Defined Functions
          • Distributed Compute
          • Result Estimation
          • Incomplete Queries
        • Management
          • Array Schema
          • Groups
          • Object Management
        • Performance
          • Summary of Factors
          • Dense vs. Sparse
          • Dimensions vs. Attributes
          • Compression
          • Tiling and Data Layout
          • Tuning Writes
          • Tuning Reads
      • API Reference
    • Tables
      • Introduction
      • Quickstart
      • Foundation
        • Data Model
        • Key Concepts
          • Indexes
          • Columnar Storage
          • Compression
          • Data Manipulation
          • Optimize Tables
          • ACID
          • Serverless SQL
          • SQL Connectors
          • Dataframes
          • CSV Ingestion
      • Tutorials
        • Basics
          • Ingestion with SQL
          • CSV Ingestion
          • Basic S3 Example
          • Running Locally
        • Advanced
          • Scalable Ingestion
          • Scalable Queries
      • API Reference
    • AI & ML
      • Vector Search
        • Introduction
        • Quickstart
        • Foundation
          • Data Model
          • Key Concepts
            • Vector Search
            • Vector Databases
            • Algorithms
            • Distance Metrics
            • Updates
            • Deployment Methods
            • Architecture
            • Distributed Compute
          • Storage Format Spec
        • Tutorials
          • Basics
            • Ingestion & Querying
            • Updates
            • Deletions
            • Basic S3 Example
            • Running Locally
          • Advanced
            • Versioning
            • Time Traveling
            • Consolidation
            • Distributed Compute
            • RAG LLM
            • LLM Memory
            • File Search
            • Image Search
            • Protein Search
          • Performance
        • API Reference
      • ML Models
        • Introduction
        • Quickstart
        • Foundation
          • Basics
          • Storage
          • Cloud Execution
          • Why TileDB for Machine Learning
        • Tutorials
          • Ingestion
            • Data Ingestion
              • Dense Datasets
              • Sparse Datasets
            • ML Model Ingestion
          • Management
            • Array Schema
            • Machine Learning: Groups
            • Time Traveling
    • Life Sciences
      • Single-cell
        • Introduction
        • Quickstart
        • Foundation
          • Data Model
          • Key Concepts
            • Data Structures
            • Use of Apache Arrow
            • Join IDs
            • State Management
            • TileDB Cloud URIs
          • SOMA API Specification
        • Tutorials
          • Data Ingestion
          • Bulk Ingestion Tutorial
          • Data Access
          • Distributed Compute
          • Basic S3 Example
          • Multi-Experiment Queries
          • Appending Data to a SOMA Experiment
          • Add New Measurements
          • SQL Queries
          • Running Locally
          • Shapes in TileDB-SOMA
          • Drug Discovery App
        • Spatial
          • Introduction
          • Foundation
            • Spatial Data Model
            • Data Structures
          • Tutorials
            • Spatial Data Ingestion
            • Access Spatial Data
            • Manage Coordinate Spaces
        • API Reference
      • Population Genomics
        • Introduction
        • Quickstart
        • Foundation
          • Data Model
          • Key Concepts
            • The N+1 Problem
            • Architecture
            • Arrays
            • Ingestion
            • Reads
            • Variant Statistics
            • Annotations
            • User-Defined Functions
            • Tables and SQL
            • Distributed Compute
          • Storage Format Spec
        • Tutorials
          • Basics
            • Basic Ingestion
            • Basic Queries
            • Export to VCF
            • Add New Samples
            • Deleting Samples
            • Basic S3 Example
            • Basic TileDB Cloud
          • Advanced
            • Scalable Ingestion
            • Scalable Queries
            • Query Transforms
            • Handling Large Queries
            • Annotations
              • Finding Annotations
              • Embedded Annotations
              • External Annotations
              • Annotation VCFs
              • Ingesting Annotations
            • Variant Statistics
            • Tables and SQL
            • User-Defined Functions
            • Sample Metadata
            • Split VCF
          • Performance
        • API Reference
          • Command Line Interface
          • Python API
          • Cloud API
      • Biomedical Imaging
        • Introduction
        • Foundation
          • Data Model
          • Key Concepts
            • Arrays
            • Ingestion
            • Reads
            • User Defined Functions
          • Storage Format Spec
        • Quickstart
        • Tutorials
          • Basics
            • Ingestion
            • Read
              • OpenSlide
              • TileDB-Py
          • Advanced
            • Batched Ingestion
            • Chunked Ingestion
            • Machine Learning
              • PyTorch
            • Napari
    • Files
  • API Reference
  • Self-Hosting
    • Installation
    • Upgrades
    • Administrative Tasks
    • Image Customization
      • Customize User-Defined Function Images
      • AWS ECR Container Registry
      • Customize Jupyter Notebook Images
    • Single Sign-On
      • Configure Single Sign-On
      • OpenID Connect
      • Okta SCIM
      • Microsoft Entra
  • Glossary

On this page

  • Create ML model
  • Overview
  • Preview
  • Metadata
  • Sharing & Activity
  • Settings
  • Versioning
  • Rename ML model
  • Delete ML model
  1. Catalog
  2. Code
  3. ML Models

ML Models

machine learning (ml)
catalog
Learn how TileDB catalogs and manages machine learning models.
Manage your ML models alongside your data

TileDB allows you to create, manage, and serve machine learning (ML) models inside its secure infrastructure. TileDB catalogs and version controls your ML models in the same platform as your data.

Create ML model

Section Structure: ML Models includes all the information you need to create and register your ML models in the TileDB catalog.

Once created, your ML model will appear under Assets -> Code -> ML models.

Browse all your ML models in a single place. Browse all your ML models in a single place.

Overview

The Overview tab provides basic information about an ML model:

  • Description - If you provided a description to the ML model (e.g., from Settings), it is visible here. The description is indexed and searchable in the catalog. Therefore, it’s recommended to add a meaningful description for all your assets.
  • TileDB URI - The unique resource identifier for TileDB, based on which you can refer to the ML model. It contains the namespace and the UUID of the asset.
  • UUID - The unique identifier for the ML model.
  • Original URI - The location on cloud storage where the asset is stored. This property is visible only to the admin of the asset.
  • Permissions - What rights the current user has on this asset.
  • License - If available, under which license the asset is available. Editable through Settings, if you are the admin of the asset.
  • Tags - Any tags on the asset, if available, which will be searchable in the TileDB catalog.
  • Framework - The framework used to create the ML model.
  • Python version - The Python version used to create the ML model.
Referring to the ML model programmatically

It is important to understand how to refer to your ML model programmatically. You can do it in two ways:

  1. Using the TileDB URI format tiledb://<account>/<ml_model_name>. This is the most user-friendly way, but TileDB allows duplicated ML model names, and if you have an ML model with a non-unique name, this will throw an error.
  2. Using the TileDB URI from the asset’s Overview tab (that is, the URI with format tiledb://<account>/<UUID>). TileDB URIs referencing the asset’s UUID are unique. Thus, this method will always work.

The basic information about the ML model. The basic information about the ML model.

Preview

You can see human-readable information about the ML model under the Preview tab.

Rendering the ML model in human-readable form. Rendering the ML model in human-readable form.

Metadata

ML models may be associated with metadata in the form of key-value pairs, which is visible in the Metadata tab.

The metadata screen of the ML model. The metadata screen of the ML model.

Sharing & Activity

The Sharing screen allows you to securely share your ML model with other TileDB users, whereas the Activity screen shows you the various accesses performed on the ML model by you or any other user with whom you have shared your ML model. They are both covered in detail in the Collaborate section.

Settings

In the ML model settings, you can modify the following:

  • Description - Note that this is indexed and, thus, searchable in the TileDB catalog.
  • License - The type of license for the ML model, especially if you are making this publicly available.
  • Tags - These can be used for efficient search in the catalog.
  • Mark as read-only - This is useful if you want to prevent any ML model changes by you or someone with whom you shared the ML model.
  • Make public - If you wish to share the ML model with all the TileDB users. This will appear in the Marketplace tab in the left navigation menu. If you make a ML model public, you can easily change it back to private in the same manner.
  • Cloud credentials - Credentials should be provided so that TileDB can securely access the ML model on the cloud store where it is physically stored.
  • Rename ML model - Read the Rename ML model subsection below.
  • Delete ML model - Read the Delete ML model subsection below.

Tweaking the ML model settings. Tweaking the ML model settings.

Versioning

TileDB supports versioning for ML models. Every time you edit an ML model, TileDB creates a new version. You can select which version to preview by selecting the button next to the ML model name, starting with Latest version - .... This brings up a modal on the right, which allows you to browse and select different ML model versions. Then you can preview the selected ML model version.

Browsing and selecting different ML model versions. Browsing and selecting different ML model versions.

Rename ML model

You can rename an ML model from the Settings tab. This action does not alter or copy the contents of the ML model; it just registers the asset in the catalog under a different name.

You can programmatically rename an ML model as follows:

  • Python
tiledb.cloud.asset.update_info(
    "`tiledb://<account>/<previous_name>`",
    name="<new_name>",
    access_credentials_name="<acn>",  # Optional - The cloud credentials that access the ML model (should already exist in your account settings)
)
Warning

Take caution when renaming ML models, as any URIs including the previous ML model name will no longer work.

Delete ML model

When deleting an ML model, you have two options:

  • Unregister: This operation removes the ML model from the TileDB catalog, but it does not physically remove it from the object store. Since the ML model will persist on storage, you can register it again in the TileDB catalog in the future.
  • Delete: This operation both unregisters and physically removes the ML model from storage. Note that this operation cannot be undone.

You can delete the ML model from the Settings tab, which will prompt you to choose among the two operations above.

The two options when removing an ML model. The two options when removing an ML model.

You can also programmatically delete or unregister an ML model as follows:

  • Python
# Unregister an ML model
tiledb.cloud.asset.deregister(uri="tiledb://<account>/<ml_model_name>")

# Delete an ML model
tiledb.cloud.asset.delete(uri="tiledb://<account>/<ml_model_name>")
Task Graphs
Groups