Zilliz Cloud boosts vector database performance
source link: https://www.infoworld.com/article/3712664/zilliz-cloud-boosts-vector-database-performance.html
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Zilliz Cloud boosts vector database performance
The vector database cloud service may attract developers with performance and cost advantages over traditional databases for AI-related workloads, analysts say.
Jamesboy Nuchaikong / Shutterstock
San Francisco-based Zilliz has released a new version of its database-as-a-service (DBaaS) offering, Zilliz Cloud. The company claims the new version offers better performance while reducing cost of ownership compared to its previous version.
Zilliz Cloud is built atop the open source Milvus vector database management system. Zilliz was founded by engineers who had helped develop the Milvus vector database.
The new version of Zilliz Cloud, according to the company, offers 10x better performance than the original Milvus vector database. This is achieved by using the Hierarchical Navigable Small World (HNSW) graph index in combination with an improved filtered search.
HNSW, however, is table stakes for most vector databases, including those of rivals Weaviate and Pinecone. It is one of the most popular graph indexes for building vector databases.
“HNSW is increasingly a must-have capability, so Zilliz would be at a disadvantage without it being supported by its DBMS,” said Doug Henschen, principal analyst at Constellation Research.
The reason behind the popularity of graph-based indexes can be attributed to their fundamental quality of being able to find the approximate nearest neighbors in high-dimensional data while being memory efficient. This quality results in an increase in performance and reduction in cost of ownership.
Another example of a graph-based index is Vamana. Other types of indexes used in vector databases include the Inverted File Index (IVF).
Additional features of the Zilliz Cloud update include the cosine similarity metric, range search, and upsert.
The cosine similarity metric is often used for text processing, where the direction of the embedding vectors is important but the distance between them is not.
A range search is used in a vector database to narrow search results based on the distance between a query vector and database vectors.
The upsert function, in a vector database, is used to either add a new vector to the index or update one if a vector with the same ID exists.
In addition to providing a unified Milvus Client that Zilliz claims will improve the developer experience, the new version of Zilliz Cloud can be integrated with data analytics, machine learning, and streaming platforms like Apache Spark, Apache Kafka, and Airbyte.
Despite the advantages of the new version, Constellation Research’s Henschen believes that many enterprises will turn to mainstream databases they already use for capabilities such as vector embeddings and vector search.
“The challenge for vendors like Zilliz is that they don’t have the transactional data of the enterprise with them typically,” said Holger Mueller, another principal analyst at Constellation Research.
“Either they have to provide the ease of use of getting transactional data in them or they need to have a solution that helps enterprises update vectors from their system of record. Failure to do so will force enterprises to look at their existing databases, such as the ones from Oracle, AWS, IBM, and Microsoft,” Mueller added.
The competition is even stiffer for Zilliz as rivals such as Pinecone also offer their products as cloud-based services, Henschen added.
However, the analyst said that dedicated AI teams and AI developers may find performance and cost advantages in using a dedicated vector database product or service, assuming it provides all of the features they need for supporting their use cases.
Recommend
-
17
Linux is a two-edged sword. On the one hand, there’s so much you can configure. On the other hand, there’s so much you can configure. It is sometimes hard to know just what you should do to get the best performance, espec...
-
7
背景介绍 人可以通过听觉感知位置、运动、音调、音量、旋律并获...
-
5
Transform 2021Live now: Conversational AI & Intelligent AI Assistants Summit, presented by Five9 July 12-16Watch NowThis article is pa...
-
5
Zilliz 陈室余:音视频相似性检索的技术实现丨ECUG Meetup 回顾本文根据陈室余(Zilliz 资深数据工程师)于 2021 年 6 月 26 日举办的「ECUG Meetup 第 1 期 | 2021 音视频技术最佳实践·杭...
-
6
Zilliz Planet的博客_CSDN博客-Milvus,Towhee,Arctern领域博主 原创 202...
-
6
向量数据库公司 Zilliz 完成 6000 万美元 B+ 轮融资 目前,Zilliz 已累计完成 1.13 亿美元的融资。 继打造了广受欢迎的开源向量数据库 Milvus 之后,Zilliz 推出了云端全托管向量数据库服务 Zilliz Cloud,进一步赋能企业 AI 应用,在...
-
2
向量数据库公司Zilliz完成6000万美元B+轮融资2022-08-25 09:35:26 来源:高瓴创投 作者: 今日,向量数据库公司 Zilliz 宣布完成 6000 万美元的新一笔融资,成功将其 B 轮融资规模进一步扩大至 1.03 亿美元...
-
4
综合报道16min read对话 Zilliz 星爵 :向量数据库是大模型的「记忆体」2023/05/10
-
10
ChatGPT 点燃向量数据库赛道,刚刚,Zilliz Cloud 云服务重磅发布!
-
9
From the creators of Milvus, the vector database trailblazerSort by: 👋 Launching a fully-managed vector database solution capable of billion+ scale would not have been possible without the awesome team at Zilliz....
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK