home.social

#vectordatabase — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #vectordatabase, aggregated by home.social.

fetched live
  1. I'm now experimenting with Open WebUI and local bge-m3 (embeddings), bge-reranker and Gemma-4-26b (instruct). I'm slowly learning how to integrate and test RAG systems. It's not so easy. If the instruct model is too eager to please it's not so clear if it uses the provided sources at all. I test with a rather "outdated" instruct model, llama-3.1-9b. It doesn't have enough stored information to "decode" more than a re-hash of the prompt.

    My current test set includes Nancy Leveson "Engineering a Safer World", Robert Rosen "Essays on Life Itself" and Enrico Martino "Intuitionistic Proof Versus Classical Truth". There are lots of structural similarities between "Systems Safety" and Rosennean (M,R)-systems. The connection to Brouwer is more subtle.

    My takeaway on RAG: people who just consume such solutions will have a hard time spotting shortcomings.

    Edit: after a lot of tuning my homelab RAG system is now useful.
    #homelab #RAG #vectordatabase

  2. I'm now experimenting with Open WebUI and local bge-m3 (embeddings), bge-reranker and Gemma-4-26b (instruct). I'm slowly learning how to integrate and test RAG systems. It's not so easy. If the instruct model is too eager to please it's not so clear if it uses the provided sources at all. I test with a rather "outdated" instruct model, llama-3.1-9b. It doesn't have enough stored information to "decode" more than a re-hash of the prompt.

    My current test set includes Nancy Leveson "Engineering a Safer World", Robert Rosen "Essays on Life Itself" and Enrico Martino "Intuitionistic Proof Versus Classical Truth". There are lots of structural similarities between "Systems Safety" and Rosennean (M,R)-systems. The connection to Brouwer is more subtle.

    My takeaway on RAG: people who just consume such solutions will have a hard time spotting shortcomings.

    Edit: after a lot of tuning my homelab RAG system is now useful.
    #homelab #RAG #vectordatabase

  3. I'm now experimenting with Open WebUI and local bge-m3 (embeddings), bge-reranker and Gemma-4-26b (instruct). I'm slowly learning how to integrate and test RAG systems. It's not so easy. If the instruct model is too eager to please it's not so clear if it uses the provided sources at all. I test with a rather "outdated" instruct model, llama-3.1-9b. It doesn't have enough stored information to "decode" more than a re-hash of the prompt.

    My current test set includes Nancy Leveson "Engineering a Safer World", Robert Rosen "Essays on Life Itself" and Enrico Martino "Intuitionistic Proof Versus Classical Truth". There are lots of structural similarities between "Systems Safety" and Rosennean (M,R)-systems. The connection to Brouwer is more subtle.

    My takeaway on RAG: people who just consume such solutions will have a hard time spotting shortcomings.

    Edit: after a lot of tuning my homelab RAG system is now useful.
    #homelab #RAG #vectordatabase

  4. I'm now experimenting with Open WebUI and local bge-m3 (embeddings), bge-reranker and Gemma-4-26b (instruct). I'm slowly learning how to integrate and test RAG systems. It's not so easy. If the instruct model is too eager to please it's not so clear if it uses the provided sources at all. I test with a rather "outdated" instruct model, llama-3.1-9b. It doesn't have enough stored information to "decode" more than a re-hash of the prompt.

    My current test set includes Nancy Leveson "Engineering a Safer World", Robert Rosen "Essays on Life Itself" and Enrico Martino "Intuitionistic Proof Versus Classical Truth". There are lots of structural similarities between "Systems Safety" and Rosennean (M,R)-systems. The connection to Brouwer is more subtle.

    My takeaway on RAG: people who just consume such solutions will have a hard time spotting shortcomings.

    Edit: after a lot of tuning my homelab RAG system is now useful.

  5. I'm now experimenting with Open WebUI and local bge-m3 (embeddings), bge-reranker and Gemma-4-26b (instruct). I'm slowly learning how to integrate and test RAG systems. It's not so easy. If the instruct model is too eager to please it's not so clear if it uses the provided sources at all. I test with a rather "outdated" instruct model, llama-3.1-9b. It doesn't have enough stored information to "decode" more than a re-hash of the prompt.

    My current test set includes Nancy Leveson "Engineering a Safer World", Robert Rosen "Essays on Life Itself" and Enrico Martino "Intuitionistic Proof Versus Classical Truth". There are lots of structural similarities between "Systems Safety" and Rosennean (M,R)-systems. The connection to Brouwer is more subtle.

    My takeaway on RAG: people who just consume such solutions will have a hard time spotting shortcomings.

    Edit: after a lot of tuning my homelab RAG system is now useful.
    #homelab #RAG #vectordatabase

  6. Zilliz - Provides a managed vector database service.

    Cossmology Profile: dub.sh/HxFCcoG

    Key People: Charles Xie, James Luan

    #VectorDatabase #OpenSource #OSS #COSS

  7. Databases for #AI: Should you use a vector #database? 🤔

    This article compares #opensource projects competing to handle modern #AI workloads, including #machinelearning and #LLMs. Discover which databases best meet today’s AI challenges: lpi.org/636x

    (Disclaimer: This post contains an AI-generated image.)

    #AndyOram #AI #vectordatabase #machinelearning #LLMs #SQL #opensource #hybridsearch #generativeAI #MariaDB #MongoDB #Milvus #Qdrant #Weaviate #Vespa #ChromaDB #LanceDB

  8. Databases for : Should you use a vector ? 🤔

    This article compares projects competing to handle modern workloads, including and . Discover which databases best meet today’s AI challenges: lpi.org/636x

    (Disclaimer: This post contains an AI-generated image.)

  9. Databases for #AI: Should you use a vector #database? 🤔

    This article compares #opensource projects competing to handle modern #AI workloads, including #machinelearning and #LLMs. Discover which databases best meet today’s AI challenges: lpi.org/636x

    (Disclaimer: This post contains an AI-generated image.)

    #AndyOram #AI #vectordatabase #machinelearning #LLMs #SQL #opensource #hybridsearch #generativeAI #MariaDB #MongoDB #Milvus #Qdrant #Weaviate #Vespa #ChromaDB #LanceDB

  10. Databases for #AI: Should you use a vector #database? 🤔

    This article compares #opensource projects competing to handle modern #AI workloads, including #machinelearning and #LLMs. Discover which databases best meet today’s AI challenges: lpi.org/636x

    (Disclaimer: This post contains an AI-generated image.)

    #AndyOram #AI #vectordatabase #machinelearning #LLMs #SQL #opensource #hybridsearch #generativeAI #MariaDB #MongoDB #Milvus #Qdrant #Weaviate #Vespa #ChromaDB #LanceDB

  11. Databases for #AI: Should you use a vector #database? 🤔

    This article compares #opensource projects competing to handle modern #AI workloads, including #machinelearning and #LLMs. Discover which databases best meet today’s AI challenges: lpi.org/636x

    (Disclaimer: This post contains an AI-generated image.)

    #AndyOram #AI #vectordatabase #machinelearning #LLMs #SQL #opensource #hybridsearch #generativeAI #MariaDB #MongoDB #Milvus #Qdrant #Weaviate #Vespa #ChromaDB #LanceDB

  12. Your RAG’s Secret Backdoor: Leaking Data Through Vector Databases
    This article exposes a vulnerability in Retrieval-Augmented Generation (RAG) systems, where misconfigured vector databases can lead to sensitive data leakage. By improperly securing these databases, attackers can gain access to internal documents such as HR policies and top-secret product roadmaps. The RAG system works by storing document chunks as embeddings in a special-purpose vector database and querying it to provide context for the LLM. The focus on securing the LLM while neglecting the vector database leaves it vulnerable to data exfiltration. The attacker can exploit weak access controls and clever retrieval attacks to gain access to sensitive data. Key lesson: Secure vector databases to prevent data breaches caused by RAG system vulnerabilities. #BugBounty #ArtificialIntelligence #DataLeak #Infosec #VectorDatabase

    infosecwriteups.com/your-rags-

  13. Your RAG’s Secret Backdoor: Leaking Data Through Vector Databases
    This article exposes a vulnerability in Retrieval-Augmented Generation (RAG) systems, where misconfigured vector databases can lead to sensitive data leakage. By improperly securing these databases, attackers can gain access to internal documents such as HR policies and top-secret product roadmaps. The RAG system works by storing document chunks as embeddings in a special-purpose vector database and querying it to provide context for the LLM. The focus on securing the LLM while neglecting the vector database leaves it vulnerable to data exfiltration. The attacker can exploit weak access controls and clever retrieval attacks to gain access to sensitive data. Key lesson: Secure vector databases to prevent data breaches caused by RAG system vulnerabilities. #BugBounty #ArtificialIntelligence #DataLeak #Infosec #VectorDatabase

    infosecwriteups.com/your-rags-

  14. Your RAG’s Secret Backdoor: Leaking Data Through Vector Databases
    This article exposes a vulnerability in Retrieval-Augmented Generation (RAG) systems, where misconfigured vector databases can lead to sensitive data leakage. By improperly securing these databases, attackers can gain access to internal documents such as HR policies and top-secret product roadmaps. The RAG system works by storing document chunks as embeddings in a special-purpose vector database and querying it to provide context for the LLM. The focus on securing the LLM while neglecting the vector database leaves it vulnerable to data exfiltration. The attacker can exploit weak access controls and clever retrieval attacks to gain access to sensitive data. Key lesson: Secure vector databases to prevent data breaches caused by RAG system vulnerabilities. #BugBounty #ArtificialIntelligence #DataLeak #Infosec #VectorDatabase

    infosecwriteups.com/your-rags-

  15. Your RAG’s Secret Backdoor: Leaking Data Through Vector Databases
    This article exposes a vulnerability in Retrieval-Augmented Generation (RAG) systems, where misconfigured vector databases can lead to sensitive data leakage. By improperly securing these databases, attackers can gain access to internal documents such as HR policies and top-secret product roadmaps. The RAG system works by storing document chunks as embeddings in a special-purpose vector database and querying it to provide context for the LLM. The focus on securing the LLM while neglecting the vector database leaves it vulnerable to data exfiltration. The attacker can exploit weak access controls and clever retrieval attacks to gain access to sensitive data. Key lesson: Secure vector databases to prevent data breaches caused by RAG system vulnerabilities. #BugBounty #ArtificialIntelligence #DataLeak #Infosec #VectorDatabase

    infosecwriteups.com/your-rags-

  16. Your RAG’s Secret Backdoor: Leaking Data Through Vector Databases
    This article exposes a vulnerability in Retrieval-Augmented Generation (RAG) systems, where misconfigured vector databases can lead to sensitive data leakage. By improperly securing these databases, attackers can gain access to internal documents such as HR policies and top-secret product roadmaps. The RAG system works by storing document chunks as embeddings in a special-purpose vector database and querying it to provide context for the LLM. The focus on securing the LLM while neglecting the vector database leaves it vulnerable to data exfiltration. The attacker can exploit weak access controls and clever retrieval attacks to gain access to sensitive data. Key lesson: Secure vector databases to prevent data breaches caused by RAG system vulnerabilities. #BugBounty #ArtificialIntelligence #DataLeak #Infosec #VectorDatabase

    infosecwriteups.com/your-rags-

  17. Did you know? Our pgedge-vectorizer tool (on GitHub: github.com/pgEdge/pgedge-vecto) automatically chunks text content and generates vector embeddings with the help of background workers.

    OpenAI, Voyage AI, and Ollama are supported as embedding providers, and a simple SQL interface allows you to enable vectorization on any table. (There’s even built-in views and functions for monitoring queue status.)

    #github #opensource #semanticsearch #vector #vectordatabase #openai #ollama #voyageai

  18. Did you know? Our pgedge-vectorizer tool (on GitHub: github.com/pgEdge/pgedge-vecto) automatically chunks text content and generates vector embeddings with the help of background workers.

    OpenAI, Voyage AI, and Ollama are supported as embedding providers, and a simple SQL interface allows you to enable vectorization on any table. (There’s even built-in views and functions for monitoring queue status.)

    #github #opensource #semanticsearch #vector #vectordatabase #openai #ollama #voyageai

  19. Did you know? Our pgedge-vectorizer tool (on GitHub: github.com/pgEdge/pgedge-vecto) automatically chunks text content and generates vector embeddings with the help of background workers.

    OpenAI, Voyage AI, and Ollama are supported as embedding providers, and a simple SQL interface allows you to enable vectorization on any table. (There’s even built-in views and functions for monitoring queue status.)

    #github #opensource #semanticsearch #vector #vectordatabase #openai #ollama #voyageai

  20. Retrieval-Augmented Generation (RAG) Tutorial: Architecture, Implementation, and Production Guide:
    glukhov.org/rag/

  21. PostgreSQL with DiskANN indexing now beats Pinecone by 28x on latency at 75% lower cost. AdwaitX analyzes how OpenAI scaled to 800M users and why developers consolidate AI workloads. Technical breakdown #AdwaitX #PostgreSQL #VectorDatabase #AI

    adwaitx.com/postgresql-ai-appl

  22. If you're located near Illinois, Shaun Thomas will be presenting on "The New Postgres AI Ecosystem" at the Illinois Prairie PostgreSQL User Group this February 18th at 5:30 PM CST. 🐘

    Come by the DRW and say hi: meetup.com/illinois-prairie-po

    #postgresql #postgres #ai #vectordatabase #pgvector #vectorization #aidev #illinois #chicago

  23. If you're located near Illinois, Shaun Thomas will be presenting on "The New Postgres AI Ecosystem" at the Illinois Prairie PostgreSQL User Group this February 18th at 5:30 PM CST. 🐘

    Come by the DRW and say hi: meetup.com/illinois-prairie-po

    #postgresql #postgres #ai #vectordatabase #pgvector #vectorization #aidev #illinois #chicago

  24. If you're located near Illinois, Shaun Thomas will be presenting on "The New Postgres AI Ecosystem" at the Illinois Prairie PostgreSQL User Group this February 18th at 5:30 PM CST. 🐘

    Come by the DRW and say hi: meetup.com/illinois-prairie-po

    #postgresql #postgres #ai #vectordatabase #pgvector #vectorization #aidev #illinois #chicago

  25. If you're located near Illinois, Shaun Thomas will be presenting on "The New Postgres AI Ecosystem" at the Illinois Prairie PostgreSQL User Group this February 18th at 5:30 PM CST. 🐘

    Come by the DRW and say hi: meetup.com/illinois-prairie-po

    #postgresql #postgres #ai #vectordatabase #pgvector #vectorization #aidev #illinois #chicago

  26. pgedge-vectorizer: #Postgres extension that automatically vectorizes document contents and keeps vector embeddings current when the underlying content changes.

    Unlike other solutions, no external services or third party pipelines are required. It's also 100% open source under the #PostgreSQL license. ✨

    Check it out on GitHub: 👉 github.com/pgEdge/pgedge-vecto

    #programming #vector #vectordatabase #vectorsearch #vectordb #ai #llm #aiengineering #aidev #dba

  27. pgedge-vectorizer: #Postgres extension that automatically vectorizes document contents and keeps vector embeddings current when the underlying content changes.

    Unlike other solutions, no external services or third party pipelines are required. It's also 100% open source under the #PostgreSQL license. ✨

    Check it out on GitHub: 👉 github.com/pgEdge/pgedge-vecto

    #programming #vector #vectordatabase #vectorsearch #vectordb #ai #llm #aiengineering #aidev #dba

  28. pgedge-vectorizer: #Postgres extension that automatically vectorizes document contents and keeps vector embeddings current when the underlying content changes.

    Unlike other solutions, no external services or third party pipelines are required. It's also 100% open source under the #PostgreSQL license. ✨

    Check it out on GitHub: 👉 github.com/pgEdge/pgedge-vecto

    #programming #vector #vectordatabase #vectorsearch #vectordb #ai #llm #aiengineering #aidev #dba

  29. pgedge-vectorizer: #Postgres extension that automatically vectorizes document contents and keeps vector embeddings current when the underlying content changes.

    Unlike other solutions, no external services or third party pipelines are required. It's also 100% open source under the #PostgreSQL license. ✨

    Check it out on GitHub: 👉 github.com/pgEdge/pgedge-vecto

    #programming #vector #vectordatabase #vectorsearch #vectordb #ai #llm #aiengineering #aidev #dba

  30. Trợ lý AI như ChatGPT thường quên lịch sử sau mỗi phiên làm việc, khiến người dùng phải mô tả lại lỗi nhiều lần. Bài viết đề xuất giải pháp: thêm lớp "bộ nhớ liên tục" dùng vector storage giữa CLI và AI, tự động lưu/lấy giải pháp cho các lỗi lặp lại. Braves este các thách thức như vệ sinh dữ liệu, định dạng fix lệnh chuẩn và bảo mật. Thử nghiệm CLI Python dùng DeepSeek V3 cho thấy giảm chi phí token về 0 cho sự cố đã giải quyết.

    #AI #CLI #DevTools #VectorDatabase #Programming
    #TríTuệNhânTạo #L

  31. SurgeDB: Cơ sở dữ liệu vector nhúng, hiệu năng cao, chạy nhẹ trên thiết bị biên, laptop hay VPS nhỏ. Viết bằng Rust, không phụ thuộc ngoài, hỗ trợ SIMD, HNSW, lọc metadata và bền vững với WAL. Chỉ tốn ~39MB RAM cho 100k vectors (768-dim), độ trễ tìm kiếm 0.64ms. Khác biệt với SQLite-vec và LanceDB ở kiến trúc hybrid in-memory + nén mạnh (SQ8/Binary). Đang tìm cộng sự phát triển WASM, tối ưu SIMD, binding Python/Node. Mã nguồn mở MIT. #SurgeDB #VectorDatabase #Rust #EdgeAI #HNSW #SQLite #AI #Mach