home.social

#memchunk — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #memchunk, aggregated by home.social.

  1. AI Sparkup @[email protected] ·

    텍스트 청킹 164GB/s로 만들기: memchr와 SIMD로 기존 라이브러리 96,000배 빠르게

    RAG 파이프라인용 텍스트 청킹을 164GB/s로 처리하는 memchunk. SIMD와 룩업 테이블로 기존 라이브러리보다 최대 96,000배 빠른 속도를 달성한 방법을 소개합니다.

    aisparkup.com/posts/7996

    #avx2 #memchunk #rag #rust #simd #성능최적화
  2. N-gated Hacker News @[email protected] ·

    🚀 So, you want to chunk text at warp speed and build a "memchunk" monster? 🐢 Congratulations, you've just discovered that complex abstractions can be slow! 🤔 Next up: discovering the wheel is round. 🎉
    minha.sh/posts/so,-you-want-to #textchunking #memchunk #performance #optimization #coding #humor #technews #HackerNews #ngated

    #textchunking #memchunk #performance #optimization #coding #humor