home.social

#matmul — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #matmul, aggregated by home.social.

  1. Detailing the tiling scheme used for a CUDA kernel doing matrix-matrix multiplication indii.org/blog/gpu-matrix-mult

  2. Researchers upend AI status quo by eliminating matrix multiplication in LLMs - Enlarge / Illustration of a brain inside of a light bulb. (credit: Gett... - arstechnica.com/?p=2033314 #matrixmultiplication #machinelearning #googlegemini #ucsantacruz #matrixmath #chatgpt #ternary #biz#matmul #gpu #ai

  3. Researchers upend AI status quo by eliminating matrix multiplication in LLMs - Enlarge / Illustration of a brain inside of a light bulb. (credit: Gett... - arstechnica.com/?p=2033314 #matrixmultiplication #machinelearning #googlegemini #ucsantacruz #matrixmath #chatgpt #ternary #biz#matmul #gpu #ai

  4. Researchers upend AI status quo by eliminating matrix multiplication in LLMs - Enlarge / Illustration of a brain inside of a light bulb. (credit: Gett... - arstechnica.com/?p=2033314 #matrixmultiplication #machinelearning #googlegemini #ucsantacruz #matrixmath #chatgpt #ternary #biz#matmul #gpu #ai

  5. Researchers upend AI status quo by eliminating matrix multiplication in LLMs - Enlarge / Illustration of a brain inside of a light bulb. (credit: Gett... - arstechnica.com/?p=2033314 #matrixmultiplication #machinelearning #googlegemini #ucsantacruz #matrixmath #chatgpt #ternary #biz#matmul #gpu #ai

  6. Researchers upend AI status quo by eliminating matrix multiplication in LLMs - Enlarge / Illustration of a brain inside of a light bulb. (credit: Gett... - arstechnica.com/?p=2033314 #matrixmultiplication #machinelearning #googlegemini #ucsantacruz #matrixmath #chatgpt #ternary #biz#matmul #gpu #ai

  7. My #Python code using #numpy is taking ~20 minutes to multiply two large-ish matrices (~17k x ~33k, ~33k x 700). Is this normal? I feel like this shouldn't be normal.

    #NumPy #LinearAlgebra #Matmul

  8. Another incredible thread from Horace He:

    twitter.com/cHHillee/status/16

    This time in response to a thread from @karpathy where slightly increasing the size of the embedding matrix resulted in a large speedup.

    This thread covers some nuances of memory accesses and utilization for matmul, the basics of which are introduced here:

    docs.nvidia.com/deeplearning/p

    #CUDA #matmul