Search
1000 results for “sparse_array”
-
DeepSeek tests “sparse attention” to slash AI processing costs - Ever wonder why ChatGPT slows down during long conversations... - https://arstechnica.com/ai/2025/09/deepseek-tests-sparse-attention-to-slash-ai-processing-costs/ #computationalefficiency #transformerarchitecture #long-contextprocessing #aidevelopmenttools #aiinfrastructure #machinelearning #sparseattention #aiefficiency #airesearch #opensource #chineseai #deepseek #biz #ai
-
'Outlier Robust and Sparse Estimation of Linear Regression Coefficients', by Takeyuki Sasai, Hironori Fujisawa.
http://jmlr.org/papers/v26/23-1583.html
#outlier #outliers #robust -
Co-designing a sparse music codec with ChatGPT o3
https://akuz.me/co-designing-a-sparse-music-codec-with-chatgpt-o3-in-one-day-my-mini-pied-piper.html
#HackerNews #CoDesign #SparseMusicCodec #ChatGPT #Innovation #MusicTechnology
-
'Rank-one Convexification for Sparse Regression', by Alper Atamturk, Andres Gomez.
http://jmlr.org/papers/v26/19-159.html
#sparse #lasso #convexification -
@liamvhogan #Canberra was pretty sparse and to me felt reasonably egalitarian in the 1970s/1980s. The cost and availability of housing now is a huge problem. Isn’t it nationwide - in fact international? #ausecon
-
'Numerically Stable Sparse Gaussian Processes via Minimum Separation using Cover Trees', by Alexander Terenin et al.
http://jmlr.org/papers/v25/22-1170.html
#interpolation #sparse #gaussian -
Interesting #math video on sparse rulers, which has applications ranging from #stellar #interferometry to #ElectricalEngineering designing voltage taps on transformers (ok, these days we have switchmode PS, but it's still cool).
-
Wikipedia on disadvantages of sparse files:
"Loading executables on 32 bit Windows (exe or dll) which are sparse takes a much longer time since the file cannot be memory mapped in the limited 4 GB address space, and are not cached as there is no codepath for caching 32 bit sparse executables"Who thought "I will make a dll that's full of 0 bytes, and let the filesystem handle it as a sparse file" could possibly be a solution to their problem?
-
Free time is sparse. #LetterboxdFriday #LastFourWatched #Cimemastodon
-
Free time is sparse. #LetterboxdFriday #LastFourWatched #Cimemastodon
-
Free time is sparse. #LetterboxdFriday #LastFourWatched #Cimemastodon
-
“we identified a sparse subset of neurons in the primary visual cortex (V1) and higher visual areas that respond emergently to ICs [illusory contours]. We found that these highly selective "IC-encoders" mediate the neural representation of IC inference. Strikingly, selective activation of these neurons using two-photon holographic optogenetics was sufficient to recreate IC representation in the rest of the V1 network, in the absence of any visual stimulus.”
From: “Recurrent pattern completion drives the neocortical representation of sensory inference” by Shin et al. 2023 https://www.biorxiv.org/content/10.1101/2023.06.05.543698v1
-
"The Desperation of Sparse Structure", a tetraptych in the Dark Proteome series. #darkProteome #G3BP1
-
A connection between sparse and low rank matrices. Let S be a sparse similarity matrix, for example the distances of the 3 nearest neighbours in a low dimensional manifold. Can you recover S if you have a low rank (dense) matrix L from in a high dimensional space? This paper provides a geometric interpretation for S = max(0,L). It proposes a decomposition algorithm, that can be modelled as a ReLU neural network layer.
#MachineLearning #SparseDecomposition #LowRank #TMLR
https://openreview.net/forum?id=p8gncJbMit -
'EiGLasso for Scalable Sparse Kronecker-Sum Inverse Covariance Estimation', by Jun Ho Yoon, Seyoung Kim.
http://jmlr.org/papers/v23/21-0511.html
#kronecker #sparse #gaussian -
Un po' di cose sparse che ho fatto nell'ultima settimana:
Aiutato i miei con la raccolta delle olive, rivisto Bibi, la loro nuova gattina, fatto un mini cinnamon rolls vegano, ricominciato a giocare ad Animal Crossing dopo mesi, ho un dente nuovo ( di cui vi risparmio la foto :D)...
Adesso invece mi sto bevendo una "birra" che ha il sapore e la consistenza di uno smoothie alla fragola.
Ma dopo mi ci vuole assolutamente una IPA come si deve!
#gattinisegreti #cucinaSegreta #birrette -
Un po' di cose sparse che ho fatto nell'ultima settimana:
Aiutato i miei con la raccolta delle olive, rivisto Bibi, la loro nuova gattina, fatto un mini cinnamon rolls vegano, ricominciato a giocare ad Animal Crossing dopo mesi, ho un dente nuovo ( di cui vi risparmio la foto :D)...
Adesso invece mi sto bevendo una "birra" che ha il sapore e la consistenza di uno smoothie alla fragola.
Ma dopo mi ci vuole assolutamente una IPA come si deve!
#gattinisegreti #cucinaSegreta #birrette -
Un po' di cose sparse che ho fatto nell'ultima settimana:
Aiutato i miei con la raccolta delle olive, rivisto Bibi, la loro nuova gattina, fatto un mini cinnamon rolls vegano, ricominciato a giocare ad Animal Crossing dopo mesi, ho un dente nuovo ( di cui vi risparmio la foto :D)...
Adesso invece mi sto bevendo una "birra" che ha il sapore e la consistenza di uno smoothie alla fragola.
Ma dopo mi ci vuole assolutamente una IPA come si deve!
#gattinisegreti #cucinaSegreta #birrette -
DeepSeek AI Releases DeepSeek-V4: Compressed Sparse Attention and Heavily Compressed Attention Enable One-Million-Token Contexts DeepSeek-AI has released a preview version of the DeepSeek-V4 series...
#Agentic #AI #AI #Infrastructure #AI #Paper #Summary #AI #Shorts #Applications #Artificial
Origin | Interest | Match -
🌪 Allerta FOMO
🌧 Piogge sparse di FUD
🎈 Raffiche di HYPE📈 Alta pressione sui fondamentali
☀️ Clima stabile sul Fair ValuePrevisioni a medio-lungo termine:
Dash è costruito per resistere. 😎#CFV #DashTo5000 #Dash #CryptoWeather #CryptoTwitter #BuiltToLast #Crypto #DAO #Privacy #Freedom #Trustless #Sovereignty #Meme #Web3 #FairValue
-
The Lottery Ticket Hypothesis: finding sparse trainable NNs with 90% less params
https://arxiv.org/abs/1803.03635
#HackerNews #LotteryTicketHypothesis #SparseNeuralNetworks #DeepLearning #AIResearch #ModelOptimization
-
Công cụ mới mang tên Sparse giúp nén các mô hình AI đã fine-tune dưới dạng "delta" (phần chênh lệch) so với mô hình gốc.
Điểm nổi bật:
- Nén mô hình 14GB xuống còn 1.4GB (không mất dữ liệu) hoặc 50MB (tương đương LoRA).
- Áp dụng được cho MỌI mô hình đã huấn luyện xong, không cần can thiệp lúc training.
- Tốc độ khôi phục cực nhanh (khoảng 4 giây).
- Giải pháp tối ưu cho lưu trữ và phân phối các mô hình AI chuyên biệt.#AI #MachineLearning #Sparse #Compression #DeepLearning #CongNghe #TriTueNh
-
I added a short wikipage on Sparse Sets to my wiki: https://www.sheeeeeeeep.art/ds-sparse-set.html
Also, I added a favicon with my et nihilum signature.
-
New release v1.02 of SVO 30 (Sparse Voxel Octree), a reduced version of Minecraft for #AtariFalcon computer https://www.leonik.net/dml/sec_svo30.py #atari #minecraft #AtariST
-
Всё что нужно знать про torch.sparse
Разработчики PyTorch предоставили модуль torch.sparse для работы с разреженными тензорами , где большинство элементов – нули. Зачем это нужно? Представьте матрицу смежности графа, сильно обрезанную сеть или облако точек – хранить такие данные плотным массивом без надобности расточительно. Разрежённая структура сохраняет только ненулевые элементы и их индексы, что сильно экономит память и ускоряет вычисления . Например, матрица размером 10,000 на 10,000 с 100 000 ненулевых float-значений в разрежённом COO-формате займёт не 400 МБ, а около 2 МБ. Несмотря на перспективы, API разрежённых тензоров в PyTorch пока в бете и может менять крошечные детали . Будьте к этому готовы: часть операций поддерживается, часть – нет, и некоторые автоград-ячейки пока работают только для COO, а для CSR, например, градиент не считается. Но обо всём по порядку.
https://habr.com/ru/companies/otus/articles/942164/
#ml #Data_Science #разрежённые_тензоры #PyTorch #оптимизация_памяти #torchsparse #матричное_умножение
-
An illustrated guide to automatic sparse differentiation
https://iclr-blogposts.github.io/2025/blog/sparse-autodiff/
#HackerNews #automaticdifferentiation #sparseautodiff #illustration #machinelearning #ICLR2025
-
quadrable: Authenticated multi-version database: sparse binary merkle tree with compact partial-tree proofs https://lobste.rs/s/eae7p2 #databases #distributed #merkle-trees
https://github.com/hoytech/quadrable
