#sparsity — Public Fediverse posts

'A minimax optimal approach to high-dimensional double sparse linear regression', by Yanhang Zhang, Zhifan Li, Shixiang Liu, Jianxin Yin.

http://jmlr.org/papers/v25/23-0653.html

#sparse #thresholding #sparsity

'skscope: Fast Sparsity-Constrained Optimization in Python', by Zezhi Wang, Junxian Zhu, Xueqin Wang, Jin Zhu, Huiyang Pen, Peng Chen, Anran Wang, Xiaoke Zhang.

http://jmlr.org/papers/v25/23-1574.html

#sparse #optimization #sparsity

#mistral's 8x22B is ~260GB

the trend is to get models smaller, not bigger

#pruning, #sparsity, #quantization, #distillation

so why such a huge model?

does mistral have no other models?

The last talk of the second day of #DIPOpt, by Remi Grinonval, “Rapture of the deep: highs and lows of sparsity in a world of depths”.
#Sparsity #inverseproblems

Yasuhisa Kuroda released a spectral data processing program for chemical analysis called SPANA https://www.eonet.ne.jp/~spana-lsq/index-e.html. He has been kind enough to incorporate our BEADS algorithm (baseline estimation & denoising w/ #sparsity) to separate peaks, baseline and noise using sparsity priors! https://doi.org/10.1016/j.chemolab.2014.09.014 #analyticalchemistry

Damian Bogunowicz, Neural Magic: On revolutionising deep learning with CPUs https://www.artificialintelligence-news.com/2023/07/24/damian-bogunowicz-neural-magic-revolutionising-deep-learning-cpus/ #ai #sparsity #llm #tech #technology

'Fundamental limits and algorithms for sparse linear regression with sublinear sparsity', by Lan V. Truong.

http://jmlr.org/papers/v24/21-0543.html

#sparse #sparsity #interpolation

New podcast from @thegradient with Hattie Zhou (twitter: https://twitter.com/oh_that_hat):

`Lottery Tickets and Algorithmic Reasoning in LLMs`

https://thegradientpub.substack.com/p/hattie-zhou-lottery-tickets-and-algorithmic

The first half is focused on the lottery ticket hypothesis, which is a favorite topic of mine.

#ML #sparsity #LLMs

Inside APFS: from containers to clones

https://eclecticlight.co/2023/01/02/inside-apfs-from-containers-to-clones/

#GUIDPartitionTable #Technology #filesystem #sparsefile #container #partition #Sparsity #clone #Macs #APFS #HFS+ #GPT

Inside APFS: from containers to clones

https://eclecticlight.co/2023/01/02/inside-apfs-from-containers-to-clones/

#GUIDPartitionTable #Technology #filesystem #sparsefile #container #partition #Sparsity #clone #Macs #APFS #HFS+ #GPT