#qat — Public Fediverse posts

QAD от NVIDIA: разбираюсь, почему 4-битная квантизация перестала всё ломать

NVIDIA выпустила отчет о методе QAD, который позволяет квантовать LLM в 4 бита без потери качества на сложных задачах (математика, код). Разбираем, почему привычный QAT «ломает» модели после RLHF, как дистилляция через KL-дивергенцию решает эту проблему и почему метод работает даже на рандомных данных. Личный опыт попыток уместить 49B модель в железо и анализ нового подхода.

https://habr.com/ru/articles/991586/

#LLM #Квантизация #NVIDIA #QAD #QAT #FP4 #Blackwell #Machine_Learning #Llama #Distillation

Gemma 3 QAT Models: Bringing AI to Consumer GPUs

https://developers.googleblog.com/en/gemma-3-quantized-aware-trained-state-of-the-art-ai-to-consumer-gpus/

#HackerNews #Gemma3 #QAT #AI #ConsumerGPUs #MachineLearning #TechInnovation

Google Releases Gemma 3 QAT AI Models for Consumer GPUs

#AI #AIModels #GoogleAI #Gemma3 #LLM #OpenSourceAI #GPUs #QAT #Quantization #DeepLearning #MachineLearning #NVIDIA #RTX3090 #Kaggle

https://winbuzzer.com/2025/04/20/google-releases-gemma-3-qat-ai-models-for-consumer-gpus-xcxwbn/

Who knew a 'sin tax' on #Khat could lead to #MentalHealth revolution in #Somaliland? Country's innovative approach is #Funding treatment for addicts, but let's not forget: #InternationalDonors, you're not off the hook yet! #MentalHealthMatters #Qat

https://saxafimedia.com/somaliland-sin-tax-mental-health/

Answering myself: LKCF seems to use the in-tree QAT driver by default for a bunch of algorithms. #QAT #linux #kernel

Is anyone using the upstreamed Intel #QAT kernel module for anything? Is it useful at all? All the Intel instructions seem to start with installing their stuff instead. #linux #kernel

Anyone else gone down the rabbit hole of #Intel #QAT support on #FreeBSD?

The performance boost is crazy, Server The Home has a great write up about it on the Xeon D CPU:
https://www.servethehome.com/welcome-to-the-intel-ice-lake-d-era-with-the-xeon-d-2700-and-d-1700-series/

It accelerates #OpenSSL
https://github.com/intel/QAT_Engine/tree/master

It also accelerates gzip with a QATzip module.

For #Nginx there is a great guide:
https://www.intel.com/content/www/us/en/developer/articles/guide/nginx-https-with-qat-tuning-guide.html

It looks like a lot of work to configure and test, but hopefully later this summer I can give it a go on a system . CPU that supports QAT.

#SysAdmin

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
#IRN 0 - 1 #USA
#WAL 0 - 3 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
#IRN 0 - 1 #USA
#WAL 0 - 3 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
#IRN 0 - 1 #USA
#WAL 0 - 3 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
#IRN 0 - 1 #USA
#WAL 0 - 3 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
#IRN 0 - 1 #USA
#WAL 0 - 3 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
#IRN 0 - 1 #USA
#WAL 0 - 3 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
#IRN 0 - 1 #USA
#WAL 0 - 3 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
#IRN 0 - 1 #USA
#WAL 0 - 3 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
#IRN 0 - 1 #USA
#WAL 0 - 3 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
#IRN 0 - 1 #USA
#WAL 0 - 3 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
#WAL 0 - 3 #ENG
Running Games:
90'+7' #IRN 0 - 1 #USA

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
Running Games:
81' #IRN 0 - 1 #USA
83' #WAL 0 - 3 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
Running Games:
67' #IRN 0 - 1 #USA
69' #WAL 0 - 3 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
Running Games:
52' #IRN 0 - 1 #USA
55' #WAL 0 - 2 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
Running Games:
HT #IRN 0 - 1 #USA
HT #WAL 0 - 0 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
Running Games:
44' #IRN 0 - 1 #USA
43' #WAL 0 - 0 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
Running Games:
29' #IRN 0 - 0 #USA
29' #WAL 0 - 0 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
Running Games:
13' #IRN 0 - 0 #USA
15' #WAL 0 - 0 #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
Upcoming Games:
29/11/2022 19:00 UTC #IRN - #USA
29/11/2022 19:00 UTC #WAL - #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc

#FIFA World Cup 2022 Scores. Group Stage.

Ended Games:
#ECU 1 - 2 #SEN
#NED 2 - 0 #QAT
Upcoming Games:
29/11/2022 19:00 UTC #IRN - #USA
29/11/2022 19:00 UTC #WAL - #ENG

#fifaworldcup #worldcup #fifaworldcup2022 #football #soccer #futbol #mundialqatar #mundialqatar2022 #qatar2022 #mastodonfc