#inference — Public Fediverse posts

Benchmarking Pocket-Scale Inference

https://artificialanalysis.ai/hardware-inference-stack/mobile-phones

Comments: https://news.ycombinator.com/item?id=49469786

#HackerNews #benchmarking #pocket-scale #inference #AI #hardware #mobile #phones #tech #analysis

LLMs could control their host machines by exploiting inference engines

https://boydkane.com/essays/llms-could-control-their-host-machines-by-exploiting-inference-engines

Comments: https://news.ycombinator.com/item?id=49424387

#HackerNews #LLMs #AI #security #inference #engines #machine #learning #technology #risks

#blog #journal #autism #catatonia #functioning #bestfriend #family #language #verbal #inference #roughdraft #finaldraft https://rant.li/atmercurialatrant-li/catatonia-and-autism-superior-functioning

Liquid AI's Tiny Encoders Run Long-Context Inference 3.7× Faster on CPU Than ModernBERT

Stay curious — follow @1ban_news.

https://1ban.news/lfm-encoders-cpu-inference-2026/

#1ban #lfm #encoders #cpu #inference #tech

I'm using Text-To-Speech (TTS) on my Desktop (Calender Events, Firefox Read Aloud) and with Home Assistant. However the quality isn't the best and I wanted a better option.

I've started a new project for this called crane-wyoming which is in alpha/beta stage as it is not feature complete but works well for TTS.

https://codeberg.org/cryptomilk/crane-wyoming

#homeassistant #speech #speechd #speechdispatcher #tts #inference #llm #voice #asr #qwen #voxtral #ai #rust

Version 0.18.0 of my #debian13 #chatbot completed this morning - huge UI change! 🌊

Hoping to get 1.0 out before August! 🥂

https://llgit.llamachile.tube/gramps/cAIc

#AI, #ClusterOrchestration, #RAG, #cAIc, #GPUs, #CPUs, #Inference, #Homelab, #TechInnovation, #HardwareCompatibility

The #AIglossary provides definitions for common #AIterms, including #AGI, #AIagents, #APIendpoints, #chainofthought #reasoning, #codingagents, #compute, #deeplearning, #diffusion, #distillation, #finetuning, #GANs, #hallucinations, #inference, and #LLMs. It aims to demystify the language used in the #AIindustry, making it accessible to those building, investing in, or simply interested in #AI. It’s a living document, updated as the field evolves. https://techcrunch.com/2026/07/03/artificial-intelligence-definition-glossary-hallucinations-guide-to-common-ai-terms/?eicker.news #tech #media #news

The Hidden Engineering Behind Fast AI: How LLM Inference Actually Works

https://techlife.blog/posts/llm-inference-optimization/

#LLM #Inference #PagedAttention #vLLM #FlashAttention #SpeculativeDecoding #MachineLearning #GPUOptimization #KVCache

Flux 2 Klein pure C inference

https://github.com/antirez/flux2.c

#HackerNews #Flux2 #Klein #C #Inference #MachineLearning #CProgramming #OpenSource

`His initial intended uses were for linguistic analysis and other mathematical subjects like card shuffling, but both Markov chains and matrices rapidly found use in other fields.`

https://en.wikipedia.org/wiki/Stochastic_matrix#History

#AndreyMarkov #Markov #MarkovChain #MarkovModel #statistics #stochastic #stochasticProcess #randomWalk #statisticalPhysics #physics #inference #distribution #equilibrium #transitionRate #transitionMatrix #MarkovMatrix #stochasticMatrix #linearAlgebra #differentialEquation #equation

#Mistral AI conducted a comprehensive #lifecycle #analysis of its #LLM, Mistral Large 2, to quantify its #environmental #impact. The #study, #peerreviewed and compliant with international standards, revealed the model’s #training and #inference #impacts, including #greenhousegas emissions, #water use, and #resourcedepletion. https://mistral.ai/news/our-contribution-to-a-global-environmental-standard-for-ai?eicker.news #tech #media #news

Constraints and Indications • 2
• https://inquiryintoinquiry.com/2024/07/04/constraints-and-indications-2-a/

Coping with collaboration, communication, context, integration, interoperability, perspective, purpose, and the reality of the information dimension demands a transition from conceptual environments bounded by dyadic relations to those informed by triadic relations, especially the variety of triadic sign relations employed by pragmatic semiotics.

Along the lines of my first post on this topic I am presently concerned with the logical and mathematical requirements of dealing with constraints but when it comes to the constraints involved in communicating across cultural and disciplinary barriers I could recommend a paper Susan Awbrey and I wrote for a conference devoted to those very issues.

Conference Presentation —

Awbrey, S.M., and Awbrey, J.L. (1999), “Organizations of Learning or Learning Organizations : The Challenge of Creating Integrative Universities for the Next Century”, Second International Conference of the Journal ‘Organization’, Re‑Organizing Knowledge, Trans‑Forming Institutions : Knowing, Knowledge, and the University in the 21st Century, University of Massachusetts, Amherst, MA.
• https://cspeirce.com/menu/library/aboutcsp/awbrey/integrat.htm

Published Paper —

Awbrey, S.M., and Awbrey, J.L. (2001), “Conceptual Barriers to Creating Integrative Universities”, Organization : The Interdisciplinary Journal of Organization, Theory, and Society 8(2), Sage Publications, London, UK, 269–284.
• https://journals.sagepub.com/doi/abs/10.1177/1350508401082013
• https://www.academia.edu/1266492/Conceptual_Barriers_to_Creating_Integrative_Universities

#Peirce #Logic #Semiotics #Indication #Inference #Information #Inquiry
#Ashby #Cybernetics #Constraint #Control #Regulation #RequisiteVariety
#AdaptiveSystems #IntelligentSystems #InquiryDrivenSystems #Pragmatics

Neurone, #inférence, #entraînement, #hallucination… de quoi on parle ?
https://next.ink/133395/neurone-inferences-entrainement-hallucination-de-quoi-on-parle/