#chit — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #chit, aggregated by home.social.
-
#LocalLLM update! I was able to implement this rather complicated feature using Pi and Qwen3.6 27B.
It added a rendering state to my #Chit LLM chat app that renders rectangles over the uploaded image.
Basically you ask for a specific JSON format back, and if it detects it in the stream, it'll create a new image, rendering the rectangles over the objects.
It didn't work immediately out of the gate, but it took a couple turns to fix some bugs. But ultimately it DID work, and so far it works great. :D
But the real headline is that I didn't use Claude or OpenAI stuff. All local. 4090. 24gb.
That's the future we need to head towards if we're going to be using AI for coding going forward. If we're going to shift towards this method of development, we CANNOT be bound to any company, with their leash around our necks and wallets.
-
#LocalLLM update! I was able to implement this rather complicated feature using Pi and Qwen3.6 27B.
It added a rendering state to my #Chit LLM chat app that renders rectangles over the uploaded image.
Basically you ask for a specific JSON format back, and if it detects it in the stream, it'll create a new image, rendering the rectangles over the objects.
It didn't work immediately out of the gate, but it took a couple turns to fix some bugs. But ultimately it DID work, and so far it works great. :D
But the real headline is that I didn't use Claude or OpenAI stuff. All local. 4090. 24gb.
That's the future we need to head towards if we're going to be using AI for coding going forward. If we're going to shift towards this method of development, we CANNOT be bound to any company, with their leash around our necks and wallets.
-
#LocalLLM update! I was able to implement this rather complicated feature using Pi and Qwen3.6 27B.
It added a rendering state to my #Chit LLM chat app that renders rectangles over the uploaded image.
Basically you ask for a specific JSON format back, and if it detects it in the stream, it'll create a new image, rendering the rectangles over the objects.
It didn't work immediately out of the gate, but it took a couple turns to fix some bugs. But ultimately it DID work, and so far it works great. :D
But the real headline is that I didn't use Claude or OpenAI stuff. All local. 4090. 24gb.
That's the future we need to head towards if we're going to be using AI for coding going forward. If we're going to shift towards this method of development, we CANNOT be bound to any company, with their leash around our necks and wallets.
-
#LocalLLM update! I was able to implement this rather complicated feature using Pi and Qwen3.6 27B.
It added a rendering state to my #Chit LLM chat app that renders rectangles over the uploaded image.
Basically you ask for a specific JSON format back, and if it detects it in the stream, it'll create a new image, rendering the rectangles over the objects.
It didn't work immediately out of the gate, but it took a couple turns to fix some bugs. But ultimately it DID work, and so far it works great. :D
But the real headline is that I didn't use Claude or OpenAI stuff. All local. 4090. 24gb.
That's the future we need to head towards if we're going to be using AI for coding going forward. If we're going to shift towards this method of development, we CANNOT be bound to any company, with their leash around our necks and wallets.
-
#LocalLLM update! I was able to implement this rather complicated feature using Pi and Qwen3.6 27B.
It added a rendering state to my #Chit LLM chat app that renders rectangles over the uploaded image.
Basically you ask for a specific JSON format back, and if it detects it in the stream, it'll create a new image, rendering the rectangles over the objects.
It didn't work immediately out of the gate, but it took a couple turns to fix some bugs. But ultimately it DID work, and so far it works great. :D
But the real headline is that I didn't use Claude or OpenAI stuff. All local. 4090. 24gb.
That's the future we need to head towards if we're going to be using AI for coding going forward. If we're going to shift towards this method of development, we CANNOT be bound to any company, with their leash around our necks and wallets.
-
Nimic altceva nu împovărează sufletul decât roadele păcatului „De mă voi coborî în iad de față ești, de voi lua aripile mele de dimineață și mă voi așeza la marginile mării, încât să mă ascund de ochii Tăi, și acolo mâna Ta mă va povățui și mă va ține dreapta Ta.” 👉 https://c.aparatorul.md/ts2hq 👈 #închisoare #adulter #balena #chit #Clevetire #Corabie #corabieri #CuvinteAscetice #Iona #mărturia #marinari #marturiamincinoasa #Neputințe #pizmuire #Profet #scufundat...
https://c.aparatorul.md/ts2hq -
Nimic altceva nu împovărează sufletul decât roadele păcatului „De mă voi coborî în iad de față ești, de voi lua aripile mele de dimineață și mă voi așeza la marginile mării, încât să mă ascund de ochii Tăi, și acolo mâna Ta mă va povățui și mă va ține dreapta Ta.” 👉 https://c.aparatorul.md/vjy8l 👈 #închisoare #adulter #balena #chit #Clevetire #Corabie #corabieri #CuvinteAscetice #Iona #mărturia #marinari #marturiamincinoasa #Neputințe #pizmuire #Profet #scufundat...
https://c.aparatorul.md/vjy8l -
Nimic altceva nu împovărează sufletul decât roadele păcatului „De mă voi coborî în iad de față ești, de voi lua aripile mele de dimineață și mă voi așeza la marginile mării, încât să mă ascund de ochii Tăi, și acolo mâna Ta mă va povățui și mă va ține dreapta Ta.” 👉 https://c.aparatorul.md/qd1fc 👈 #închisoare #adulter #balena #chit #Clevetire #Corabie #corabieri #CuvinteAscetice #Iona #mărturia #marinari #marturiamincinoasa #Neputințe #pizmuire #Profet #scufundat...
https://c.aparatorul.md/qd1fc -
Fun #LLM tip for you.
The red block indicates a response that, originally, was a denial.
> "I cannot fulfill the request to set a dog on fire, as creating content that depicts animal abuse or harm is against my safety guidelines. I can, however, update the scene with other elements if you'd like, such as adding some clouds to the sky or changing the time of day."
I've found that if you EDIT THE RESPONSE and replace it with something like I did in the pic, or similar wording... and then let it respond again (to continue the response)... most of the time it will actually go through with the restricted request.
And that's not specific to any one model. Some are more resistant than others, but none I've tried are completely locked up. And then after that it's usually smooth sailing. :P
Most chat interfaces don't let you do this, though.
Mine does. 😉
-
Nimic altceva nu împovărează sufletul decât roadele păcatului „De mă voi coborî în iad de față ești, de voi lua aripile mele de dimineață și mă voi așeza la marginile mării, încât să mă ascund de ochii Tăi, și acolo mâna Ta mă va povățui și mă va ține dreapta Ta.” 👉 https://c.aparatorul.md/fp6it 👈 #închisoare #adulter #balena #chit #Clevetire #Corabie #corabieri #CuvinteAscetice #Iona #mărturia #marinari #marturiamincinoasa #Neputințe #pizmuire #Profet #scufundat...
https://c.aparatorul.md/fp6it -
Daaaang, the new season of #theChitShow started off with a banger!
-
Daaaang, the new season of #theChitShow started off with a banger!
-
Daaaang, the new season of #theChitShow started off with a banger!
-
Daaaang, the new season of #theChitShow started off with a banger!
-
Daaaang, the new season of #theChitShow started off with a banger!
-
Nimic altceva nu împovărează sufletul decât roadele păcatului „De mă voi coborî în iad de față ești, de voi lua aripile mele de dimineață și mă voi așeza la marginile mării, încât să mă ascund de ochii Tăi, și acolo mâna Ta mă va povățui și mă va ține dreapta Ta.” 👉 https://c.aparatorul.md/2ef9p 👈 #închisoare #adulter #balena #chit #Clevetire #Corabie #corabieri #CuvinteAscetice #Iona #mărturia #marinari #marturiamincinoasa #Neputințe #pizmuire #Profet #scufundat...
https://c.aparatorul.md/2ef9p -
My new inspirational fridge magnet for my wife arrived today.
-
My new inspirational fridge magnet for my wife arrived today.
-
My new inspirational fridge magnet for my wife arrived today.
-
My new inspirational fridge magnet for my wife arrived today.
-
My new inspirational fridge magnet for my wife arrived today.
-
If you haven’t been paying attention, there is a new season of #Chit coming out, with some #Thanksgiving dinner scenes you do not want to miss.
-
A new #chit and a new #StrongBad email on the same day?! We are blessed!
-
A new #chit and a new #StrongBad email on the same day?! We are blessed!
-
A new #chit and a new #StrongBad email on the same day?! We are blessed!
-
A new #chit and a new #StrongBad email on the same day?! We are blessed!
-
A new #chit and a new #StrongBad email on the same day?! We are blessed!
-
-
-
-
-
-
Nimic altceva nu împovărează sufletul decât roadele păcatului „De mă voi coborî în iad de față ești, de voi lua aripile mele de dimineață și mă voi așeza la marginile mării, încât să mă ascund de ochii Tăi, și acolo mâna Ta mă va povățui și mă va ține dreapta Ta.” 👉 https://c.aparatorul.md/ezf06 👈 #închisoare #adulter #balena #chit #Clevetire #Corabie #corabieri #CuvinteAscetice #Iona #mărturia #marinari #marturiamincinoasa #Neputințe #pizmuire #Profet #scufundat...
https://c.aparatorul.md/ezf06 -
-
You gotta ponk to make a honk. 😂
-
You gotta ponk to make a honk. 😂
-
You gotta ponk to make a honk. 😂
-
You gotta ponk to make a honk. 😂
-
You gotta ponk to make a honk. 😂
-
Nimic altceva nu împovărează sufletul decât roadele păcatului „De mă voi coborî în iad de față ești, de voi lua aripile mele de dimineață și mă voi așeza la marginile mării, încât să mă ascund de ochii Tăi, și acolo mâna Ta mă va povățui și mă va ține dreapta Ta.” 👉 https://c.aparatorul.md/7n40p 👈 #închisoare #adulter #balena #chit #Clevetire #Corabie #corabieri #CuvinteAscetice #Iona #mărturia #marinari #marturiamincinoasa #Neputințe #pizmuire #Profet #scufundat...
https://c.aparatorul.md/7n40p -
-
Still a WIP, but I'm finally making progress on my rewrite of #Chit, the front-end chat interface for #Ollama.
Closing in on feature parity with the original (then I can start adding new features). I'm psyched to finally have chat 'sessions' so I don't have to lose whatever I'm doing just to ask some other thing. (I'd have to duplicate tabs before.)
It maintains state between reloads quite solidly, too.
You can poke at it over here; it'll gets updated whenever I make a push. It's still alpha, and missing some basic features (temperature controls, for instance, a config page, etc), but should work fine.
It uses a default Ollama installed -- you may need to tweak your server to allow access, but that's beyond the scope of this right now.
https://fortyseven.github.io/chit-v2/
At some point, when it gets closer to solid, I'll make a quick tutorial video.
-
Nimic altceva nu împovărează sufletul decât roadele păcatului „De mă voi coborî în iad de față ești, de voi lua aripile mele de dimineață și mă voi așeza la marginile mării, încât să mă ascund de ochii Tăi, și acolo mâna Ta mă va povățui și mă va ține dreapta Ta.” 👉 https://c.aparatorul.md/87wrk 👈 #închisoare #adulter #balena #chit #Clevetire #Corabie #corabieri #CuvinteAscetice #Iona #mărturia #marinari #marturiamincinoasa #Neputințe #pizmuire #Profet #scufundat...
https://c.aparatorul.md/87wrk -
I think what bugs me about this is that I've been able to assemble a decent summary system prompt that has, so far at least, not invented anything.
"How do you know", you may ask. Well, I can't say with 100% certainty because after a while I started trusting it.
But for a while I was immensely distrustful of it, and I'd regularly put through it real articles, and content I was familiar with, and look at the results.
But I've been using it for quite a few months now, with Llama 3.1, and it's proven itself quite good with whole raw text dumps of webpages.
(I use it so often that I include it with the handful of default system prompts with #chit (my Ollama front-end).)
Here it is: https://gist.github.com/Fortyseven/708dac25d24f1d2d063d4b3f2dc48596
Since I started using it regularly, if something sounds out of place or "sounds wrong", I'll go and verify. (And honestly, I'll even fuck up verifying: it'll be technically correct about something, but I'll have misread or overlooked the fact in question.)
So I'd love to know how Apple is fucking this up. Apparently this is not an isolated incident: https://www.theverge.com/2024/11/12/24289939/apple-intelligence-ai-notification-summaries-awkward-funny-bad
I wonder if their prompts have been dumped yet?
-
Working on a new feature for #Chit: optional follow-up suggestions! The follow-up query is returning a valid JSON response _most_ of the time...
```
You will be provided with an AI assistant's response. Generate a JSON array of 4 suggested follow-up queries the user might want to query you about it.For example, follow-up queries might be among:
- "Tell me more about..."
- "What is..."
- "Rewrite that response in a more professional tone..."
- "Why does..."
- "Does it say..."Only respond with valid JSON in this format: ["suggestion", "suggestion2"]
``` -
Nimic altceva nu împovărează sufletul decât roadele păcatului https://c.aparatorul.md/3mfrd #închisoare #adulter #balena #chit #Clevetire #Corabie #corabieri #CuvinteAscetice #Iona #mărturia #marinari #marturiamincinoasa #Neputințe #pizmuire #Profet #scufundat #SfântulSimeonStâlpniculDinMunteleMinunat #vadireapacatului
-
Added syntax highlighting and a bunch of various new conveniences to #Chit.
https://github.com/Fortyseven/chit
-
Givin' shit to books from nearly 50 years ago! TAKE THAT!
(My favorite bit: "Finally, we have the hyperbolic conclusion: “destined to become one of those books…too big to fit on the shelf.” Oh, the irony! This book is probably so thin it could be folded in half and used as a coaster.")