#on-device-ai — Public Fediverse posts

Longer-term take on Google’s Recorder app: a human in the loop remains needed

Over the last six months, one of the apps I’ve used most on my phone has been one of the few that I can only use on my phone–Google’s Pixel-only Recorder. The free voice-transcription app that I latched onto after ditching Evernote has become a regular part of my workflow, even as it’s made its limits more obvious to me.

Recorder’s core advantage remains the ability to work offline, which is good on both functional and privacy grounds. I’m stuck on horrible WiFi or in a cellular dead zone? No problem. A sensitive conversation with a source that I don’t want instantly uploaded to a cloud-based transcription service? Handled.

(That second scenario has yet to actually come up in my work; if, however, somebody summons me to a clandestine meeting in a garage in Rosslyn, it’s nice to know I’ll be ready.)

But maybe because this app has to rely on the processing power of the Pixel 9 Pro I bought nearly two years ago instead of borrowing any cloud smarts, it continues to make the same mistakes:

• Its speaker recognition is more of a cloud of probability; in one transcript of a four-person panel last week, the app IDed me as “Speaker 1,”Speaker 2,” and “Speaker 3” while labeling only one quote as coming from “Speaker 4.”
• It continue to capitalize random nouns–in particular, hitting its virtual Shift key for “Enterprise” when transcribing conversations about the computing needs of large organizations so often that I have to wonder if it was trained on Star Trek, German, or both.
• Sometimes it just skips a sentence or two or three. I don’t know how that’s possible, considering there’s no break in the recorded audio, unless maybe my phone’s processor got briefly swamped.

But even with these repeatable glitches, cleaning up a transcription rarely requires more than one playback while I have Recorder’s transcription open in an editing app–usually Google Docs, since that’s one of Recorder’s supported export options and since that Web app can itself work offline.

Google’s updates to the app haven’t yet made a meaningful difference in its transcription accuracy but have added the option to get an AI-generated summary of a transcript. That, too, works offline, and I should try that more often.

My overall take remains unchanged from what I wrote here in March: While this app could work better, I’d still want to/have to check any AI transcription against the original recording, so this one isn’t adding that much work. And it retains its non-trivial edge of costing nothing when I already pay enough for cloud services and can only expect those expenses to keep ratcheting up.

Longer-term take on Google’s Recorder app: a human in the loop remains needed

Over the last six months, one of the apps I’ve used most on my phone has been one of the few that I can only use on my phone–Google’s Pixel-only Recorder. The free voice-transcription app that I latched onto after ditching Evernote has become a regular part of my workflow, even as it’s made its limits more obvious to me.

Recorder’s core advantage remains the ability to work offline, which is good on both functional and privacy grounds. I’m stuck on horrible WiFi or in a cellular dead zone? No problem. A sensitive conversation with a source that I don’t want instantly uploaded to a cloud-based transcription service? Handled.

(That second scenario has yet to actually come up in my work; if, however, somebody summons me to a clandestine meeting in a garage in Rosslyn, it’s nice to know I’ll be ready.)

But maybe because this app has to rely on the processing power of the Pixel 9 Pro I bought nearly two years ago instead of borrowing any cloud smarts, it continues to make the same mistakes:

• Its speaker recognition is more of a cloud of probability; in one transcript of a four-person panel last week, the app IDed me as “Speaker 1,”Speaker 2,” and “Speaker 3” while labeling only one quote as coming from “Speaker 4.”
• It continue to capitalize random nouns–in particular, hitting its virtual Shift key for “Enterprise” when transcribing conversations about the computing needs of large organizations so often that I have to wonder if it was trained on Star Trek, German, or both.
• Sometimes it just skips a sentence or two or three. I don’t know how that’s possible, considering there’s no break in the recorded audio, unless maybe my phone’s processor got briefly swamped.

But even with these repeatable glitches, cleaning up a transcription rarely requires more than one playback while I have Recorder’s transcription open in an editing app–usually Google Docs, since that’s one of Recorder’s supported export options and since that Web app can itself work offline.

Google’s updates to the app haven’t yet made a meaningful difference in its transcription accuracy but have added the option to get an AI-generated summary of a transcript. That, too, works offline, and I should try that more often.

My overall take remains unchanged from what I wrote here in March: While this app could work better, I’d still want to/have to check any AI transcription against the original recording, so this one isn’t adding that much work. And it retains its non-trivial edge of costing nothing when I already pay enough for cloud services and can only expect those expenses to keep ratcheting up.

Longer-term take on Google’s Recorder app: a human in the loop remains needed

Over the last six months, one of the apps I’ve used most on my phone has been one of the few that I can only use on my phone–Google’s Pixel-only Recorder. The free voice-transcription app that I latched onto after ditching Evernote has become a regular part of my workflow, even as it’s made its limits more obvious to me.

Recorder’s core advantage remains the ability to work offline, which is good on both functional and privacy grounds. I’m stuck on horrible WiFi or in a cellular dead zone? No problem. A sensitive conversation with a source that I don’t want instantly uploaded to a cloud-based transcription service? Handled.

(That second scenario has yet to actually come up in my work; if, however, somebody summons me to a clandestine meeting in a garage in Rosslyn, it’s nice to know I’ll be ready.)

But maybe because this app has to rely on the processing power of the Pixel 9 Pro I bought nearly two years ago instead of borrowing any cloud smarts, it continues to make the same mistakes:

• Its speaker recognition is more of a cloud of probability; in one transcript of a four-person panel last week, the app IDed me as “Speaker 1,”Speaker 2,” and “Speaker 3” while labeling only one quote as coming from “Speaker 4.”
• It continue to capitalize random nouns–in particular, hitting its virtual Shift key for “Enterprise” when transcribing conversations about the computing needs of large organizations so often that I have to wonder if it was trained on Star Trek, German, or both.
• Sometimes it just skips a sentence or two or three. I don’t know how that’s possible, considering there’s no break in the recorded audio, unless maybe my phone’s processor got briefly swamped.

But even with these repeatable glitches, cleaning up a transcription rarely requires more than one playback while I have Recorder’s transcription open in an editing app–usually Google Docs, since that’s one of Recorder’s supported export options and since that Web app can itself work offline.

Google’s updates to the app haven’t yet made a meaningful difference in its transcription accuracy but have added the option to get an AI-generated summary of a transcript. That, too, works offline, and I should try that more often.

My overall take remains unchanged from what I wrote here in March: While this app could work better, I’d still want to/have to check any AI transcription against the original recording, so this one isn’t adding that much work. And it retains its non-trivial edge of costing nothing when I already pay enough for cloud services and can only expect those expenses to keep ratcheting up.

Longer-term take on Google’s Recorder app: a human in the loop remains needed

Over the last six months, one of the apps I’ve used most on my phone has been one of the few that I can only use on my phone–Google’s Pixel-only Recorder. The free voice-transcription app that I latched onto after ditching Evernote has become a regular part of my workflow, even as it’s made its limits more obvious to me.

Recorder’s core advantage remains the ability to work offline, which is good on both functional and privacy grounds. I’m stuck on horrible WiFi or in a cellular dead zone? No problem. A sensitive conversation with a source that I don’t want instantly uploaded to a cloud-based transcription service? Handled.

(That second scenario has yet to actually come up in my work; if, however, somebody summons me to a clandestine meeting in a garage in Rosslyn, it’s nice to know I’ll be ready.)

But maybe because this app has to rely on the processing power of the Pixel 9 Pro I bought nearly two years ago instead of borrowing any cloud smarts, it continues to make the same mistakes:

• Its speaker recognition is more of a cloud of probability; in one transcript of a four-person panel last week, the app IDed me as “Speaker 1,”Speaker 2,” and “Speaker 3” while labeling only one quote as coming from “Speaker 4.”
• It continue to capitalize random nouns–in particular, hitting its virtual Shift key for “Enterprise” when transcribing conversations about the computing needs of large organizations so often that I have to wonder if it was trained on Star Trek, German, or both.
• Sometimes it just skips a sentence or two or three. I don’t know how that’s possible, considering there’s no break in the recorded audio, unless maybe my phone’s processor got briefly swamped.

But even with these repeatable glitches, cleaning up a transcription rarely requires more than one playback while I have Recorder’s transcription open in an editing app–usually Google Docs, since that’s one of Recorder’s supported export options and since that Web app can itself work offline.

Google’s updates to the app haven’t yet made a meaningful difference in its transcription accuracy but have added the option to get an AI-generated summary of a transcript. That, too, works offline, and I should try that more often.

My overall take remains unchanged from what I wrote here in March: While this app could work better, I’d still want to/have to check any AI transcription against the original recording, so this one isn’t adding that much work. And it retains its non-trivial edge of costing nothing when I already pay enough for cloud services and can only expect those expenses to keep ratcheting up.

Most AI apps send your question to someone else's server. Frand doesn't have one to send it to.

Frand runs Google DeepMind's Gemma models directly on your Android phone. Your chats are answered on-device: no cloud round-trip, no tracking, no transcripts on a server. The model is a file on your phone, not a service.

One-time purchase, no subscription. Get Frand: go.codrlabs.com/frand

#Frand #OnDeviceAI #PrivateAI #Privacy

Note taking is difficult. This is why we made Perspective Transcribe. Transcribe can take notes and transcribe everything on device. We've even added Siri AI indexing on our All Access plan. We'd love to know if you use Perspective Transcribe too! #AI, #OnDeviceAi, #SiriAI

Note taking is difficult. This is why we made Perspective Transcribe. Transcribe can take notes and transcribe everything on device. We've even added Siri AI indexing on our All Access plan. We'd love to know if you use Perspective Transcribe too! #AI, #OnDeviceAi, #SiriAI

Note taking is difficult. This is why we made Perspective Transcribe. Transcribe can take notes and transcribe everything on device. We've even added Siri AI indexing on our All Access plan. We'd love to know if you use Perspective Transcribe too! #AI, #OnDeviceAi, #SiriAI

Note taking is difficult. This is why we made Perspective Transcribe. Transcribe can take notes and transcribe everything on device. We've even added Siri AI indexing on our All Access plan. We'd love to know if you use Perspective Transcribe too! #AI, #OnDeviceAi, #SiriAI

"Offline" usually means "until it finds a signal."

Frand has a switch for that. Offline-only mode blocks every network skill, even on full bars and open wifi. Web Search, Weather, News, Wikipedia: all off, by your choice, not by circumstance.

What's left never needed the network anyway: calculator, unit converter, date math, QR codes. And the model is a file on your phone.

Android: go.codrlabs.com/frand

#Frand #LocalLLM #OnDeviceAI #PrivacyFirst

Ask for a workout plan and the Coach answers. Want it blunt? Switch to Straight Shooter.

Frand ships six personas — Classic, Straight Shooter, Coach, Professor, Gremlin and Zen — each with its own face and way of talking. Auto Frand routes each question by subject and stays put for follow-ups instead of flip-flopping. Or pick one per chat.

Same on-device model, same privacy. Android.

Find yours: https://go.codrlabs.com/frand

#Frand #OnDeviceAI #PrivateAI #Gemma

Qualcomm's next Hexagon NPU adds an Element Accelerator and 50% more shared memory, running 30B MoE models on-device for agentic AI. Details here.

#Qualcomm #Snapdragon #HexagonNPU #AgenticAI #OnDeviceAI #SnapdragonSummit #TechNews

https://securityexpress.info/qualcomm-hexagon-npu-agentic-ai/?utm_source=mastodon&utm_medium=jetpack_social

Qualcomm's next Hexagon NPU adds an Element Accelerator and 50% more shared memory, running 30B MoE models on-device for agentic AI. Details here.

#Qualcomm #Snapdragon #HexagonNPU #AgenticAI #OnDeviceAI #SnapdragonSummit #TechNews

https://securityexpress.info/qualcomm-hexagon-npu-agentic-ai/?utm_source=mastodon&utm_medium=jetpack_social

Qualcomm's next Hexagon NPU adds an Element Accelerator and 50% more shared memory, running 30B MoE models on-device for agentic AI. Details here.

#Qualcomm #Snapdragon #HexagonNPU #AgenticAI #OnDeviceAI #SnapdragonSummit #TechNews

https://securityexpress.info/qualcomm-hexagon-npu-agentic-ai/?utm_source=mastodon&utm_medium=jetpack_social

Qualcomm's next Hexagon NPU adds an Element Accelerator and 50% more shared memory, running 30B MoE models on-device for agentic AI. Details here.

#Qualcomm #Snapdragon #HexagonNPU #AgenticAI #OnDeviceAI #SnapdragonSummit #TechNews

https://securityexpress.info/qualcomm-hexagon-npu-agentic-ai/?utm_source=mastodon&utm_medium=jetpack_social

Snap your plate and let on-device AI estimate the calories and macros. No photos sent anywhere, no internet required. Snap. Know. Thrive. https://calometric.app #OnDeviceAI #Privacy #HealthTech #AppleWatch

On-device AI latency often comes from token-by-token generation, not model size. Speculative decoding attacks that bottleneck directly. https://hackernoon.com/speculative-decoding-and-the-latency-ceiling-for-on-device-llms #ondeviceai

On-device AI latency often comes from token-by-token generation, not model size. Speculative decoding attacks that bottleneck directly. https://hackernoon.com/speculative-decoding-and-the-latency-ceiling-for-on-device-llms #ondeviceai

On-device AI latency often comes from token-by-token generation, not model size. Speculative decoding attacks that bottleneck directly. https://hackernoon.com/speculative-decoding-and-the-latency-ceiling-for-on-device-llms #ondeviceai

On-device AI latency often comes from token-by-token generation, not model size. Speculative decoding attacks that bottleneck directly. https://hackernoon.com/speculative-decoding-and-the-latency-ceiling-for-on-device-llms #ondeviceai

Perspective Intelligence is the most accessible platform for using AI, and its capabilities are growing extremely fast! Download the app to start doing more with your Apple device at https://perspectiveintelligence.app #AI, #OnDeviceAI, #Apple #PerspectiveIntelligence

Perspective Intelligence is the most accessible platform for using AI, and its capabilities are growing extremely fast! Download the app to start doing more with your Apple device at https://perspectiveintelligence.app #AI, #OnDeviceAI, #Apple #PerspectiveIntelligence

Perspective Intelligence is the most accessible platform for using AI, and its capabilities are growing extremely fast! Download the app to start doing more with your Apple device at https://perspectiveintelligence.app #AI, #OnDeviceAI, #Apple #PerspectiveIntelligence

Perspective Intelligence is the most accessible platform for using AI, and its capabilities are growing extremely fast! Download the app to start doing more with your Apple device at https://perspectiveintelligence.app #AI, #OnDeviceAI, #Apple #PerspectiveIntelligence

Private notes should be truly private. 🔐

Notes: private & encrypted - is an Android app with no internet permission at all.

What you get:
• Notes, photos, drawings, voice recordings, and geolocation store
• Fully offline dictation on-device
• Voice transcription with local AI
• AES-256-GCM encryption for protected notes
• No accounts, analytics, ads, or subscriptions

https://play.google.com/store/apps/details?id=com.pwnall.note

#Privacy #Android #CyberSecurity #Encryption #OfflineFirst #DataPrivacy #OnDeviceAI #Notes

Many people say that cloud AI is the answer to everything and that is why we have so many data centers. Well, if cloud AI is so amazing then how come I had to use on-device AI to fix a failed update in the ChatGPT app? There really is power in what we can do on our own hardware, which is why I try to spread the word about what's possible. #AI, #OnDeviceAI, #Troubleshooting

Many people say that cloud AI is the answer to everything and that is why we have so many data centers. Well, if cloud AI is so amazing then how come I had to use on-device AI to fix a failed update in the ChatGPT app? There really is power in what we can do on our own hardware, which is why I try to spread the word about what's possible. #AI, #OnDeviceAI, #Troubleshooting

Many people say that cloud AI is the answer to everything and that is why we have so many data centers. Well, if cloud AI is so amazing then how come I had to use on-device AI to fix a failed update in the ChatGPT app? There really is power in what we can do on our own hardware, which is why I try to spread the word about what's possible. #AI, #OnDeviceAI, #Troubleshooting

Many people say that cloud AI is the answer to everything and that is why we have so many data centers. Well, if cloud AI is so amazing then how come I had to use on-device AI to fix a failed update in the ChatGPT app? There really is power in what we can do on our own hardware, which is why I try to spread the word about what's possible. #AI, #OnDeviceAI, #Troubleshooting

Perspective Intelligence 2.5 is now officially out for iOS and macOS! This is our biggest app update yet! You can learn more and get the app at https://perspectiveintelligence.app #Apple, #AI, #OnDeviceAI, #GoogleGemma, #Swift

Perspective Intelligence 2.5 is now officially out for iOS and macOS! This is our biggest app update yet! You can learn more and get the app at https://perspectiveintelligence.app #Apple, #AI, #OnDeviceAI, #GoogleGemma, #Swift

Perspective Intelligence 2.5 is now officially out for iOS and macOS! This is our biggest app update yet! You can learn more and get the app at https://perspectiveintelligence.app #Apple, #AI, #OnDeviceAI, #GoogleGemma, #Swift

Document Analyzation in Perspective Intelligence is now amazing! We are doing a lot of testing for this next version release. #AI, #OnDeviceAI

Document Analyzation in Perspective Intelligence is now amazing! We are doing a lot of testing for this next version release. #AI, #OnDeviceAI

Perspective Intelligence got 67 tokens per second last night with Gemma 4 E2B on LiteRT after making improvements to the app! That is a huge improvement and I can't wait for everyone to try it out. #AI, #OnDeviceAI

Come join us on the Techopolis Discord! We are talking all about AI games and more over there. https://techopolis.app/discord #OnDeviceAI, #A11y, #VoiceOver, #AI

Perspective Intelligence will soon have Apple Foundation Models, MLX and LiteRT support in this next release, but don't worry. we will make sure it is simple for everyone out there that just wants to keep things simple. #onDeviceAI

Know what you eat. Not who's watching. Calometric tracks calories and macros 100% on-device. No account, no subscription. Your food diary never leaves your phone. https://calometric.app #CalorieTracker #Privacy #OnDeviceAI #iOS