#rubrics — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #rubrics, aggregated by home.social.
-
“few other human activities offer such unambiguous feedback. There are no objective tests for whether financial analysis or advertising copy is “good.” Undeterred, AI companies set out to make such tests, collectively paying billions of dollars to professionals of all types to write exacting and comprehensive criteria for a job well done.”
“… of the more than 30 workers I spoke with occupied a position along a vast and growing data-supply chain. There are people crafting #checklists that define a good #ChatbotResponse, typically called “#rubrics,” and other people grading those rubrics. Others #grade chatbot answers according to those rubrics, and still others take the rubrics and write out what’s often described as a “#GoldenOutput,” or the ideal chatbot answer.”
“Others are asked to explain every step they took to arrive at this golden output in the voice of a #chatbot thinking to itself, producing what’s called a “#ReasoningTrace” for #AI to follow later when it encounters a similar task out in the real world. Sometimes the labs want only rubrics for prompts their AI can’t already do, which means companies like #Mercor ask workers to produce “#stumpers,” or requests that will make the #AIModel fail.”
It’s not that AI will totally replace the expertise of #WhiteCollar PhD, Legal and other specialist professions. What will happen is that hard earned expertise will be priced lower. How low? As low as AI technology can make it, think Communist era pay.
#ZeroHourWork / #work / #economics / #SupplyDemand <http://theverge.com/cs/features/877388/white-collar-workers-training-ai-mercor> (paywall) / <https://archive.md/kAiZL>
-
“few other human activities offer such unambiguous feedback. There are no objective tests for whether financial analysis or advertising copy is “good.” Undeterred, AI companies set out to make such tests, collectively paying billions of dollars to professionals of all types to write exacting and comprehensive criteria for a job well done.”
“… of the more than 30 workers I spoke with occupied a position along a vast and growing data-supply chain. There are people crafting #checklists that define a good #ChatbotResponse, typically called “#rubrics,” and other people grading those rubrics. Others #grade chatbot answers according to those rubrics, and still others take the rubrics and write out what’s often described as a “#GoldenOutput,” or the ideal chatbot answer.”
“Others are asked to explain every step they took to arrive at this golden output in the voice of a #chatbot thinking to itself, producing what’s called a “#ReasoningTrace” for #AI to follow later when it encounters a similar task out in the real world. Sometimes the labs want only rubrics for prompts their AI can’t already do, which means companies like #Mercor ask workers to produce “#stumpers,” or requests that will make the #AIModel fail.”
It’s not that AI will totally replace the expertise of #WhiteCollar PhD, Legal and other specialist professions. What will happen is that hard earned expertise will be priced lower. How low? As low as AI technology can make it, think Communist era pay.
#ZeroHourWork / #work / #economics / #SupplyDemand <http://theverge.com/cs/features/877388/white-collar-workers-training-ai-mercor> (paywall) / <https://archive.md/kAiZL>
-
“few other human activities offer such unambiguous feedback. There are no objective tests for whether financial analysis or advertising copy is “good.” Undeterred, AI companies set out to make such tests, collectively paying billions of dollars to professionals of all types to write exacting and comprehensive criteria for a job well done.”
“… of the more than 30 workers I spoke with occupied a position along a vast and growing data-supply chain. There are people crafting #checklists that define a good #ChatbotResponse, typically called “#rubrics,” and other people grading those rubrics. Others #grade chatbot answers according to those rubrics, and still others take the rubrics and write out what’s often described as a “#GoldenOutput,” or the ideal chatbot answer.”
“Others are asked to explain every step they took to arrive at this golden output in the voice of a #chatbot thinking to itself, producing what’s called a “#ReasoningTrace” for #AI to follow later when it encounters a similar task out in the real world. Sometimes the labs want only rubrics for prompts their AI can’t already do, which means companies like #Mercor ask workers to produce “#stumpers,” or requests that will make the #AIModel fail.”
It’s not that AI will totally replace the expertise of #WhiteCollar PhD, Legal and other specialist professions. What will happen is that hard earned expertise will be priced lower. How low? As low as AI technology can make it, think Communist era pay.
#ZeroHourWork / #work / #economics / #SupplyDemand <http://theverge.com/cs/features/877388/white-collar-workers-training-ai-mercor> (paywall) / <https://archive.md/kAiZL>
-
“few other human activities offer such unambiguous feedback. There are no objective tests for whether financial analysis or advertising copy is “good.” Undeterred, AI companies set out to make such tests, collectively paying billions of dollars to professionals of all types to write exacting and comprehensive criteria for a job well done.”
“… of the more than 30 workers I spoke with occupied a position along a vast and growing data-supply chain. There are people crafting #checklists that define a good #ChatbotResponse, typically called “#rubrics,” and other people grading those rubrics. Others #grade chatbot answers according to those rubrics, and still others take the rubrics and write out what’s often described as a “#GoldenOutput,” or the ideal chatbot answer.”
“Others are asked to explain every step they took to arrive at this golden output in the voice of a #chatbot thinking to itself, producing what’s called a “#ReasoningTrace” for #AI to follow later when it encounters a similar task out in the real world. Sometimes the labs want only rubrics for prompts their AI can’t already do, which means companies like #Mercor ask workers to produce “#stumpers,” or requests that will make the #AIModel fail.”
It’s not that AI will totally replace the expertise of #WhiteCollar PhD, Legal and other specialist professions. What will happen is that hard earned expertise will be priced lower. How low? As low as AI technology can make it, think Communist era pay.
#ZeroHourWork / #work / #economics / #SupplyDemand <http://theverge.com/cs/features/877388/white-collar-workers-training-ai-mercor> (paywall) / <https://archive.md/kAiZL>
-
“few other human activities offer such unambiguous feedback. There are no objective tests for whether financial analysis or advertising copy is “good.” Undeterred, AI companies set out to make such tests, collectively paying billions of dollars to professionals of all types to write exacting and comprehensive criteria for a job well done.”
“… of the more than 30 workers I spoke with occupied a position along a vast and growing data-supply chain. There are people crafting #checklists that define a good #ChatbotResponse, typically called “#rubrics,” and other people grading those rubrics. Others #grade chatbot answers according to those rubrics, and still others take the rubrics and write out what’s often described as a “#GoldenOutput,” or the ideal chatbot answer.”
“Others are asked to explain every step they took to arrive at this golden output in the voice of a #chatbot thinking to itself, producing what’s called a “#ReasoningTrace” for #AI to follow later when it encounters a similar task out in the real world. Sometimes the labs want only rubrics for prompts their AI can’t already do, which means companies like #Mercor ask workers to produce “#stumpers,” or requests that will make the #AIModel fail.”
It’s not that AI will totally replace the expertise of #WhiteCollar PhD, Legal and other specialist professions. What will happen is that hard earned expertise will be priced lower. How low? As low as AI technology can make it, think Communist era pay.
#ZeroHourWork / #work / #economics / #SupplyDemand <http://theverge.com/cs/features/877388/white-collar-workers-training-ai-mercor> (paywall) / <https://archive.md/kAiZL>
-
SUNY Colleague, Sonja Thomson, School of Nursing and Allied Health Operations Coordinator, Empire State University inspired this blog post!
Why Rubrics Matter: Supporting Online Nursing Education with Structure & Research https://online.suny.edu/onlineteaching/2025/04/08/nursing-rubrics/
#rubrics #onlinelearning #instructionaldesign #nursing #onlinediscussion #edutoot -
Interesting piece on evaluation rubrics which makes me think about their use as sense making frameworks. Extending this practice into participatory sense making is my favourite kind of evaluation work.
-
I have released an updated version of my #Moodle report for assignments with advanced grading methods https://moodle.org/plugins/report_advancedgrading report (#rubrics) It confirms compatibility with Moodle 4.5 and includes updated behat tests.
Your can find it here
https://moodle.org/plugins/report_advancedgrading -
Dank @derautomation, der mich vor einer Weile daran erinnere, dass es sowas Schlaues wie #Rubrics gibt, gleich mal zwei Bewertungsbögen für die ersten Schulaufgaben in den diesjährigen Deutschklassen gebastelt. 🤓 Gut, dass es das #fediLZ gibt.
-
Und inzwischen ist auch der zugehörige #Bewertungsbogen für Studienarbeiten online abrufbar.
Die dort genannten #Kriterien und #Gewichtungen für eine #Abschlussarbeit dienen mir seit einiger Zeit als gute Richtschnur zur Benotung. Man kann über #Rubrics treffend streiten, sie tragen aber – wie ich von meinen Studis höre – sehr zur Transparenz bei.
Ihr findet das Material unter https://www.isd.kit.edu/personal/td-personal_davidlohner.php?tab=%5B274%5D#tabpanel-274 ganz unten verlinkt.
-
Und inzwischen ist auch der zugehörige #Bewertungsbogen für Studienarbeiten online abrufbar.
Die dort genannten #Kriterien und #Gewichtungen für eine #Abschlussarbeit dienen mir seit einiger Zeit als gute Richtschnur zur Benotung. Man kann über #Rubrics treffend streiten, sie tragen aber – wie ich von meinen Studis höre – sehr zur Transparenz bei.
Ihr findet das Material unter https://www.isd.kit.edu/personal/td-personal_davidlohner.php?tab=%5B274%5D#tabpanel-274 ganz unten verlinkt.
-
Und inzwischen ist auch der zugehörige #Bewertungsbogen für Studienarbeiten online abrufbar.
Die dort genannten #Kriterien und #Gewichtungen für eine #Abschlussarbeit dienen mir seit einiger Zeit als gute Richtschnur zur Benotung. Man kann über #Rubrics treffend streiten, sie tragen aber – wie ich von meinen Studis höre – sehr zur Transparenz bei.
Ihr findet das Material unter https://www.isd.kit.edu/personal/td-personal_davidlohner.php?tab=%5B274%5D#tabpanel-274 ganz unten verlinkt.
-
Und inzwischen ist auch der zugehörige #Bewertungsbogen für Studienarbeiten online abrufbar.
Die dort genannten #Kriterien und #Gewichtungen für eine #Abschlussarbeit dienen mir seit einiger Zeit als gute Richtschnur zur Benotung. Man kann über #Rubrics treffend streiten, sie tragen aber – wie ich von meinen Studis höre – sehr zur Transparenz bei.
Ihr findet das Material unter https://www.isd.kit.edu/personal/td-personal_davidlohner.php?tab=%5B274%5D#tabpanel-274 ganz unten verlinkt.
-
Und inzwischen ist auch der zugehörige #Bewertungsbogen für Studienarbeiten online abrufbar.
Die dort genannten #Kriterien und #Gewichtungen für eine #Abschlussarbeit dienen mir seit einiger Zeit als gute Richtschnur zur Benotung. Man kann über #Rubrics treffend streiten, sie tragen aber – wie ich von meinen Studis höre – sehr zur Transparenz bei.
Ihr findet das Material unter https://www.isd.kit.edu/personal/td-personal_davidlohner.php?tab=%5B274%5D#tabpanel-274 ganz unten verlinkt.
-
Rubrics für alle!
Heute: Lineare Erörterung
Früher: siehe Links unten
#FediLZ #deutsch #bewertung #noten #schule #rubrics #edutoot
Weitere Bewertungsbögen:
1) https://bildung.social/@derautomation/109522843802230915
2) https://bildung.social/@derautomation/109523815958943209
-
Rubrics für alle!
Heute: der Hintergrundbericht
Früher: siehe Links unten
#FediLZ #deutsch #bewertung #noten #schule #rubrics #edutoot
Weitere Bewertungsbögen:
1) https://bildung.social/@derautomation/109522843802230915
-
Trialling #rubrics on #GoogleClassroom with masses of improvement questions for each level in each AO with a response sheet for students to fill in.
"Have you done X? Where do you include Y?How could you increase Z?"
#A-level absolutely loves it.
#GCSE worked brilliantly across the spectrum.Really hoping I don't need to update them that much next year because they were a pain to write. But got great responses.
-
Bewertungsbögen überarbeiten (Teil 3)
Anbei der "alte" und der "neue" Bewertungsbogen zum Thema Inhaltsangabe.
Ich muss zugeben, es ist eine Mischung aus beiden Welten geworten 😅
#rubrics #deutsch #FediLZ #bewertung #noten
Selbstzitat:
1) https://bildung.social/@derautomation/109518625359506437 -
Bewertungsbögen überarbeiten (Teil 2)
Anbei der "alte" und der "neue" Bewertungsbogen zum Thema Schilderung.
#rubrics #FediLZ #bewertung #noten
Selbstzitat: https://bildung.social/@derautomation/109518625359506437
