home.social

#university — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #university, aggregated by home.social.

  1. Copilot saving time for individuals does not mean Copilot saves time for organisations

    I thought this was a really interesting finding from Microsoft’s own research on Copilot 365 using usage data from 6000 trial licenses across 56 firms:

    The introduction of Copilot has led to significant changes in email-related behaviors among workers. The average worker in the control group spent 2.8 hours each week reading email and licensees spent 12 fewer minutes reading emails each week, a 7% decrease. This time savings reflects a combination of fewer individual emails read each week, 9 fewer per week, and an increase in reading efficiency, as workers with Copilot spend a few seconds less reading each email on average. Copilot users spent 18% less time reading email, saving more than half an hour each week. We hypothesize that some combination of Outlook Summarize and searching for email content in M365 Copilot Chat allows users to spend less time with individual emails.

    If individuals are saving time by reading fewer e-mails and reading existing e-mails more quickly, this plausibly increases the likelihood they will take action which causes more work to be accumulated downstream of the ‘saving’. The authors have an optimistic reading based on Copilot users replying to the same number of e-mails, but the point where ‘more effective triage’ becomes ‘inattention’ is rather ambiguous at best. This doesn’t mean that more time spent reading e-mail is necessarily good, only that less time spent on e-mail is plausibly going to create problems just as much as it represents an efficiency gain. If you just measure efficiency in terms of individualised effects then you’re just not going to pick up on the second-order consequences of AI-generated efficiency savings within organisations. The same point holds true for individuals making documents more quickly:

    We expect that the generative capacities of M365 Copilot may help workers produce Word documents more quickly. That speed can have additional ripple effects on how people work. They may have time to contribute to more documents; they may finish rough drafts earlier and take the time to elicit feedback from more colleagues; alternatively, they may co-write less often with colleagues, using Copilot as a substitute writing partner.

    This is an interesting finding but there’s absolutely no reason to assume it’s intrinsically a positive thing. People producing documents more quickly can just as easily mean the proliferation of ‘workslop’ in which low quality documents circulate which require more downstream work to address their deficiencies. The social costs only show up in this research design when it comes to meetings:

    We looked at Copilot’s effect on the number of Teams meetings attended and total time spent in meetings each week. We find that receiving a Copilot license leads to small and statistically insignificant increases in both metrics, but also a (statistically significant) decrease in the proportion of scheduled meeting time during which people actually met, i.e., Copilot licensees are likelier to join meetings later and leave meetings earlier.

    Again not all meetings are valuable. But if Copilot users are likelier to join meetings later and leave earlier it suggest that the AI is being leveraged to support personal time saving, on the assumption the automated features will protect against any determinant to the shared work. It’s not clear to me why this would be the case.

    #AI #copilot #efficiency #enterpriseAI #higherEducation #microsoft #university
  2. Copilot saving time for individuals does not mean Copilot saves time for organisations

    I thought this was a really interesting finding from Microsoft’s own research on Copilot 365 using usage data from 6000 trial licenses across 56 firms:

    The introduction of Copilot has led to significant changes in email-related behaviors among workers. The average worker in the control group spent 2.8 hours each week reading email and licensees spent 12 fewer minutes reading emails each week, a 7% decrease. This time savings reflects a combination of fewer individual emails read each week, 9 fewer per week, and an increase in reading efficiency, as workers with Copilot spend a few seconds less reading each email on average. Copilot users spent 18% less time reading email, saving more than half an hour each week. We hypothesize that some combination of Outlook Summarize and searching for email content in M365 Copilot Chat allows users to spend less time with individual emails.

    If individuals are saving time by reading fewer e-mails and reading existing e-mails more quickly, this plausibly increases the likelihood they will take action which causes more work to be accumulated downstream of the ‘saving’. The authors have an optimistic reading based on Copilot users replying to the same number of e-mails, but the point where ‘more effective triage’ becomes ‘inattention’ is rather ambiguous at best. This doesn’t mean that more time spent reading e-mail is necessarily good, only that less time spent on e-mail is plausibly going to create problems just as much as it represents an efficiency gain. If you just measure efficiency in terms of individualised effects then you’re just not going to pick up on the second-order consequences of AI-generated efficiency savings within organisations. The same point holds true for individuals making documents more quickly:

    We expect that the generative capacities of M365 Copilot may help workers produce Word documents more quickly. That speed can have additional ripple effects on how people work. They may have time to contribute to more documents; they may finish rough drafts earlier and take the time to elicit feedback from more colleagues; alternatively, they may co-write less often with colleagues, using Copilot as a substitute writing partner.

    This is an interesting finding but there’s absolutely no reason to assume it’s intrinsically a positive thing. People producing documents more quickly can just as easily mean the proliferation of ‘workslop’ in which low quality documents circulate which require more downstream work to address their deficiencies. The social costs only show up in this research design when it comes to meetings:

    We looked at Copilot’s effect on the number of Teams meetings attended and total time spent in meetings each week. We find that receiving a Copilot license leads to small and statistically insignificant increases in both metrics, but also a (statistically significant) decrease in the proportion of scheduled meeting time during which people actually met, i.e., Copilot licensees are likelier to join meetings later and leave meetings earlier.

    Again not all meetings are valuable. But if Copilot users are likelier to join meetings later and leave earlier it suggest that the AI is being leveraged to support personal time saving, on the assumption the automated features will protect against any determinant to the shared work. It’s not clear to me why this would be the case.

    #AI #copilot #efficiency #enterpriseAI #higherEducation #microsoft #university
  3. Copilot saving time for individuals does not mean Copilot saves time for organisations

    I thought this was a really interesting finding from Microsoft’s own research on Copilot 365 using usage data from 6000 trial licenses across 56 firms:

    The introduction of Copilot has led to significant changes in email-related behaviors among workers. The average worker in the control group spent 2.8 hours each week reading email and licensees spent 12 fewer minutes reading emails each week, a 7% decrease. This time savings reflects a combination of fewer individual emails read each week, 9 fewer per week, and an increase in reading efficiency, as workers with Copilot spend a few seconds less reading each email on average. Copilot users spent 18% less time reading email, saving more than half an hour each week. We hypothesize that some combination of Outlook Summarize and searching for email content in M365 Copilot Chat allows users to spend less time with individual emails.

    If individuals are saving time by reading fewer e-mails and reading existing e-mails more quickly, this plausibly increases the likelihood they will take action which causes more work to be accumulated downstream of the ‘saving’. The authors have an optimistic reading based on Copilot users replying to the same number of e-mails, but the point where ‘more effective triage’ becomes ‘inattention’ is rather ambiguous at best. This doesn’t mean that more time spent reading e-mail is necessarily good, only that less time spent on e-mail is plausibly going to create problems just as much as it represents an efficiency gain. If you just measure efficiency in terms of individualised effects then you’re just not going to pick up on the second-order consequences of AI-generated efficiency savings within organisations. The same point holds true for individuals making documents more quickly:

    We expect that the generative capacities of M365 Copilot may help workers produce Word documents more quickly. That speed can have additional ripple effects on how people work. They may have time to contribute to more documents; they may finish rough drafts earlier and take the time to elicit feedback from more colleagues; alternatively, they may co-write less often with colleagues, using Copilot as a substitute writing partner.

    This is an interesting finding but there’s absolutely no reason to assume it’s intrinsically a positive thing. People producing documents more quickly can just as easily mean the proliferation of ‘workslop’ in which low quality documents circulate which require more downstream work to address their deficiencies. The social costs only show up in this research design when it comes to meetings:

    We looked at Copilot’s effect on the number of Teams meetings attended and total time spent in meetings each week. We find that receiving a Copilot license leads to small and statistically insignificant increases in both metrics, but also a (statistically significant) decrease in the proportion of scheduled meeting time during which people actually met, i.e., Copilot licensees are likelier to join meetings later and leave meetings earlier.

    Again not all meetings are valuable. But if Copilot users are likelier to join meetings later and leave earlier it suggest that the AI is being leveraged to support personal time saving, on the assumption the automated features will protect against any determinant to the shared work. It’s not clear to me why this would be the case.

    #AI #copilot #efficiency #enterpriseAI #higherEducation #microsoft #university
  4. Copilot saving time for individuals does not mean Copilot saves time for organisations

    I thought this was a really interesting finding from Microsoft’s own research on Copilot 365 using usage data from 6000 trial licenses across 56 firms:

    The introduction of Copilot has led to significant changes in email-related behaviors among workers. The average worker in the control group spent 2.8 hours each week reading email and licensees spent 12 fewer minutes reading emails each week, a 7% decrease. This time savings reflects a combination of fewer individual emails read each week, 9 fewer per week, and an increase in reading efficiency, as workers with Copilot spend a few seconds less reading each email on average. Copilot users spent 18% less time reading email, saving more than half an hour each week. We hypothesize that some combination of Outlook Summarize and searching for email content in M365 Copilot Chat allows users to spend less time with individual emails.

    If individuals are saving time by reading fewer e-mails and reading existing e-mails more quickly, this plausibly increases the likelihood they will take action which causes more work to be accumulated downstream of the ‘saving’. The authors have an optimistic reading based on Copilot users replying to the same number of e-mails, but the point where ‘more effective triage’ becomes ‘inattention’ is rather ambiguous at best. This doesn’t mean that more time spent reading e-mail is necessarily good, only that less time spent on e-mail is plausibly going to create problems just as much as it represents an efficiency gain. If you just measure efficiency in terms of individualised effects then you’re just not going to pick up on the second-order consequences of AI-generated efficiency savings within organisations. The same point holds true for individuals making documents more quickly:

    We expect that the generative capacities of M365 Copilot may help workers produce Word documents more quickly. That speed can have additional ripple effects on how people work. They may have time to contribute to more documents; they may finish rough drafts earlier and take the time to elicit feedback from more colleagues; alternatively, they may co-write less often with colleagues, using Copilot as a substitute writing partner.

    This is an interesting finding but there’s absolutely no reason to assume it’s intrinsically a positive thing. People producing documents more quickly can just as easily mean the proliferation of ‘workslop’ in which low quality documents circulate which require more downstream work to address their deficiencies. The social costs only show up in this research design when it comes to meetings:

    We looked at Copilot’s effect on the number of Teams meetings attended and total time spent in meetings each week. We find that receiving a Copilot license leads to small and statistically insignificant increases in both metrics, but also a (statistically significant) decrease in the proportion of scheduled meeting time during which people actually met, i.e., Copilot licensees are likelier to join meetings later and leave meetings earlier.

    Again not all meetings are valuable. But if Copilot users are likelier to join meetings later and leave earlier it suggest that the AI is being leveraged to support personal time saving, on the assumption the automated features will protect against any determinant to the shared work. It’s not clear to me why this would be the case.

    #AI #copilot #efficiency #enterpriseAI #higherEducation #microsoft #university
  5. Copilot saving time for individuals does not mean Copilot saves time for organisations

    I thought this was a really interesting finding from Microsoft’s own research on Copilot 365 using usage data from 6000 trial licenses across 56 firms:

    The introduction of Copilot has led to significant changes in email-related behaviors among workers. The average worker in the control group spent 2.8 hours each week reading email and licensees spent 12 fewer minutes reading emails each week, a 7% decrease. This time savings reflects a combination of fewer individual emails read each week, 9 fewer per week, and an increase in reading efficiency, as workers with Copilot spend a few seconds less reading each email on average. Copilot users spent 18% less time reading email, saving more than half an hour each week. We hypothesize that some combination of Outlook Summarize and searching for email content in M365 Copilot Chat allows users to spend less time with individual emails.

    If individuals are saving time by reading fewer e-mails and reading existing e-mails more quickly, this plausibly increases the likelihood they will take action which causes more work to be accumulated downstream of the ‘saving’. The authors have an optimistic reading based on Copilot users replying to the same number of e-mails, but the point where ‘more effective triage’ becomes ‘inattention’ is rather ambiguous at best. This doesn’t mean that more time spent reading e-mail is necessarily good, only that less time spent on e-mail is plausibly going to create problems just as much as it represents an efficiency gain. If you just measure efficiency in terms of individualised effects then you’re just not going to pick up on the second-order consequences of AI-generated efficiency savings within organisations. The same point holds true for individuals making documents more quickly:

    We expect that the generative capacities of M365 Copilot may help workers produce Word documents more quickly. That speed can have additional ripple effects on how people work. They may have time to contribute to more documents; they may finish rough drafts earlier and take the time to elicit feedback from more colleagues; alternatively, they may co-write less often with colleagues, using Copilot as a substitute writing partner.

    This is an interesting finding but there’s absolutely no reason to assume it’s intrinsically a positive thing. People producing documents more quickly can just as easily mean the proliferation of ‘workslop’ in which low quality documents circulate which require more downstream work to address their deficiencies. The social costs only show up in this research design when it comes to meetings:

    We looked at Copilot’s effect on the number of Teams meetings attended and total time spent in meetings each week. We find that receiving a Copilot license leads to small and statistically insignificant increases in both metrics, but also a (statistically significant) decrease in the proportion of scheduled meeting time during which people actually met, i.e., Copilot licensees are likelier to join meetings later and leave meetings earlier.

    Again not all meetings are valuable. But if Copilot users are likelier to join meetings later and leave earlier it suggest that the AI is being leveraged to support personal time saving, on the assumption the automated features will protect against any determinant to the shared work. It’s not clear to me why this would be the case.

    #AI #copilot #efficiency #enterpriseAI #higherEducation #microsoft #university