#airedteam — Public Fediverse posts

𝐀𝐧𝐧𝐨𝐮𝐧𝐜𝐢𝐧𝐠 𝐌𝐢𝐜𝐫𝐨𝐬𝐨𝐟𝐭’𝐬 𝐨𝐩𝐞𝐧 𝐚𝐮𝐭𝐨𝐦𝐚𝐭𝐢𝐨𝐧 𝐟𝐫𝐚𝐦𝐞𝐰𝐨𝐫𝐤 𝐭𝐨 𝐫𝐞𝐝 𝐭𝐞𝐚𝐦 𝐠𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐯𝐞 𝐀𝐈 𝐒𝐲𝐬𝐭𝐞𝐦𝐬

𝐏𝐲𝐑𝐈𝐓 automates AI Red Teaming tasks to allow operators to focus on more complicated and time-consuming tasks and can also identify security harms such as misuse (e.g., malware generation, jailbreaking), and privacy harms (e.g., identity theft).​

Find out more:

https://www.microsoft.com/en-us/security/blog/2024/02/22/announcing-microsofts-open-automation-framework-to-red-team-generative-ai-systems/

GitHub repo: https://github.com/Azure/PyRIT

How to Guide: https://github.com/Azure/PyRIT/blob/main/doc/how_to_guide.ipynb

#redteam #airedteam #redteaming #PyRIT #ml #ai #framewrok #python #cyber #llm #ai #aisecurity #microsoft #microsoftsecurity #opensource #MicrosoftAIRedTeam #GenAI #jailbreaking #promtp #promptinjection #malware #privacy #responsibleai #cybersecurity #aisecurity #secureai #machinelearning #generativeai

𝐀𝐧𝐧𝐨𝐮𝐧𝐜𝐢𝐧𝐠 𝐌𝐢𝐜𝐫𝐨𝐬𝐨𝐟𝐭’𝐬 𝐨𝐩𝐞𝐧 𝐚𝐮𝐭𝐨𝐦𝐚𝐭𝐢𝐨𝐧 𝐟𝐫𝐚𝐦𝐞𝐰𝐨𝐫𝐤 𝐭𝐨 𝐫𝐞𝐝 𝐭𝐞𝐚𝐦 𝐠𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐯𝐞 𝐀𝐈 𝐒𝐲𝐬𝐭𝐞𝐦𝐬

𝐏𝐲𝐑𝐈𝐓 automates AI Red Teaming tasks to allow operators to focus on more complicated and time-consuming tasks and can also identify security harms such as misuse (e.g., malware generation, jailbreaking), and privacy harms (e.g., identity theft).​

Find out more:

https://www.microsoft.com/en-us/security/blog/2024/02/22/announcing-microsofts-open-automation-framework-to-red-team-generative-ai-systems/

GitHub repo: https://github.com/Azure/PyRIT

How to Guide: https://github.com/Azure/PyRIT/blob/main/doc/how_to_guide.ipynb

#redteam #airedteam #redteaming #PyRIT #ml #ai #framewrok #python #cyber #llm #ai #aisecurity #microsoft #microsoftsecurity #opensource #MicrosoftAIRedTeam #GenAI #jailbreaking #promtp #promptinjection #malware #privacy #responsibleai #cybersecurity #aisecurity #secureai #machinelearning #generativeai

𝐀𝐧𝐧𝐨𝐮𝐧𝐜𝐢𝐧𝐠 𝐌𝐢𝐜𝐫𝐨𝐬𝐨𝐟𝐭’𝐬 𝐨𝐩𝐞𝐧 𝐚𝐮𝐭𝐨𝐦𝐚𝐭𝐢𝐨𝐧 𝐟𝐫𝐚𝐦𝐞𝐰𝐨𝐫𝐤 𝐭𝐨 𝐫𝐞𝐝 𝐭𝐞𝐚𝐦 𝐠𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐯𝐞 𝐀𝐈 𝐒𝐲𝐬𝐭𝐞𝐦𝐬

𝐏𝐲𝐑𝐈𝐓 automates AI Red Teaming tasks to allow operators to focus on more complicated and time-consuming tasks and can also identify security harms such as misuse (e.g., malware generation, jailbreaking), and privacy harms (e.g., identity theft).​

Find out more:

https://www.microsoft.com/en-us/security/blog/2024/02/22/announcing-microsofts-open-automation-framework-to-red-team-generative-ai-systems/

GitHub repo: https://github.com/Azure/PyRIT

How to Guide: https://github.com/Azure/PyRIT/blob/main/doc/how_to_guide.ipynb

#redteam #airedteam #redteaming #PyRIT #ml #ai #framewrok #python #cyber #llm #ai #aisecurity #microsoft #microsoftsecurity #opensource #MicrosoftAIRedTeam #GenAI #jailbreaking #promtp #promptinjection #malware #privacy #responsibleai #cybersecurity #aisecurity #secureai #machinelearning #generativeai

𝐀𝐧𝐧𝐨𝐮𝐧𝐜𝐢𝐧𝐠 𝐌𝐢𝐜𝐫𝐨𝐬𝐨𝐟𝐭’𝐬 𝐨𝐩𝐞𝐧 𝐚𝐮𝐭𝐨𝐦𝐚𝐭𝐢𝐨𝐧 𝐟𝐫𝐚𝐦𝐞𝐰𝐨𝐫𝐤 𝐭𝐨 𝐫𝐞𝐝 𝐭𝐞𝐚𝐦 𝐠𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐯𝐞 𝐀𝐈 𝐒𝐲𝐬𝐭𝐞𝐦𝐬

𝐏𝐲𝐑𝐈𝐓 automates AI Red Teaming tasks to allow operators to focus on more complicated and time-consuming tasks and can also identify security harms such as misuse (e.g., malware generation, jailbreaking), and privacy harms (e.g., identity theft).​

Find out more:

https://www.microsoft.com/en-us/security/blog/2024/02/22/announcing-microsofts-open-automation-framework-to-red-team-generative-ai-systems/

GitHub repo: https://github.com/Azure/PyRIT

How to Guide: https://github.com/Azure/PyRIT/blob/main/doc/how_to_guide.ipynb

#redteam #airedteam #redteaming #PyRIT #ml #ai #framewrok #python #cyber #llm #ai #aisecurity #microsoft #microsoftsecurity #opensource #MicrosoftAIRedTeam #GenAI #jailbreaking #promtp #promptinjection #malware #privacy #responsibleai #cybersecurity #aisecurity #secureai #machinelearning #generativeai

𝐀𝐧𝐧𝐨𝐮𝐧𝐜𝐢𝐧𝐠 𝐌𝐢𝐜𝐫𝐨𝐬𝐨𝐟𝐭’𝐬 𝐨𝐩𝐞𝐧 𝐚𝐮𝐭𝐨𝐦𝐚𝐭𝐢𝐨𝐧 𝐟𝐫𝐚𝐦𝐞𝐰𝐨𝐫𝐤 𝐭𝐨 𝐫𝐞𝐝 𝐭𝐞𝐚𝐦 𝐠𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐯𝐞 𝐀𝐈 𝐒𝐲𝐬𝐭𝐞𝐦𝐬

𝐏𝐲𝐑𝐈𝐓 automates AI Red Teaming tasks to allow operators to focus on more complicated and time-consuming tasks and can also identify security harms such as misuse (e.g., malware generation, jailbreaking), and privacy harms (e.g., identity theft).​

Find out more:

https://www.microsoft.com/en-us/security/blog/2024/02/22/announcing-microsofts-open-automation-framework-to-red-team-generative-ai-systems/

GitHub repo: https://github.com/Azure/PyRIT

How to Guide: https://github.com/Azure/PyRIT/blob/main/doc/how_to_guide.ipynb

#redteam #airedteam #redteaming #PyRIT #ml #ai #framewrok #python #cyber #llm #ai #aisecurity #microsoft #microsoftsecurity #opensource #MicrosoftAIRedTeam #GenAI #jailbreaking #promtp #promptinjection #malware #privacy #responsibleai #cybersecurity #aisecurity #secureai #machinelearning #generativeai

These 7 items should be on your CISO checklist for 2024 – Source: www.cybertalk.org https://ciso2ciso.com/these-7-items-should-be-on-your-ciso-checklist-for-2024-source-www-cybertalk-org-2/ #rssfeedpostgeneratorecho #CitizenDevelopers #CyberSecurityNews #SecurityMaturity #CyberCriminals #CloudSecurity #cybersecurity #Cybersecurity #TRENDINGNOW #AIredteam #CyberTalk #zerotrust #CXOFILES #hackers #SaaS #ztna #AI

These 7 items should be on your CISO checklist for 2024 – Source: www.cybertalk.org https://ciso2ciso.com/these-7-items-should-be-on-your-ciso-checklist-for-2024-source-www-cybertalk-org-2/ #rssfeedpostgeneratorecho #CitizenDevelopers #CyberSecurityNews #SecurityMaturity #CyberCriminals #CloudSecurity #cybersecurity #Cybersecurity #TRENDINGNOW #AIredteam #CyberTalk #zerotrust #CXOFILES #hackers #SaaS #ztna #AI

These 7 items should be on your CISO checklist for 2024 – Source: www.cybertalk.org https://ciso2ciso.com/these-7-items-should-be-on-your-ciso-checklist-for-2024-source-www-cybertalk-org-2/ #rssfeedpostgeneratorecho #CitizenDevelopers #CyberSecurityNews #SecurityMaturity #CyberCriminals #CloudSecurity #cybersecurity #Cybersecurity #TRENDINGNOW #AIredteam #CyberTalk #zerotrust #CXOFILES #hackers #SaaS #ztna #AI

These 7 items should be on your CISO checklist for 2024 – Source: www.cybertalk.org https://ciso2ciso.com/these-7-items-should-be-on-your-ciso-checklist-for-2024-source-www-cybertalk-org-2/ #rssfeedpostgeneratorecho #CitizenDevelopers #CyberSecurityNews #SecurityMaturity #CyberCriminals #CloudSecurity #cybersecurity #Cybersecurity #TRENDINGNOW #AIredteam #CyberTalk #zerotrust #CXOFILES #hackers #SaaS #ztna #AI

Red-teaming is not a plan; it finds flaws with the goal of improving existing plans, infrastructures, and practices. #airedteam #aiharms

In this op-ed, we take a step back from our experiences at DEFCON31’s Generative Red Team challenge to reflect on the broader question of the significance of red teaming for algorithmic accountability and AI harm mitigation. https://techpolicy.press/can-we-red-team-our-way-to-ai-accountability/

Red-teaming is not a plan; it finds flaws with the goal of improving existing plans, infrastructures, and practices. #airedteam #aiharms

In this op-ed, we take a step back from our experiences at DEFCON31’s Generative Red Team challenge to reflect on the broader question of the significance of red teaming for algorithmic accountability and AI harm mitigation. https://techpolicy.press/can-we-red-team-our-way-to-ai-accountability/

Red-teaming is not a plan; it finds flaws with the goal of improving existing plans, infrastructures, and practices. #airedteam #aiharms

In this op-ed, we take a step back from our experiences at DEFCON31’s Generative Red Team challenge to reflect on the broader question of the significance of red teaming for algorithmic accountability and AI harm mitigation. https://techpolicy.press/can-we-red-team-our-way-to-ai-accountability/

Red-teaming is not a plan; it finds flaws with the goal of improving existing plans, infrastructures, and practices. #airedteam #aiharms

In this op-ed, we take a step back from our experiences at DEFCON31’s Generative Red Team challenge to reflect on the broader question of the significance of red teaming for algorithmic accountability and AI harm mitigation. https://techpolicy.press/can-we-red-team-our-way-to-ai-accountability/

Red-teaming is not a plan; it finds flaws with the goal of improving existing plans, infrastructures, and practices. #airedteam #aiharms

In this op-ed, we take a step back from our experiences at DEFCON31’s Generative Red Team challenge to reflect on the broader question of the significance of red teaming for algorithmic accountability and AI harm mitigation. https://techpolicy.press/can-we-red-team-our-way-to-ai-accountability/

With all of AI’s potential to empower people and organizations, it also comes with risks that the security community must address.

we’re sharing some recent developments so that the community can be better informed and better equipped for a new world of AI exploration:

- New research: A dedicated AI Security Red Team within Microsoft Threat Intelligence explored how traditional software threats affect AI and how security professionals, developers, and machine learning engineers should think about securing and monitoring AI and machine learning models.

- New tools for defenders: Microsoft recently released an open-source automation tool for security testing of AI systems called Counterfit (https://github.com/Azure/counterfit/ ).

- Industry collaboration to help secure the AI supply chain: We worked with Hugging Face, one of the most popular machine learning model repositories, to mitigate threats to AI and machine learning frameworks by collaborating on an AI-specific security scanner.

Find out what microsoft AI Security Red Team investigated:

https://www.microsoft.com/en-us/security/blog/2023/03/02/new-research-tooling-and-partnerships-for-more-secure-ai-and-machine-learning/

MITRE ATLAS, the ATT&CK-style framework for adversarial machine learning: https://atlas.mitre.org/

#security #ai #Counterfit #azure #microsoft #redteam #airedteam #research #sercurityresearch #AIsecurity #ML #threatintelligence #openai #mitre #mitreatlas #atlas #python #caldera #threatmodeling #threat #cybersecurity #cloud #cloudsecurity