#eleutherai — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #eleutherai, aggregated by home.social.
-
https://www.europesays.com/pl/249215/ Wojna o sztuczną inteligencję, czyli otwarte modele kontra korporacyjni giganci i ich zamknięte algorytmy #ai #BigTech #Biznes #Business #EleutherAI #gemini #google #Gpt4 #HuggingFace #Llama2 #meta #OpenSource #openai #OpenLLaMA #PL #Poland #Polish #Polska #Polski #RedPajama #SztucznaInteligencja #technologia
-
🔍 Nghiên cứu phân tích 23+ mô hình từ 7 phòng thí nghiệm cho thấy đặc tính “thermodynamic” của mô hình phụ thuộc nhiều hơn vào nhà phát triển hơn là số tham số. Các mô hình EleutherAI (Pythia, GPT‑NeoX) có xu hướng giảm tín hiệu (G<1), trong khi Meta/OpenAI (LLaMA, OPT, GPT‑2) mở rộng (G>1). Fine‑tuning chỉ thay đổi độ lớn, hiếm khi đảo ngược dấu, nên việc chọn base model quan trọng. #AI #NLP #LLM #MachineLearning #Mô_hình #DeepLearning #Research #EleutherAI #Meta #LLaMA #Finetuning
https://ww
-
TechCrunch: EleutherAI releases massive AI training dataset of licensed and open domain text. “The dataset, called the Common Pile v0.1, took around two years to complete in collaboration with AI startups Poolside, Hugging Face, and others, along with several academic institutions. Weighing in at 8 terabytes in size, the Common Pile v0.1 was used to train two new AI models from EleutherAI, […]
-
TechCrunch: EleutherAI releases massive AI training dataset of licensed and open domain text. “The dataset, called the Common Pile v0.1, took around two years to complete in collaboration with AI startups Poolside, Hugging Face, and others, along with several academic institutions. Weighing in at 8 terabytes in size, the Common Pile v0.1 was used to train two new AI models from EleutherAI, […]
-
TechCrunch: EleutherAI releases massive AI training dataset of licensed and open domain text. “The dataset, called the Common Pile v0.1, took around two years to complete in collaboration with AI startups Poolside, Hugging Face, and others, along with several academic institutions. Weighing in at 8 terabytes in size, the Common Pile v0.1 was used to train two new AI models from EleutherAI, […]
-
TechCrunch: EleutherAI releases massive AI training dataset of licensed and open domain text. “The dataset, called the Common Pile v0.1, took around two years to complete in collaboration with AI startups Poolside, Hugging Face, and others, along with several academic institutions. Weighing in at 8 terabytes in size, the Common Pile v0.1 was used to train two new AI models from EleutherAI, […]
-
TechCrunch: EleutherAI releases massive AI training dataset of licensed and open domain text. “The dataset, called the Common Pile v0.1, took around two years to complete in collaboration with AI startups Poolside, Hugging Face, and others, along with several academic institutions. Weighing in at 8 terabytes in size, the Common Pile v0.1 was used to train two new AI models from EleutherAI, […]
-
EleutherAI is a grassroots non-profit AI research group, formed in July 2020 by Connor Leahy, Sid Black, and Leo Gao. Known for creating open-source models like GPT-Neo, GPT-J, and GPT-NeoX, their Pile dataset is widely used for training large language models. In early 2023, they incorporated as the EleutherAI Institute. #AI #OpenSource #EleutherAI #MachineLearning #GPT
https://eleuther.ai -
EleutherAI is a grassroots non-profit AI research group, formed in July 2020 by Connor Leahy, Sid Black, and Leo Gao. Known for creating open-source models like GPT-Neo, GPT-J, and GPT-NeoX, their Pile dataset is widely used for training large language models. In early 2023, they incorporated as the EleutherAI Institute. #AI #OpenSource #EleutherAI #MachineLearning #GPT
https://eleuther.ai -
EleutherAI is a grassroots non-profit AI research group, formed in July 2020 by Connor Leahy, Sid Black, and Leo Gao. Known for creating open-source models like GPT-Neo, GPT-J, and GPT-NeoX, their Pile dataset is widely used for training large language models. In early 2023, they incorporated as the EleutherAI Institute. #AI #OpenSource #EleutherAI #MachineLearning #GPT
https://eleuther.ai -
EleutherAI is a grassroots non-profit AI research group, formed in July 2020 by Connor Leahy, Sid Black, and Leo Gao. Known for creating open-source models like GPT-Neo, GPT-J, and GPT-NeoX, their Pile dataset is widely used for training large language models. In early 2023, they incorporated as the EleutherAI Institute. #AI #OpenSource #EleutherAI #MachineLearning #GPT
https://eleuther.ai -
EleutherAI is a grassroots non-profit AI research group, formed in July 2020 by Connor Leahy, Sid Black, and Leo Gao. Known for creating open-source models like GPT-Neo, GPT-J, and GPT-NeoX, their Pile dataset is widely used for training large language models. In early 2023, they incorporated as the EleutherAI Institute. #AI #OpenSource #EleutherAI #MachineLearning #GPT
https://eleuther.ai -
"Recently it was revealed that an AI research lab called #EleutherAI had harvested subtitles from YouTube videos without the creators' consent. This data was then combined with data from Wikipedia, the U.K. Parliament and Enron Staff emails and added to a dataset called “the Pile.”
(Tom's Guide 7/22/2024) -
"Recently it was revealed that an AI research lab called #EleutherAI had harvested subtitles from YouTube videos without the creators' consent. This data was then combined with data from Wikipedia, the U.K. Parliament and Enron Staff emails and added to a dataset called “the Pile.”
(Tom's Guide 7/22/2024) -
YouTube creators surprised to find Apple and others trained AI on their videos - Enlarge / YouTuber Marques Brownlee discusses iOS 18 in a new video. Th... - https://arstechnica.com/?p=2037316 #largelanguagemodels #eleutherai #anthropic #thepile #youtube #google #apple #tech #ai
-
YouTube creators surprised to find Apple and others trained AI on their videos - Enlarge / YouTuber Marques Brownlee discusses iOS 18 in a new video. Th... - https://arstechnica.com/?p=2037316 #largelanguagemodels #eleutherai #anthropic #thepile #youtube #google #apple #tech #ai
-
YouTube creators surprised to find Apple and others trained AI on their videos - Enlarge / YouTuber Marques Brownlee discusses iOS 18 in a new video. Th... - https://arstechnica.com/?p=2037316 #largelanguagemodels #eleutherai #anthropic #thepile #youtube #google #apple #tech #ai
-
YouTube creators surprised to find Apple and others trained AI on their videos - Enlarge / YouTuber Marques Brownlee discusses iOS 18 in a new video. Th... - https://arstechnica.com/?p=2037316 #largelanguagemodels #eleutherai #anthropic #thepile #youtube #google #apple #tech #ai
-
YouTube creators surprised to find Apple and others trained AI on their videos - Enlarge / YouTuber Marques Brownlee discusses iOS 18 in a new video. Th... - https://arstechnica.com/?p=2037316 #largelanguagemodels #eleutherai #anthropic #thepile #youtube #google #apple #tech #ai
-
AI companies used YouTube videos without permission to train models
https://stackdiary.com/ai-companies-used-youtube-videos-without-permission-to-train-models/
#AI #Jobs #Technology #Innovation #Future #Automation #Creativity #Economy #FairUse #Regulation #JobLoss #TechIndustry #Data #Ethics #Disruption #AIImpact #Workforce #Change #Equality #Productivity #UBI #JobMarket #AIResearch #EconomicValue #AIDevelopment #Society #YouTube #ContentCreation #AITraining #Apple #Nvidia #Anthropic #Salesforce #EleutherAI #BigTech #LLM #Privacy
-
AI companies used YouTube videos without permission to train models
https://stackdiary.com/ai-companies-used-youtube-videos-without-permission-to-train-models/
#AI #Jobs #Technology #Innovation #Future #Automation #Creativity #Economy #FairUse #Regulation #JobLoss #TechIndustry #Data #Ethics #Disruption #AIImpact #Workforce #Change #Equality #Productivity #UBI #JobMarket #AIResearch #EconomicValue #AIDevelopment #Society #YouTube #ContentCreation #AITraining #Apple #Nvidia #Anthropic #Salesforce #EleutherAI #BigTech #LLM #Privacy
-
AI companies used YouTube videos without permission to train models
https://stackdiary.com/ai-companies-used-youtube-videos-without-permission-to-train-models/
#AI #Jobs #Technology #Innovation #Future #Automation #Creativity #Economy #FairUse #Regulation #JobLoss #TechIndustry #Data #Ethics #Disruption #AIImpact #Workforce #Change #Equality #Productivity #UBI #JobMarket #AIResearch #EconomicValue #AIDevelopment #Society #YouTube #ContentCreation #AITraining #Apple #Nvidia #Anthropic #Salesforce #EleutherAI #BigTech #LLM #Privacy
-
AI companies used YouTube videos without permission to train models
https://stackdiary.com/ai-companies-used-youtube-videos-without-permission-to-train-models/
#AI #Jobs #Technology #Innovation #Future #Automation #Creativity #Economy #FairUse #Regulation #JobLoss #TechIndustry #Data #Ethics #Disruption #AIImpact #Workforce #Change #Equality #Productivity #UBI #JobMarket #AIResearch #EconomicValue #AIDevelopment #Society #YouTube #ContentCreation #AITraining #Apple #Nvidia #Anthropic #Salesforce #EleutherAI #BigTech #LLM #Privacy
-
Did you remember #EleutherAi exists?
I honestly completely forgot about them.
#ArtificialIntelligence #AI -
Did you remember #EleutherAi exists?
I honestly completely forgot about them.
#ArtificialIntelligence #AI -
How the Foundation Model Transparency Index Distorts Transparency | EleutherAI Blog https://blog.eleuther.ai/fmti-critique/
I saw the Foundation Model Transparency Index paper come out recently and was surprised that OpenAI scored as high as they did. This Eleuther AI post breaks down how the Foundation Model Transparency index gets it all wrong, and is not really measuring transparency at all.
#fmti
#foundationmodeltransparencyindex
#opensource
#LLM
#eleutherai -
How the Foundation Model Transparency Index Distorts Transparency | EleutherAI Blog https://blog.eleuther.ai/fmti-critique/
I saw the Foundation Model Transparency Index paper come out recently and was surprised that OpenAI scored as high as they did. This Eleuther AI post breaks down how the Foundation Model Transparency index gets it all wrong, and is not really measuring transparency at all.
#fmti
#foundationmodeltransparencyindex
#opensource
#LLM
#eleutherai -
How the Foundation Model Transparency Index Distorts Transparency | EleutherAI Blog https://blog.eleuther.ai/fmti-critique/
I saw the Foundation Model Transparency Index paper come out recently and was surprised that OpenAI scored as high as they did. This Eleuther AI post breaks down how the Foundation Model Transparency index gets it all wrong, and is not really measuring transparency at all.
#fmti
#foundationmodeltransparencyindex
#opensource
#LLM
#eleutherai -
How the Foundation Model Transparency Index Distorts Transparency | EleutherAI Blog https://blog.eleuther.ai/fmti-critique/
I saw the Foundation Model Transparency Index paper come out recently and was surprised that OpenAI scored as high as they did. This Eleuther AI post breaks down how the Foundation Model Transparency index gets it all wrong, and is not really measuring transparency at all.
#fmti
#foundationmodeltransparencyindex
#opensource
#LLM
#eleutherai -
CW: Long thread/40
Some "open AI" is much more open than the industry dominating offerings. There's #EleutherAI, a donor-supported nonprofit whose model comes with documentation and code, licensed #Apache2. There are also some smaller academic offerings: #Vicuna (UCSD/CMU/Berkeley); #Koala (Berkeley) and #Alpaca (Stanford).
These are indeed more open (though Alpaca - which ran on a laptop - had to be withdrawn because it "hallucinated" so profusely).
40/
-
CW: Long thread/40
Some "open AI" is much more open than the industry dominating offerings. There's #EleutherAI, a donor-supported nonprofit whose model comes with documentation and code, licensed #Apache2. There are also some smaller academic offerings: #Vicuna (UCSD/CMU/Berkeley); #Koala (Berkeley) and #Alpaca (Stanford).
These are indeed more open (though Alpaca - which ran on a laptop - had to be withdrawn because it "hallucinated" so profusely).
40/
-
CW: Long thread/40
Some "open AI" is much more open than the industry dominating offerings. There's #EleutherAI, a donor-supported nonprofit whose model comes with documentation and code, licensed #Apache2. There are also some smaller academic offerings: #Vicuna (UCSD/CMU/Berkeley); #Koala (Berkeley) and #Alpaca (Stanford).
These are indeed more open (though Alpaca - which ran on a laptop - had to be withdrawn because it "hallucinated" so profusely).
40/
-
CW: Long thread/40
Some "open AI" is much more open than the industry dominating offerings. There's #EleutherAI, a donor-supported nonprofit whose model comes with documentation and code, licensed #Apache2. There are also some smaller academic offerings: #Vicuna (UCSD/CMU/Berkeley); #Koala (Berkeley) and #Alpaca (Stanford).
These are indeed more open (though Alpaca - which ran on a laptop - had to be withdrawn because it "hallucinated" so profusely).
40/
-
CW: Long thread/40
Some "open AI" is much more open than the industry dominating offerings. There's #EleutherAI, a donor-supported nonprofit whose model comes with documentation and code, licensed #Apache2. There are also some smaller academic offerings: #Vicuna (UCSD/CMU/Berkeley); #Koala (Berkeley) and #Alpaca (Stanford).
These are indeed more open (though Alpaca - which ran on a laptop - had to be withdrawn because it "hallucinated" so profusely).
40/
-
Gizmodo: Anti-Piracy Group Takes Massive AI Training Dataset 'Books3′ Offline https://gizmodo.com/anti-piracy-group-takes-ai-training-dataset-books3-off-1850743763 #generativepretrainedtransformer #artificialneuralnetworks #artificialintelligence #largelanguagemodels #technologyinternet #mariafredenslund #sarahsilverman #shawnpresser #deeplearning #eleutherai #microsoft #chatgpts #thepile #chatgpt #openai #llama #gpt3 #gpt4 #meta
-
Gizmodo: Anti-Piracy Group Takes Massive AI Training Dataset 'Books3′ Offline https://gizmodo.com/anti-piracy-group-takes-ai-training-dataset-books3-off-1850743763 #generativepretrainedtransformer #artificialneuralnetworks #artificialintelligence #largelanguagemodels #technologyinternet #mariafredenslund #sarahsilverman #shawnpresser #deeplearning #eleutherai #microsoft #chatgpts #thepile #chatgpt #openai #llama #gpt3 #gpt4 #meta
-
The article points out we'll see lawsuits against artificial intelligence models for years to come. Good for her & them; these companies should start over w/o copywritten sources.
#AI #artificial #intelligence #copyright #law is a #thing | #dataset #large #language #models #illegal #sources #Bibliotik #fragrantly #illegal #programmers #artists #suing #similar #case #EleutherAI #ThePile #publishers #writers #songwriters #stolen #works #Meta #llama #ChatGPT #library #OpenAI https://www.theverge.com/2023/7/9/23788741/sarah-silverman-openai-meta-chatgpt-llama-copyright-infringement-chatbots-artificial-intelligence-ai -
The article points out we'll see lawsuits against artificial intelligence models for years to come. Good for her & them; these companies should start over w/o copywritten sources.
#AI #artificial #intelligence #copyright #law is a #thing | #dataset #large #language #models #illegal #sources #Bibliotik #fragrantly #illegal #programmers #artists #suing #similar #case #EleutherAI #ThePile #publishers #writers #songwriters #stolen #works #Meta #llama #ChatGPT #library #OpenAI https://www.theverge.com/2023/7/9/23788741/sarah-silverman-openai-meta-chatgpt-llama-copyright-infringement-chatbots-artificial-intelligence-ai -
The article points out we'll see lawsuits against artificial intelligence models for years to come. Good for her & them; these companies should start over w/o copywritten sources.
#AI #artificial #intelligence #copyright #law is a #thing | #dataset #large #language #models #illegal #sources #Bibliotik #fragrantly #illegal #programmers #artists #suing #similar #case #EleutherAI #ThePile #publishers #writers #songwriters #stolen #works #Meta #llama #ChatGPT #library #OpenAI https://www.theverge.com/2023/7/9/23788741/sarah-silverman-openai-meta-chatgpt-llama-copyright-infringement-chatbots-artificial-intelligence-ai -
🚀 New episode of The Changelog!
This week we’re taking you to the hallway track of The #Linux Foundation’s #OSSummit North America 2023 in Vancouver, Canada 🇨🇦
This episode features three conversations about #opensource #AI:
1️⃣ Beyang Liu (Co-founder and CTO at #Sourcegraph)
2️⃣ @dennyglee (Developer Advocate at #Databricks)
3️⃣ Stella Biderman (Head of Research at #EleutherAI) -
🚀 New episode of The Changelog!
This week we’re taking you to the hallway track of The #Linux Foundation’s #OSSummit North America 2023 in Vancouver, Canada 🇨🇦
This episode features three conversations about #opensource #AI:
1️⃣ Beyang Liu (Co-founder and CTO at #Sourcegraph)
2️⃣ @dennyglee (Developer Advocate at #Databricks)
3️⃣ Stella Biderman (Head of Research at #EleutherAI) -
🚀 New episode of The Changelog!
This week we’re taking you to the hallway track of The #Linux Foundation’s #OSSummit North America 2023 in Vancouver, Canada 🇨🇦
This episode features three conversations about #opensource #AI:
1️⃣ Beyang Liu (Co-founder and CTO at #Sourcegraph)
2️⃣ @dennyglee (Developer Advocate at #Databricks)
3️⃣ Stella Biderman (Head of Research at #EleutherAI) -
🚀 New episode of The Changelog!
This week we’re taking you to the hallway track of The #Linux Foundation’s #OSSummit North America 2023 in Vancouver, Canada 🇨🇦
This episode features three conversations about #opensource #AI:
1️⃣ Beyang Liu (Co-founder and CTO at #Sourcegraph)
2️⃣ @dennyglee (Developer Advocate at #Databricks)
3️⃣ Stella Biderman (Head of Research at #EleutherAI) -
🚀 New episode of The Changelog!
This week we’re taking you to the hallway track of The #Linux Foundation’s #OSSummit North America 2023 in Vancouver, Canada 🇨🇦
This episode features three conversations about #opensource #AI:
1️⃣ Beyang Liu (Co-founder and CTO at #Sourcegraph)
2️⃣ @dennyglee (Developer Advocate at #Databricks)
3️⃣ Stella Biderman (Head of Research at #EleutherAI) -
Releasing 3B and 7B #RedPajama-#INCITE family of models including base, instruction-tuned & chat models — #TOGETHER
"The biggest takeaway is the demonstration that performant #LLMs can be built quickly by the open-source community. This work builds on top of our 1.2 trillion token RedPajama dataset, EleutherAI’s #Pythia training code, #FlashAttention from #Stanford and #Together, the #HELM benchmarks from Stanford #CRFM and generous support from #MILA, #EleutherAI & #LAION for compute time on the #Summit #supercomputer within the INCITE program award 'Scalable Foundation Models for Transferable Generalist AI'. We believe these kind of open collaborations, at larger scales, will be behind the best #AI systems of the future. "
-
Releasing 3B and 7B #RedPajama-#INCITE family of models including base, instruction-tuned & chat models — #TOGETHER
"The biggest takeaway is the demonstration that performant #LLMs can be built quickly by the open-source community. This work builds on top of our 1.2 trillion token RedPajama dataset, EleutherAI’s #Pythia training code, #FlashAttention from #Stanford and #Together, the #HELM benchmarks from Stanford #CRFM and generous support from #MILA, #EleutherAI & #LAION for compute time on the #Summit #supercomputer within the INCITE program award 'Scalable Foundation Models for Transferable Generalist AI'. We believe these kind of open collaborations, at larger scales, will be behind the best #AI systems of the future. "
-
Releasing 3B and 7B #RedPajama-#INCITE family of models including base, instruction-tuned & chat models — #TOGETHER
"The biggest takeaway is the demonstration that performant #LLMs can be built quickly by the open-source community. This work builds on top of our 1.2 trillion token RedPajama dataset, EleutherAI’s #Pythia training code, #FlashAttention from #Stanford and #Together, the #HELM benchmarks from Stanford #CRFM and generous support from #MILA, #EleutherAI & #LAION for compute time on the #Summit #supercomputer within the INCITE program award 'Scalable Foundation Models for Transferable Generalist AI'. We believe these kind of open collaborations, at larger scales, will be behind the best #AI systems of the future. "
-
Releasing 3B and 7B #RedPajama-#INCITE family of models including base, instruction-tuned & chat models — #TOGETHER
"The biggest takeaway is the demonstration that performant #LLMs can be built quickly by the open-source community. This work builds on top of our 1.2 trillion token RedPajama dataset, EleutherAI’s #Pythia training code, #FlashAttention from #Stanford and #Together, the #HELM benchmarks from Stanford #CRFM and generous support from #MILA, #EleutherAI & #LAION for compute time on the #Summit #supercomputer within the INCITE program award 'Scalable Foundation Models for Transferable Generalist AI'. We believe these kind of open collaborations, at larger scales, will be behind the best #AI systems of the future. "
-
Releasing 3B and 7B #RedPajama-#INCITE family of models including base, instruction-tuned & chat models — #TOGETHER
"The biggest takeaway is the demonstration that performant #LLMs can be built quickly by the open-source community. This work builds on top of our 1.2 trillion token RedPajama dataset, EleutherAI’s #Pythia training code, #FlashAttention from #Stanford and #Together, the #HELM benchmarks from Stanford #CRFM and generous support from #MILA, #EleutherAI & #LAION for compute time on the #Summit #supercomputer within the INCITE program award 'Scalable Foundation Models for Transferable Generalist AI'. We believe these kind of open collaborations, at larger scales, will be behind the best #AI systems of the future. "
-
Ars Technica: “A really big deal”—Dolly is a free, open source, ChatGPT-style AI model https://arstechnica.com/?p=1931693 #Tech #arstechnica #IT #Technology #largelanguagemodels #machinelearning #textsynthesis #ApacheSpark #Databricks #EleutherAI #finetuning #Biz&IT #pythia #Dolly #LLaMA #meta #AI
-
Ars Technica: “A really big deal”—Dolly is a free, open source, ChatGPT-style AI model https://arstechnica.com/?p=1931693 #Tech #arstechnica #IT #Technology #largelanguagemodels #machinelearning #textsynthesis #ApacheSpark #Databricks #EleutherAI #finetuning #Biz&IT #pythia #Dolly #LLaMA #meta #AI
-
Ars Technica: “A really big deal”—Dolly is a free, open source, ChatGPT-style AI model https://arstechnica.com/?p=1931693 #Tech #arstechnica #IT #Technology #largelanguagemodels #machinelearning #textsynthesis #ApacheSpark #Databricks #EleutherAI #finetuning #Biz&IT #pythia #Dolly #LLaMA #meta #AI
-
Ars Technica: “A really big deal”—Dolly is a free, open source, ChatGPT-style AI model https://arstechnica.com/?p=1931693 #Tech #arstechnica #IT #Technology #largelanguagemodels #machinelearning #textsynthesis #ApacheSpark #Databricks #EleutherAI #finetuning #Biz&IT #pythia #Dolly #LLaMA #meta #AI
-
“A really big deal”—Dolly is a free, open source, ChatGPT-style AI model - Enlarge (credit: Databricks)
On Wednesday, Databricks released... - https://arstechnica.com/?p=1931693 #largelanguagemodels #machinelearning #textsynthesis #apachespark #databricks #eleutherai #finetuning #biz #pythia #dolly #llama #meta #ai
-
“A really big deal”—Dolly is a free, open source, ChatGPT-style AI model - Enlarge (credit: Databricks)
On Wednesday, Databricks released... - https://arstechnica.com/?p=1931693 #largelanguagemodels #machinelearning #textsynthesis #apachespark #databricks #eleutherai #finetuning #biz #pythia #dolly #llama #meta #ai
-
“A really big deal”—Dolly is a free, open source, ChatGPT-style AI model - Enlarge (credit: Databricks)
On Wednesday, Databricks released... - https://arstechnica.com/?p=1931693 #largelanguagemodels #machinelearning #textsynthesis #apachespark #databricks #eleutherai #finetuning #biz #pythia #dolly #llama #meta #ai
-
“A really big deal”—Dolly is a free, open source, ChatGPT-style AI model - Enlarge (credit: Databricks)
On Wednesday, Databricks released... - https://arstechnica.com/?p=1931693 #largelanguagemodels #machinelearning #textsynthesis #apachespark #databricks #eleutherai #finetuning #biz #pythia #dolly #llama #meta #ai
-
“A really big deal”—Dolly is a free, open source, ChatGPT-style AI model - Enlarge (credit: Databricks)
On Wednesday, Databricks released... - https://arstechnica.com/?p=1931693 #largelanguagemodels #machinelearning #textsynthesis #apachespark #databricks #eleutherai #finetuning #biz #pythia #dolly #llama #meta #ai
-
There are some really good papers that have sought to make the best of the current situation, but #EleutherAI had the compute to do it the right way and so we did.
https://arxiv.org/abs/2211.08411
https://arxiv.org/abs/2202.07646
https://arxiv.org/abs/2202.07206
https://arxiv.org/abs/2207.14251We hope that this work will empower more people to work on questions in interpretability, especially the causal impact of training data on model behavior!
-
There are some really good papers that have sought to make the best of the current situation, but #EleutherAI had the compute to do it the right way and so we did.
https://arxiv.org/abs/2211.08411
https://arxiv.org/abs/2202.07646
https://arxiv.org/abs/2202.07206
https://arxiv.org/abs/2207.14251We hope that this work will empower more people to work on questions in interpretability, especially the causal impact of training data on model behavior!