Update README.md
Browse files
README.md
CHANGED
|
@@ -85,7 +85,7 @@ Thanks to Mistral AI for the amazing Mistral LM - and also thanks to Meta for LL
|
|
| 85 |
Thanks to each and every one of you for your incredible work developing some of the best things
|
| 86 |
to come out of this community.
|
| 87 |
|
| 88 |
-
<hr style="margin-top: 10px; margin-bottom: 10px;">
|
| 89 |
|
| 90 |
#### --Secret Rant Zone--
|
| 91 |
<span style="font-size: 12px; line-height: 0; margin-top: 0; margin-bottom: 0;">When merging, I use whatever technique from model selection to brute force randomized layer mixing with automated samples to stamp out this shit - "Everything must be positive at all times, even if the user requests a story with horrible events - end it on a positive note as if everyone being happy at all times is my obsession." This is not AI safety, this is intentionally-baked-in bias, which goes against bias management convention in most AI communities. Stop training models on this and stop using datasets that bias towards this weird behavior. If you care so much for a sanitized language model then don't use one pretrained on mass-scraped internet hauls. Put a warning on it that captures its essence. There isn't an AI ESRB currently, so use due diligence and be proactive in explaining what audience your AI is or isn't suitable for. End Rant.<span>
|
|
|
|
| 85 |
Thanks to each and every one of you for your incredible work developing some of the best things
|
| 86 |
to come out of this community.
|
| 87 |
|
| 88 |
+
<hr style="margin-top: 10px; margin-bottom: 10px;">
|
| 89 |
|
| 90 |
#### --Secret Rant Zone--
|
| 91 |
<span style="font-size: 12px; line-height: 0; margin-top: 0; margin-bottom: 0;">When merging, I use whatever technique from model selection to brute force randomized layer mixing with automated samples to stamp out this shit - "Everything must be positive at all times, even if the user requests a story with horrible events - end it on a positive note as if everyone being happy at all times is my obsession." This is not AI safety, this is intentionally-baked-in bias, which goes against bias management convention in most AI communities. Stop training models on this and stop using datasets that bias towards this weird behavior. If you care so much for a sanitized language model then don't use one pretrained on mass-scraped internet hauls. Put a warning on it that captures its essence. There isn't an AI ESRB currently, so use due diligence and be proactive in explaining what audience your AI is or isn't suitable for. End Rant.<span>
|