Improving language model behavior by training on a curated dataset
Research shows fine-tuning language models on small curated datasets improves behavior alignment with specific values.
Excerpt
Our latest research finds we can improve language model behavior with respect to specific behavioral values by fine-tuning on a small, curated dataset.
Read at source: https://openai.com/index/improving-language-model-behavior