On the generalization of language models from in-context learning and finetuning: a controlled study
arXiv:2505.00661v3 Announce Type: replace-cross Abstract: Large language models exhibit exciting capabilities, yet can show surprisingly narrow generalization from finetuning. E.g.…