The abilities of Large Language Models in general scale, with ever bigger models proving themselves more capable of performing various tasks. However, further abilities are found in these models that cannot be explained or seen as a scaling up of their smaller counterparts.
Read the full paper here, reviewing so-called called emergent abilities found within these models.