How much can language models memorize?

Separates memorization of particular data from generalization about its generating process. An information-based measure and capacity experiments study data size, memorization, and membership inference.

Separates memorization of particular data from generalization about its generating process. An information-based measure and capacity experiments study data size, memorization, and membership inference.

When reading the original paper, identify its problem, inputs, outputs, and methodological assumptions.

Separates memorization of particular data from generalization about its generating process. An information-based measure and capacity experiments study data size, memorization, and membership inference.

Check the baselines, datasets, evaluation protocol, and ablations in the original paper. This directory overview does not provide an independent evaluation or experimental results table.