Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction

Builds minimal algorithmic tasks for testing planning and diverse generation. Comparisons of next-token learning, multi-token methods, and input noise provide a controlled testbed for creative behavior.

Builds minimal algorithmic tasks for testing planning and diverse generation. Comparisons of next-token learning, multi-token methods, and input noise provide a controlled testbed for creative behavior.

When reading the original paper, identify its problem, inputs, outputs, and methodological assumptions.

Builds minimal algorithmic tasks for testing planning and diverse generation. Comparisons of next-token learning, multi-token methods, and input noise provide a controlled testbed for creative behavior.

Check the baselines, datasets, evaluation protocol, and ablations in the original paper. This directory overview does not provide an independent evaluation or experimental results table.