Large Language Models, Quiz 1
September 2025 term, 26 Oct 2025, Set QDB2
To increase the numerical precision of the attention scores.
To reduce the overall computational cost of the attention mechanism.
To ensure that the sum of the attention scores for each query equals 1.
To avoid numerical issues and loss of gradients during training.
Sign in to report a problem with this question.
You cannot change your answers after submitting.
The palette shows the status of every question. Pick a number to go straight to it.
Figure from the original question paper Which of the following is true regarding sinusoidal encoding? Figure from the original question paper
