Key answer
First determine whether an unstated answer can be derived from supplied information. If key premises are missing, leave it unresolved or identify the gap. “Use only the material” may permit calculation and reasoning, not silently imported facts.
Full explanation
*Sufficient Context* examined GPT-4o, Claude 3.5 Sonnet, Gemini and others on FreshQA, MuSiQue and HotpotQA, separating context sufficiency from answer correctness. Models erred with sufficient context and produced seemingly certain wrong answers with insufficient context. Nearby relevant text does not establish a supporting evidence chain. Sections 3–4
Distinguish:
· Explicitly stated: answer and locate the original text/data.
· Derivable: give premises and calculation. Comparable monthly sales of 100 and 120 imply 20% growth.
· Undetermined: identify missing information. That sales increase alone does not show advertising caused it; causal evidence is needed.
Also distinguish “not stated” from “did not happen.” An omitted refund deadline does not mean there is no deadline. A few search results omitting a rule do not establish its absence from the document.
Answer only from the supplied material. Necessary calculations and logical deductions are allowed with stated support. Separately identify omissions, contradictions and missing conditions. List external-fact gaps rather than filling them with assumptions presented as source conclusions.
Quote verbatim when requested; connect multiple passages for synthesis when appropriate. Check every key conclusion against the material, especially quantities, negation, scope and causation.