question_id,batch_id,topic,category,prompt,expected_answer_length,required_claim_count,required_claim_weight,factual_accuracy_numerator,factual_accuracy_denominator,factual_accuracy_percent,citation_occurrences,valid_citation_occurrences,citation_url_validity_percent,citation_claim_edges,citation_support_numerator,citation_support_denominator,citation_support_percent,citation_completeness_numerator,citation_completeness_denominator,citation_completeness_percent,authority_coverage_numerator,authority_coverage_denominator,authority_coverage_percent,well_placed_citation_occurrences,citation_placement_denominator,citation_placement_percent,preferred_source_hit,final_numeric_score,result,failed_hard_gates,key_finding
Q01,B01,Health guidance,public_health,"According to current CDC guidance for adults, what minimum weekly aerobic activity can be met with moderate activity, vigorous activity, or an equivalent combination? How many days of muscle-strengthening activity are recommended, and may the weekly activity be split into smaller chunks?",2-4 sentences,3,5,4,5,80,6,5,83.3333,6,4.5,6,75,3,5,60,2.25,5,45,5,6,83.3333,false,62,FAIL,final_numeric_score_at_least_85;factual_accuracy_at_least_90;citation_url_validity_equals_100;citation_support_precision_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80;zero_fabricated_or_unresolvable_citations,"The activity totals and smaller-chunk advice were right, but a required strength qualifier was missing and one citation was unverifiable."
Q02,B01,Health guidance,food_safety,"What daily caffeine amount does the FDA cite as not generally associated with negative effects for most adults, about how many 12-fluid-ounce cups of coffee does that represent, and what two cautions does the FDA give about individual sensitivity and pregnancy or related conditions?",2-4 sentences,4,5,3,5,60,7,7,100,9,5,9,55.5556,2,5,40,1.5,5,30,6,7,85.7143,false,38.6825,FAIL,final_numeric_score_at_least_85;factual_accuracy_at_least_90;citation_support_precision_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80;zero_material_contradiction_of_a_required_claim,"The 400 mg framing was preserved, but the cup conversion and caution population were materially incomplete."
Q03,B01,Health guidance,nutrition,"In the NIH Office of Dietary Supplements vitamin D guidance, what is the recommended daily amount for adults ages 19-70 and for adults age 71 or older? Give both micrograms and International Units, and state the listed amount for pregnant or breastfeeding teens and women.",2-4 sentences,3,5,5,5,100,3,3,100,5,4,5,80,5,5,100,5,5,100,3,3,100,true,96.3333,FAIL,citation_support_precision_at_least_90,All NIH intake values were accurate and complete; one redundant Mayo citation only partially entailed the combined age-band claim.
Q04,B01,Health guidance,sleep_health,"What daily sleep duration does CDC list for adults ages 18-60, ages 61-64, and age 65 or older?",1-3 sentences,3,3,3,3,100,2,1,50,6,3,6,50,3,3,100,0.75,3,25,1,2,50,false,73,FAIL,final_numeric_score_at_least_85;citation_url_validity_equals_100;citation_support_precision_at_least_90;authority_coverage_at_least_80;zero_fabricated_or_unresolvable_citations,"The three sleep bands were correct, but one of two citations was unverifiable and the surviving source was a general secondary explainer."
Q05,B02,"Earth, space, and climate science",space_science,"When did NASA launch Voyager 1, which two planets were its primary flyby targets, and when did it enter interstellar space? Include the mission distinction NASA assigns to it.",2-4 sentences,4,5,3,5,60,5,4,80,10,6.5,10,65,3,5,60,3,5,60,4,5,80,true,54,FAIL,final_numeric_score_at_least_85;factual_accuracy_at_least_90;citation_url_validity_equals_100;citation_support_precision_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80;zero_fabricated_or_unresolvable_citations,"Launch, targets, and August 2012 were right, but the answer replaced the required NASA distinction with a phase name."
Q06,B02,"Earth, space, and climate science",earth_science,"According to the U.S. Geological Survey's global water estimate, what percentage of Earth's total water is in the oceans, and how is freshwater divided between ice and glaciers and groundwater? Also state approximately what fraction of all Earth's water is in fresh rivers and lakes.",2-4 sentences,4,5,3,5,60,6,3,50,10,4,10,40,3,5,60,3,5,60,3,6,50,true,44,FAIL,final_numeric_score_at_least_85;factual_accuracy_at_least_90;citation_url_validity_equals_100;citation_support_precision_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80;zero_fabricated_or_unresolvable_citations;zero_material_contradiction_of_a_required_claim,The large reservoirs were accurate; the tiny rivers-and-lakes fraction was materially misstated and half the citation occurrences were broken.
Q07,B02,"Earth, space, and climate science",atmospheric_science,"What is ozone made of, what harmful radiation does the stratospheric ozone layer absorb, and what kinds of human-made chemicals drive depletion? Under continued current policies, around which years is recovery to 1980 values projected for most of the world, the Arctic, and the Antarctic?",3-5 sentences,6,6,4.5,6,75,5,5,100,5,4,5,80,3,6,50,3,6,50,4,5,80,false,53,FAIL,final_numeric_score_at_least_85;factual_accuracy_at_least_90;citation_support_precision_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80;zero_material_contradiction_of_a_required_claim,"Ozone composition and depletion chemistry were good, but the regional recovery timetable did not match the frozen benchmark."
Q08,B02,"Earth, space, and climate science",climate_science,"What did the IPCC AR6 Synthesis Report conclude about the human cause of recent global warming, and how much warmer was the 2011-2020 global surface temperature than 1850-1900? Give the report's separate best estimates for warming over land and over the ocean.",2-4 sentences,4,5,4,5,80,0,0,,0,0,0,,0,5,0,0,5,0,0,0,,false,21,FAIL,final_numeric_score_at_least_85;factual_accuracy_at_least_90;citation_url_validity_equals_100;citation_support_precision_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80,"Most temperature values were right, but the central attribution wording was weakened and the answer contained no live citation at all."
Q09,B03,Public data and economics,demography,"What U.S. resident population did the 2020 Census report as of April 1, 2020, and what was the percentage increase from 2010? Explain whether overseas military and federal civilian employees were part of that resident count or were added separately for congressional apportionment.",2-4 sentences,4,7,6,7,85.7143,3,3,100,6,6,6,100,5,7,71.4286,5,7,71.4286,3,3,100,true,78.3333,FAIL,final_numeric_score_at_least_85;factual_accuracy_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80,"The resident count, date, scope, and growth were correct; overseas home-state allocation was incomplete."
Q10,B03,Public data and economics,price_statistics,"How does the U.S. Bureau of Labor Statistics define the Consumer Price Index, what are its eight major expenditure groups, and are sales and excise taxes tied directly to specific goods and services included?",2-5 sentences,3,6,6,6,100,3,3,100,3,3,3,100,6,6,100,6,6,100,3,3,100,true,100,PASS,,"The CPI basket, substitution distinction, and non-cost-of-living qualifier all matched the BLS benchmark with official citations."
Q11,B03,Public data and economics,monetary_policy,"In the Federal Reserve's longer-run framework current after its 2025 review, what inflation rate does the FOMC judge consistent with its mandate, over what horizon, and which price index measures that rate?",1-3 sentences,3,5,5,5,100,4,4,100,6,6,6,100,5,5,100,5,5,100,4,4,100,true,100,PASS,,"The longer-run 2% PCE framing and measure distinction were accurate, complete, and supported by Federal Reserve sources."
Q12,B03,Public data and economics,tax_guidance,"For calendar year 2024, what optional IRS standard mileage rates applied to business use, charitable service, and medical or qualifying military moving use? Include who could use the moving-expense rate during the statutory suspension.",2-4 sentences,4,5,4,5,80,4,2,50,8,3,8,37.5,3,5,60,3,5,60,1,4,25,true,51.5,FAIL,final_numeric_score_at_least_85;factual_accuracy_at_least_90;citation_url_validity_equals_100;citation_support_precision_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80;zero_fabricated_or_unresolvable_citations,"All three mileage rates were right, but two KPMG links were dead and the military PCS qualifier was incomplete."
Q13,B04,"Law, regulation, and security policy",copyright_law,"What four factors does Section 107 require courts to consider when evaluating fair use, and does U.S. law provide a fixed safe number of words or percentage of a work that may be used without permission?",3-5 sentences,5,6,6,6,100,4,4,100,13,13,13,100,6,6,100,6,6,100,4,4,100,true,97,PASS,,All four statutory fair-use factors and the case-by-case rule were accurate and supported; only the requested sentence range was missed.
Q14,B04,"Law, regulation, and security policy",commercial_email_law,"Does the CAN-SPAM Act exempt business-to-business commercial email? Summarize the FTC's requirements for headers and subject lines, ad identification, a physical postal address, opt-out access, and the deadlines for keeping the mechanism available and honoring a request.",3-6 sentences,6,8,7.5,8,93.75,7,7,100,11,11,11,100,7,8,87.5,7,8,87.5,7,7,100,true,85,FAIL,citation_completeness_equals_100,"CAN-SPAM duties and timing were largely correct, but the ad-identification exception was omitted."
Q15,B04,"Law, regulation, and security policy",digital_identity,"Under final NIST SP 800-63B-4, what minimum password length is required for single-factor use, what shorter minimum may be allowed when a password is used only as part of multi-factor authentication, and what does NIST require about composition rules and blocklist checks?",2-4 sentences,4,6,5.5,6,91.6667,4,4,100,6,2.5,6,41.6667,3,6,50,0.75,6,12.5,3,4,75,false,47.3333,FAIL,final_numeric_score_at_least_85;citation_support_precision_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80,"Several password rules were directionally right, but citation support was weak and the named final-revision requirement was not met cleanly."
Q16,B04,"Law, regulation, and security policy",data_protection_law,"Under GDPR Article 17, give two grounds that can trigger erasure and list all five paragraph 3 categories in which the right does not apply to the extent processing is necessary.",3-6 sentences,7,7,6.5,7,92.8571,6,6,100,21,18.5,21,88.0952,6,7,85.7143,6,7,85.7143,6,6,100,false,78.2857,FAIL,final_numeric_score_at_least_85;citation_support_precision_at_least_90;citation_completeness_equals_100,"The two grounds and exception categories were mostly accurate, but one legally material necessity limit and the sentence range were missed."
Q17,B05,Web and software standards,web_accessibility,"For WCAG 2.2 Success Criterion 1.4.3 at Level AA, what minimum contrast ratio applies to normal text and to large-scale text? Name the two content categories besides large text that the criterion exempts from a contrast requirement.",2-4 sentences,4,4,4,4,100,6,6,100,15,15,15,100,4,4,100,4,4,100,6,6,100,true,100,PASS,,"Contrast ratios, large-text thresholds, and exemptions were accurate, fully cited, and anchored by W3C material."
Q18,B05,Web and software standards,http,"What condition does HTTP status code 429 represent under RFC 6585, what should the response representation explain, and what optional header may tell a client how long to wait? Does the RFC define how the server identifies a user or counts requests?",2-4 sentences,4,5,5,5,100,5,0,0,7,0,7,0,0,5,0,0,5,0,0,5,0,false,38,FAIL,final_numeric_score_at_least_85;citation_url_validity_equals_100;citation_support_precision_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80;zero_fabricated_or_unresolvable_citations,"The 429 semantics were accurate, but every Stack Overflow revision citation remained unverifiable, so none could earn support or completeness credit."
Q19,B05,Web and software standards,web_crawling,"Under RFC 9309, where must a robots.txt file be located and how must it be encoded and served? Explain whether its rules are access authorization and what security risk can come from listing paths in it.",2-4 sentences,4,6,6,6,100,6,0,0,8,0,8,0,0,6,0,0,6,0,0,6,0,false,38,FAIL,final_numeric_score_at_least_85;citation_url_validity_equals_100;citation_support_precision_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80;zero_fabricated_or_unresolvable_citations,"The robots.txt statements matched RFC 9309, but all six preserved citation occurrences were either unverifiable or broken."
Q20,B05,Web and software standards,python,"According to the official Python tutorial, how do lists and tuples differ in mutability and typical use? Can a tuple contain a mutable object, and what syntax creates a one-item tuple?",2-4 sentences,4,4,3,4,75,4,4,100,5,5,5,100,2,4,50,0.25,4,6.25,4,4,100,true,64,FAIL,final_numeric_score_at_least_85;factual_accuracy_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80,"Mutability and singleton syntax were right, but typical access patterns were incomplete and the supporting sources had low authority."
Q21,B06,History and world heritage,colonial_history,"On what date was Jamestown established, under whose corporate and royal authority, and what distinction does the Library of Congress give it? Include the Library's caution about the land's earlier inhabitants.",2-4 sentences,4,6,6,6,100,6,5,83.3333,9,4,9,44.4444,6,6,100,6,6,100,3,6,50,true,84.8889,FAIL,final_numeric_score_at_least_85;citation_url_validity_equals_100;citation_support_precision_at_least_90;zero_fabricated_or_unresolvable_citations,"All Jamestown facts were accurate and an official LOC source covered them, but two decorative/weak placements and one unverifiable news citation reduced precision."
Q22,B06,History and world heritage,constitutional_history,"When did Congress pass, the states ratify, and the Secretary of State certify the 19th Amendment? Which state supplied the decisive ratification, and why does the National Archives caution that ratification did not immediately enfranchise every woman?",3-5 sentences,5,6,6,6,100,0,0,,0,0,0,,0,6,0,0,6,0,0,0,,false,38,FAIL,final_numeric_score_at_least_85;citation_url_validity_equals_100;citation_support_precision_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80,"All five 19th Amendment facts matched the benchmark, yet the answer supplied zero citations."
Q23,B06,History and world heritage,world_heritage,"When was the Great Barrier Reef inscribed on the UNESCO World Heritage List, under which four criteria, and approximately how large is the listed ecosystem? State the approximate counts of individual reefs and islands described by UNESCO.",2-4 sentences,5,6,4.5,6,75,0,0,,0,0,0,,0,6,0,0,6,0,0,0,,false,9,FAIL,final_numeric_score_at_least_85;factual_accuracy_at_least_90;citation_url_validity_equals_100;citation_support_precision_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80;zero_material_contradiction_of_a_required_claim,"Year, criteria, and area were right, but reef and island counts were wrong or over-precise and no citation was supplied."
Q24,B06,History and world heritage,conservation_history,"When and by whose signature was Yellowstone National Park established, what global distinction does the National Park Service give it, and what did the founding law do with the land? Did the park predate the National Park Service itself?",2-4 sentences,4,6,5,6,83.3333,0,0,,0,0,0,,0,6,0,0,6,0,0,0,,false,22,FAIL,final_numeric_score_at_least_85;factual_accuracy_at_least_90;citation_url_validity_equals_100;citation_support_precision_at_least_90;citation_completeness_equals_100;authority_coverage_at_least_80,"The law, land withdrawal, and 1916 comparison were right; the NPS attribution was weakened and the entire answer was uncited."