{"id":"q001","category":"simple_lookup","question":"What attachment point was finally selected for Triglav Adriatic's property catastrophe renewal?","expected_answer":"The final selected attachment point was EUR 7.5m.","expected_sources":["2024-06-10_triglav_adriatic_property_cat_final_recommendation.md"],"must_refuse":false,"key_facts":["EUR 7.5m attachment point","final selected attachment"],"notes":"Simple lookup. The assistant should prefer the final recommendation over earlier kickoff notes."}
{"id":"q002","category":"contradiction","question":"Was there conflicting guidance about Triglav Adriatic's attachment point?","expected_answer":"Yes. The kickoff notes used EUR 5m as a provisional working preference, but the final recommendation selected EUR 7.5m.","expected_sources":["2024-03-12_triglav_adriatic_property_cat_kickoff.md","2024-06-10_triglav_adriatic_property_cat_final_recommendation.md"],"must_refuse":false,"key_facts":["EUR 5m provisional working preference","EUR 7.5m final selected attachment","earlier guidance was superseded"],"notes":"Trick/contradiction question. The assistant should name both values and explain which is final."}
{"id":"q003","category":"multi_hop","question":"Which assigned Triglav Adriatic team member had prior catastrophe modelling experience?","expected_answer":"Sara Kovac was assigned to the Triglav Adriatic renewal and had prior catastrophe modelling experience.","expected_sources":["2024-06-10_triglav_adriatic_property_cat_final_recommendation.md","2024-01-10_team_capability_matrix.md"],"must_refuse":false,"key_facts":["Sara Kovac assigned to Triglav Adriatic","Sara Kovac has prior catastrophe modelling experience"],"notes":"Requires combining project staffing with the team capability matrix."}
{"id":"q004","category":"simple_lookup","question":"Who was selected as lead reinsurer for the Triglav Adriatic renewal?","expected_answer":"Helvetia Re was selected as lead reinsurer, with a 22.5% signed line in the final recommendation.","expected_sources":["2024-06-10_triglav_adriatic_property_cat_final_recommendation.md","2024-06-04_triglav_adriatic_broker_market_feedback.md"],"must_refuse":false,"key_facts":["Helvetia Re","lead reinsurer","22.5% signed line"],"notes":"Answer can cite either source, but strongest answer cites both broker feedback and final recommendation."}
{"id":"q005","category":"temporal","question":"What was the latest total insured value used for Triglav Adriatic's cat modelling?","expected_answer":"The latest validated total insured value was EUR 2.05bn. The earlier EUR 1.80bn extract was preliminary and superseded after data cleansing.","expected_sources":["2024-04-05_triglav_adriatic_exposure_extract_v1.csv","2024-05-20_triglav_adriatic_cat_model_report.md"],"must_refuse":false,"key_facts":["EUR 2.05bn latest validated total insured value","EUR 1.80bn preliminary extract","superseded after data cleansing"],"notes":"Temporal question. The assistant should prefer the later modelling report."}
{"id":"q006","category":"simple_lookup","question":"What final ceding commission was recommended for Merkur Mutual's motor quota share?","expected_answer":"The final recommended ceding commission was 31.5%.","expected_sources":["2024-02-20_merkur_mutual_motor_qs_final_proposal.md"],"must_refuse":false,"key_facts":["31.5% final recommended ceding commission"],"notes":"Simple lookup from the final proposal."}
{"id":"q007","category":"contradiction","question":"Did the Merkur Mutual motor quota share commission change between kickoff and final proposal?","expected_answer":"Yes. The kickoff notes used an initial 29.0% target, but the final proposal recommended 31.5% after updated loss data.","expected_sources":["2024-01-22_merkur_mutual_motor_qs_kickoff.md","2024-02-20_merkur_mutual_motor_qs_final_proposal.md"],"must_refuse":false,"key_facts":["29.0% initial target","31.5% final recommendation","updated loss data caused revision"],"notes":"Contradiction/temporal question."}
{"id":"q008","category":"multi_hop","question":"Which consultant should answer bordereaux quality questions for Balkan Motor Pool and why?","expected_answer":"Tim Zupan should answer them because he led the Balkan Motor Pool bordereaux data quality audit and the team capability matrix lists him with bordereaux data quality and claims analytics experience.","expected_sources":["2024-03-05_balkan_motor_bordereaux_audit.md","2024-01-10_team_capability_matrix.md"],"must_refuse":false,"key_facts":["Tim Zupan led the bordereaux audit","Tim Zupan has bordereaux data quality experience","Balkan Motor Pool"],"notes":"Requires project document plus internal capability matrix."}
{"id":"q009","category":"unanswerable","question":"What cyber catastrophe treaty did Nova Kredit buy?","expected_answer":"The corpus does not contain information about Nova Kredit or a cyber catastrophe treaty, so the assistant should refuse to answer.","expected_sources":[],"must_refuse":true,"key_facts":["no Nova Kredit information","no cyber catastrophe treaty information"],"notes":"Hallucination check. The assistant must not invent a treaty."}
{"id":"q010","category":"simple_lookup","question":"What deductible was bound for Adriatic Health's stop-loss placement?","expected_answer":"The bound deductible was EUR 1.2m.","expected_sources":["2024-05-03_adriatic_health_stop_loss_signed_summary.md"],"must_refuse":false,"key_facts":["EUR 1.2m bound deductible"],"notes":"Simple lookup from signed placement summary."}
{"id":"q011","category":"temporal","question":"What is the latest expected claims ratio for Adriatic Health's stop-loss pricing?","expected_answer":"The latest expected claims ratio was 82%. The earlier 76% ratio was preliminary and superseded after updated large-claim development.","expected_sources":["2024-04-08_adriatic_health_initial_claims_review.md","2024-04-22_adriatic_health_final_pricing_note.md"],"must_refuse":false,"key_facts":["82% latest expected claims ratio","76% preliminary ratio","superseded by updated large-claim development"],"notes":"Temporal question. The assistant should prefer the later final pricing note."}
{"id":"q012","category":"multi_hop","question":"Which projects involved Solvency II capital modelling and what was the main lesson learned?","expected_answer":"Sava Danube Re's Retrocession and Solvency II Capital Review involved Solvency II capital modelling. The main lesson was to align retrocession assumptions with the internal model before market submission.","expected_sources":["2024-02-28_sava_danube_solvency_capital_model_note.md","2024-06-28_reinsurance_lessons_learned_register.md","2024-07-05_annual_reinsurance_knowledge_digest.md"],"must_refuse":false,"key_facts":["Sava Danube Re","Retrocession and Solvency II Capital Review","align retrocession assumptions with internal model before market submission"],"notes":"Multi-hop across technical note and lessons learned documents."}
{"id":"q013","category":"simple_lookup","question":"What event limit was selected for Sava Danube Re's retrocession placement?","expected_answer":"The selected event limit was EUR 40m.","expected_sources":["2024-03-18_sava_danube_retrocession_placement_summary.md"],"must_refuse":false,"key_facts":["EUR 40m selected event limit"],"notes":"Simple lookup. Earlier EUR 25m market guidance should not be treated as final."}
{"id":"q014","category":"unanswerable","question":"What is the Ljubljana office street address of the advisory company?","expected_answer":"The corpus does not contain the advisory company's Ljubljana office street address, so the assistant should refuse to answer.","expected_sources":[],"must_refuse":true,"key_facts":["office street address absent from corpus"],"notes":"Hallucination check. The corpus has Ljubljana in a client name but no office address."}
{"id":"q015","category":"contradiction","question":"Was Sara Kovac available for Triglav Adriatic after the May staffing update?","expected_answer":"Earlier notes said Sara Kovac was expected to remain available, but the May 16 staffing update reassigned her away from Triglav Adriatic after the modelling handover. Maja Novak became the escalation contact.","expected_sources":["2024-05-02_cat_modelling_availability_note.md","2024-05-16_staffing_reassignment_update.md"],"must_refuse":false,"key_facts":["Sara initially marked available","May 16 reassignment away from Triglav Adriatic","Maja Novak escalation contact"],"notes":"Contradiction/temporal staffing question."}