Modality Relevance is not Modality Utility: Post-hoc Selective Modality Escalation for Cost-Aware Multimodal RAG
2026-07-08T08:52:17Z•561c050241de87455b7b0cf4e570715c1bbeb9991196f44b57ca419717a1ba56
HuggingFaceLLM-generated metadataMaxSimPORTSSigned MaxSimcode search datasetcontextual document retrievalcost-aware routingdata poisoningdataset releaselate-interaction retrievalmetadata generationmulti-hop retrievalmultimodal RAGnegation handlingretriever alignmentscientific repositoriessearch manipulationselective modality escalationset-level retrievalsupply-chain risktool selectiontool-calling LLMsverifiervision-language models
What happened
Collection of recent IR/ML research (July 2026) covering cost-aware multimodal RAG, retriever alignment for tool selection (PORTS), large-scale scientific code search dataset, set-level multi-hop retrieval, late-interaction (MaxSim/Signed MaxSim) theory, contextual multimodal document retrieval (CMDR), LLM-generated metadata tradeoffs, uncertainty-aware remote-sensing retrieval, and related retrieval/CoT distillation work. Security-relevant implications: (1) cost-aware selective modality escalation introduces a verifier-and-escalation decision point that could be manipulated to increase VLM/IO
Why it matters
A reviewed impact interpretation has not been published for this record.
Evidence and limitations
- Source ID
- arxiv_cs_ir
- Record identifier
- 561c050241de87455b7b0cf4e570715c1bbeb9991196f44b57ca419717a1ba56
- Enrichment time
- 2026-07-08T08:52:17Z
- AI-assisted enrichment
- Yes
This record may overlap with other records. Its enrichment can be incomplete or wrong, and machine assistance was used. Validate consequential decisions against the linked source and your own environment.