LLMORPH: Automated Metamorphic Testing of Large Language Models

2026-03-26T08:51:52Z32e1ed55cccc4f932398339d0f1edc294b9f8f4bc1887cb5efb4da9437fe42d1
ADASAPI-discoveryAPIsLLM-testingaccessibility-reportingagentic-trace-analysisautomated-oraclesautomated-repairbenchmarkscloud-anomaly-detectioncode-generationdatasetsdetect-repair-verifylogging-smellsmetamorphic-testingpenetration-testingrobustness-testingtoolingvulnerability-detection

What happened

Collection of recent research tooling and empirical studies focused on testing, robustness, and security of AI-enabled and traditional software systems. Highlights include LLMORPH (metamorphic testing for LLM-based NLP tasks), LLMLOOP (iterative refinement of LLM-generated code and tests), a Detect–Repair–Verify study and EduCollab benchmark for evaluating vulnerability detection/repair on LLM-generated web apps, PerturbationDrive for ADAS robustness testing, generation of abstract penetration test cases from architecture models, a taxonomy and dataset of logging smells in ML code (including ‘

Why it matters

A reviewed impact interpretation has not been published for this record.

Evidence and limitations

Source ID
arxiv_cs_se
Record identifier
32e1ed55cccc4f932398339d0f1edc294b9f8f4bc1887cb5efb4da9437fe42d1
Enrichment time
2026-03-26T08:51:52Z
AI-assisted enrichment
Yes

This record may overlap with other records. Its enrichment can be incomplete or wrong, and machine assistance was used. Validate consequential decisions against the linked source and your own environment.