LLMORPH: Automated Metamorphic Testing of Large Language Models
2026-03-26T08:51:52Z•32e1ed55cccc4f932398339d0f1edc294b9f8f4bc1887cb5efb4da9437fe42d1
ADASAPI-discoveryAPIsLLM-testingaccessibility-reportingagentic-trace-analysisautomated-oraclesautomated-repairbenchmarkscloud-anomaly-detectioncode-generationdatasetsdetect-repair-verifylogging-smellsmetamorphic-testingpenetration-testingrobustness-testingtoolingvulnerability-detection
What happened
Collection of recent research tooling and empirical studies focused on testing, robustness, and security of AI-enabled and traditional software systems. Highlights include LLMORPH (metamorphic testing for LLM-based NLP tasks), LLMLOOP (iterative refinement of LLM-generated code and tests), a Detect–Repair–Verify study and EduCollab benchmark for evaluating vulnerability detection/repair on LLM-generated web apps, PerturbationDrive for ADAS robustness testing, generation of abstract penetration test cases from architecture models, a taxonomy and dataset of logging smells in ML code (including ‘
Why it matters
A reviewed impact interpretation has not been published for this record.
Evidence and limitations
- Source ID
- arxiv_cs_se
- Record identifier
- 32e1ed55cccc4f932398339d0f1edc294b9f8f4bc1887cb5efb4da9437fe42d1
- Enrichment time
- 2026-03-26T08:51:52Z
- AI-assisted enrichment
- Yes
This record may overlap with other records. Its enrichment can be incomplete or wrong, and machine assistance was used. Validate consequential decisions against the linked source and your own environment.