Feature Recovery for Object Understanding After Irreversible Fire Damage
Abstract
TRACE is a benchmark for post-fire object understanding that introduces a feature recovery module to restore degraded representations and improve detection and vision-language tasks under severe physical damage.
Objects in post-fire environments often undergo irreversible physical transformations that change their geometry, material state, and visual appearance. Detecting and identifying these remnants is critical for locating hazards, reconstructing pre-incident contents, and inventorying losses. Unlike standard image corruptions, these degradations affect the physical structure of the object itself. To study this setting, we introduce TRACE, a transformation-aware benchmark for post-fire object understanding. TRACE contains 21.4K real-image-grounded synthetic scenes and paired object-level pristine-to-degraded progressions spanning 499 object identities across 189 categories. We define five tasks targeting localization and pre-degradation understanding: degraded-object detection, pristine-state recovery and retrieval, original material recovery, pristine description generation, and functional reasoning. Existing models degrade sharply with severity. From the least to the most severe level, RF-DETR mAP decreases by 71% relative, while InternVL3.5 retrieval R@1 falls from 93.85 to 28.11. To address this, we propose the Feature Recovery Module (FRM), a plug-and-play module that maps degraded encoder features to pristine-aligned representations while keeping the host frozen. Trained only with paired feature supervision, FRM improves scene-level detection, CLIP/SigLIP2 feature recovery, and all four object-level VLM tasks, with larger gains under more severe degradation. Across VLM hosts and severity levels, relative gains average 12.5% for retrieval, 20.1% for material recovery, 13.2% for description generation, and 12.4% for functional reasoning.
Community
How well can today’s vision models understand an object after its physical structure and material state have changed?
This paper introduces TRACE, a benchmark for object understanding under irreversible physical transformation, with 21.4K post-fire scenes and paired pristine-to-degraded trajectories across 499 object identities. It also proposes FRM, a feature recovery module that maps degraded representations toward pristine-aligned features while keeping the host model frozen. Across detection, retrieval, material recovery, description, and functional reasoning, performance drops sharply as physical damage increases.
Understanding objects after severe transformation matters in real-world settings such as disaster response, inspection, recovery, and embodied systems. TRACE aims to support better models that reason about what an object was, what properties remain, and how physical change affects downstream understanding
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Degraded Infrared Small Object Detection via Degradation-Adapted Physics-Guided Restoration (2026)
- TaskGuard: Task-Conditioned Restoration Utility for Risk-Aware Object Detection (2026)
- Bridge Damage Detection from Low-Light UAV Imagery via Degradation-Aware Mixture-of-Experts Enhancement (2026)
- RMR-P: Road Metadata-Aware Restoration for Pavement Inspection (2026)
- LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2609.12078 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper