Disagreement-aware late fusion of 3DCNN and MViT for clip-level video anomaly detection

Simple item page
dc.contributor.authorMohanarangan, K
dc.contributor.authorPalanisamy, P
dc.date.accessioned2026-10-30T06:30:06Z
dc.date.available2026-10-30T06:30:06Z
dc.date.issued2026-06-30
dc.description.abstractWe propose Adaptive Late Router with Temperature Scaling (ALeRT), an inference-only, disagreement-aware late fusion framework for clip-level video anomaly detection. ALeRT combines two complementary experts: MMAnet, a lightweight multi-scale 3D CNN for fine-grained motion dynamics, and MViT, a Kinetics-pretrained multiscale Vision Transformer for long-range spatiotemporal modeling, without requiring joint retraining. Model outputs are calibrated using temperature scaling and fused via a Product-of-Experts (PoE) to reinforce agreement, while disagreement is resolved using confidence margins and per-class Positive Predictive Value (PPV). Temporal consistency is further enhanced through exponential moving average (EMA) smoothing. The framework is evaluated across multiple random seeds, reporting mean performance with low variance, demonstrating strong robustness and generalization. Experiments on LPS (Loss Preventive Surveillance), UCF-Crime-Clips (UCF-CC), and Virat2-RC (ReClassified) datasets show consistent improvements over individual backbones. Notably, ALeRT achieves these gains with only 3.1 ms fusion overhead per clip, enabling real-time inference (5.7–6.0 events/s, maximum of 300 FPS(FPS (frames per second) indicates the number of video frames processed per second.)) on commodity GPUs. These results highlight the effectiveness of disagreement-aware fusion for scalable and deployment-ready video anomaly detection.
dc.identifier.issn29482992
dc.identifier.urihttps://doi.org/10.1007/s10791-026-10197-8
dc.identifier.urihttp://nitt.ndl.gov.in/handle/123456789/363
dc.language.isoen
dc.publisherSpringer Science and Business Media B.V.
dc.relation.ispartofseriesDiscover Computing; Vol. 29/ No. 1/ Art. 403
dc.titleDisagreement-aware late fusion of 3DCNN and MViT for clip-level video anomaly detection
dc.typeArticle
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
Disagreement-aware late fusion of 3DCNN and MViT for clip-level video anomaly detection.pdf
Size:
4.37 MB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
411 B
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Journal Articles