ALLNet: Multi-task Dense Prediction for Degraded Images
Abstract
Multi-taskdensepredictionaims tosimultaneously addressmultiplepixel-level tasksthroughaunifiednetworkforvisualsceneunderstanding.However,adverse environmental conditions limit thegeneralizationand practicality of such tasks. Toaddress this, we proposeALLNet, anovel framework that effectively explores degradationpatterns and integratesmulti-task collaborative information. Specifically, we designa MoE-basedMixtureofAdaptiveExperts(MaE)restorationcomponentnetworkthatenhancesdegradationfeaturesthroughdynamicroutingandguidestask-specific featureextraction. Furthermore,weformulateaTaskawareCollaborativeRefinement (TCR)moduletocaptureglobalsemanticcorrelationsandcross-taskdependencies,facilitatingbidirectionalcollaborationbetween restorationandtask-specific featuresondegradedimages. Tothebestofourknowledge, thisrepresentsthe firstattemptatmulti-taskdensepredictionunderimage degradation.ExperimentalresultsondegradedNYUDv2andPASCAL-Contextbenchmarksdemonstratethat ourarchitecturesignificantlyoutperformsexistingmethodsindegradedscenarios.