Search engine for discovering works of Art, research articles, and books related to Art and Culture
ShareThis
Javascript must be enabled to continue!

NullSCE: Sequential Concept Erasure in Generative Video Diffusion Models via Null-space Guidance

View through CrossRef
Text-to-video models (T2Vs) trained on large, unfiltered video corpora often learn and reproduce content including harmful concepts. Concept erasure techniques aim to remove such harmful concepts from pre-trained models while preserving overall generative capability. Although existing methods have achieved some success, they are all limited to batch-wise concept erasure. Applying them sequentially in streaming settings leads to two critical issues: erasure-forgetting phenomenon, where later erasures reactivate earlier ones, and cumulative drift, where repeated weight updates degrade overall generative capability. Thus, we introduce NullSCE, a null-space-guided sequential concept erasure framework for T2Vs. NullSCE reformulates the batch-wise concept erasure as a constrained optimization problem augmented with cumulative constraints that lock in previously erased concepts, and a norm-ball regularizer that bounds parameter drift. To solve it efficiently, we project each new erasure gradient onto the null space of prior conceptual erasure targets' gradients, ensuring orthogonality and minimizing inter-step interference. Through extensive experiments on state-of-the-art T2Vs and real-world datasets, we show that NullSCE reliably prevents concept reactivation, controls drift accumulation, and preserves high-fidelity video synthesis.
Title: NullSCE: Sequential Concept Erasure in Generative Video Diffusion Models via Null-space Guidance
Description:
Text-to-video models (T2Vs) trained on large, unfiltered video corpora often learn and reproduce content including harmful concepts.
Concept erasure techniques aim to remove such harmful concepts from pre-trained models while preserving overall generative capability.
Although existing methods have achieved some success, they are all limited to batch-wise concept erasure.
Applying them sequentially in streaming settings leads to two critical issues: erasure-forgetting phenomenon, where later erasures reactivate earlier ones, and cumulative drift, where repeated weight updates degrade overall generative capability.
Thus, we introduce NullSCE, a null-space-guided sequential concept erasure framework for T2Vs.
NullSCE reformulates the batch-wise concept erasure as a constrained optimization problem augmented with cumulative constraints that lock in previously erased concepts, and a norm-ball regularizer that bounds parameter drift.
To solve it efficiently, we project each new erasure gradient onto the null space of prior conceptual erasure targets' gradients, ensuring orthogonality and minimizing inter-step interference.
Through extensive experiments on state-of-the-art T2Vs and real-world datasets, we show that NullSCE reliably prevents concept reactivation, controls drift accumulation, and preserves high-fidelity video synthesis.

Related Results

Drawing Erasure
Drawing Erasure
Architectural practice is often a project in asserting control over the natural environment in pursuit of permanence and stability, but what if erasure could disrupt this? What new...
Audio and video editing system design based on OpenCV
Audio and video editing system design based on OpenCV
With the rapid development of the Internet, a new carrier for people to perceive the world and communicate with each other - audio and video - is gradually being favoured by the pu...
Written to be Erased: Paper Rights and the Visibility of Migrant Domestic Workers
Written to be Erased: Paper Rights and the Visibility of Migrant Domestic Workers
Abstract This chapter conceptualizes forms and processes of erasure and visibility of migrant domestic workers through the analysis of interview data, media cover...
Comment on: Macroscopic water vapor diffusion is not enhanced in snow
Comment on: Macroscopic water vapor diffusion is not enhanced in snow
Abstract. The central thesis of the authors’ paper is that macroscopic water vapor diffusion is not enhanced in snow compared to diffusion through humid air alone. Further, mass di...
Video tracking for marketing applications
Video tracking for marketing applications
Traçage du contenu marketing vidéo Au cours des dernières décennies, la production et la consommation de vidéos ont considérablement augmenté et il est communément ...

Back to Top