Jun Zhu

ControlAudio: Tackling Text-Guided, Timing-Indicated and Intelligible Audio Generation via Progressive Diffusion Modeling ACL 2026 Benchmarking Trustworthiness in Multimodal LLMs for Video Understanding AAAI 2026 H-RDT: Human Manipulation Enhanced Bimanual Robotic Manipulation AAAI 2026 RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformers ICML 2025 Direct Discriminative Optimization: Your Likelihood-Based Visual Generative Model is Secretly a GAN Discriminator ICML 2025 RDT-1B: a Diffusion Foundation Model for Bimanual Manipulation ICLR 2025 DimensionX: Create Any 3D and 4D Scenes from a Single Image with Decoupled Video Diffusion ICCV 2025 MeshAnything V2: Artist-Created Mesh Generation with Adjacent Mesh Tokenization ICCV 2025 DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learning ICCV 2025 FrameBridge: Improving Image-to-Video Generation with Bridge Models ICML 2025 Oscillation-Reduced MXFP4 Training for Vision Transformers ICML 2025 Visual Generation Without Guidance ICML 2025 DUSTED: Dual-Attention Enhanced Spatial Transcriptomics Denoiser AAAI 2025 Riding the Wave: Multi-Scale Spatial-Temporal Graph Learning for Highway Traffic Flow Prediction Under Overload Scenarios IJCAI 2025 Improving Accuracy and Calibration via Differentiated Deep Mutual Learning CVPR 2025 PivotMesh: Generic 3D Mesh Generation via Pivot Vertices Guidance ICLR 2025 Self-Consistent Model-based Adaptation for Visual Reinforcement Learning IJCAI 2025 Pruning Large Language Models with Semi-Structural Adaptive Sparse Training AAAI 2025 Robust Representation Consistency Model via Contrastive Denoising ICLR 2025 Elucidating the Preconditioning in Consistency Distillation ICLR 2025 SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration ICLR 2025 ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing ICLR 2025 On the Optimization and Generalization of Two-layer Transformers with Sign Gradient Descent ICLR 2025 Toward Guidance-Free AR Visual Generation via Condition Contrastive Alignment ICLR 2025 SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization ICML 2025 Diffusion Bridge Implicit Models ICLR 2025 SpargeAttention: Accurate and Training-free Sparse Attention Accelerating Any Model Inference ICML 2025 Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Sampling ICLR 2025 STAIR: Improving Safety Alignment with Introspective Reasoning ICML 2025 Embodied Active Defense: Leveraging Recurrent Feedback to Counter Adversarial Patches ICLR 2024 Rethinking Model Ensemble in Transfer-based Adversarial Attacks ICLR 2024 Consistency Diffusion Bridge Models NIPS 2024 Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Model NIPS 2024 C-GAIL: Stabilizing Generative Adversarial Imitation Learning with Control Theory NIPS 2024 S-STE: Continuous Pruning Function for Efficient 2:4 Sparse Pre-training NIPS 2024 On Mesa-Optimization in Autoregressively Trained Transformers: Emergence and Capability NIPS 2024 MultiTrust: A Comprehensive Benchmark Towards Trustworthy Multimodal Large Language Models NIPS 2024 Diffusion Models are Certifiably Robust Classifiers NIPS 2024 PEAC: Unsupervised Pre-training for Cross-Embodiment Reinforcement Learning NIPS 2024 T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Models NIPS 2024 PINNacle: A Comprehensive Benchmark of Physics-Informed Neural Networks for Solving PDEs NIPS 2024 Noise Contrastive Alignment of Language Models with Explicit Rewards NIPS 2024 Aligning Diffusion Behaviors with Q-functions for Efficient Continuous Control NIPS 2024 Vidu4D: Single Generated Video to High-Fidelity 4D Reconstruction with Dynamic Gaussian Surfels NIPS 2024 DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Training ICML 2024 Efficient Black-box Adversarial Attacks via Bayesian Optimization Guided by a Function Prior ICML 2024 Robust Classification via a Single Diffusion Model ICML 2024 DGPO: Discovering Multiple Strategies with Diversity-Guided Policy Optimization AAAI 2024 Jetfire: Efficient and Accurate Transformer Pretraining with INT8 Data Flow and Per-Block Quantization ICML 2024 Fourier Controller Networks for Real-Time Decision-Making in Embodied Learning ICML 2024 Towards Efficient Exact Optimization of Language Model Alignment ICML 2024 Accelerating Transformer Pre-training with 2:4 Sparsity ICML 2024 Virtual-Event-Based Posterior Sampling and Inference for Neyman-Scott Processes JMLR 2024 Optimal Learning Policies for Differential Privacy in Multi-armed Bandits JMLR 2024 DreamReward: Aligning Human Preference in Text-to-3D Generation ECCV 2024 LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agents ECCV 2024 Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection ECCV 2024 CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Model ECCV 2024 Exploring the Transferability of Visual Prompting for Multimodal Large Language Models CVPR 2024 Score Regularized Policy Optimization through Diffusion Behavior ICLR 2024 Efficient Backpropagation with Variance Controlled Adaptive Sampling ICLR 2024 InstructPix2NeRF: Instructed 3D Portrait Editing from a Single Image ICLR 2024 Benchmarking Robustness of 3D Object Detection to Common Corruptions CVPR 2023 Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Models ICLR 2023 Offline Reinforcement Learning via High-Fidelity Generative Behavior Modeling ICLR 2023 Equivariant Energy-Guided SDE for Inverse Molecular Design ICLR 2023 DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection ICLR 2023 Bi-level Physics-Informed Neural Networks for PDE Constrained Optimization using Broyden's Hypergradients ICLR 2023 A constrained Bayesian approach to out-of-distribution prediction UAI 2023 ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation NIPS 2023 Towards Accelerated Model Training via Bayesian Data Selection NIPS 2023 Memory Efficient Optimizers with 4-bit States NIPS 2023 Learning Sample Difficulty from Pre-trained Models for Reliable Prediction NIPS 2023 Overcoming Recency Bias of Normalization Statistics in Continual Learning: Balance and Adaptation NIPS 2023 Diffusion Models and Semi-Supervised Learners Benefit Mutually with Few Labels NIPS 2023 Training Transformers with 4-bit Integers NIPS 2023 DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statistics NIPS 2023 Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimality NIPS 2023 Revisiting Discriminative vs. Generative Classifiers: Theory and Implications ICML 2023 DQ-DETR: Dual Query Detection Transformer for Phrase Extraction and Grounding AAAI 2023 Certifiable Out-of-Distribution Generalization AAAI 2023 Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEs ICML 2023 MultiAdam: Parameter-wise Scale-invariant Optimizer for Multiscale Training of Physics-informed Neural Networks ICML 2023 Stabilizing GANs’ Training with Brownian Motion Controller ICML 2023 Contrastive Energy Prediction for Exact Energy-Guided Diffusion Sampling in Offline Reinforcement Learning ICML 2023 Can Infinitely Wide Deep Nets Help Small-data Multi-label Learning? ACML 2023 NUNO: A General Framework for Learning Parametric PDEs with Non-Uniform Data ICML 2023 GNOT: A General Neural Operator Transformer for Operator Learning ICML 2023 One Transformer Fits All Distributions in Multi-Modal Diffusion at Scale ICML 2023 Towards Effective Adversarial Textured 3D Meshes on Physical Face Recognition CVPR 2023 All Are Worth Words: A ViT Backbone for Diffusion Models CVPR 2023 PREIM3D: 3D Consistent Precise Image Attribute Editing From a Single Image CVPR 2023 On the Reuse Bias in Off-Policy Reinforcement Learning IJCAI 2023 Detection Transformer with Stable Matching ICCV 2023 OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalization CVPR 2022 Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Models ICLR 2022 Memory Replay with Data Compression for Continual Learning ICLR 2022 A Unified Hard-Constraint Framework for Solving Geometrically Complex PDEs NIPS 2022 Isometric 3D Adversarial Examples in the Physical World NIPS 2022 Fast Instrument Learning with Faster Rates NIPS 2022 Exploring Memorization in Adversarial Training ICLR 2022 Towards Safe Reinforcement Learning via Constraining Conditional Value-at-Risk IJCAI 2022 Boosting Transferability of Targeted Adversarial Examples via Hierarchical Generative Networks ECCV 2022 INT: Towards Infinite-Frames 3D Detection with an Efficient Framework ECCV 2022 CoSCL: Cooperation of Small Continual Learners Is Stronger than a Big One ECCV 2022 Censored Quantile Regression Neural Networks for Distribution-Free Survival Analysis NIPS 2022 DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps NIPS 2022 EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equations NIPS 2022 Accelerated Linearized Laplace Approximation for Bayesian Deep Learning NIPS 2022 GSmooth: Certified Robustness against Semantic Transformations via Generalized Randomized Smoothing ICML 2022 NeuralEF: Deconstructing Kernels by Deep Neural Networks ICML 2022 Estimating the Optimal Covariance with Imperfect Mean in Diffusion Probabilistic Models ICML 2022 DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETR ICLR 2022 Policy Learning for Robust Markov Decision Process with a Mismatched Generative Model AAAI 2022 ViewFool: Evaluating the Robustness of Visual Recognition to Adversarial Viewpoints NIPS 2022 Cluster Attack: Query-based Adversarial Attacks on Graph with Graph-Dependent Priors IJCAI 2022 BayesAdapter: Being Bayesian, Inexpensively and Reliably, via Bayesian Fine-tuning ACML 2022 Tianshou: A Highly Modularized Deep Reinforcement Learning Library JMLR 2022 Efficient Inference for Dynamic Flexible Interactions of Neural Populations JMLR 2022 Thompson Sampling for (Combinatorial) Pure Exploration ICML 2022 Fast Lossless Neural Compression with Integer-Only Discrete Flows ICML 2022 Robustness and Accuracy Could Be Reconcilable by (Proper) Definition ICML 2022 Maximum Likelihood Training for Score-based Diffusion ODEs by High Order Denoising Score Matching ICML 2022 Confidence-based Reliable Learning under Dual Noises NIPS 2022 Two Coupled Rejection Metrics Can Tell Adversarial Examples Apart CVPR 2022 Towards Job-Transition-Tag Graph for a Better Job Title Representation Learning NAACL 2022 AutoLoss-GMS: Searching Generalized Margin-Based Softmax Loss Function for Person Re-Identification CVPR 2022 BE-STI: Spatial-Temporal Integrated Network for Class-Agnostic Motion Prediction With Bidirectional Enhancement CVPR 2022 MiCE: Mixture of Contrastive Experts for Unsupervised Image Clustering ICLR 2021 AFEC: Active Forgetting of Negative Transfer in Continual Learning NIPS 2021 On the Convergence of Prior-Guided Zeroth-Order Optimization Algorithms NIPS 2021 Rethinking and Reweighting the Univariate Losses for Multi-Label Ranking: Consistency and Generalization NIPS 2021 Learning Task-Distribution Reward Shaping with Meta-Learning AAAI 2021 Stability and Generalization of Bilevel Programming in Hyperparameter Optimization NIPS 2021 LiBRe: A Practical Bayesian Approach to Adversarial Detection CVPR 2021 PVGNet: A Bottom-Up One-Stage 3D Object Detector With Integrated Multi-Level Features CVPR 2021 Unsupervised Part Segmentation Through Disentangling Appearance and Shape CVPR 2021 Improving Transferability of Adversarial Patches on Face Recognition With Generative Models CVPR 2021 ORDisCo: Effective and Efficient Usage of Incremental Unlabeled Data for Semi-Supervised Continual Learning CVPR 2021 Variational (Gradient) Estimate of the Score Function in Energy-based Latent Variable Models ICML 2021 Scalable Quasi-Bayesian Inference for Instrumental Variable Regression NIPS 2021 Improving Generative Moment Matching Networks with Distribution Partition AAAI 2021 A Bayesian Approach for Subset Selection in Contextual Bandits AAAI 2021 Efficient Inference of Flexible Interaction in Spiking-neuron Networks ICLR 2021 Bag of Tricks for Adversarial Training ICLR 2021 Implicit Normalizing Flows ICLR 2021 Accumulative Poisoning Attacks on Real-time Data NIPS 2021 Fork or Fail: Cycle-Consistent Training with Many-to-One Mappings AISTATS 2021 Black-Box Detection of Backdoor Attacks With Limited Information and Data ICCV 2021 Towards Face Encryption by Generating Adversarial Identity Masks ICCV 2021 Combining Tree Search and Action Prediction for State-of-the-Art Performance in DouDiZhu IJCAI 2021 Variance Reduction and Quasi-Newton for Particle-Based Variational Inference ICML 2020 Multi-label classification: do Hamming loss and subset accuracy really conflict with each other? NIPS 2020 Boosting Adversarial Training with Hypersphere Embedding NIPS 2020 Adversarial Distributional Training for Robust Deep Learning NIPS 2020 Further Analysis of Outlier Detection with Deep Generative Models NIPS 2020 Understanding and Exploring the Network with Stochastic Architectures NIPS 2020 Calibrated Reliable Regression using Maximum Mean Discrepancy NIPS 2020 Bi-level Score Matching for Learning Energy-based Latent Variable Models NIPS 2020 Efficient Learning of Generative Models via Finite-Difference Score Matching NIPS 2020 A Wasserstein Minimum Velocity Approach to Learning Unnormalized Models AISTATS 2020 Benchmarking Adversarial Robustness on Image Classification CVPR 2020 Training Interpretable Convolutional Neural Networks by Differentiating Class-specific Filters ECCV 2020 Design and Interpretation of Universal Adversarial Patches in Face Detection ECCV 2020 Defense Against Adversarial Attacks via Controlling Gradient Leaking on Embedded Manifolds ECCV 2020 SUMO: Unbiased Estimation of Log Marginal Probability for Latent Variable Models ICLR 2020 Posterior sampling for multi-agent reinforcement learning: solving extensive games with imperfect information ICLR 2020 Rethinking Softmax Cross-Entropy Loss for Adversarial Robustness ICLR 2020 Mixup Inference: Better Exploiting Mixup to Defend Adversarial Attacks ICLR 2020 Lazy-CFR: fast and near-optimal regret minimization for extensive games with imperfect information ICLR 2020 SVQN: Sequential Variational Soft Q-Learning Networks ICLR 2020 To Relieve Your Headache of Training an MRF, Take AdVIL ICLR 2020 VFlow: More Expressive Generative Flows with Variational Data Augmentation ICML 2020 Understanding and Stabilizing GANs’ Training Dynamics Using Control Theory ICML 2020 Nonparametric Score Estimators ICML 2020 Exploration Analysis in Finite-Horizon Turn-based Stochastic Games UAI 2020 Scalable Training of Inference Networks for Gaussian-Process Models ICML 2019 Composite Binary Decomposition Networks AAAI 2019 Playing FPS Games With Environment-Aware Hierarchical Reinforcement Learning IJCAI 2019 Function Space Particle Optimization for Bayesian Neural Networks ICLR 2019 Improving Black-box Adversarial Attacks with a Transfer-based Prior NIPS 2019 Generative Well-intentioned Networks NIPS 2019 Cluster Alignment With a Teacher for Unsupervised Domain Adaptation ICCV 2019 Sparse Adversarial Perturbations for Videos AAAI 2019 Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attacks CVPR 2019 Efficient Decision-Based Black-Box Adversarial Attacks on Face Recognition CVPR 2019 Multi-objects Generation with Amortized Structural Regularization NIPS 2019 Combo-Action: Training Agent For FPS Game with Auxiliary Tasks AAAI 2019 Direct Training for Spiking Neural Networks: Faster, Larger, Better AAAI 2019 Understanding and Accelerating Particle-Based Variational Inference ICML 2019 Understanding MCMC Dynamics as Flows on the Wasserstein Space ICML 2019 Improving Adversarial Robustness via Promoting Ensemble Diversity ICML 2019 Stochastic Expectation Maximization with Variance Reduction NIPS 2018 Stochastic Training of Graph Convolutional Networks with Variance Reduction ICML 2018 Adversarial Attack on Graph Structured Data ICML 2018 Max-Mahalanobis Linear Discriminant Analysis Networks ICML 2018 A Spectral Approach to Gradient Estimation for Implicit Distributions ICML 2018 Racing Thompson: an Efficient Algorithm for Thompson Sampling with Non-conjugate Priors ICML 2018 Message Passing Stein Variational Gradient Descent ICML 2018 Probabilistic Machine Learning: Models, Algorithms and a Programming Library IJCAI 2018 Learning to Write Stylized Chinese Characters by Reading a Handful of Examples IJCAI 2018 Kernel Implicit Variational Inference ICLR 2018 Boosting Adversarial Attacks With Momentum CVPR 2018 Smooth Neighbors on Teacher Graphs for Semi-Supervised Learning CVPR 2018 Textbook Question Answering Under Instructor Guidance With Memory Networks CVPR 2018 Defense Against Adversarial Attacks Using High-Level Representation Guided Denoiser CVPR 2018 Towards Robust Detection of Adversarial Examples NIPS 2018 Graphical Generative Adversarial Networks NIPS 2018 Semi-crowdsourced Clustering with Deep Generative Models NIPS 2018 Population Matching Discrepancy and Applications in Deep Learning NIPS 2017 Forecast the Plausible Paths in Crowd Scenes IJCAI 2017 Online Bayesian Passive-Aggressive Learning JMLR 2017 Improving Learning-from-Crowds through Expert Validation IJCAI 2017 Semi-supervised Max-margin Topic Model with Manifold Posterior Regularization IJCAI 2017 Structured Generative Adversarial Networks NIPS 2017 Triple Generative Adversarial Nets NIPS 2017 Improving Interpretability of Deep Neural Networks With Semantic Information CVPR 2017 Distributed Accelerated Proximal Coordinate Gradient Methods IJCAI 2017 Identify the Nash Equilibrium in Static Games with Random Payoffs ICML 2017 Segment-Level Sequence Modeling using Gated Recursive Semi-Markov Conditional Random Fields ACL 2016 Generative Topic Embedding: a Continuous Representation of Documents ACL 2016 Conditional Generative Moment-Matching Networks NIPS 2016 Learning to Generate with Memory ICML 2016 Crowd Scene Understanding with Coherent Recurrent Neural Networks IJCAI 2016 Diversity-Promoting Bayesian Learning of Latent Variable Models ICML 2016 Kernel Bayesian Inference with Posterior Regularization NIPS 2016 Stochastic Gradient Geodesic MCMC Methods NIPS 2016 Discriminative Deep Random Walk for Network Classification ACL 2016 Max-Margin Majority Voting for Learning from Crowds NIPS 2015 DP-space: Bayesian Nonparametric Subspace Clustering with Small-variance Asymptotics ICML 2015 A Generative Word Embedding Model and its Low Rank Positive Semidefinite Solution EMNLP 2015 Adaptive Dropout Rates for Learning with Corrupted Features IJCAI 2015 Modelling High-Dimensional Sequences with LSTM-RTRBM: Application to Polyphonic Music Generation IJCAI 2015 Max-Margin Deep Generative Models NIPS 2015 Robust Bayesian Max-Margin Clustering NIPS 2014 Gibbs Max-margin Topic Models with Data Augmentation JMLR 2014 Online Bayesian Passive-Aggressive Learning ICML 2014 Distributed Bayesian Posterior Sampling via Moment Sharing NIPS 2014 Bayesian Max-margin Multi-Task Learning with Data Augmentation ICML 2014 Bayesian Inference with Posterior Regularization and Applications to Infinite Latent SVMs JMLR 2014 Max-Margin Infinite Hidden Markov Models ICML 2014 Robust RegBayes: Selectively Incorporating First-Order Logic Domain Knowledge into Bayesian Models ICML 2014 Spectral Methods for Supervised Topic Models NIPS 2014 Learning From Weakly Supervised Data by The Expectation Loss SVM (e-SVM) algorithm NIPS 2014 Improved Bayesian Logistic Supervised Topic Models with Data Augmentation ACL 2013 Action Recognition with Actons ICCV 2013 Scalable Inference for Logistic-Normal Topic Models NIPS 2013 Gibbs Max-Margin Topic Models with Fast Sampling Algorithms ICML 2013 Fast Max-Margin Matrix Factorization with Data Augmentation ICML 2013 Generalized Relational Topic Models with Data Augmentation IJCAI 2013 Monte Carlo Methods for Maximum Margin Supervised Topic Models NIPS 2012 MedLDA: Maximum Margin Supervised Topic Models JMLR 2012 Nonparametric Max-Margin Matrix Factorization for Collaborative Prediction NIPS 2012 Infinite Latent SVM for Classification and Multi-task Learning NIPS 2011 Efficient Relational Learning with Hidden Variable Detection NIPS 2010 Adaptive Multi-Task Lasso: with Application to eQTL Detection NIPS 2010 Large Margin Learning of Upstream Scene Understanding Models NIPS 2010 Predictive Subspace Learning for Multi-view Data: a Large Margin Approach NIPS 2010 Maximum Entropy Discrimination Markov Networks JMLR 2009 Partially Observed Maximum Entropy Discrimination Markov Networks NIPS 2008 Dynamic Hierarchical Markov Random Fields for Integrated Web Data Extraction JMLR 2008