Tensor-galore: Memory-efficient training via gradient tensor decomposition
Robert Joseph George, David Pitt, Jiawei Zhao, Jean Kossaifi, Cheng Luo, Yuandong Tian, Anima Anandkumar
Journal, 2025
Publications
2025
Factorized implicit global convolution for automotive computational fluid dynamics prediction
Chris Choy, Alexey Kamenev, Jean Kossaifi, Max Rietmann, Jan Kautz, Kamyar Azizzadenesheli
arXiv preprint arXiv:2502.04317, 2025
Analyzing Political Text at Scale with Online Tensor LDA
Sara Kangaslahti, Danny Ebanks, Jean Kossaifi, Anqi Liu, R Michael Alvarez, Animashree Anandkumar
Journal, 2025
Enabling automatic differentiation with mollified graph neural operators
Ryan Y Lin, Julius Berner, Valentin Duruisseaux, David Pitt, Daniel Leibovici, Jean Kossaifi, Kamyar Azizzadenesheli, Anima Anandkumar
arXiv preprint arXiv:2504.08277, 2025
TensorGRaD: Tensor Gradient Robust Decomposition for Memory-Efficient Neural Operator Training
Sebastian Loeschcke, David Pitt, Robert Joseph George, Jiawei Zhao, Cheng Luo, Yuandong Tian, Jean Kossaifi, Anima Anandkumar
arXiv preprint arXiv:2501.02379, 2025
Principled Approaches for Extending Neural Architectures to Function Spaces for Operator Learning
Julius Berner, Miguel Liu-Schiaffini, Jean Kossaifi, Valentin Duruisseaux, Boris Bonev, Kamyar Azizzadenesheli, Anima Anandkumar
arXiv preprint arXiv:2506.10973, 2025
2024
Multi-grid tensorized Fourier neural operator for high-resolution PDEs
Jean Kossaifi, Nikola Kovachki, Kamyar Azizzadenesheli, Anima Anandkumar
TMLR (Transactions on Machine Learning Research), 2024
Tensor methods in deep learning
Yannis Panagakis, Jean Kossaifi, Grigorios G Chrysos, James Oldfield, Taylor Patti, Mihalis A Nicolaou, Anima Anandkumar, Stefanos Zafeiriou
Publication, 2024
Geometry-informed neural operator for large-scale 3d pdes
Zongyi Li, Nikola Kovachki, Chris Choy, Boyi Li, Jean Kossaifi, Shourya Otta, Mohammad Amin Nabian, Maximilian Stadler, Christian Hundt, Kamyar Azizzadenesheli, others
Advances in Neural Information Processing Systems (NeurIPS), 2024
Neural operators for accelerating scientific simulations and design
Kamyar Azizzadenesheli, Nikola Kovachki, Zongyi Li, Miguel Liu-Schiaffini, Jean Kossaifi, Anima Anandkumar
Nature Reviews Physics, 2024
Equivariant graph neural operator for modeling 3d dynamics
Minkai Xu, Jiaqi Han, Aaron Lou, Jean Kossaifi, Arvind Ramanathan, Kamyar Azizzadenesheli, Jure Leskovec, Stefano Ermon, Anima Anandkumar
ICML (International Conference on Machine Learning), 2024
Guaranteed Approximation Bounds for Mixed-Precision Neural Operators
Renbo Tu, Colin White, Jean Kossaifi, Boris Bonev, Gennady Pekhimenko, Kamyar Azizzadenesheli, Anima Anandkumar
International Conference on Learning Representations (ICLR), 2024
Pretraining codomain attention neural operators for solving multiphysics pdes
Md Ashiqur Rahman, Robert Joseph George, Mogab Elleithy, Daniel Leibovici, Zongyi Li, Boris Bonev, Colin White, Julius Berner, Raymond A Yeh, Jean Kossaifi, others
Advances in Neural Information Processing Systems, 2024
Towards Comprehensive Evaluation of Data-Driven Numerical Weather Prediction Models
Jaideep Pathak, Boris Bonev, Thorsten Kurth, Noah D Brenowitz, Yair Cohen, Karthik Kashinath, Jean Kossaifi, Kamyar Azizzadenesheli, Nikola Kovachki, Maximilian Baust, others
104th Annual AMS Meeting 2024, 2024
High-Performance Tensor-Train Primitives Using GPU Tensor Cores
Xiao-Yang Liu, Hao Hong, Zeliang Zhang, Weiqin Tong, Jean Kossaifi, Xiaodong Wang, Anwar Walid
IEEE Transactions on Computers, 2024
Fourier neural operators for learning dynamics in quantum spin systems
Freya Shah, Taylor L Patti, Julius Berner, Bahareh Tolooshams, Jean Kossaifi, Anima Anandkumar
arXiv preprint arXiv:2409.03302, 2024
Exploring the design space of deep-learning-based weather forecasting systems
Shoaib Ahmed Siddiqui, Jean Kossaifi, Boris Bonev, Christopher Choy, Jan Kautz, David Krueger, Kamyar Azizzadenesheli
arXiv preprint arXiv:2410.07472, 2024
A library for learning neural operators
Jean Kossaifi, Nikola Kovachki, Zongyi Li, David Pitt, Miguel Liu-Schiaffini, Robert Joseph George, Boris Bonev, Kamyar Azizzadenesheli, Julius Berner, Valentin Duruisseaux, others
arXiv preprint arXiv:2412.10354, 2024
Nvidia Earth-2: 2024 AI Research Highlights in hybrid climate simulation, km-scale atmospheric emulation, weather forecasting, ocean coupling, generative AI downscaling \& data assimilation.
Mike S Pritchard, Karthik Kashinath, Boris Bonev, Noah Brenowitz, Simon Byrne, Yair Cohen, Piyush Garg, Suman Ravuri, David Hall, Jean Kossaifi, others
AGU Fall Meeting Abstracts, 2024
Activating Identity and Political Action in the\# Metoo Era
Melina Much, Daniel Ebanks, Sara Kangaslahti, Jean Kossaifi, R Michael Alvarez, Anqi Liu, Anima Anandkumar
Available at SSRN 5289639, 2024
2023
Towards a scalable discrete quantum generative adversarial neural network
Smit Chaudhary, Patrick Huembeli, Ian MacCormack, Taylor L Patti, Jean Kossaifi, Alexey Galda
Quantum Science and Technology, 2023
Efficient and Large-Scale Semidefinite Programming with Quantum Neural Networks
Taylor Patti, Jean Kossaifi, Anima Anandkumar, Susanne Yelin
APS March Meeting Abstracts, 2023
Towards a scalable discrete quantum generative adversarial neural network
Alexey Galda, Smit Chaudhary, Patrick Huembeli, Ian MacCormack, Jean Kossaifi, Taylor Patty
APS March Meeting Abstracts, 2023
Score-based diffusion models in function space
Jae Hyun Lim, Nikola B Kovachki, Ricardo Baptista, Christopher Beckham, Kamyar Azizzadenesheli, Jean Kossaifi, Vikram Voleti, Jiaming Song, Karsten Kreis, Jan Kautz, others
arXiv preprint arXiv:2302.07400, 2023
Quantum Goemans-Williamson algorithm with the Hadamard test and approximate amplitude constraints
Taylor L Patti, Jean Kossaifi, Anima Anandkumar, Susanne F Yelin
Quantum, 2023
Speeding up Fourier neural operators via mixed precision
Colin White, Renbo Tu, Jean Kossaifi, Gennady Pekhimenko, Kamyar Azizzadenesheli, Anima Anandkumar
arXiv e-prints, 2023
Physics-informed neural operators with exact differentiation on arbitrary geometries
Colin White, Julius Berner, Jean Kossaifi, Mogab Elleithy, David Pitt, Daniel Leibovici, Zongyi Li, Kamyar Azizzadenesheli, Anima Anandkumar
The symbiosis of deep learning and differential equations III, 2023
NVIDIA Earth-2: Towards km-scale interactive digital twins
Karthik Kashinath, Michael Pritchard, Anima Anandkumar, Jaideep Pathak, Noah Brenowitz, Yair Cohen, Boris Bonev, Peter Messmer, Thorsten Kurth, Kamyar Azizzadenesheli, others
AGU Fall Meeting Abstracts, 2023
2022
Variational Quantum Optimization with Multi-Basis Encodings
Taylor L Patti, Jean Kossaifi, Anima Anandkumar, Susanne F Yelin
Physical Review Research, 2022
Quantum Semidefinite Programming with the Hadamard Test and Approximate Amplitude Constraints
Taylor L Patti, Jean Kossaifi, Anima Anandkumar, Susanne F Yelin
ArXivorg, 2022
Augmenting Deep Classifiers with Polynomial Neural Networks
Grigorios G Chrysos, Markos Georgopoulos, Jiankang Deng, Jean Kossaifi, Yannis Panagakis, Anima Anandkumar
European Conference in Computer Vision (ECCV), 2022
Heat: Hardware-efficient automatic tensor decomposition for transformer compression
Jiaqi Gu, Ben Keller, Jean Kossaifi, Anima Anandkumar, Brucek Khailany, David Z Pan
arXiv preprint arXiv:2211.16749, 2022
Incremental spatial and spectral learning of neural operators for solving large-scale PDEs
Robert Joseph George, Jiawei Zhao, Jean Kossaifi, Zongyi Li, Anima Anandkumar
arXiv preprint arXiv:2211.15188, 2022
2021
SEWA DB: A rich database for audio-visual emotion and sentiment research in the wild
Jean Kossaifi, Robert Walecki, Yannis Panagakis, Jie Shen, Maximilian Schmitt, Fabien Ringeval, Jing Han, Vedhas Pandit, Antoine Toisoul, Bjoern W Schuller, others
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021
Tensor Dropout for Robust Learning
Arinbj{\"o}rn Kolbeinsson, Jean Kossaifi, Yannis Panagakis, Adrian Bulat, Anima Anandkumar, Ioanna Tzoulaki, Paul Matthews
IEEE Journal of Selected Topics in Signal Processing, 2021
Unsupervised Controllable Generation with Self-Training
Grigorios G Chrysos, Jean Kossaifi, Zhiding Yu, Anima Anandkumar
International Joint Conference on Neural Networks (IJCNN), 2021
Estimation of continuous valence and arousal levels from faces in naturalistic conditions
Antoine Toisoul, Jean Kossaifi, Adrian Bulat, Georgios Tzimiropoulos, Maja Pantic
Nature Machine Intelligence, 2021
Tensor methods in computer vision and deep learning
Yannis Panagakis, Jean Kossaifi, Grigorios G Chrysos, James Oldfield, Mihalis A Nicolaou, Anima Anandkumar, Stefanos Zafeiriou
Proceedings of the IEEE, 2021
Tesseract: Tensorised Actors for Multi-Agent Reinforcement Learning
Anuj Mahajan, Mikayel Samvelyan, Lei Mao, Viktor Makoviychuk, Animesh Garg, Jean Kossaifi, Shimon Whiteson, Yuke Zhu, Animashree Anandkumar
International Conference on Machine Learning (ICML), 2021
AugMax: Adversarial Composition of Random Augmentations for Robust Training
Haotao Wang, Chaowei Xiao, Jean Kossaifi, Zhiding Yu, Anima Anandkumar, Zhangyang Wang
Advances in Neural Information Processing Systems (NeurIPS), 2021
Defensive Tensorization
Adrian Bulat, Jean Kossaifi, Sourav Bhattacharya, Yannis Panagakis, Timothy Hospedales, Georgios Tzimiropoulos, Nicholas D Lane, Maja Pantic
BMVC, 2021
Reinforcement learning in factored action spaces using tensor decompositions
Anuj Mahajan, Mikayel Samvelyan, Lei Mao, Viktor Makoviychuk, Animesh Garg, Jean Kossaifi, Shimon Whiteson, Yuke Zhu, Animashree Anandkumar
arXiv preprint arXiv:2110.14538, 2021
Tensorly-quantum: Quantum machine learning with tensor methods
Taylor L Patti, Jean Kossaifi, Susanne F Yelin, Anima Anandkumar
arXiv preprint arXiv:2112.10239, 2021
2020
Tensor regression networks
Jean Kossaifi, Zachary C Lipton, Arinbjorn Kolbeinsson, Aran Khanna, Tommaso Furlanello, Anima Anandkumar
Journal of Machine Learning Research (JMLR), 2020
Incremental multi-domain learning with network latent tensor factorization
Adrian Bulat, Jean Kossaifi, Georgios Tzimiropoulos, Maja Pantic
the AAAI Conference on Artificial Intelligence (AAAI), 2020
Factorized Higher-Order CNNs with an Application to Spatio-Temporal Emotion Estimation
Jean Kossaifi, Antoine Toisoul, Adrian Bulat, Yannis Panagakis, Maja Pantic
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020
Speech-driven facial animation using polynomial fusion of features
Triantafyllos Kefalas, Konstantinos Vougioukas, Yannis Panagakis, Stavros Petridis, Jean Kossaifi, Maja Pantic
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2020
Toward fast and accurate human pose estimation via soft-gated skip connections
Adrian Bulat, Jean Kossaifi, Georgios Tzimiropoulos, Maja Pantic
15th IEEE International Conference on Automatic Face \& Gesture Recognition (FG), 2020
RoCGAN: Robust Conditional GAN
Grigorios G Chrysos, Jean Kossaifi, Stefanos Zafeiriou
International Journal of Computer Vision (IJCV), 2020
Convolutional Tensor-Train LSTM for Spatio-Temporal Learning
Jiahao Su, Wonmin Byeon, Jean Kossaifi, Furong Huang, Jan Kautz, Animashree Anandkumar
Advances in Neural Information Processing Systems (NeurIPS), 2020
2019
TensorLy: Tensor Learning in Python
Jean Kossaifi, Yannis Panagakis, Anima Anandkumar, Maja Pantic
Journal of Machine Learning Research (JMLR), 2019
Robust Conditional Generative Adversarial Networks
Grigorios G Chrysos, Jean Kossaifi, Stefanos Zafeiriou
International Conference on Learning Representations (ICLR), 2019
T-Net: Parametrizing Fully Convolutional Nets with a Single High-Order Tensor
Jean Kossaifi, Adrian Bulat, Georgios Tzimiropoulos, Maja Pantic
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
Disentangling Geometry and Appearance with Regularised Geometry-Aware Generative Adversarial Networks
Linh Tran, Jean Kossaifi, Yannis Panagakis, Maja Pantic
International Journal of Computer Vision (IJCV), 2019
Improved training of binary networks for human pose estimation and image recognition
Adrian Bulat, Georgios Tzimiropoulos, Jean Kossaifi, Maja Pantic
arXiv preprint arXiv:1904.05868, 2019
Matrix and tensor decompositions for training binary neural networks
Adrian Bulat, Jean Kossaifi, Georgios Tzimiropoulos, Maja Pantic
arXiv preprint arXiv:1904.07852, 2019
Valence and arousal estimation in-the-wild with tensor methods
Anna Mitenkova, Jean Kossaifi, Yannis Panagakis, Maja Pantic
2019 14th IEEE International Conference on Automatic Face \& Gesture Recognition (FG 2019), 2019
Spectral learning on matrices and tensors
Majid Janzamin, Rong Ge, Jean Kossaifi, Anima Anandkumar
Foundations and Trends{\textregistered} in Machine Learning, 2019
Machine learning methods for face modelling and analysis in-the-wild
Jean Kossaifi
Publication, 2019
2018
GAGAN: Geometry-Aware Generative Adversarial Networks
Jean Kossaifi, Linh Tran, Yannis Panagakis, Maja Pantic
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
Stochastic activation pruning for robust adversarial defense
Guneet S Dhillon, Kamyar Azizzadenesheli, Zachary C Lipton, Jeremy Bernstein, Jean Kossaifi, Aran Khanna, Anima Anandkumar
International Conference on Learning Representations (ICLR), 2018
2017
AFEW-VA Database for Valence and Arousal estimation In-The-Wild
Jean Kossaifi, Georgios Tzimiropoulos, Sinisa Todorovic, Maja Pantic
Image and Vision Computing, 2017
Tensor Contraction Layers for Parsimonious Deep Nets
Jean Kossaifi, Aran Khanna, Zachary C Lipton, Tommaso Furlanello, Anima Anandkumar
IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2017
2016
Fast and exact Newton and Bidirectional fitting of Active Appearance Models.
Jean Kossaifi, Yorgos Tzimiropoulos, Maja Pantic
IEEE Transactions on Image Processing (TIP), 2016
2015
Fast and Exact Bi-Directional Fitting of Active Appearance Models
Jean Kossaifi, Georgios Tzimiropoulos, Maja Pantic
IEEE International Conference on Image Processing (ICIP), 2015
The first facial landmark tracking in-the-wild challenge: Benchmark and results
Jie Shen, Stefanos Zafeiriou, Grigoris G Chrysos, Jean Kossaifi, Georgios Tzimiropoulos, Maja Pantic
the IEEE international conference on computer vision workshops, 2015
2014
Fast Newton Active Appearance Models
Jean Kossaifi, Georgios Tzimiropoulos, Maja Pantic
IEEE International Conference on Image Processing (ICIP), 2014
Machine learning for neuroimaging with scikit-learn
Alexandre Abraham, Fabian Pedregosa, Michael Eickenberg, Philippe Gervais, Andreas Muller, Jean Kossaifi, Alexandre Gramfort, Bertrand Thirion, G{\"a}el Varoquaux
Frontiers in Neuroinformatics, 2014