109 4.1.3 Spectral Matching Independent Component Analysis ,
They capture respectively the magnetic and electric signals produced by active neurons from the scalp surface or close to it. Due to the distance between the brain and the M/EEG sensors, these signals are a mixture of sources. The physics of the mixing is well understood: it is a linear process and can be considered instantaneous. It means that each sensor sees the sum of the contributions of all sources, Magnetoencephalography and Electroencephalography (M/EEG) are popular non-invasive techniques to record brain activity, 1993. ,
, What characterizes most neural sources at the origin of M/EEG signals is their spectral signature. Typically, brain sources are rhythmic signals, containing what is often referred to as oscillations, 2017.
What makes ICA quite remarkable it that it can identify those contamination sources 'blindly', that is, without prior knowledge of the underlying physics of the system (except linearity). Besides EEG, it is also widely used for the same purpose in MEG studies, 1997. ,
Faster independent component analysis by preconditioning with Hessian approximations, IEEE Transactions on Signal Processing, vol.66, issue.15, pp.4040-4049, 2018. ,
URL : https://hal.archives-ouvertes.fr/hal-01970746
Accelerating likelihood optimization for ICA on real signals, International Conference on Latent Variable Analysis and Signal Separation, pp.151-160, 2018. ,
URL : https://hal.archives-ouvertes.fr/hal-01822602
Faster ICA under orthogonal constraint, Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2018. ,
URL : https://hal.archives-ouvertes.fr/hal-01651842
Beyond Pham's algorithm for joint diagonalization, ESANN, 2019. ,
A quasi-Newton algorithm on the orthogonal manifold for NMF with transform learning, ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.700-704, 2019. ,
URL : https://hal.archives-ouvertes.fr/hal-02346829
Stochastic algorithms with descent guarantees for ICA, The 22nd International Conference on Artificial Intelligence and Statistics, pp.1564-1573, 2019. ,
URL : https://hal.archives-ouvertes.fr/hal-02372092
Learning step sizes for unfolded sparse coding, 2019. ,
URL : https://hal.archives-ouvertes.fr/hal-02140383
Alexandre Gramfort, Bertrand Thirion, and Gaël Varoquaux. Machine learning for neuroimaging with scikit-learn, Frontiers in neuroinformatics, vol.8, 2014. ,
Optimization algorithms on matrix manifolds, 2009. ,
K-svd: An algorithm for designing overcomplete dictionaries for sparse representation, IEEE Transactions on signal processing, vol.54, issue.11, pp.4311-4322, 2006. ,
A baseline for the multivariate comparison of resting-state networks, Frontiers in systems neuroscience, vol.5, 2011. ,
Bibliography Shun-ichi Amari, Andrzej Cichocki, and Howard Hua Yang. A new learning algorithm for blind signal separation, Advances in neural information processing systems, vol.24, pp.757-763, 1996. ,
Stability analysis of learning algorithms for blind source separation, Neural Networks, vol.10, issue.8, pp.1345-1351, 1997. ,
Complex independent component analysis of frequency-domain electroencephalographic data, Neural Networks, vol.16, pp.1311-1323, 2003. ,
Applying dimension reduction to EEG data by principal component analysis reduces the quality of its subsequent independent component decomposition, NeuroImage, vol.175, pp.176-187, 2018. ,
URL : https://hal.archives-ouvertes.fr/hal-02341930
Abnormal functional connectivity of default mode sub-networks in autism spectrum disorder patients, Neuroimage, vol.53, issue.1, pp.247-256, 2010. ,
Kernel independent component analysis, Journal of machine learning research, vol.3, pp.1-48, 2002. ,
Multi-way space-time-wave-vector analysis for eeg source separation, Signal Processing, vol.92, issue.4, pp.1021-1031, 2012. ,
Localization of distributed eeg sources in the context of epilepsy: a simulation study, IRBM, vol.37, issue.5-6, pp.242-253, 2016. ,
URL : https://hal.archives-ouvertes.fr/hal-01359237
Investigations into resting-state connectivity using independent component analysis, Philosophical Transactions of the Royal Society B: Biological Sciences, vol.360, pp.1001-1013, 1457. ,
An information-maximization approach to blind separation and blind deconvolution, Neural computation, vol.7, issue.6, pp.1129-1159, 1995. ,
A blind source separation technique using second-order statistics, IEEE Transactions on Signal Processing, vol.45, issue.2, pp.434-444, 1997. ,
Approximate likelihood for noisy mixtures, Proc. ICA, vol.99, pp.325-330, 1999. ,
Differential Geometry, Lie Groups and Symmetric Spaces over General Base Fields and Rings. Memoirs of the, Bibliography, vol.131, 2008. ,
URL : https://hal.archives-ouvertes.fr/hal-00004190
The tradeoffs of large scale learning, Advances in neural information processing systems, pp.161-168, 2008. ,
Optimization methods for large-scale machine learning, 2016. ,
Investigating the electrophysiological basis of resting state networks using magnetoencephalography, Proceedings of the National Academy of Sciences, vol.108, pp.16783-16788, 2011. ,
Introduction to random signals and applied Kalman filtering, vol.3, 1992. ,
The convergence of a class of double-rank minimization algorithms 1. general considerations, IMA Journal of Applied Mathematics, vol.6, issue.1, pp.76-90, 1970. ,
Rhythms of the Brain, 2006. ,
, Neuronal oscillations in cortical networks. Science, vol.304, issue.5679, pp.1926-1929, 2004.
Space and time in the brain, Science, vol.358, issue.6362, pp.482-485, 2017. ,
A limited memory algorithm for bound constrained optimization, SIAM Journal on Scientific Computing, vol.16, issue.5, pp.1190-1208, 1995. ,
Principal components and independent component analysis of solar and space data, Solar Physics, vol.248, issue.2, pp.247-261, 2008. ,
On-line expectation-maximization algorithm for latent data models, Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol.71, issue.3, pp.593-613, 2009. ,
On the stability of some source separation algorithms, Proc. of the 1998 IEEE SP workshop on neural networks for signal processing (NNSP '98), pp.13-22, 1998. ,
On the performance of orthogonal source separation algorithms, Proceedings of EUSIPCO, vol.94, pp.776-779, 1994. ,
Infomax and maximum likelihood for blind source separation, IEEE Signal processing letters, vol.4, issue.4, pp.112-114, 1997. ,
Blind signal separation: statistical principles, Proceedings of the IEEE, vol.86, issue.10, pp.2009-2025, 1998. ,
The three easy routes to independent component analysis; contrasts and geometry, Proc. ICA, vol.2001, pp.1-6, 2001. ,
Equivariant adaptive source separation, IEEE Transactions on Signal Processing, vol.44, issue.12, pp.3017-3030, 1996. ,
Blind beamforming for non-gaussian signals, IEE Proceedings F -Radar and Signal Processing, vol.140, pp.362-370, 1993. ,
Jacobi angles for simultaneous diagonalization, SIAM journal on matrix analysis and applications, vol.17, issue.1, pp.161-164, 1996. ,
Blind separation of noisy Gaussian stationary sources. application to cosmic microwave background imaging, 11th European Signal Processing Conference, pp.1-4, 2002. ,
URL : https://hal.archives-ouvertes.fr/in2p3-00012625
Comparative performance analysis of eight blind source separation methods on radiocommunications signals, Proc. of IEEE International Joint Conference on Neural Networks, vol.1, pp.273-278, 2004. ,
URL : https://hal.archives-ouvertes.fr/hal-02476419
A relative trust-region algorithm for independent component analysis, Neurocomputing, vol.70, issue.7, pp.1502-1510, 2007. ,
Independent component analysis, a new concept? Signal processing, vol.36, pp.287-314, 1994. ,
Handbook of Blind Source Separation: Independent component analysis and applications, 2010. ,
URL : https://hal.archives-ouvertes.fr/hal-00460653
On the blind source separation of human electroencephalogram by approximate joint diagonalization of second order statistics, Clinical Neurophysiology, vol.119, issue.12, pp.2677-2686, 2008. ,
URL : https://hal.archives-ouvertes.fr/hal-00343628
The ADHD-200 consortium: a model to advance the translational potential of neuroimaging in clinical neuroscience. Frontiers in systems neuroscience, vol.6, 2012. ,
Integration of amplitude and phase statistics for complete artifact removal in independent components of neuromagnetic recordings, IEEE Transactions on Biomedical Engineering, vol.55, issue.10, pp.2353-2362, 2008. ,
Analyse générale des liaisons stochastiques: etude particulière de l'analyse factorielle linéaire. Revue de l'Institut international de statistique, pp.2-8, 1953. ,
Variable metric method for minimization, SIAM Journal on Optimization, vol.1, issue.1, pp.1-17, 1991. ,
Identifiability issues in noisy ica, IEEE Signal processing letters, vol.11, issue.5, pp.470-473, 2004. ,
Canonical decomposition of ictal scalp eeg reliably detects the seizure onset zone, NeuroImage, vol.37, issue.3, pp.844-854, 2007. ,
SAGA: A fast incremental gradient method with support for non-strongly convex composite objectives, Proc. NIPS, pp.1646-1654, 2014. ,
URL : https://hal.archives-ouvertes.fr/hal-01016843
Comparative power spectral analysis of simultaneous elecroencephalographic and magnetoencephalographic recordings in humans suggests non-resistive extracellular media, Journal of Computational Neuroscience, vol.29, issue.3, pp.405-421, 2010. ,
URL : https://hal.archives-ouvertes.fr/hal-00520481
Multidetector multicomponent spectral matching and applications for cosmic microwave background data analysis, Monthly Notices of the Royal Astronomical Society, vol.346, issue.4, pp.1089-1102, 2003. ,
EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis, Journal of neuroscience methods, vol.134, issue.1, pp.9-21, 2004. ,
Independent EEG sources are dipolar, PloS one, vol.7, issue.2, p.30135, 2012. ,
URL : https://hal.archives-ouvertes.fr/hal-00674521
Maximum likelihood from incomplete data via the EM algorithm, Journal of the Royal Statistical Society. Series B (methodological), pp.1-38, 1977. ,
Model selection for convolutive ICA with an application to spatiotemporal analysis of EEG, Neural Computation, vol.19, issue.4, pp.934-955, 2007. ,
A new approach to variable metric algorithms, The computer journal, vol.13, issue.3, pp.317-322, 1970. ,
A rapidly convergent descent method for minimization, The computer journal, vol.6, issue.2, pp.163-168, 1963. ,
A variational method for learning sparse and overcomplete representations, Neural Computation, vol.13, issue.11, pp.2517-2532, 2001. ,
A family of variable-metric methods derived by variational means, Mathematics of computation, vol.24, issue.109, pp.23-26, 1970. ,
Measuring directional coupling between EEG sources, Neuroimage, vol.43, issue.3, pp.497-508, 2008. ,
MNE software for processing MEG and EEG data, NeuroImage, vol.86, pp.446-460, 2014. ,
URL : https://hal.archives-ouvertes.fr/hal-02369299
Magnetoencephalography-theory, instrumentation, and applications to noninvasive studies of the working human brain, Reviews of modern Physics, vol.65, issue.2, p.413, 1993. ,
Human cortical oscillations: a neuromagnetic view through the skull, Trends in Neurosciences, vol.20, issue.1, pp.44-49, 1997. ,
Variable selection for gaussian graphical models, Artificial Intelligence and Statistics, pp.538-546, 2012. ,
Independent component analysis applied to feature extraction from colour and stereo images, Network: Computation in Neural Systems, vol.11, issue.3, pp.191-210, 2000. ,
Functional magnetic resonance imaging, Sinauer Associates Sunderland, vol.1, 2004. ,
Fast and robust fixed-point algorithms for independent component analysis, IEEE Transactions on Neural Networks, vol.10, issue.3, pp.626-634, 1999. ,
The fixed-point algorithm and maximum likelihood estimation for independent component analysis, Neural Processing Letters, vol.10, issue.1, pp.1-5, 1999. ,
Independent component analysis: algorithms and applications, Neural networks, vol.13, issue.4, pp.411-430, 2000. ,
Independent component analysis, vol.46, 2004. ,
Independent component analysis of short-time Fourier transforms for spontaneous EEG/MEG analysis, NeuroImage, vol.49, issue.1, pp.257-271, 2010. ,
Independent component analysis for noisy data-MEG data analysis, Neural Networks, vol.13, issue.10, pp.1063-1074, 2000. ,
A preconditioned L-BFGS algorithm with application to molecular energy minimization, 2004. ,
Accelerating stochastic gradient descent using predictive variance reduction, Proc. NIPS, pp.315-323, 2013. ,
Extended ICA removes artifacts from electroencephalographic recordings, Proceedings of the 10th International Conference on Neural Information Processing Systems, NIPS'97, pp.894-900, 1997. ,
Removing electroencephalographic artifacts by blind source separation, Psychophysiology, vol.37, issue.2, pp.163-178, 2000. ,
Blind separation of sources, part i: An adaptive algorithm based on neuromimetic architecture, Signal processing, vol.24, issue.1, pp.1-10, 1991. ,
Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics. Linear algebra and its applications, vol.18, pp.95-138, 1977. ,
Learning the parts of objects by non-negative matrix factorization, Nature, vol.401, issue.6755, pp.788-791, 1999. ,
Application of independent component analysis to microarrays, Genome biology, vol.4, issue.11, p.76, 2003. ,
Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources, Neural computation, vol.11, issue.2, pp.417-441, 1999. ,
Online algorithms for nonnegative matrix factorization with the Itakura-Saito divergence, Applications of Signal Processing to Audio and Acoustics (WASPAA), 2011 IEEE Workshop on, pp.313-316, 2011. ,
URL : https://hal.archives-ouvertes.fr/hal-00602050
Learning overcomplete representations, Neural computation, vol.12, issue.2, pp.337-365, 2000. ,
A modified bfgs method and its global convergence in nonconvex minimization, Journal of Computational and Applied Mathematics, vol.129, issue.1-2, pp.15-35, 2001. ,
Blind multilinear identification, IEEE Transactions on Information Theory, vol.60, issue.2, pp.1260-1280, 2013. ,
URL : https://hal.archives-ouvertes.fr/hal-00763275
On the limited memory bfgs method for large scale optimization, Mathematical programming, vol.45, pp.503-528, 1989. ,
All-sky astrophysical component separation with fast independent component analysis (FASTICA), Monthly Notices of the Royal Astronomical Society, vol.334, issue.1, pp.53-68, 2002. ,
Optimization with first-order surrogate functions, Proceedings of the 30th International Conference on Machine Learning (ICML-13), pp.783-791, 2013. ,
URL : https://hal.archives-ouvertes.fr/hal-00822229
Incremental majorization-minimization optimization with application to large-scale machine learning, Proc. ICML, vol.25, pp.689-696, 2009. ,
URL : https://hal.archives-ouvertes.fr/hal-00948338
Blind separation of auditory event-related brain responses into independent components, Proceedings of the National Academy of Sciences, vol.94, pp.10979-10984, 1997. ,
Mining event-related brain dynamics, Trends in cognitive sciences, vol.8, issue.5, pp.204-210, 2004. ,
Improving MEG source localizations: an automated method for complete artifact removal based on independent component analysis, NeuroImage, vol.40, issue.1, pp.160-173, 2008. ,
A neural net for blind separation of nonstationary signals, Neural networks, vol.8, issue.3, pp.411-419, 1995. ,
Analysis of fmri data by blind separation into independent spatial components, 1997. ,
Decomposing eeg data into space-time-frequency components using parallel factor analysis, NeuroImage, vol.22, issue.3, pp.1035-1045, 2004. ,
Caveats with stochastic gradient and maximum likelihood based ICA for EEG, International Conference on Latent Variable Analysis and Signal Separation, pp.279-289, 2017. ,
Line search algorithms with guaranteed sufficient decrease, ACM Transactions on Mathematical Software (TOMS), vol.20, issue.3, pp.286-307, 1994. ,
Self-adaptive source separation. ii. comparison of the direct, feedback, and mixed linear network, IEEE Trans. on Signal Processing, vol.46, issue.1, pp.39-50, 1998. ,
Parallel factor analysis as an exploratory tool for wavelet transformed eventrelated eeg, NeuroImage, vol.29, issue.3, pp.938-947, 2006. ,
Maximum likelihood for blind separation and deconvolution of noisy signals using mixture models, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing, vol.5, pp.3617-3620, 1997. ,
A view of the EM algorithm that justifies incremental, sparse, and other variants, Learning in graphical models, pp.355-368, 1998. ,
Problem complexity and method efficiency in optimization, 1983. ,
Electroencephalography : basic principles, clinical applications, and related fields, 2005. ,
A novel method for reliable and fast extraction of neuronal eeg/meg oscillations on the basis of spatio-spectral decomposition, NeuroImage, vol.55, issue.4, pp.1528-1535, 2011. ,
Numerical Optimization, 1999. ,
Blind source separation and analysis of multispectral astronomical images, Astronomy and Astrophysics Supplement Series, vol.147, issue.1, pp.129-138, 2000. ,
The fastica algorithm revisited: Convergence analysis, IEEE Transactions on Neural Networks, vol.17, issue.6, pp.1370-1381, 2006. ,
Modeling the shape of the scene: A holistic representation of the spatial envelope, International journal of computer vision, vol.42, issue.3, pp.145-175, 2001. ,
Emergence of simple-cell receptive field properties by learning a sparse code for natural images, Nature, vol.381, issue.6583, p.607, 1996. ,
Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values, Environmetrics, vol.5, issue.2, pp.111-126, 1994. ,
Variational EM algorithms for non-gaussian latent variable models, Proc. NIPS, pp.1059-1066, 2006. ,
Newton method for the ICA mixture model, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.1805-1808, 2008. ,
AMICA: An adaptive mixture of independent component analyzers with shared components, 2012. ,
Blind separation of instantaneous mixture of sources via the Gaussian mutual information criterion, Signal Processing, vol.81, issue.4, pp.855-870, 2001. ,
Joint approximate diagonalization of positive definite hermitian matrices, SIAM Journal on Matrix Analysis and Applications, vol.22, issue.4, pp.1136-1152, 2001. ,
Bibliography Dinh-Tuan Pham and Jean-Francois Cardoso. Source adaptive blind source separation: Gaussian models and sparsity, Wavelets: Applications in Signal and Image Processing, X, Proc. of SPIE, vol.49, pp.1837-1848, 2001. ,
Blind separation of mixture of independent sources through a quasi-maximum likelihood approach, IEEE Transactions on Signal Processing, vol.45, issue.7, pp.1712-1725, 1997. ,
Output-only modal analysis using blind source separation techniques. Mechanical systems and signal processing, vol.21, pp.2335-2358, 2007. ,
Tensor decomposition of polarized seismic waves, GRETSI'2015, 2015. ,
URL : https://hal.archives-ouvertes.fr/hal-01164363
A stochastic approximation method. The annals of mathematical statistics, pp.400-407, 1951. ,
Self-similarity and multifractality in human brain activity: A wavelet-based analysis of scale-free brain dynamics, Journal of Neuroscience Methods, vol.309, pp.175-187, 2018. ,
Independent components analysis with the JADE algorithm, TrAC Trends in Analytical Chemistry, vol.50, pp.22-32, 2013. ,
Alexandre Gramfort, and Denis A Engeman. Manifold-regression to predict from meg/eeg brain signals without source modeling, 2019. ,
Two bilateral sources of the late AEP as identified by a spatio-temporal dipole model, Electroencephalogr. Clin. Neurophysiol, vol.62, issue.1, pp.32-44, 1985. ,
Minimizing finite sums with the stochastic average gradient, Mathematical Programming, vol.162, issue.1-2, pp.83-112, 2017. ,
URL : https://hal.archives-ouvertes.fr/hal-00860051
Metabolite fingerprinting: detecting biological features by independent component analysis, Bioinformatics, vol.20, issue.15, pp.2447-2454, 2004. ,
Conditioning of quasi-Newton methods for function minimization, Mathematics of computation, vol.24, issue.111, pp.647-656, 1970. ,
Local convergence analysis of FastICA and related algorithms, IEEE Transactions on Neural Networks, vol.19, issue.6, pp.1022-1032, 2008. ,
An introduction to the conjugate gradient method without the agonizing pain, 1994. ,
Parallel factor analysis in sensor array processing, IEEE transactions on Signal Processing, vol.48, issue.8, pp.2377-2388, 2000. ,
Using joint ICA to link function and structure using MEG and DTI in schizophrenia, Neuroimage, vol.83, pp.418-430, 2013. ,
EEG signal classification using PCA, ICA, LDA and support vector machines. Expert systems with applications, vol.37, pp.8659-8666, 2010. ,
Spatiotemporal Signal Space Separation method for rejecting nearby interference in MEG measurements, Physics in Medicine and Biology, vol.51, issue.7, pp.1759-1769, 2006. ,
Performance analysis of the FastICA algorithm and cramer-rao bounds for linear independent component analysis, IEEE transactions on Signal Processing, vol.54, issue.4, pp.1189-1203, 2006. ,
Infomax-ICA using Hessian-free optimization, Acoustics, Speech and Signal Processing, pp.2537-2541, 2017. ,
EEG artifact removal -state-ofthe-art and guidelines, Journal of neural engineering, vol.12, issue.3, p.31001, 2015. ,
Signal-space projection method for separating MEG or EEG into components, Medical and Biological Engineering and Computing, vol.35, issue.2, pp.135-140, 1997. ,
The NumPy array: a structure for efficient numerical computation, Comp. in Sci. & Eng, vol.13, issue.2, pp.22-30, 2011. ,
URL : https://hal.archives-ouvertes.fr/inria-00564007
A group model for stable multi-subject ICA on fMRI datasets, Neuroimage, vol.51, issue.1, pp.288-299, 2010. ,
URL : https://hal.archives-ouvertes.fr/hal-00489507
Independent component approach to the analysis of EEG and MEG recordings, IEEE Transactions on Biomedical Engineering, vol.47, issue.5, pp.589-593, 2000. ,
Independent component analysis of raman spectra: Application on paraffin-embedded skin biopsies, Biomedical Signal Processing and Control, vol.2, issue.1, pp.40-50, 2007. ,
A convergence and asymptotic analysis of the generalized symmetric FastICA algorithm, IEEE transactions on signal processing, vol.63, issue.24, pp.6445-6458, 2015. ,
Multidimensional space-time-frequency component analysis of event related eeg data using closed-form parafac, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, pp.349-352, 2009. ,
It's not too late: The onset of the frontocentral p3 indexes successful response inhibition in the stop-signal paradigm, Psychophysiology, vol.52, issue.4, pp.472-480, 2015. ,
Convergence conditions for ascent methods, SIAM review, vol.11, issue.2, pp.226-235, 1969. ,
Robust independent component analysis by iterative maximization of the kurtosis contrast with algebraic optimal step size, IEEE Transactions on Neural Networks, vol.21, issue.2, pp.248-261, 2009. ,
URL : https://hal.archives-ouvertes.fr/hal-00457300
How fast is fastica, 2006 14th European Signal Processing Conference, pp.1-5, 2006. ,
Blind source separation with relative Newton method, Proc. ICA, pp.897-902, 2003. ,
A fast algorithm for joint diagonalization with non-orthogonal transformations and its application to blind source separation, Journal of Machine Learning Research, vol.5, pp.777-800, 2004. ,