""" .. _tut-inplace: ======================= Modifying data in-place ======================= Many of MNE-Python's data objects (`~mne.io.Raw`, `~mne.Epochs`, `~mne.Evoked`, etc) have methods that modify the data in-place (either optionally or obligatorily). This can be advantageous when working with large datasets because it reduces the amount of computer memory needed to perform the computations. However, it can lead to unexpected results if you're not aware that it's happening. This tutorial provides a few examples of in-place processing, and how and when to avoid it. As usual we'll start by importing the modules we need and loading some :ref:`example data `: """ # Authors: The MNE-Python contributors. # License: BSD-3-Clause # Copyright the MNE-Python contributors. # %% import mne sample_data_folder = mne.datasets.sample.data_path() sample_data_raw_file = sample_data_folder / "MEG" / "sample" / "sample_audvis_raw.fif" # the preload flag loads the data into memory now raw = mne.io.read_raw_fif(sample_data_raw_file, preload=True) raw.crop(tmax=10.0) # raw.crop() always happens in-place # %% # Signal processing # ----------------- # # Most MNE-Python data objects have built-in methods for filtering, including # high-, low-, and band-pass filters (`~mne.io.Raw.filter`), band-stop filters # (`~mne.io.Raw.notch_filter`), # Hilbert transforms (`~mne.io.Raw.apply_hilbert`), # and even arbitrary or user-defined functions (`~mne.io.Raw.apply_function`). # These typically **always** modify data in-place, so if we want to preserve # the unprocessed data for comparison, we must first make a copy of it. For # example: original_raw = raw.copy() raw.apply_hilbert() print( f"original data type was {original_raw.get_data().dtype}, after " f"apply_hilbert the data type changed to {raw.get_data().dtype}." ) # %% # Channel picking # --------------- # # Another group of methods where data is modified in-place are the # channel-picking methods. For example: print(f'original data had {original_raw.info["nchan"]} channels.') original_raw.pick("eeg") # selects only the EEG channels print(f'after picking, it has {original_raw.info["nchan"]} channels.') # %% # Note also that when picking only EEG channels, projectors that affected only # the magnetometers were dropped, since there are no longer any magnetometer # channels. # # # The ``copy`` parameter # ---------------------- # # Above we saw an example of using the `~mne.io.Raw.copy` method to facilitate # comparing data before and after processing. This is not needed when using # certain MNE-Python *functions*, because they have a *function parameter* # where you can specify ``copy=True`` (return a modified copy of the data) or # ``copy=False`` (operate in-place). For example, `mne.set_eeg_reference` is # one such function; notice that here we plot ``original_raw`` *after* the # rereferencing has been done, but ``original_raw`` is unaffected because # we specified ``copy=True``: # sphinx_gallery_thumbnail_number=2 rereferenced_raw, ref_data = mne.set_eeg_reference(original_raw, ["EEG 003"], copy=True) fig_orig = original_raw.plot() fig_reref = rereferenced_raw.plot() # %% # Another example is the picking function `mne.pick_info`, which operates on # `mne.Info` dictionaries rather than on data objects. See # :ref:`tut-info-class` for details. # # # Summary # ------- # # Generally speaking, you should expect that *methods of data objects* will # operate in-place, and *functions that take a data object as a parameter* will # operate on a copy of the data (unless the function has a ``copy`` parameter # and it defaults to ``False`` or you specify ``copy=False``). # During the exploratory phase of your analysis, where you might want # to try out the effects of different data cleaning approaches, you should get # used to patterns like ``raw.copy().filter(...).plot()`` or # ``raw.copy().apply_proj().compute_psd().plot()`` if you want to avoid having # to re-load data and repeat earlier steps each time you change a computation # (see the :ref:`sect-meth-chain` section for more info on method chaining).