Advertisement
Research Article| Volume 15, ISSUE 2, P491-508, March 2022

Local and distant cortical responses to single pulse intracranial stimulation in the human brain are differentially modulated by specific stimulation parameters

  • Angelique C. Paulk
    Correspondence
    Corresponding author. Department of Neurology, Massachusetts General Hospital, Boston, MA, 02114, USA.
    Affiliations
    Department of Neurology, Massachusetts General Hospital and Harvard Medical School, Boston, MA, 02114, USA

    Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
    Search for articles by this author
  • Rina Zelmann
    Affiliations
    Department of Neurology, Massachusetts General Hospital and Harvard Medical School, Boston, MA, 02114, USA

    Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
    Search for articles by this author
  • Britni Crocker
    Affiliations
    Department of Neurology, Massachusetts General Hospital and Harvard Medical School, Boston, MA, 02114, USA

    Harvard-MIT Health Sciences and Technology, Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
    Search for articles by this author
  • Author Footnotes
    1 Present address: Department of Psychiatry, University of Minnesota, Minneapolis, MN 55455, USA.
    Alik S. Widge
    Footnotes
    1 Present address: Department of Psychiatry, University of Minnesota, Minneapolis, MN 55455, USA.
    Affiliations
    Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, 02129, USA
    Search for articles by this author
  • Darin D. Dougherty
    Affiliations
    Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA

    Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, 02129, USA
    Search for articles by this author
  • Author Footnotes
    2 Present address: Department of Neurosurgery, Albert Einstein College of Medicine, Montefiore Medical Center, Bronx, NY, 10467, USA.
    Emad N. Eskandar
    Footnotes
    2 Present address: Department of Neurosurgery, Albert Einstein College of Medicine, Montefiore Medical Center, Bronx, NY, 10467, USA.
    Affiliations
    Department of Neurosurgery, Massachusetts General Hospital and Harvard Medical School, Boston, MA, 02114, USA
    Search for articles by this author
  • Daniel S. Weisholtz
    Affiliations
    Department of Neurology, Brigham and Women's Hospital, Boston, MA, 02114, USA
    Search for articles by this author
  • R. Mark Richardson
    Affiliations
    Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA

    Department of Neurosurgery, Massachusetts General Hospital and Harvard Medical School, Boston, MA, 02114, USA
    Search for articles by this author
  • G. Rees Cosgrove
    Affiliations
    Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA, 02114, USA
    Search for articles by this author
  • Ziv M. Williams
    Affiliations
    Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA

    Department of Neurosurgery, Massachusetts General Hospital and Harvard Medical School, Boston, MA, 02114, USA
    Search for articles by this author
  • Sydney S. Cash
    Affiliations
    Department of Neurology, Massachusetts General Hospital and Harvard Medical School, Boston, MA, 02114, USA

    Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
    Search for articles by this author
  • Author Footnotes
    1 Present address: Department of Psychiatry, University of Minnesota, Minneapolis, MN 55455, USA.
    2 Present address: Department of Neurosurgery, Albert Einstein College of Medicine, Montefiore Medical Center, Bronx, NY, 10467, USA.
Open AccessPublished:March 02, 2022DOI:https://doi.org/10.1016/j.brs.2022.02.017

      Highlights

      • Intracranial single pulse electrical stimulation (SPES) response increases with increased pulse duration near stimulation.
      • SPES response varies nonlinearly with injected current with an effect of distance from the stimulation site.
      • SPES near the grey-white boundary has larger local responses, but white matter stimulation induces larger distant responses.
      • The relationship between SPES location and responses depends on brain region stimulated.

      Abstract

      Background

      Electrical neuromodulation via direct electrical stimulation (DES) is an increasingly common therapy for a wide variety of neuropsychiatric diseases. Unfortunately, therapeutic efficacy is inconsistent, likely due to our limited understanding of the relationship between the massive stimulation parameter space and brain tissue responses.

      Objective

      To better understand how different parameters induce varied neural responses, we systematically examined single pulse-induced cortico-cortico evoked potentials (CCEP) as a function of stimulation amplitude, duration, brain region, and whether grey or white matter was stimulated.

      Methods

      We measured voltage peak amplitudes and area under the curve (AUC) of intracranially recorded stimulation responses as a function of distance from the stimulation site, pulse width, current injected, location relative to grey and white matter, and brain region stimulated (N = 52, n = 719 stimulation sites).

      Results

      Increasing stimulation pulse width increased responses near the stimulation location. Increasing stimulation amplitude (current) increased both evoked amplitudes and AUC nonlinearly. Locally (<15 mm), stimulation at the boundary between grey and white matter induced larger responses. In contrast, for distant sites (>15 mm), white matter stimulation consistently produced larger responses than stimulation in or near grey matter. The stimulation location-response curves followed different trends for cingulate, lateral frontal, and lateral temporal cortical stimulation.

      Conclusion

      These results demonstrate that a stronger local response may require stimulation in the grey-white boundary while stimulation in the white matter could be needed for network activation. Thus, stimulation parameters tailored for a specific anatomical-functional outcome may be key to advancing neuromodulatory therapy.

      Keywords

      Abbreviations

      SPES
      Single pulse electrical stimulation
      CCEP
      cortico-cortico evoked potential
      DES
      Direct electrical stimulation
      EEG
      electroencephalogram
      sEEG
      stereo EEG
      ERP
      event-related potential
      LFP
      local field potential
      AUC
      area under the curve
      GLM
      Generalized Linear Model
      FDR
      False Discovery Rate
      AIC
      Akaike Information Criterion

      1. Introduction

      Direct electrical stimulation (DES) of brain tissue can alleviate symptoms of neuropsychiatric diseases ranging from Parkinson's to obsessive compulsive disorder (OCD) to epilepsy [
      • Mayberg H.S.
      • Lozano A.M.
      • Voon V.
      • McNeely H.E.
      • Seminowicz D.
      • Hamani C.
      • et al.
      Deep brain stimulation for treatment-resistant depression.
      ,
      • Perlmutter J.S.
      • Mink J.W.
      Deep brain stimulation.
      ,
      • Bronstein J.M.
      • Tagliati M.
      • Alterman R.L.
      • Lozano A.M.
      • Volkmann J.
      • Stefani A.
      • et al.
      Deep brain stimulation for Parkinson disease: an expert consensus and review of key issues.
      ,
      • Lozano A.M.
      • Lipsman N.
      Probing and regulating dysfunctional circuits using deep brain stimulation.
      ,
      • Revell M.A.
      Deep brain stimulation for movement disorders.
      ,
      • Herrington T.M.
      • Cheng J.J.
      • Eskandar E.N.
      Mechanisms of deep brain stimulation.
      ,
      • Widge A.S.
      • Ellard K.K.
      • Paulk A.C.
      • Basu I.
      • Yousefi A.
      • Zorowitz S.
      • et al.
      Treating refractory mental illness with closed-loop brain stimulation : progress towards a patient-specific transdiagnostic approach.
      ,
      • Widge A.S.
      • Malone D.A.
      • Dougherty D.D.
      Closing the loop on deep brain stimulation for treatment-resistant depression.
      ,
      • Cagnan H.
      • Denison T.
      • McIntyre C.
      • Brown P.
      Emerging technologies for improved deep brain stimulation.
      ,
      • Kokkinos V.
      • Sisterson N.D.
      • Wozny T.A.
      • Richardson R.M.
      Association of closed-loop brain stimulation neurophysiological features with seizure control among patients with focal epilepsy.
      ,
      • Wozny T.A.
      • Wang D.D.
      • Starr P.A.
      Simultaneous cortical and subcortical recordings in humans with movement disorders: acute and chronic paradigms.
      ]. However, neurophysiological, behavioral and therapeutic effects of DES remain quite variable and unpredictable [
      • Laxton A.W.
      • Lozano A.M.
      Deep brain stimulation for the treatment of alzheimer disease and dementias.
      ,
      • Chiken S.
      • Nambu A.
      Mechanism of deep brain stimulation: inhibition, excitation, or disruption.
      ,
      • Mankin E.A.
      • Fried I.
      Modulation of human memory by deep brain stimulation of the entorhinal-hippocampal circuitry.
      ,
      • Holtzheimer P.E.
      • Husain M.M.
      • Lisanby S.H.
      • Taylor S.F.
      • Whitworth L.A.
      • McClintock S.
      • et al.
      Subcallosal cingulate deep brain stimulation for treatment-resistant depression: a multisite, randomised, sham-controlled trial.
      ,
      • Dougherty D.D.
      • Rezai A.R.
      • Carpenter L.L.
      • Howland R.H.
      • Bhati M.T.
      • O'Reardon J.P.
      • et al.
      A randomized sham-controlled trial of deep brain stimulation of the ventral capsule/ventral striatum for chronic treatment-resistant depression.
      ,
      • Sullivan C.R.P.
      • Olsen S.
      • Widge A.S.
      Deep brain stimulation for psychiatric disorders: from focal brain targets to cognitive networks.
      ]. This variability in efficacy likely results from stimulation interacting with the target brain network differently in different patients, in part due to complex interactions between stimulation parameters, including location, pulse width and duration, injected current, location relative to grey and white matter, and stimulation frequency [
      • Mankin E.A.
      • Fried I.
      Modulation of human memory by deep brain stimulation of the entorhinal-hippocampal circuitry.
      ,
      • Boccard S.G.J.
      • Pereira E.A.C.
      • Moir L.
      • Hartevelt T.J.V.
      • Kringelbach M.L.
      • Fitzgerald J.J.
      • et al.
      Deep brain stimulation of the anterior cingulate cortex: targeting the affective component of chronic pain.
      ,
      • Sankar T.
      • Lipsman N.
      • Lozano A.M.
      Deep brain stimulation for disorders of memory and cognition.
      ,
      • Jacobs J.
      • Miller J.
      • Lee S.A.
      • Gorniak R.
      • Kahana M.J.
      • Rizzuto D.S.
      • et al.
      Direct electrical stimulation of the human entorhinal region and Hippocampus impairs memory.
      ,
      • Ezzyat Y.
      • Kragel J.E.
      • Burke J.F.
      • Levy D.F.
      • Lyalenko A.
      • Wanda P.
      • et al.
      Direct brain stimulation modulates encoding states and memory performance in humans.
      ,
      • Ezzyat Y.
      • Wanda P.A.
      • Levy D.F.
      • Kadel A.
      • Aka A.
      • Pedisich I.
      • et al.
      Closed-loop stimulation of temporal cortex rescues functional networks and improves memory.
      ,
      • Rao V.R.
      • Sellers K.K.
      • Wallace D.L.
      • Lee M.B.
      • Bijanzadeh M.
      • Sani O.G.
      • et al.
      Direct electrical stimulation of lateral orbitofrontal cortex acutely improves mood in individuals with symptoms of depression.
      ,
      • Basu I.
      • Robertson M.M.
      • Crocker B.
      • Peled N.
      • Farnes K.
      • Vallejo-Lopez D.I.
      • et al.
      Consistent linear and non-linear responses to electrical brain stimulation across individuals and primate species.
      ,
      • Bick S.K.
      • Patel S.R.
      • Katnani H.A.
      • Peled N.
      • Cash S.S.
      • Eskandar E.N.
      Caudate stimulation enhances learning.
      ,
      • Widge A.S.
      • Zorowitz S.
      • Basu I.
      • Paulk A.C.
      • Cash S.S.
      • Eskandar E.N.
      • et al.
      Deep brain stimulation of the internal capsule enhances human cognitive control and prefrontal cortex function.
      ,
      • Basu I.
      • Yousefi A.
      • Crocker B.
      • Zelmann R.
      • Paulk A.C.
      • Peled N.
      • et al.
      Closed-loop enhancement and neural decoding of cognitive control in humans.
      ,
      • Yih J.
      • Beam D.E.
      • Fox K.C.R.
      • Parvizi J.
      Intensity of affective experience is modulated by magnitude of intracranial electrical stimulation in human orbitofrontal, cingulate and insular cortices.
      ,
      • Mohan U.R.
      • Watrous A.J.
      • Miller J.F.
      • Lega B.C.
      • Sperling M.R.
      • Worrell G.A.
      • et al.
      The effects of direct brain stimulation in humans depend on frequency, amplitude, and white-matter proximity.
      ,
      • Crocker B.
      • Ostrowski L.
      • Williams Z.M.
      • Dougherty D.D.
      • Eskandar E.N.
      • Widge A.S.
      • et al.
      Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
      ,
      • Yang Y.
      • Qiao S.
      • Sani O.G.
      • Sedillo J.I.
      • Ferrentino B.
      • Pesaran B.
      • et al.
      Modelling and prediction of the dynamic responses of large-scale brain networks during direct electrical stimulation.
      ,
      • Rizzone M.
      • Lanotte M.
      • Bergamasco B.
      • Tavella A.
      • Torre E.
      • Faccani G.
      • et al.
      Deep brain stimulation of the subthalamic nucleus in Parkinson's disease : effects of variation in stimulation parameters.
      ,
      • Anderson C.J.
      • Anderson D.N.
      • Pulst S.M.
      • Butson C.R.
      • Dorval A.D.
      Neural selectivity, efficiency, and dose equivalence in deep brain stimulation through pulse width tuning and segmented electrodes.
      ,
      • Schor J.S.
      • Nelson A.B.
      Multiple stimulation parameters influence efficacy of deep brain stimulation in parkinsonian mice.
      ,
      • Lech M.
      • Berry B.
      • Topcu C.
      • Kremen V.
      • Nejedly P.
      • Lega B.
      • et al.
      Direct electrical stimulation of the human brain has inverse effects on the theta and gamma neural activities.
      ]. Attempts to better understand the mechanisms underlying DES neuromodulation are complicated by near infinite parameter possibilities as well as numerous hypotheses for why certain stimulation parameters are effective while others are not [
      • Perlmutter J.S.
      • Mink J.W.
      Deep brain stimulation.
      ,
      • Herrington T.M.
      • Cheng J.J.
      • Eskandar E.N.
      Mechanisms of deep brain stimulation.
      ,
      • Widge A.S.
      • Malone D.A.
      • Dougherty D.D.
      Closing the loop on deep brain stimulation for treatment-resistant depression.
      ,
      • Chiken S.
      • Nambu A.
      Mechanism of deep brain stimulation: inhibition, excitation, or disruption.
      ,
      • Solomon E.A.
      • Kragel J.E.
      • Gross R.
      • Lega B.
      • Sperling M.R.
      • Worrell G.
      • et al.
      Medial temporal lobe functional connectivity predicts stimulation-induced theta power.
      ,
      • Rolston J.D.
      • Desal S.A.
      • Laxpati N.G.
      • Gross R.E.
      Electrical stimulation for epilepsy: experimental approaches.
      ,
      • Bourne S.K.
      • Eckhardt C.A.
      • Sheth S.A.
      Mechanisms of deep brain stimulation for obsessive compulsive disorder: effects upon cells and circuits.
      ,
      • Mcintyre C.C.
      • Foutz T.J.
      Computational modeling of deep brain stimulation.
      ,
      • Caldwell D.J.
      • Ojemann J.G.
      • Rao R.P.N.
      Direct electrical stimulation in electrocorticographic brain-computer interfaces: enabling technologies for input to cortex.
      ,
      • Eisinger R.S.
      • Cernera S.
      • Gittis A.
      • Gunduz A.
      • Okun M.S.
      A review of basal ganglia circuits and physiology: application to deep brain stimulation.
      ]. Adding to this challenge is that there are only a handful of studies that systematically examine the intracranial neurophysiological effects of invasive brain stimulation in humans [
      • Basu I.
      • Robertson M.M.
      • Crocker B.
      • Peled N.
      • Farnes K.
      • Vallejo-Lopez D.I.
      • et al.
      Consistent linear and non-linear responses to electrical brain stimulation across individuals and primate species.
      ,
      • Mohan U.R.
      • Watrous A.J.
      • Miller J.F.
      • Lega B.C.
      • Sperling M.R.
      • Worrell G.A.
      • et al.
      The effects of direct brain stimulation in humans depend on frequency, amplitude, and white-matter proximity.
      ,
      • Rizzone M.
      • Lanotte M.
      • Bergamasco B.
      • Tavella A.
      • Torre E.
      • Faccani G.
      • et al.
      Deep brain stimulation of the subthalamic nucleus in Parkinson's disease : effects of variation in stimulation parameters.
      ,
      • Anderson C.J.
      • Anderson D.N.
      • Pulst S.M.
      • Butson C.R.
      • Dorval A.D.
      Neural selectivity, efficiency, and dose equivalence in deep brain stimulation through pulse width tuning and segmented electrodes.
      ,
      • Lech M.
      • Berry B.
      • Topcu C.
      • Kremen V.
      • Nejedly P.
      • Lega B.
      • et al.
      Direct electrical stimulation of the human brain has inverse effects on the theta and gamma neural activities.
      ,
      • Boëx C.
      • Vulliémoz S.
      • Spinelli L.
      • Pollo C.
      • Seeck M.
      High and low frequency electrical stimulation in non-lesional temporal lobe epilepsy.
      ,
      • Brocker D.T.
      • Grill W.M.
      ,
      • Meador K.J.
      • Kapur R.
      • Loring D.W.
      • Kanner A.M.
      • Morrell M.J.
      Quality of life and mood in patients with medically intractable epilepsy treated with targeted responsive neurostimulation.
      ,
      • Donos C.
      • Mîndruţă I.
      • Ciurea J.
      • Mălîia M.D.
      • Barborica A.
      A comparative study of the effects of pulse parameters for intracranial direct electrical stimulation in epilepsy.
      ,
      • Muller L.
      • Rolston J.D.
      • Fox N.P.
      • Knowlton R.
      • Rao V.R.
      • Chang E.F.
      Direct electrical stimulation of human cortex evokes high gamma activity that predicts conscious somatosensory perception.
      ,
      • Miller K.J.
      • Müller K.R.
      • Hermes D.
      Basis profile curve identification to understand electrical stimulation effects in human brain networks.
      ]. Not fully understanding the input-output relationships between DES and human cortical responses makes it difficult to predict which parameters, if adjusted properly, will optimize therapeutic effects.
      A growing body of literature, however, has revealed consistent relationships between some stimulation parameters and neural responses across individuals [
      • Basu I.
      • Robertson M.M.
      • Crocker B.
      • Peled N.
      • Farnes K.
      • Vallejo-Lopez D.I.
      • et al.
      Consistent linear and non-linear responses to electrical brain stimulation across individuals and primate species.
      ,
      • Mohan U.R.
      • Watrous A.J.
      • Miller J.F.
      • Lega B.C.
      • Sperling M.R.
      • Worrell G.A.
      • et al.
      The effects of direct brain stimulation in humans depend on frequency, amplitude, and white-matter proximity.
      ,
      • Rizzone M.
      • Lanotte M.
      • Bergamasco B.
      • Tavella A.
      • Torre E.
      • Faccani G.
      • et al.
      Deep brain stimulation of the subthalamic nucleus in Parkinson's disease : effects of variation in stimulation parameters.
      ,
      • Anderson C.J.
      • Anderson D.N.
      • Pulst S.M.
      • Butson C.R.
      • Dorval A.D.
      Neural selectivity, efficiency, and dose equivalence in deep brain stimulation through pulse width tuning and segmented electrodes.
      ,
      • Lech M.
      • Berry B.
      • Topcu C.
      • Kremen V.
      • Nejedly P.
      • Lega B.
      • et al.
      Direct electrical stimulation of the human brain has inverse effects on the theta and gamma neural activities.
      ,
      • Boëx C.
      • Vulliémoz S.
      • Spinelli L.
      • Pollo C.
      • Seeck M.
      High and low frequency electrical stimulation in non-lesional temporal lobe epilepsy.
      ,
      • Trebaul L.
      • Deman P.
      • Tuyisenge V.
      • Jedynak M.
      • Hugues E.
      • Rudrauf D.
      • et al.
      Probabilistic functional tractography of the human cortex revisited.
      ], suggesting that there may be a conserved topographical specificity for how the human brain responds to different stimulation parameters. This concept is best reflected in isolated single pulse electrical stimulation (SPES, via macro-electrodes) where local cortico-cortico evoked potentials (CCEPs) usually show consistent waveforms divisible into N1 and N2 voltage peaks [
      • Crocker B.
      • Ostrowski L.
      • Williams Z.M.
      • Dougherty D.D.
      • Eskandar E.N.
      • Widge A.S.
      • et al.
      Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
      ,
      • Trebaul L.
      • Deman P.
      • Tuyisenge V.
      • Jedynak M.
      • Hugues E.
      • Rudrauf D.
      • et al.
      Probabilistic functional tractography of the human cortex revisited.
      ,
      • Klooster M.A.
      • van ’T
      • Zijlmans M.
      • Leijten F.S.S.
      • Ferrier C.H.
      • Van Putten M.J.A.M.
      • Huiskamp G.J.M.
      Time-frequency analysis of single pulse electrical stimulation to assist delineation of epileptogenic cortex.
      ,
      • Matsuzaki N.
      • Juhász C.
      • Asano E.
      Cortico-cortical evoked potentials and stimulation-elicited gamma activity preferentially propagate from lower- to higher-order visual areas.
      ,
      • Keller C.J.
      • Honey C.J.
      • Mégevand P.
      • Entz L.
      • Ulbert I.
      • Mehta A.D.
      Mapping human brain networks with cortico-cortical evoked potentials.
      ,
      • Trebaul L.
      • Rudrauf D.
      • Job A.S.
      • Mălîia M.D.
      • Popa I.
      • Barborica A.
      • et al.
      Stimulation artifact correction method for estimation of early cortico-cortical evoked potentials.
      ,
      • Matsumoto R.
      • Kunieda T.
      • Nair D.
      Single pulse electrical stimulation to probe functional and pathological connectivity in epilepsy.
      ,
      • Yukihiro Y.
      • Kengo S.
      • Takeharu K.
      • Riki M.
      • Yoshiki A.
      • Takuro N.
      • et al.
      Clinical impact of intraoperative CCEP monitoring in evaluating the dorsal language white matter pathway.
      ]. In addition, SPES have been extensively used to map brain connectivity including the effect of pathologies, such as epilepsy [
      • Matsumoto R.
      • Kunieda T.
      • Nair D.
      Single pulse electrical stimulation to probe functional and pathological connectivity in epilepsy.
      ,
      • Boulogne S.
      • Ryvlin P.
      • Rheims S.
      Single and paired-pulse electrical stimulation during invasive EEG recordings.
      ]. Various parameters affect the CCEP size and shape [
      • Crocker B.
      • Ostrowski L.
      • Williams Z.M.
      • Dougherty D.D.
      • Eskandar E.N.
      • Widge A.S.
      • et al.
      Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
      ,
      • Trebaul L.
      • Deman P.
      • Tuyisenge V.
      • Jedynak M.
      • Hugues E.
      • Rudrauf D.
      • et al.
      Probabilistic functional tractography of the human cortex revisited.
      ,
      • Klooster M.A.
      • van ’T
      • Zijlmans M.
      • Leijten F.S.S.
      • Ferrier C.H.
      • Van Putten M.J.A.M.
      • Huiskamp G.J.M.
      Time-frequency analysis of single pulse electrical stimulation to assist delineation of epileptogenic cortex.
      ,
      • Matsuzaki N.
      • Juhász C.
      • Asano E.
      Cortico-cortical evoked potentials and stimulation-elicited gamma activity preferentially propagate from lower- to higher-order visual areas.
      ,
      • Keller C.J.
      • Honey C.J.
      • Mégevand P.
      • Entz L.
      • Ulbert I.
      • Mehta A.D.
      Mapping human brain networks with cortico-cortical evoked potentials.
      ,
      • Trebaul L.
      • Rudrauf D.
      • Job A.S.
      • Mălîia M.D.
      • Popa I.
      • Barborica A.
      • et al.
      Stimulation artifact correction method for estimation of early cortico-cortical evoked potentials.
      ,
      • Matsumoto R.
      • Kunieda T.
      • Nair D.
      Single pulse electrical stimulation to probe functional and pathological connectivity in epilepsy.
      ,
      • Yukihiro Y.
      • Kengo S.
      • Takeharu K.
      • Riki M.
      • Yoshiki A.
      • Takuro N.
      • et al.
      Clinical impact of intraoperative CCEP monitoring in evaluating the dorsal language white matter pathway.
      ].
      Despite the importance of SPES, there is little work systematically exploring the relationship between input parameters and physiological output. For instance, there is little information on the impact of stimulus duration on CCEP. Pulse width, or duration, has been shown to have an effect in mouse models as well as a possible clinical effects in Parkinson's Disease [
      • Rizzone M.
      • Lanotte M.
      • Bergamasco B.
      • Tavella A.
      • Torre E.
      • Faccani G.
      • et al.
      Deep brain stimulation of the subthalamic nucleus in Parkinson's disease : effects of variation in stimulation parameters.
      ,
      • Anderson C.J.
      • Anderson D.N.
      • Pulst S.M.
      • Butson C.R.
      • Dorval A.D.
      Neural selectivity, efficiency, and dose equivalence in deep brain stimulation through pulse width tuning and segmented electrodes.
      ,
      • Schor J.S.
      • Nelson A.B.
      Multiple stimulation parameters influence efficacy of deep brain stimulation in parkinsonian mice.
      ,
      • Patel B.
      • Chiu S.
      • Wong J.K.
      • Patterson A.
      • Burns M.
      • Zeilman P.
      • et al.
      Deep brain stimulation programming strategies: segmented leads, independent current sources and future technology.
      ]. However, with SPES, pulse width ranges from 0.3 to 3000 ms have been reported, using both monophasic and biphasic stimulation, with few consistencies across studies in the field [
      • Donos C.
      • Mîndruţă I.
      • Ciurea J.
      • Mălîia M.D.
      • Barborica A.
      A comparative study of the effects of pulse parameters for intracranial direct electrical stimulation in epilepsy.
      ,
      • Trebaul L.
      • Deman P.
      • Tuyisenge V.
      • Jedynak M.
      • Hugues E.
      • Rudrauf D.
      • et al.
      Probabilistic functional tractography of the human cortex revisited.
      ,
      • Matsumoto R.
      • Kunieda T.
      • Nair D.
      Single pulse electrical stimulation to probe functional and pathological connectivity in epilepsy.
      ,
      • Kuneida T.
      • Yamao Y.
      • Kikuchi T.
      • Matsumoto R.
      New approach for exploring cerebral functional connectivity: review of cortico-cortical evoked potential.
      ]. Therefore, there remains a need to use the same stimulation parameters and approach to identify the relationships between responses and SPES pulse width duration parameters. Our expectation is that increasing duration will induce larger and more widespread stimulation responses.
      Similarly, little is known about how the amplitude of injected current sculpts the shape of the voltage response. With trains of stimulation (which include multiple single pulses), injected current has been shown to have a linear relationship with behavioral and physiological responses [
      • Basu I.
      • Robertson M.M.
      • Crocker B.
      • Peled N.
      • Farnes K.
      • Vallejo-Lopez D.I.
      • et al.
      Consistent linear and non-linear responses to electrical brain stimulation across individuals and primate species.
      ,
      • Yih J.
      • Beam D.E.
      • Fox K.C.R.
      • Parvizi J.
      Intensity of affective experience is modulated by magnitude of intracranial electrical stimulation in human orbitofrontal, cingulate and insular cortices.
      ]. Therefore, we hypothesize that there would be a linear relationship between SPES responses and current amplitude.
      Stimulation location effects on responses is expected to be more complex, as DES location can be relative to the ‘microarchitecture’ (e.g., cortical layer or nearness to the closest white matter tract) or ‘macroarchitecture’ (e.g., location relative to other brain regions or white matter bundles reaching those regions). Stimulation location, not surprisingly, has a substantial impact on both behavioral and physiological responses with differing clinical outcomes [
      • Mankin E.A.
      • Fried I.
      Modulation of human memory by deep brain stimulation of the entorhinal-hippocampal circuitry.
      ,
      • Mohan U.R.
      • Watrous A.J.
      • Miller J.F.
      • Lega B.C.
      • Sperling M.R.
      • Worrell G.A.
      • et al.
      The effects of direct brain stimulation in humans depend on frequency, amplitude, and white-matter proximity.
      ,
      • Brocker D.T.
      • Grill W.M.
      ,
      • Trebaul L.
      • Deman P.
      • Tuyisenge V.
      • Jedynak M.
      • Hugues E.
      • Rudrauf D.
      • et al.
      Probabilistic functional tractography of the human cortex revisited.
      ,
      • Stoney S.D.
      • Thompson W.D.
      • Asanuma H.
      Excitation of pyramidal tract cells by intracortical microstimulation: effective extent of stimulating current.
      ,
      • Gunalan K.
      • Howell B.
      • McIntyre C.C.
      Quantifying axonal responses in patient-specific models of subthalamic deep brain stimulation.
      ,
      • Anderson D.N.
      • Duffley G.
      • Vorwerk J.
      • Dorval A.D.
      • Butson C.R.
      Anodic stimulation misunderstood: preferential activation of fiber orientations with anodic waveforms in deep brain stimulation.
      ,
      • Stiso J.
      • Khambhati A.N.
      • Menara T.
      • Kahn A.E.
      • Stein J.M.
      • Das S.R.
      • et al.
      White matter network architecture guides direct electrical stimulation through optimal state transitions.
      ]. The most therapeutically effective DES, whether inducing very focal or more widespread neural responses or engagement of the network to induce different states, is thought to generally engage white matter tracts [
      • Crocker B.
      • Ostrowski L.
      • Williams Z.M.
      • Dougherty D.D.
      • Eskandar E.N.
      • Widge A.S.
      • et al.
      Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
      ,
      • Stiso J.
      • Khambhati A.N.
      • Menara T.
      • Kahn A.E.
      • Stein J.M.
      • Das S.R.
      • et al.
      White matter network architecture guides direct electrical stimulation through optimal state transitions.
      ], which has been supported by a recent study relating stimulation effects to white matter proximity [
      • Mohan U.R.
      • Watrous A.J.
      • Miller J.F.
      • Lega B.C.
      • Sperling M.R.
      • Worrell G.A.
      • et al.
      The effects of direct brain stimulation in humans depend on frequency, amplitude, and white-matter proximity.
      ,
      • Solomon E.A.
      • Kragel J.E.
      • Gross R.
      • Lega B.
      • Sperling M.R.
      • Worrell G.
      • et al.
      Medial temporal lobe functional connectivity predicts stimulation-induced theta power.
      ]. Indeed, some experiments and modeling studies of electrode location, spacing, and orientation relative to subcortical regions and white matter tracts have suggested it is possible to map, and plan, deep brain stimulation (DBS) approaches to subcortical stimulation that predict optimal therapeutic effects [
      • Herrington T.M.
      • Cheng J.J.
      • Eskandar E.N.
      Mechanisms of deep brain stimulation.
      ,
      • Rizzone M.
      • Lanotte M.
      • Bergamasco B.
      • Tavella A.
      • Torre E.
      • Faccani G.
      • et al.
      Deep brain stimulation of the subthalamic nucleus in Parkinson's disease : effects of variation in stimulation parameters.
      ,
      • Mahlknecht P.
      • Limousin P.
      • Foltynie T.
      Deep brain stimulation for movement disorders: update on recent discoveries and outlook on future developments.
      ,
      • Riva-Posse P.
      • Choi K.S.
      • Holtzheimer P.E.
      • Crowell A.L.
      • Garlow S.J.
      • Rajendra J.K.
      • et al.
      A connectomic approach for subcallosal cingulate deep brain stimulation surgery: prospective targeting in treatment-resistant depression.
      ]. But parallel information for cortical structures is lacking.
      Further, there is an effect of distance from the stimulation site that must be taken into account. Responses close to the site of stimulation are quite different from ones further away and their dependence on parameters may differ as well. For example, local stimulation responses appear to reflect functional connectivity while distant stimulation responses may better reflect structural (white matter tract) connectivity [
      • Crocker B.
      • Ostrowski L.
      • Williams Z.M.
      • Dougherty D.D.
      • Eskandar E.N.
      • Widge A.S.
      • et al.
      Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
      ].
      Based on this existing literature, we hypothesized that: 1) increasing waveform single duration (pulse width) engages more of the distant brain network; 2) SPES responses linearly vary with injected current locally and distally; 3) SPES responses increase linearly with stimulation closer to white matter (moving away from grey matter) with increasing angular orientation to the cortical column linearly increasing SPES responses; 4) these relationships between stimulation parameters and both local and distance neural responses depend on the brain region stimulated. To test these hypotheses, we sampled the neural responses to intracranial SPES via macroelectrodes across a population of 52 patients with intractable epilepsy implanted with intracranial leads in the process of monitoring for seizure foci across 719 stimulation sites. Focusing on the bipolar, charge-balanced stimulation between neighboring macroelectrodes used in numerous studies [
      • Basu I.
      • Robertson M.M.
      • Crocker B.
      • Peled N.
      • Farnes K.
      • Vallejo-Lopez D.I.
      • et al.
      Consistent linear and non-linear responses to electrical brain stimulation across individuals and primate species.
      ,
      • Trebaul L.
      • Deman P.
      • Tuyisenge V.
      • Jedynak M.
      • Hugues E.
      • Rudrauf D.
      • et al.
      Probabilistic functional tractography of the human cortex revisited.
      ,
      • Keller C.J.
      • Honey C.J.
      • Mégevand P.
      • Entz L.
      • Ulbert I.
      • Mehta A.D.
      Mapping human brain networks with cortico-cortical evoked potentials.
      ,
      • Matsumoto R.
      • Kunieda T.
      • Nair D.
      Single pulse electrical stimulation to probe functional and pathological connectivity in epilepsy.
      ,
      • Matsumoto R.
      • Nair D.R.
      • LaPresto E.
      • Najm I.
      • Bingaman W.
      • Shibasaki H.
      • et al.
      Functional connectivity in the human language system: a cortico-cortical evoked potential study.
      ,
      • Matsumoto R.
      • Nair D.R.
      • LaPresto E.
      • Bingaman W.
      • Shibasaki H.
      • Lüders H.O.
      Functional connectivity in human cortical motor system: a cortico-cortical evoked potential study.
      ,
      • Keller C.J.
      • Honey C.J.
      • Entz L.
      • Bickel S.
      • Groppe D.M.
      • Toth E.
      • et al.
      Corticocortical evoked potentials reveal projectors and integrators in human brain networks.
      ], we examined neural responses to stimulation across >6500 bipolar recording sites.

      2. Materials and methods

      2.1 Human participants and recordings

      We recorded intracranial neural activity from 52 participants with intractable epilepsy undergoing invasive monitoring. A subset of the data from the single pulse electrical stimulation data were used in a previous publication (N = 11) [
      • Crocker B.
      • Ostrowski L.
      • Williams Z.M.
      • Dougherty D.D.
      • Eskandar E.N.
      • Widge A.S.
      • et al.
      Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
      ]. Participants underwent stereo-electroencephalography (sEEG) (n = 52), with implantation of multi-contact depth electrodes, and a subset (n = 3) implanted with either grid or strip electrodes (a.k.a. ECoG) to locate epileptogenic tissue in relation to essential cortex (Supplemental Table 1). Data with stimulation via the grid or strip electrodes were not included in the analyses here though we did examine the recordings from the sEEG and ECoG electrodes during sEEG stimulation. Depth electrodes (Ad-tech Medical, Racine WI, USA, or PMT, Chanhassen, MN, USA) with diameters 0.8–1.27 mm and 4–16 platinum/iridium-contacts 1–2.4 mm long with inter-contact spacing ranging from 4 to 10 mm (median 5 mm) were placed stereotactically, based on the clinical indications for seizure localization determined by a multidisciplinary clinical team independent of this research. Following implant, the preoperative T1-weighted MRI was aligned with a postoperative CT using volumetric image coregistration procedures and FreeSurfer scripts ([
      • Reuter M.
      • Rosas H.D.
      • Fischl B.
      Highly accurate inverse consistent registration: a robust approach.
      ,
      • Reuter M.
      • Schmansky N.J.
      • Rosas H.D.
      • Fischl B.
      Within-subject template estimation for unbiased longitudinal image analysis.
      ,
      • Reuter M.
      • Fischl B.
      Avoiding asymmetry-induced bias in longitudinal image processing.
      ,
      • Dykstra A.R.
      • Chan A.M.
      • Quinn B.T.
      • Zepeda R.
      • Keller C.J.
      • Cormier J.
      • et al.
      Individualized localization and cortical surface-based registration of intracranial electrodes.
      ]; http://surfer.nmr.mgh.harvard.edu). Electrode coordinates were manually determined from the CT in the patients’ native space [
      • Dykstra A.R.
      • Chan A.M.
      • Quinn B.T.
      • Zepeda R.
      • Keller C.J.
      • Cormier J.
      • et al.
      Individualized localization and cortical surface-based registration of intracranial electrodes.
      ] and mapped using an electrode labeling algorithm (ELA; [
      • Felsenstein O.
      • Peled N.
      • Hahn E.
      • Rockhill A.P.
      • Folsom L.
      • Gholipour T.
      • et al.
      Multi-modal neuroimaging analysis and visualization tool (MMVT).
      ,
      • Peled N.
      • Gholipour T.
      • Paulk A.C.
      • Felsenstein O.
      • Dougherty D.D.
      • Widge A.S.
      • et al.
      Invasive electrodes identification and labeling.
      ]) that registered each contact to a standardized cortical map [
      • Desikan R.S.
      • Ségonne F.
      • Fischl B.
      • Quinn B.T.
      • Dickerson B.C.
      • Blacker D.
      • et al.
      An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest.
      ].
      Participants received their normal antiepileptic medications prior to stimulation testing to minimize the risk of seizure. Recordings used a Blackrock system with a sampling rate of 2 kHz (Blackrock Microsystems, Salt Lake City, UT, USA). Depth recordings were referenced to an EEG electrode placed on skin (C2 vertebra or Cz), a chest EEG lead contact, or via an internal ground.

      3. Ethics statement

      All patients voluntarily participated after fully informed consent as monitored by the Partners Institutional Review Board covering Brigham and Women's Hospital (BWH) and Massachusetts General Hospital (MGH). Participants were informed that participation in the stimulation tests would not alter their clinical treatment in any way, and that they could withdraw at any time without jeopardizing their clinical care.

      3.1 Neural stimulation

      Stimulation was delivered with a CereStim stimulator (Blackrock Microsystems, Salt Lake City, UT) using single pulse electrical stimulation (SPES). Current injection and return paths used neighboring contacts in a bipolar configuration [
      • Brocker D.T.
      • Grill W.M.
      ]. Stimulation was controlled via a custom Cerestim API via MATLAB or a custom C++ code (https://github.com/Center-For-Neurotechnology/CereLAB). Waveforms of two different durations were used: 1) 233 μs duration: 90 μs charge-balanced biphasic symmetrical pulses with an interphase interval of 53 μsec with between 5 and 100 trials with a median of 20 trials per stimulation site (mean number of trials: 18.9 ± 12.21 per stimulation site; mean number of trials 29.5 ± 25.81 average per participant, median 20 trials per participant) [
      • Crocker B.
      • Ostrowski L.
      • Williams Z.M.
      • Dougherty D.D.
      • Eskandar E.N.
      • Widge A.S.
      • et al.
      Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
      ,
      • Matsumoto R.
      • Nair D.R.
      • LaPresto E.
      • Najm I.
      • Bingaman W.
      • Shibasaki H.
      • et al.
      Functional connectivity in the human language system: a cortico-cortical evoked potential study.
      ,
      • Matsumoto R.
      • Nair D.R.
      • LaPresto E.
      • Bingaman W.
      • Shibasaki H.
      • Lüders H.O.
      Functional connectivity in human cortical motor system: a cortico-cortical evoked potential study.
      ], and 2) 1053 μs (∼1 msec) duration: 500 μs charge-balanced biphasic symmetrical pulses with an interphase interval of 53 μsec with between 10 and 26 trials per stimulation site with a median of 10 trials per site (mean number of trials: 10.4 ± 3.49 across N = 10 participants) [
      • Matsumoto R.
      • Kunieda T.
      • Nair D.
      Single pulse electrical stimulation to probe functional and pathological connectivity in epilepsy.
      ,
      • Valentin A.
      • Anderson M.
      • Alarcon G.
      • Garcia Seoane J.J.
      • Selway R.
      • Binnie C.D.
      • et al.
      Responses to single pulse electrical stimulation identify epileptogenesis in the human brain in vivo.
      ,
      • David O.
      • Job A.S.
      • De Palma L.
      • Hoffmann D.
      • Minotti L.
      • Kahane P.
      Probabilistic functional tractography of the human cortex.
      ,
      • Rosenberg D.S.
      • Mauguière F.
      • Catenoix H.
      • Faillenot I.
      • Magnin M.
      Reciprocal thalamocortical connectivity of the medial pulvinar: a depth stimulation and evoked potential study in human brain.
      ]. The interval at 53 ms was required as a hardware-limited minimum interval between square pulses with the CereStim stimulator. Multiple current amplitudes were applied with the short duration (233 μsec) bipolar stimulation at the following steps: 0.5 mA–10 mA at 0.5 mA steps with a minimum of 10 trials per stimulation site (mean number of trials: 14.7 ± 5.64, with some instances with high trial counts which therefore skew the standard deviation value). The two durations were tested in ten participants and current amplitudes were tested in eleven participants with only three participants who underwent both current and multiple duration testing in different stimulation blocks. Further, there was overlap of participants who underwent multiple sampling of different currents and durations and those who were in the larger group (N = 52) who underwent blocks of 7 mA, 233 μsec stimulation at multiple sites in the brain (Supplemental Table 1). A trained electroencephalographer examined ongoing recordings for epileptiform activity and asked participants if they experienced any sensations. The participants were awake and were aware that they were being stimulated but were blind to the stimulation timing and parameters.
      Electrode locations for stimulation were chosen to avoid known areas of seizure onsets as judged by the participants’ clinicians. We also avoided stimulation in sites which were in or near the corpus callosum as well as sites which were too medial in the cingulate to avoid potential discomfort from direct stimulation of the dura.

      3.2 Stimulation location and electrode measures

      For identification of electrode location relative to grey and white matter, we measured the orthogonal Euclidean distance from the center of each bipolar pair of electrodes to the nearest reconstructed vertex of the pial and white matter surfaces generated from FreeSurfer tools following colocalization [
      • Reuter M.
      • Rosas H.D.
      • Fischl B.
      Highly accurate inverse consistent registration: a robust approach.
      ,
      • Reuter M.
      • Schmansky N.J.
      • Rosas H.D.
      • Fischl B.
      Within-subject template estimation for unbiased longitudinal image analysis.
      ,
      • Reuter M.
      • Fischl B.
      Avoiding asymmetry-induced bias in longitudinal image processing.
      ,
      • Dykstra A.R.
      • Chan A.M.
      • Quinn B.T.
      • Zepeda R.
      • Keller C.J.
      • Cormier J.
      • et al.
      Individualized localization and cortical surface-based registration of intracranial electrodes.
      ]. As the depth electrode can curve during implantation, the Euclidean distance between contacts can change. Therefore, bipolar stimulation pair distances between each contact were re-calculated using Euclidean measures to compensate for the depth electrode curving or bending slightly when implanted. The orientation (angle) of the bipolar pair of electrodes relative to the cortical column was calculated by first detecting the nearest grey-white junction (boundary) and outer surface (pial) points to the center of the bipolar stimulation pair. A line perpendicular to the tangent was calculated from the base (edge of layer 6) and the outer axis of the cortex (pial, outer edge of layer 1) which formed the cortical column pole. Then, the angle between the two poles (the cortical column and the bipolar pair) was calculated using the dot product of the two line segments. We also categorized stimulation sites as in the grey matter, subcortical regions, white matter, and pial surface by identifying the colocalized stimulation location if the location was within the grey matter volume, the white matter volume, and the reconstructed subcortical volumes in the participants’ native space [
      • Reuter M.
      • Rosas H.D.
      • Fischl B.
      Highly accurate inverse consistent registration: a robust approach.
      ,
      • Reuter M.
      • Schmansky N.J.
      • Rosas H.D.
      • Fischl B.
      Within-subject template estimation for unbiased longitudinal image analysis.
      ,
      • Reuter M.
      • Fischl B.
      Avoiding asymmetry-induced bias in longitudinal image processing.
      ,
      • Dykstra A.R.
      • Chan A.M.
      • Quinn B.T.
      • Zepeda R.
      • Keller C.J.
      • Cormier J.
      • et al.
      Individualized localization and cortical surface-based registration of intracranial electrodes.
      ]. The classification of the stimulation sites relative to the surfaces was done using the MATLAB inpolyhedron function ([
      • Sven
      Inpolyhedron - are points inside a triangulated volume? n.d.
      ], MATLAB 2020b). In addition, we used the MATLAB functions alphaShape and inshape to identify electrodes on the pial surface but not within the cortex.

      3.3 Data analysis

      Data analysis was performed using custom analysis code in MATLAB and Fieldtrip (http://www.ru.nl/neuroimaging/fieldtrip; [
      • Oostenveld R.
      • Fries P.
      • Maris E.
      • Schoffelen J.-M.
      FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data.
      ]). Channels with excessive line noise or without clear neural signal (determined by visual inspection) were removed from the analysis. In addition, we removed pathological channels with interictal discharges (IIDs) using an automatic IID detection algorithm ([
      • Janca R.
      • Jezdik P.
      • Cmejla R.
      • Tomasek M.
      • Worrell G.A.
      • Stead M.
      • et al.
      Detection of interictal epileptiform discharges using signal envelope distribution modelling: application to epileptic and non-epileptic intracranial recordings.
      ], version v21, default settings except -h at 60; http://isarg.fel.cvut.cz). We removed from analyses channels which had detected IIDs greater than 6.5 IIDs/minute (which is above the algorithm's false positive rate). These checks resulted in removing a mean = 8.25 ± 11.411 channels per participant. The remaining electrodes were subsequently demeaned and bipolar re-referenced relative to nearest neighbors to account for volume conduction [
      • Bastos A.M.
      • Schoffelen J.-M.
      A tutorial review of functional connectivity analysis methods and their interpretational pitfalls.
      ,
      • Mercier M.R.
      • Bickel S.
      • Megevand P.
      • Groppe D.M.
      • Schroeder C.E.
      • Mehta A.D.
      • et al.
      Evaluation of cortical local field potential diffusion in stereotactic electro-encephalography recordings: a glimpse on white matter signal.
      ]. Stimulation artifact was removed in the 20 ms around the onset of the pulse for the single pulses using a Tukey-windowed median filter [
      • Chang J.Y.
      • Pigorini A.
      • Massimini M.
      • Tononi G.
      • Nobili L.
      • Van Veen B.D.
      Multivariate autoregressive models with exogenous inputs for intracerebral responses to direct electrical stimulation of the human brain.
      ].
      The CCEP, a type of event-related potential (ERP), was analyzed by extracting epochs from 1000 ms before stimulation onset to 3000 ms after offset. Voltages were normalized by z-scoring the voltage values using the baseline data segment per trial. The number of trials per condition ranged from 5 to 100 trials, median of 20 trials across conditions (conditions include either duration, current amplitude, or location). To remove trials that had spurious voltage deflections that could be due to acute spurious external events such as referential noise and were not just a voltage response relative to baseline, we rejected trials where the voltage exceeded 5 standard deviations from the average response of all trials per site (not the baseline) per channel and condition. The average number of trials removed across participants was 2.3 ± 1.17. The average ERP across the remaining trials per condition was then calculated and the following metrics were measured for the average ERP: i) normalized overall peak amplitude (the peak amplitude during the full second after stimulation), ii) area under the curve (sum of the absolute values of zscored data for 1 s after stimulation offset), iii) absolute value of the N1 peak (between 10 and 50 ms after stimulation), iv) and absolute value of the N2 peak (50–400 ms post-stimulation) [
      • Basu I.
      • Robertson M.M.
      • Crocker B.
      • Peled N.
      • Farnes K.
      • Vallejo-Lopez D.I.
      • et al.
      Consistent linear and non-linear responses to electrical brain stimulation across individuals and primate species.
      ,
      • Keller C.J.
      • Honey C.J.
      • Mégevand P.
      • Entz L.
      • Ulbert I.
      • Mehta A.D.
      Mapping human brain networks with cortico-cortical evoked potentials.
      ,
      • Matsumoto R.
      • Kunieda T.
      • Nair D.
      Single pulse electrical stimulation to probe functional and pathological connectivity in epilepsy.
      ]. We chose the 1 s following stimulation for the overall peak and AUC values as we performed preliminary analyses and found that the variance of the variation in voltage responses exceeded 5 standard deviations of the variance before stimulation for nearly 1 s after stimulation.
      We performed a preliminary analysis of the voltage responses relative to the distance to the stimulation site (Fig. 1). We found the relationship between responses and distance would drop off with an inflection around 15 mm. Based on this examination of the voltage amplitudes relative to distance, we used a data-driven cutoff where neural data were subdivided into local responses (<15 mm from the stimulation site) and distant (>15 mm from the stimulation site), to separate the waveform characteristics nearest to the stimulation site from propagated activity.
      Fig. 1
      Fig. 1Single pulse electrical stimulation (SPES) responses vary nonlinearly with stimulation distance. A. Locations of all SPES stimulation locations (n = 719) overlaid on the colin27 [
      • Aubert-Broche B.
      • Evans A.C.
      • Collins L.
      A new improved version of the realistic digital brain phantom.
      ,
      • Schilling K.G.
      • Rheault F.
      • Petit L.
      • Hansen C.B.
      • Nath V.
      • Yeh F.C.
      • et al.
      Tractography dissection variability: what happens when 42 groups dissect 14 white matter bundles on the same dataset?.
      ,
      • Holmes C.J.
      • Hoge R.
      • Collins L.
      • Woods R.
      • Toga A.W.
      • Evans A.C.
      Enhancement of MR images using registration for signal averaging.
      ] brain and divided into six different brain region categories, N = 52. Electrode locations are only approximate as shown here as the locations were not morphed to a common brain. B. Top: locations of the stimulating electrodes (red dots with a line) in coronal slices, with black dots indicating the pial surface and grey-white boundary. Left and right columns are lateral frontal cortex and middle is cingulate. Bottom: Average stimulation responses after bipolar re-referencing (20 trials) for each location in the same participant (HP35). Red lines indicate the relative location of the stimulating electrodes to the recording electrodes (in black lines). Blue lines indicate stimulation onset. C. Example of the measurements of the cortico-cortico evoked potential (CCEP) following SPES. D. Distance dependence for responses for the overall peak responses during the 1 s after stimulation, with color coding representing different participants (N = 52, n = 719 stimulation sites). The distances of the recording sites from stimulation were binned into 3.5 mm steps per stimulation site for the statistical comparisons. Left is the entire range up to 150 mm while the right focuses on 0–30 mm. Error bars are mean and S.D. of the distributions across participants; p-value based on Kruskal-Wallis test followed by a post hoc Tukey Kramer test. For C and D, y-axis units are normalized voltages relative to the baseline, in arbitrary units (a.u.). (For interpretation of the references to color in this figure legend, the reader is referred to the Web version of this article.)

      3.4 Statistical analysis

      For all statistical analyses, our primary goal was to test how stimulation parameters result in varying neural responses locally and at a distance from the stimulation site. We treated stimulation sites as independent samples and pooled recording electrode responses based on distance from the stimulation site at the per-stimulation site level. We tested comparisons across brain regions and stimulus parameters with the Kruskal–Wallis test for non-equivalence of multiple medians followed by post hoc Tukey-Kramer tests to determine statistically separable groups. A significant post stimulation response was identified as being significantly above or below baseline activity using Wilcoxon rank sum comparisons. Multi-way ANOVA was used to examine effects of different parameters on the neural responses to determine whether brain region and stimulation parameters have stronger effects on neural activity. We corrected for multiple comparisons at a target p-value (0.05) with a Bonferroni correction. For spatially resolved analyses, we applied a false discovery rate (FDR) correction to the p-value at each spatial step, identifying significance as that point where the FDR-corrected value was lower than the Bonferroni-corrected target (as there were four different measures).
      To detail the relationships between stimulation parameters (duration, current, location) and neural responses, we performed Pearson's linear correlation between the parameters and the responses (whether voltage measures). We also performed a series of model fits using generalized linear regression models (GLM), using the functions ‘fitglm’ (assuming a normal distribution and an identity linkage to generate the first through tenth order models to fit the data) and the function ‘predict’ to produce the fitted curves to the mean responses per stimulation site to the grey/white matter boundary location. To identify the relationship between the distance to the grey-white boundary and neural responses (AUC, overall peak, N1 peak, and N2 peak values) relative to the distance to the stimulation site, we fit the models to different distance thresholds distinguishing ‘local’ versus ‘distant’ recording sites at different distances from the stimulation site (e.g. 15–50 mm). We identified the best model fit as that one which had the lowest Aikake Information Criterion (AIC). We then used F-test to test whether the model was a better fit to the data compared to a model fit which only included a constant term (indicating there was no relationship between the variables). Every fitted line was to the data points which were averaged per stimulation site per condition, such that the recording sites were binned based on stimulation location and distance relative to the stimulation location.

      3.5 Data sharing statement

      Upon publication, we will be sharing deidentified stimulation data at the Data Archive BRAIN Initiative (DABI, https://dabi.loni.usc.edu/home).

      4. Results

      We performed direct electrical stimulation (DES) while recording from intracranial leads in patients with intractable epilepsy undergoing clinically indicated neural monitoring to delineate the seizure focus (N = 52; median age = 37, ranging from 18 to 67; 30 women). Only data from implanted stereoEEG (sEEG) depth electrodes were examined in this data set (Fig. 1). In the entire data set and in all stimulation sites, we only found behavioral reports of stimulation if the stimulation happened to be too close to the meninges or too mesial (near dura) when the patients would report some tingling at low current levels (2–4 mA), which only occurred 6 instances out of all stimulation sites. We stopped stimulation immediately at that location and did not include data inducing behavioral effects in these analyses. Otherwise, for high amplitude stimulation, we continued to ask the participants if they felt anything and they did not report any subjective effects. We never induced seizures with stimulation using single pulses. While other studies report they can induce epileptiform activity including after discharges with single pulses in other data sets [
      • Matsumoto R.
      • Kunieda T.
      • Nair D.
      Single pulse electrical stimulation to probe functional and pathological connectivity in epilepsy.
      ,
      • Valentin A.
      • Anderson M.
      • Alarcon G.
      • Garcia Seoane J.J.
      • Selway R.
      • Binnie C.D.
      • et al.
      Responses to single pulse electrical stimulation identify epileptogenesis in the human brain in vivo.
      ], we believe we did not because of the fact that we generally used shorter (233 microsec) duration single pulse stimulation at with longer inter-pulse intervals compared to 1 ms duration [
      • Parmigiani S.
      • Mikulan E.P.
      • Russo S.
      • Sarasso S.
      • Zauli F.M.
      • Rubino A.
      • et al.
      Simultaneous stereo-EEG and high-density scalp EEG recordings to study the effects of intracerebral stimulation parameters.
      ,
      • Mikulan E.
      • Russo S.
      • Parmigiani S.
      • Sarasso S.
      • Zauli F.M.
      • Rubino A.
      • et al.
      Simultaneous human intracerebral stimulation and HD-EEG, ground-truth for source localization methods.
      ].
      Brain region coverage of the total of 719 individual stimulation locations across participants was relatively widespread, with a concentration of stimulation sites in the medial temporal lobe and lateral frontal lobes; Fig. 1A; Supplemental Table 1). We examined neural responses to DES at different stimulation sites across >6500 bipolar re-referenced recording sites (termed channels; Fig. 1B). Distance between stimulation sites can have a nonlinear effect on responses [
      • Paff M.
      • Loh A.
      • Sarica C.
      • Lozano A.M.
      • Fasano A.
      Update on current technologies for deep brain stimulation in Parkinson's disease.
      ,
      • Anderson D.N.
      • Anderson C.
      • Lanka N.
      • Sharma R.
      • Butson C.R.
      • Baker B.W.
      • et al.
      The μDBS: multiresolution, directional deep brain stimulation for improved targeting of small diameter fibers.
      ,
      • Anderson D.N.
      • Osting B.
      • Vorwerk J.
      • Dorval A.D.
      • Butson C.R.
      Optimized programming algorithm for cylindrical and directional deep brain stimulation electrodes.
      ], but, in this data set, across the stimulation sites, we found the distribution of inter-contact distances between the stimulating pairs of electrodes peaked at 3 mm with very few additional distances (mean and STD: 3.61 ± 0.653; median = 3.54; Supplemental Fig. 1). As such, we pooled the stimulation sites across inter-contact distances. We subdivided the stimulation sites into six main regions: lateral frontal lobes (includes the lateral frontal cortex and insula), cingulate cortex, lateral temporal lobe (including the lateral middle, superior, and inferior gyri), parietal lobe, subcortical areas (which includes the hippocampus, amygdala, caudate, and putamen), and occipital lobe (Fig. 1A; Supplemental Fig. 1). The SPES responses were measured as average absolute peak (the overall peak), area under the curve (AUC), N1 peak, and N2 peak (Fig. 1C).
      One attribute that must be considered is the fundamental difference in local versus distant responses [
      • Crocker B.
      • Ostrowski L.
      • Williams Z.M.
      • Dougherty D.D.
      • Eskandar E.N.
      • Widge A.S.
      • et al.
      Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
      ]. In particular, there can be substantial differences in response spatial extent from stimulating electrodes at different sites (Fig. 1B; Supplemental Fig. 2; HP35). Therefore, we performed a preliminary analysis of the distance between the recording and the stimulating electrodes across the data set. We found a significant difference in the responses between recording sites <21 mm and sites >35 mm away from the stimulation site with an inflection point around 15 mm, whether the contacts were along the same depth electrode or not (p < 0.00001; Kruskal-Wallis test; overall peak: Chi-Sq = 1800.32; N = 52; Fig. 1D; Supplemental Figs. 3 and 4). Hypothesizing that local and distant responses could indicate different rules for stimulation parameters, as suggested in past studies [
      • Mohan U.R.
      • Watrous A.J.
      • Miller J.F.
      • Lega B.C.
      • Sperling M.R.
      • Worrell G.A.
      • et al.
      The effects of direct brain stimulation in humans depend on frequency, amplitude, and white-matter proximity.
      ,
      • Crocker B.
      • Ostrowski L.
      • Williams Z.M.
      • Dougherty D.D.
      • Eskandar E.N.
      • Widge A.S.
      • et al.
      Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
      ,
      • Keller C.J.
      • Honey C.J.
      • Mégevand P.
      • Entz L.
      • Ulbert I.
      • Mehta A.D.
      Mapping human brain networks with cortico-cortical evoked potentials.
      ,
      • Keller C.J.
      • Honey C.J.
      • Entz L.
      • Bickel S.
      • Groppe D.M.
      • Toth E.
      • et al.
      Corticocortical evoked potentials reveal projectors and integrators in human brain networks.
      ,
      • Miocinovic S.
      • de Hemptinne C.
      • Chen W.
      • Isbaine F.
      • Willie J.T.
      • Ostrem J.L.
      • et al.
      Cortical potentials evoked by subthalamic stimulation demonstrate a short latency hyperdirect pathway in humans.
      ,
      • Milosevic L.
      • Kalia S.K.
      • Hodaie M.
      • Lozano A.M.
      • Popovic M.R.
      • Hutchison W.D.
      • et al.
      A theoretical framework for the site-specific and frequency-dependent neuronal effects of deep brain stimulation.
      ], we used this data-driven boundary to subdivide the responses into local and distant recording sites to address four main hypotheses: 1) increasing waveform duration engages more of the distant responses; 2) SPES responses linearly vary with injected current locally and distally; 3) stimulating electrode orientation (angle) and distance relative to white and grey matter varies linearly with local and distant responses to the stimulation; 4) these relationships between stimulation parameters and both local and distance neural responses depend on the brain region stimulated. We also examined these questions relative to a continuous measure of distance.

      4.1 Stimulation duration has a stronger effect on local sites

      We applied SPES at two different durations at multiple stimulation sites in a subset of participants: 233 μsec and 1 ms (N = 10, 9.3 ± 5.14 sites per participant). With the increase of duration, local (<15 mm) and distant (>15 mm) responses were significantly increased as measured by the overall peak, the AUC, the N1 peak, and the N2 peak (p < 0.00005; Wilcoxon rank sum test; N = 10; n = 102 stimulation sites; n = 1273 recording sites; d.f. = 101; Fig. 2A–D). Examining multiple points away from the stimulation site, the difference between the shorter and longer durations diminished, to the point that there was no difference between durations at distant sites (Supplemental Fig. 3B). This was likely due to the fact that there was little to no response past a certain distance from the stimulation site [
      • Crocker B.
      • Ostrowski L.
      • Williams Z.M.
      • Dougherty D.D.
      • Eskandar E.N.
      • Widge A.S.
      • et al.
      Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
      ].
      Fig. 2
      Fig. 2Responses vary nonlinearly with current, stimulation duration and recording site distance. A. Schematic of amplitude steps and stimulation durations. B. Locations of all SPES stimulation locations where we tested both durations (233 μsec versus 1 ms) mapped to a single brain (N = 10; 102 stimulation sites), with six different brain regions colored as above. C. Example of stimulation responses to two different durations (233 μsec, black, 1 ms, yellow) recorded at two neighboring sites (participant HP36). D. Overall peak, AUC, N1 peak, and N2 peak responses for the two durations for local sites (black lines, upper plots) and distant sites (grey, bottom plots). ∗ indicates p < 0.00005, Wilcoxon rank sum. E. Locations of all SPES stimulation locations where we tested multiple current steps mapped to a single brain (N = 13; 25 stimulation sites). F. Average (black line) and individual trial stimulation responses (grey lines) at neighboring electrodes for 20 amplitude steps (0.5–10 mA, with 0.5 mA steps, median 10 trials per step) for five sites in the lateral frontal lobe and four participants (designations HPXX), largely showing N2 responses. G. Higher time resolution of responses to the 20 amplitude steps for one site in the lateral frontal lobe (participant HP32) showing the N1 peak more clearly. For F and G, grey lines are per trial and black lines are average responses. H. N1 (red) and N2 (blue) peaks at different amplitude steps at neighboring contacts for two lateral frontal lobe stimulation sites, one in each hemisphere, in the same participant. Dots are per trial, error bars indicate mean and standard error per current step. Continuous curves are generalized linear model (GLM) fits to second order polynomials. I. Overall peak (peak zscored voltage in the full 1 s after stimulation), AUC, N1 peak (peak in the 50 ms after stimulation), and N2 peak responses (peak in the 50 ms–250 ms after stimulation) for local (<15 mm, black) and distant (>15 mm, grey) recording sites. For each measure (overall peak, AUC, N1, N2), the left plot includes the <15 mm and >15 mm recording sites and the right plot includes an expanded view of the >15 mm response. Every voltage value per trial is z-scored (and therefore zero-mean corrected) relative to the baseline value. Error bars indicate mean and standard error per current step; green dots are current levels significantly different from the responses at 0.5 mA for the same response measure and distance, p < 0.000062 (multiple comparisons corrected). For D, H, and I, y-axis units are normalized voltages relative to the baseline, in arbitrary units (a.u.). (For interpretation of the references to color in this figure legend, the reader is referred to the Web version of this article.)

      4.2 CCEP response features are nonlinearly related to increasing injected current

      To test the hypothesis that the size of the evoked potentials tracks linearly with increasing stimulation current, we examined the relationship between current amplitudes and responses at a set pulse with duration (233 μsec), stepping from 0.5 mA to 10 mA in 0.5 mA increments (N = 13 participants, n = 25 stimulation sites; 1.6 ± 0.89 DES sites per participant, median 10 trials per current step; Fig. 2A, E-G). First focusing on the immediate neighboring recording channels, we found increasing current induced larger voltage responses for both the N2 peak (Fig. 2F) and the N1 peak (Fig. 2G), though the response-current relationships were not linear, but appeared more to be an s-shaped curve (Fig. 2H). A threshold around 1–2 mA had to be reached to induce a clear CCEP. Between ∼0.5 and ∼5 mA, the increase in response with injected current was linear. Beyond ∼5 mA, however, the responses plateaued or even decreased (Fig. 2H).
      Moving beyond single neighboring contacts to all contacts, we found a nonlinear DES current-CCEP response relationship for overall peak, AUC, N1 peak, and N2 peak (Fig. 2I). To emphasize that the relationship between response and current for the entire current range was nonlinear, the Pearson's linear correlation between the current and response was low (mean 0.14 ± 0.04). Interestingly, the responses peaked in local (<15 mm) recording sites, where we found the responses to the middle current ranges (5–8 mA) were significantly different relative to the lowest current level (0.5 mA), but not the highest current responses (Wilcoxon rank sum test; p < 0.000062; degrees of freedom or d.f. = 24; Fig. 2I). In contrast, distant sites had significant responses (above the response at 0.5 mA) around 3–4 mA (for N1 and N2 peaks) to 5–7 mA (for AUC and overall peaks) which remained high and plateaued for the peak measures (Wilcoxon rank sum test relative to responses at 0.5 mA; p < 0.000062; d.f. = 24 Fig. 2I). These nonlinear relationships was further demonstrated by the fact that, in local sites (<15 mm), a second order polynomial (using a GLM) better fit the relationship between increasing current and the overall peak, AUC, N1 peak, and N2 peak (Fig. 2I, black line) while third order polynomial S-shaped curve best described the current-response profiles for distant recording sites (Fig. 2l, grey line) based on the minimum AIC following the GLM fit; n = 25 stimulation sites; n = 1797 recording sites; d.f. = 24; Supplemental Fig. 5).
      At finer spatial steps away from the stimulation electrode at 4 mm steps from 4 to 100 mm, we found increasing current amplitude had a stronger effect in local recording sites, with significant differences between amplitudes <39 mm away from the stimulating electrode (p < 0.00005; Kruskal-Wallis multiple comparisons test; maximum distance with a significant difference between amplitudes: overall peak: max dist. = 36 mm; AUC: max dist. = 36 mm; N1 peak: max dist. = 24 mm; N2 peak: max dist. = 39 mm; Supplemental Fig. 3). These results once again demonstrate that a different set of stimulation parameter-response rules govern local versus distant stimulation responses though, contrary to our original hypothesis, responses vary nonlinearly with stimulation current amplitude, especially locally.

      4.3 Stimulation responses vary with location in cortex and white matter

      We tested the relationship between responses and DES location relative to grey and white matter. Controlling amplitude and duration parameters while focusing on location, we examined responses at 7 mA at the shorter pulse duration of 233 μsec for 719 independent stimulation sites across 52 participants (14.5 ± 10.81 DES sites per participant; 6772 recording sites; Fig. 3A; see Methods). We chose these values since this combination of parameters consistently produced a robust response past 6 mA, even with 233 μsec pulse duration (Fig. 2). Choosing different stimulation sites along the depth electrode that were in different portions of the cortical column and white matter, we found larger N2 peak responses in the white matter and at the boundary between the grey matter and the white matter (the grey-white boundary) compared to stimulation in the grey matter alone (example participant in Fig. 3A).
      Fig. 3
      Fig. 3Responses depend on stimulation location along grey-white axis. A. Stimulation locations and responses in example participant (HP35). dACC: dorsal anterior cingulate cortex. Evoked potentials averaged across 20 trials. B. Categorization of electrode localization, with an illustration of the cortical and white matter volumes relative to implanted leads and example categorization of implanted leads. C. Effect of stimulation site on peak neural responses (upper left panel), area under the curve (AUC; upper right panel); N1 peak (lower left panel) or N2 peak (lower right panel). Recording sites are separated into local (<15 mm away from the stimulation site; white bars with black outlines, top row of figures) or distant sites (recording sites >15 mm away from the stimulation site, grey outlined bars, and expanded to the right). For each measure (overall peak, AUC, N1, N2), the left plot includes the local and distant sites while the plot to the right an expanded view of distant responses. Each dot is per stimulation site (not per recording site). Green p-values are significantly different after correcting for multiple comparisons. D. Effect of changing stimulation location relative to the cortex and white matter on responses and distance relative to the stimulation. The difference is significant between the different volumes at stimulation-recording electrode distance steps between ∼15 and 50 mm (green dots, p < 0.00005). All stimulation is at 7 mA and 233 μsec; N = 52; d.f. = 718; p-values are from Wilcoxon rank-sum test. For C and D, y-axis units are normalized voltages relative to the baseline, in arbitrary units (a.u.). (For interpretation of the references to color in this figure legend, the reader is referred to the Web version of this article.)
      To quantify this dependence on location, we used two approaches, one categorical and one a continuous distance measure which also allowed us to account for the wide variety of electrode placement as present in the data set. In the first, we categorized stimulation sites as being on or near the pial surface, in the outer cortex (with one contact of the bipolar depth at or near the outer edge of the cortex, though this could also include being within a sulcus), fully in cortex, in white matter, and in subcortical regions (amygdala, hippocampus, caudate, and putamen) in the participants’ native space (see Methods; Fig. 3B; Supplemental Figs. 1 and 2). For the second approach, we measured the Euclidean distance of the stimulation site from the grey-white boundary. Both approaches demonstrated that responses increased with proximity to white matter overall.
      With the categorical method, at local recording sites (<15 mm), we found the AUC and N2 peak were significantly higher with white matter stimulation versus cortical stimulation (p < 0.0014; Wilcoxon rank sum test), but not the overall peak and N1 peak responses after correcting for multiple comparisons (p > 0.0063; Wilcoxon rank sum test; d.f. = 718; Fig. 3C; Supplemental Fig. 6). In contrast, responses at distant recording sites (>15 mm) were significantly higher when stimulation was in white matter and subcortical regions compared to cortex for all measures (p < 0.0001; Kruskal-Wallis Multiple comparisons test; post hoc Tukey-Kramer test; d.f. = 718; Fig. 3C; Supplemental Fig. 6). The lowest stimulation responses occurred when the bipolar pair was in the outer cortex, which could include the depth contacts being within a sulcus and just at the pial surface (Fig. 1, Fig. 3A; Supplemental Figs. 1 and 2; Supplemental Fig. 6). For all locations, stimulation in the white matter compared to cortex induced an average of 13.1 ± 2.1% higher responses across voltage measures. For distant (>15 mm) sites only, this was a 31.1 ± 1.6% increase while only an 4.9 ± 0.5% increase for local sites (Local responses: Overall peak: cortex: 26.8 ± 1.79; white matter: 27.6 ± 1.62; AUC: cortex: 1.8 × 104±0.11 × 104; white matter: 1.7 × 104±0.10 × 104; N1 peak: cortex: 25.3 ± 0.89; white matter: 26.2 ± 1.54; N2 peak: cortex: 17.5 ± 1.05; white matter: 15.9 ± 0.93; Distant responses: Overall peak: cortex: 3.0 ± 0.18; white matter: 3.8 ± 0.22; AUC: cortex: 2.2 × 103±0.01 × 103; white matter: 2.7 × 103±0.02 × 103; N1 peak: cortex: 2.7 ± 0.16; white matter: 3.5 ± 0.20; N2 peak: cortex: 2.1 ± 0.13; white matter: 3.2 ± 0.18; Fig. 3C; Supplemental Fig. 6). We could further classify bipolar pair of stimulating electrodes as either within cortex (cortex-cortex) or white matter (white matter-white matter) or the electrode pair could cross a boundary (e.g. cortex-white matter or white matter-subcortical; Supplemental Fig. 7). Using this breakdown of stimulation locations, the same general pattern of increased AUC and Overall peak responses was observed with stimulation closer to white matter as well as subcortical regions compared to stimulation in cortical grey matter (p < 0.00001; Kruskal-Wallis test; d.f. = 718; Supplemental Fig. 7).

      4.4 Stimulus location has largest effects at intermediate distances

      In the foregoing results, stimulation in white matter leads to larger responses locally (<15 mm) but only for N2 peak and AUC, while at a distance (>15 mm) this is true for all measures. Does white matter stimulation lead to larger responses at any given long distance? To answer this question and to understand if changing the stimulation location also changes the degree to which activity spreads across the brain, we compared evoked responses at a given distance from the site of stimulation (Fig. 3D; Supplemental Fig. 8). Between 15 and 40 mm from the stimulation site, there were significantly larger responses when stimulation was in the white matter compared to cortical stimulation (p < 0.000063; Wilcoxon rank-sum test for comparing only white matter versus cortex at different distances; d.f. = 718; Fig. 3D). For recording sites less than 15 mm and more than 40 mm away from the stimulation site, there was no statistically verifiable difference between stimulation in grey vs. white matter. Expanding the response comparisons to include the pial surface, outer cortex, cortex, white matter, and subcortical categorizations, responses at a distance between 15 and 40 mm from the electrode were significantly larger with white matter stimulation compared to other structures (pial, outer cortex, and cortex) stimulation (p < 0.00005; Kruskal-Wallis test when comparing multiple volumes; d.f. = 718; Fig. 3D; Supplemental Fig. 8).

      4.5 Stimulation responses vary with distance to the grey-white matter boundary

      As discussed above, in addition to the categorical approach which produces an ordinal variable, we used an interval variable measuring the Euclidean distance between the center of the stimulation bipolar pair and the grey/white boundary (Fig. 4A; Supplemental Fig. 9). We adopted a convention using an axis spanning the grey-white boundary wherein negative distance values indicate cortex while positive values are in the white matter and the grey-white junction is 0 (Fig. 4; Supplemental Fig. 9). Corroborating the results using the categorical approach, we found a significant positive correlation between the proportion of channels with above-threshold stimulation responses (average response 5 STD above the mean baseline activity before stimulation) and stimulation location relative to white matter (Pearson's correlation, rho = 0.16, p = 0.00002; d.f. = 718; Fig. 4B).
      Fig. 4
      Fig. 4Responses are non-linearly related to stimulation location along the grey-white axis. A. Schematic of localization measurements. B. Proportion of all channels per stimulation site and participant with above-threshold responses. C. Local (<15 mm, black lines and curves, left) and distant (>15 mm, grey lines and curves, expanded to the right) peak in the 1 s after stimulation (top left), AUC (bottom left), N1 peak (top right), and N2 peak (bottom right) relative to the distance to the grey-white matter boundary. For each measure (overall peak, AUC, N1, N2), the left plot includes the <15 mm and >15 mm recording sites and the right plot includes an expanded view of the >15 mm response. Data is from all contacts, not just the above-threshold responses. Green dots-responses at different distances to the grey-white boundary significantly different to responses at −4 mm, p < 0.000062 (Wilcoxon rank sum test; multiple comparisons corrected; d.f. = 718). F-statistics and p-values for the model fits as compared to a model fit with a constant term for the local (black print) and distant (grey print) sites. D. Binned distance from stimulation site versus distance to the grey-white boundary for the average overall peak (peak in the 1 s following stimulation), AUC, N1 peak, and N2 peak responses across brain regions. Colorbar to the right of each plot indicates the measure and scale. For C and D, y-axis units are normalized voltages relative to the baseline, in arbitrary units (a.u.). (For interpretation of the references to color in this figure legend, the reader is referred to the Web version of this article.)
      Examining the neural responses across the grey-white boundary for all local (<15 mm) recording sites, we found, contrary to our original hypothesis, a nonlinear relationship between this distance to the grey-white boundary and responses wherein the Pearson's linear correlation values between responses and distance to the grey-white boundary were low (mean rho for all voltage measures = 0.08 ± 0.022; N = 52). Instead, after fitting data to multiple models using a GLM fit and choosing the model order fit with the lowest AIC value, we found a second order polynomial described by an inverted u-shaped curve best fit the relationships between grey-white boundary axis and the AUC, overall peaks, N1 peaks, and N2 peaks. However, only the fits for the N2 and AUC responses relative to the grey-white boundary were significantly different to a constant term model (F-test; p = 0.0007; d.f. = 718; Fig. 4C), indicating again that the stimulation location relative to white matter seems to most affect local N2 and AUC responses but not the local N1 or overall peak responses (Fig. 3C).
      Distant (>15 mm) responses were also best fit by a second order polynomial using GLM though the curve resembled an exponential term for all measures, resulting in a substantial increase as stimulation location ‘moved’ into white matter (Fig. 4C; N = 52). This curve contributed to the higher average Pearson's linear correlation values for distant sites compared to local sites (mean rho for all voltage measures = 0.15 ± 0.037; N = 52). Only the N1 response curve was not significantly different to data fit to a constant term model (F-test = 3.82; p = 0.01; d.f. = 718) while all other metrics followed a second order increasing polynomial fit and the relationship was significantly different from a constant term model fit (F-test; p < 0.00001; d.f. = 718; Fig. 4C).

      4.6 Response spread increases with white matter stimulation

      As was true with our previous analyses (Fig. 4D), responses at a distance were larger with white matter stimulation compared to cortical stimulation with the curves generally resembling an exponential or second order polynomial relationship. However, we found the relationship shifted from a second order polynomial (local) to a linear relationship as we included recording electrodes further away from the stimulating electrodes which was most prominent for the AUC measure (Supplemental Figs. 10–11). Taking the recording electrodes within a range of distances (±5 mm) at multiple steps away from the stimulating electrode, we found the models which best fit the relationship between responses and distance to the grey-white boundary could be linear, quadratic, or a second order polynomial (p < 0.0001; fits shown by minimizing AIC and an F-test comparing the fitted models to a model only containing a constant term; Supplemental Figs. 10–11). Therefore, in testing our original hypothesis that the relationship between response and distance to the white matter is linear, we once again found this is a non-linear relationship.

      4.7 Brain region impact on stimulation response sensitivity to grey-white location

      In the preceding results, we tested our hypotheses pooling all data regardless of brain region. Increasing literature, however, as well as inferences from known cytoarchitectural and connectivity differences would suggest that the responses to stimulation differ in different brain regions [
      • Basu I.
      • Robertson M.M.
      • Crocker B.
      • Peled N.
      • Farnes K.
      • Vallejo-Lopez D.I.
      • et al.
      Consistent linear and non-linear responses to electrical brain stimulation across individuals and primate species.
      ,
      • Mohan U.R.
      • Watrous A.J.
      • Miller J.F.
      • Lega B.C.
      • Sperling M.R.
      • Worrell G.A.
      • et al.
      The effects of direct brain stimulation in humans depend on frequency, amplitude, and white-matter proximity.
      ,
      • Lech M.
      • Berry B.
      • Topcu C.
      • Kremen V.
      • Nejedly P.
      • Lega B.
      • et al.
      Direct electrical stimulation of the human brain has inverse effects on the theta and gamma neural activities.
      ,
      • Solomon E.A.
      • Kragel J.E.
      • Gross R.
      • Lega B.
      • Sperling M.R.
      • Worrell G.
      • et al.
      Medial temporal lobe functional connectivity predicts stimulation-induced theta power.
      ,
      • Trebaul L.
      • Deman P.
      • Tuyisenge V.
      • Jedynak M.
      • Hugues E.
      • Rudrauf D.
      • et al.
      Probabilistic functional tractography of the human cortex revisited.
      ,
      • Stiso J.
      • Khambhati A.N.
      • Menara T.
      • Kahn A.E.
      • Stein J.M.
      • Das S.R.
      • et al.
      White matter network architecture guides direct electrical stimulation through optimal state transitions.
      ,
      • Amunts K.
      • Mohlberg H.
      • Bludau S.
      • Zilles K.
      Julich-Brain: a 3D probabilistic atlas of the human brain's cytoarchitecture.
      ,
      • Paquola C.
      • Royer J.
      • Lewis L.B.
      • Lepage C.
      • Glatard T.
      • Wagstyl K.
      • et al.
      BigBrainWarp: toolbox for integration of BigBrain 3D histology with multimodal neuroimaging.
      ,
      • Wang F.
      • Dong Z.
      • Tian Q.
      • Liao C.
      • Fan Q.
      • Hoge W.S.
      • et al.
      In vivo human whole-brain Connectom diffusion MRI dataset at 760 μm isotropic resolution.
      ,
      • Rosen B.Q.
      • Halgren E.
      A whole-cortex probabilistic diffusion tractography connectome.
      ]. We explored this question by specifically comparing responses when stimulation was in lateral frontal lobe, cingulate, and lateral temporal lobe (as we had the most coverage of these regions; Fig. 1A, Supplemental Fig. 1). We found that local responses were not significantly different between cortex and white matter stimulation in the cingulate or lateral temporal lobe for all measures (cingulate comparisons: p > 0.64; d.f. = 104; temporal lobe comparisons: p > 0.008; Wilcoxon rank-sum test; d.f. = 124), but were significant for the AUC and N2 peak responses with stimulation in the lateral frontal lobe (p < 0.0024; multiple comparisons; Wilcoxon rank-sum test; d.f. = 279; Supplemental Fig. 12). For distant sites, the overall peak and N2 peak responses were significantly higher with stimulation in the white matter compared to cortex for all three brain regions (p < 0.004; Wilcoxon rank-sum test). Yet, the distant N1 peak response was not significantly different after correcting for multiple comparisons(p > 0.01; Wilcoxon rank-sum test). AUC responses were only significantly higher with white matter near the lateral temporal lobe and cingulate (p < 0.003; Wilcoxon rank-sum test; Supplemental Fig. 12). In other words, white matter stimulation versus stimulation in the cortex had very different effects depending on if we stimulated in the cingulate, the lateral frontal lobe, or the lateral temporal lobe.
      Dissecting this relationship further by relating the responses to the continuous distance to the grey-white boundary, we found three response categories: 1) overall increase with distance to the grey-white boundary (lateral frontal lobe), 2) overall decrease or no change (cingulate); 3) nonlinear u-shaped curve (lateral temporal lobe; Fig. 5; Supplemental Figs. 13 and 14). For instance, the relationship in the lateral temporal lobe between distance to the grey-white boundary and responses were better reflected by a u-shaped curve locally and distally with the best fit being a second order polynomial (average Pearson's linear correlation: lateral temporal, local: 0.18 ± 0.04, distant: 0.29 ± 0.03; second order polynomial model fit significantly different to a constant term model; local: p ≤ 0.0102; distant: p ≤ 0.0024; n = 125 stimulation sites; d.f. = 124). In contrast, with stimulation in the lateral frontal lobe, the relationship was best described as a linear relationship across measures (average Pearson's linear correlation: lateral frontal, local: 0.20 ± 0.02, distant: 0.15 ± 0.04). We found, in local sites, a linear relationship fit all four measures in the lateral frontal lobe best (F-test comparing model fit to a constant term model fit; p < 0.0005), but a second order polynomial best fit all the distant neural measures (F-test comparison to a constant term model fit; p < 0.00001; n = 125 stimulation sites; d.f. = 124). In contrast, in the cingulate, we did not find a significant linear or nonlinear relationship between distance to the grey-white boundary and the neural responses, though there was an overall negative trend as we moved toward the white matter (average Pearson's linear correlation: cingulate, local: 0.12 ± 0.09, distant: 0.08 ± 0.05; F-test comparison fitted line to a constant term model fit; p ≥ 0.0461; n = 104 stimulation sites; Fig. 5; Supplemental Fig. 14). These complex relationships are apparent when the results are shown as a three dimensional surface representation (Fig. 5B; Supplemental Fig. 15).
      Fig. 5
      Fig. 5Region-specific effects on stimulation responses relative to grey and white matter neural responses in the lateral frontal lobe, lateral temporal lobe, and cingulate cortex. A. Local (<15 mm, black) and distant (<15 mm, grey) AUC and N1 peak responses plotted relative to the distance to the grey-white matter boundary for the different brain regions. Lines are GLM polynomial fits with the model fit order based on the minimum AIC value per fit. Each distance point and standard error bar has at least four stimulation sites contributing to each point. F-statistics and p-values for the model fits as compared to a model fit with a constant term for the local (black) and distant (grey) sites. B. Surface plots of GLM fitted lines for different stimulation to recording distances relative to the distance to the grey-white boundary for the N1 peak and AUC responses for the different brain regions. For A and B, y-axis units are normalized voltages relative to the baseline, in arbitrary units (a.u.).

      4.8 Orientation of the stimulation dipole alters responses

      Not only could the location relative to grey and white matter be important, but we hypothesize that the orientation of the simulating dipole to neuronal structures could be crucial in sculpting a response [
      • Mohan U.R.
      • Watrous A.J.
      • Miller J.F.
      • Lega B.C.
      • Sperling M.R.
      • Worrell G.A.
      • et al.
      The effects of direct brain stimulation in humans depend on frequency, amplitude, and white-matter proximity.
      ,
      • Brocker D.T.
      • Grill W.M.
      ]. We calculated the orientation of the bipolar pair of electrodes relative to the cortical column for both local and distant responses (Fig. 6A; Supplemental Fig. 16) with 0° indicating an alignment of the effective dipole with the longest axis of dendrites of pyramidal neurons in the grey matter. We found a rise in the local peak, AUC, N1 peak, and N2 peak responses with increasing angles (orientation of the electrode relative to the nearest cortical axis) up until 90° and falling off again as the orientation moved toward 180° (Fig. 6B; Supplemental Fig. 16). This local response relationship was best fit to a model with a third-degree polynomial fit (d.f. = 718). In contrast, the angle of orientation had no impact on distant responses. Neither the local or distant orientation vs. responses were linear (mean Pearson's linear correlation rho for all voltage measures = 0.05 ± 0.08; N = 52; number of stimulation sites = 719).
      Fig. 6
      Fig. 6Relationship between electrode orientation and response. A. Measures of orientation (°) of the bipolar pair of electrodes to the cortical axis. B. Local (<15 mm, top row) and distant (>15 mm, top and bottom row) overall peak and AUC responses plotted relative to the orientation (°) of the bipolar pair of electrodes to the cortical axis. Individual points and error bars are mean and standard error. Data is from all contacts, not just the above-threshold responses. For B, y-axis units are normalized voltages relative to the baseline, in arbitrary units (a.u.).
      As orientation could also be dependent on whether the stimulating bipolar pair of electrodes was in grey matter versus white matter, we subdivided the data based upon whether the stimulating electrode was in the white matter or cortical volume (Supplemental Fig. 16). We found the relationship between bipolar pair orientation versus responses to be linear for local recording sites, reaching significance for the overall peak and AUC (peak, local: rho = 0.56; p = 0.0048; AUC: local: rho = 0.61; p = 0.002; N1 peak, local: rho = 0.46; p = 0.03; N2 peak: local: rho = 0.46; p = 0.02; N = 52; number of stimulation sites = 719). Yet, the correlation between cortical orientation and responses were small or nonexistent for the local recording sites when the electrode pair was in the white matter (peak, local: rho = 0.09; p = 0.63; AUC: local: rho = 0.06; p = 0.78; N1 peak, local: rho = 0.17; p = 0.39; N2 peak: local: rho = 0.22; p = 0.26; N = 52; d.f. = 718). This result makes sense considering the stimulation sites in the white matter far away from the cortical dipole will have less of a correlation with stimulation orientation relative to the cortex. Interestingly, in contrast, responses at distant recording sites (>15 mm) had no clear relationship with orientation (peak, distant: rho = −0.23; p = 0.22; AUC: distant: rho = −0.13; p = 0.49; N1 peak, distant: rho = −0.21; p = 0.24; N2 peak: distant: rho = −0.22; p = 0.22; N = 52; d.f. = 718 Supplemental Fig. 16). In other words, for stimulation in white matter and distant contacts, orientation may not play as much of a role as it does for local cortical stimulation.

      5. Discussion

      Through a systematic DES study in a large intracranial data set we found evidence for basic rules of intracranial stimulation in the human brain (Fig. 7). We found that, as expected, increasing stimulation duration leads to larger responses at any given location. In addition, unlike previous studies involving trains of stimulation [
      • Basu I.
      • Robertson M.M.
      • Crocker B.
      • Peled N.
      • Farnes K.
      • Vallejo-Lopez D.I.
      • et al.
      Consistent linear and non-linear responses to electrical brain stimulation across individuals and primate species.
      ], we found that single pulse responses vary non-linearly with injected current and this is true both nearby the stimulation and at a distance. Specifically, increasing stimulation from 1 to ∼5 mA linearly increases the response but that beyond ∼5 mA the response either plateaus or even decreases. We also confirmed that decreasing stimulation distance to white matter can increase distant responses while the largest local responses occurred with stimulation at the grey-white boundary across brain regions while distant responses were best induced with stimulation entirely in white matter (Fig. 7).
      Fig. 7
      Fig. 7Summary of hypotheses and relevant results. The tested hypotheses (H1-4) and results of the analyses of varying single pulse stimulation including duration, current amplitude, location of stimulation relative to grey-white boundary and cortical column orientation, and the effects of brain regions which include relationships and the sites causing the highest stimulation responses relative to the grey and white matter in the cingulate (magenta), lateral temporal lobe (green), and lateral frontal lobe (blue). (For interpretation of the references to color in this figure legend, the reader is referred to the Web version of this article.)
      We also found, as hypothesized, that increasing duration increased the neural responses both locally and distally, though, as we had only two duration steps, we could not determine if the relationship was linear. Related companion work found there were no differences in responses for intracranial sEEG responses for two larger duration steps (0.5 ms and 1 ms) which could indicate there is a nonlinear saturation effect with changing duration, though, interestingly, there were differences in the response on the scalp as recorded by high density EEG shown by Parmigiani et al. [
      • Parmigiani S.
      • Mikulan E.P.
      • Russo S.
      • Sarasso S.
      • Zauli F.M.
      • Rubino A.
      • et al.
      Simultaneous stereo-EEG and high-density scalp EEG recordings to study the effects of intracerebral stimulation parameters.
      ]. Future work may not only need to include more duration steps, but also to identify if duration and amplitude are independent variables or merely parameters controlling total current which is what really dictates response, particularly if there are regional differences with changing waveform duration.
      Further, the stimulation parameter effect depended on what aspect of the voltage waveform was measured. For input current, for example, N1 peak and N2 peak exhibited different saturation points. This difference likely relates to differences in N1 and N2 mechanisms; the N1 peak is thought to reflect local excitation while N2 relates to a network polysynaptic response or inhibitory rebound (N2, [
      • Keller C.J.
      • Honey C.J.
      • Entz L.
      • Bickel S.
      • Groppe D.M.
      • Toth E.
      • et al.
      Corticocortical evoked potentials reveal projectors and integrators in human brain networks.
      ,
      • Alarcón G.
      • Martinez J.
      • Kerai S.V.
      • Lacruz M.E.
      • Quiroga R.Q.
      • Selway R.P.
      • et al.
      In vivo neuronal firing patterns during human epileptiform discharges replicated by electrical stimulation.
      ,
      • Creutzfeldt O.D.
      • Watanabe S.
      • Lux H.D.
      Relations between EEG phenomena and potentials of single cortical cells. I. Evoked responses after thalamic and epicortical stimulation.
      ]). Indeed, the decrease in the response at the highest amplitudes could imply that there is a neural suppression through saturation or the activation of inhibitory circuits in nearby cortical regions. In terms of therapy and clinical mapping, then, the question is whether there is a reason for going to high amplitudes beyond 7 mA. Indeed, particularly with safety considerations [
      • Vatsyayan R.
      • Cleary D.
      • Martin J.R.
      • Halgren E.
      • Dayeh S.A.
      Electrochemical safety limits for clinical stimulation investigated using depth and strip electrodes in the pig brain.
      ], there may not be a reason to go beyond 7 mA unless there is a targeted physiological response to induce such as inducing seizures or suppressing local neural activity [
      • Borchers S.
      • Himmelbach M.
      • Logothetis N.
      • Karnath H.
      Direct electrical stimulation of human cortex — the gold standard for mapping brain functions?.
      ].
      In contrast to our results here, in prior work, we demonstrated a consistent linear relationship between responses and stimulus current from trains of stimulation [
      • Basu I.
      • Robertson M.M.
      • Crocker B.
      • Peled N.
      • Farnes K.
      • Vallejo-Lopez D.I.
      • et al.
      Consistent linear and non-linear responses to electrical brain stimulation across individuals and primate species.
      ], highlighting an important distinction between SPES and train-based stimulation. It is possible that repeated pulses act to engage larger reverberating or oscillating networks with increasing amplitude while the mechanisms underlying responses to SPES can reach a limit by not engaging these widespread networks. Further tests, including the use of microelectrode recordings, may be needed to parse individual neuronal activity during these different stimulation approaches [
      • Paulk A.C.
      • Yang J.C.
      • Cleary D.R.
      • Soper D.J.
      • Halgren M.
      • O'Donnell A.R.
      • et al.
      Microscale physiological events on the human cortical surface.
      ,
      • Tchoe Y.
      • Bourhis A.M.
      • Cleary D.R.
      • Stedelin B.
      • Lee J.
      • Tonsfeldt K.J.
      • et al.
      Human brain mapping with multi-thousand channel PtNRGrids resolves novel spatiotemporal dynamics.
      ].
      With this large data set and consistent, systematic approach, we found that stimulation at the grey-white boundary and particularly the white matter resulted in the largest responses (Fig. 7). This effect appears most striking in the lateral frontal cortex. Further, similar results were demonstrated by a companion study conducted by Parmigiani et al., particularly with a stronger effect of white matter stimulation increasing the N2 peak intracranially as well as both the N1 and N2 peak as recorded on the scalp by high density EEG [
      • Parmigiani S.
      • Mikulan E.P.
      • Russo S.
      • Sarasso S.
      • Zauli F.M.
      • Rubino A.
      • et al.
      Simultaneous stereo-EEG and high-density scalp EEG recordings to study the effects of intracerebral stimulation parameters.
      ]. Also in keeping with the results from high density EEG data collected by Parmigiani et al. [
      • Parmigiani S.
      • Mikulan E.P.
      • Russo S.
      • Sarasso S.
      • Zauli F.M.
      • Rubino A.
      • et al.
      Simultaneous stereo-EEG and high-density scalp EEG recordings to study the effects of intracerebral stimulation parameters.
      ], we found a stronger effect on responses with the bipolar electrode oriented perpendicular to the closest cortical axis. The results presented here are interesting in light of recent work involving trains of stimulation. Trains of stimulation in grey matter were shown to be more effective at decreasing high frequency activity as opposed to stimulation in white matter, with stronger effects in the neocortex versus the medial temporal lobe [
      • Mohan U.R.
      • Watrous A.J.
      • Miller J.F.
      • Lega B.C.
      • Sperling M.R.
      • Worrell G.A.
      • et al.
      The effects of direct brain stimulation in humans depend on frequency, amplitude, and white-matter proximity.
      ]. Interestingly, though, white matter stimulation with trains (as opposed to grey matter stimulation) in the mesial temporal lobe can improve visual memory encoding [
      • Mankin E.A.
      • Aghajan Z.M.
      • Schuette P.
      • Tran M.E.
      • Tchemodanov N.
      • Titiz A.S.
      • et al.
      Stimulation of the right entorhinal white matter enhances visual memory encoding in humans.
      ]. Therefore, further work is needed to resolve the differences between low frequency voltage responses such as CCEP, high frequency responses (trains), and stimulation location. Regardless, the fact that different regions show different location dependency likely reflects the different regional microarchitecture (e.g. arrangement and number of particular neuronal types) as well as differential network connectivity (e.g. the number of long-range connections from the region).
      These differences between brain regions and responses to the different types of stimulation, particularly in terms of the stimulation spread at 15 mm, could be key for DBS planning and treatment, particularly in subcortical regions. Of course, the 15 mm spread may be a different value for areas such as the subthalamic nucleus or the amygdala or for trains of stimulation (as opposed to SPES). While this could mean that generalization of the current study to other areas of DBS is limited by the fact that we used SPES, we believe this is a necessary and important step in understanding the basic physiology of neuronal responses to stimulation and can be an important building block in looking at more clinically relevant stimulation paradigms. Further, these differences highlighted here between brain regions (even just among cortical areas) could have potential implications for the degree of precision necessary, and possible, for clinical stimulation paradigms.
      It is possible that white matter stimulation is more effective because direct axonal stimulation can result in both antidromic and orthodromic conduction [
      • Nowak L.G.
      • Bullier J.
      Axons, but not cell bodies, are activated by electrical stimulation in cortical gray matter. II. Evidence from selective inactivation of cell bodies and axon initial segments.
      ,
      • Nowak L.G.
      • Bullier J.
      Axons, but not cell bodies, are activated by electrical stimulation in cortical gray matter. I. Evidence from chronaxie measurements.
      ]. Congruent with this finding is the targeting of white matter tracts and axonal stimulation to treat depression and Parkinson's, [
      • Gunalan K.
      • Howell B.
      • McIntyre C.C.
      Quantifying axonal responses in patient-specific models of subthalamic deep brain stimulation.
      ,
      • Riva-Posse P.
      • Choi K.S.
      • Holtzheimer P.E.
      • Crowell A.L.
      • Garlow S.J.
      • Rajendra J.K.
      • et al.
      A connectomic approach for subcallosal cingulate deep brain stimulation surgery: prospective targeting in treatment-resistant depression.
      ]. Another key possibility is that there could be network effects engaging thalamic networks [
      • Miocinovic S.
      • de Hemptinne C.
      • Chen W.
      • Isbaine F.
      • Willie J.T.
      • Ostrem J.L.
      • et al.
      Cortical potentials evoked by subthalamic stimulation demonstrate a short latency hyperdirect pathway in humans.
      ] which could explain why stimulation in white matter increased N2 peak and AUC measures (which are generally the slower portions of the responses) but had less of an effect on overall peak and N1 peak responses (which are faster responses and could be more locally generated). Interestingly, in our study the local responses had a peak response with stimulation at the grey-white boundary, not necessarily in white matter itself, particularly in the lateral temporal lobe. We posit there could be an effect of being closer to the axon hillocks of large pyramidal cells in cortical layers 4–6 and that the grey-white boundary is a convergence point for multiple output neurons or is a site with a higher concentration of excitatory versus inhibitory contributions which could explain the peak local responses [
      • Milosevic L.
      • Kalia S.K.
      • Hodaie M.
      • Lozano A.M.
      • Popovic M.R.
      • Hutchison W.D.
      • et al.
      A theoretical framework for the site-specific and frequency-dependent neuronal effects of deep brain stimulation.
      ]. To test these ideas, model fitting in combination with cytoarchitectonic maps are likely necessary [
      • Amunts K.
      • Mohlberg H.
      • Bludau S.
      • Zilles K.
      Julich-Brain: a 3D probabilistic atlas of the human brain's cytoarchitecture.
      ,
      • Paquola C.
      • Royer J.
      • Lewis L.B.
      • Lepage C.
      • Glatard T.
      • Wagstyl K.
      • et al.
      BigBrainWarp: toolbox for integration of BigBrain 3D histology with multimodal neuroimaging.
      ] in addition to sampling of neural data on microscale levels [
      • Chiken S.
      • Nambu A.
      Mechanism of deep brain stimulation: inhibition, excitation, or disruption.
      ,
      • Paulk A.C.
      • Yang J.C.
      • Cleary D.R.
      • Soper D.J.
      • Halgren M.
      • O'Donnell A.R.
      • et al.
      Microscale physiological events on the human cortical surface.
      ,
      • Tchoe Y.
      • Bourhis A.M.
      • Cleary D.R.
      • Stedelin B.
      • Lee J.
      • Tonsfeldt K.J.
      • et al.
      Human brain mapping with multi-thousand channel PtNRGrids resolves novel spatiotemporal dynamics.
      ,
      • Yang J.C.
      • Paulk A.C.
      • Salami P.
      • Heon Lee S.
      • Ganji M.
      • Soper D.J.
      • et al.
      Microscale dynamics of electrophysiological markers of epilepsy.
      ].
      For all these comparisons, we focused on distances between sites based on the geometry of the brain structures. This choice was made to limit the scope to a purely distance measure. While there are exciting conclusions to be made relative to white matter tractography, connectivity, and stimulation [
      • Crocker B.
      • Ostrowski L.
      • Williams Z.M.
      • Dougherty D.D.
      • Eskandar E.N.
      • Widge A.S.
      • et al.
      Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
      ,
      • Stiso J.
      • Khambhati A.N.
      • Menara T.
      • Kahn A.E.
      • Stein J.M.
      • Das S.R.
      • et al.
      White matter network architecture guides direct electrical stimulation through optimal state transitions.
      ,
      • Mankin E.A.
      • Aghajan Z.M.
      • Schuette P.
      • Tran M.E.
      • Tchemodanov N.
      • Titiz A.S.
      • et al.
      Stimulation of the right entorhinal white matter enhances visual memory encoding in humans.
      ], this data set did not have consistent enough sampling of noninvasive scans mapping white matter (such as diffusion tensor imaging, or DTI). Further, both our approach and a companion study by Parmigiani et al. [
      • Parmigiani S.
      • Mikulan E.P.
      • Russo S.
      • Sarasso S.
      • Zauli F.M.
      • Rubino A.
      • et al.
      Simultaneous stereo-EEG and high-density scalp EEG recordings to study the effects of intracerebral stimulation parameters.
      ] was to start from a naïve geometrically-focused perspective. We performed hypothesis testing and results focused on the geometry to generate independent conclusions from structural or functional connectivity in the brain such that future secondary analyses could allow us to compare these geometrically focused results with connectome studies [
      • Crocker B.
      • Ostrowski L.
      • Williams Z.M.
      • Dougherty D.D.
      • Eskandar E.N.
      • Widge A.S.
      • et al.
      Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
      ,
      • Stiso J.
      • Khambhati A.N.
      • Menara T.
      • Kahn A.E.
      • Stein J.M.
      • Das S.R.
      • et al.
      White matter network architecture guides direct electrical stimulation through optimal state transitions.
      ]. Pooling and comparisons of stimulation responses, brain geometry, and connectivity will be key particularly as trains of stimulation in white matter in the medial temporal lobe has been shown to induce network-wide changes including increases in theta power with a concurrent decrease in high frequency power which is related to functional connectivity [
      • Solomon E.A.
      • Kragel J.E.
      • Gross R.
      • Lega B.
      • Sperling M.R.
      • Worrell G.
      • et al.
      Medial temporal lobe functional connectivity predicts stimulation-induced theta power.
      ]. For example, Human Brain Connectome data could be instrumental in answering this question [
      • Alarcón G.
      • Martinez J.
      • Kerai S.V.
      • Lacruz M.E.
      • Quiroga R.Q.
      • Selway R.P.
      • et al.
      In vivo neuronal firing patterns during human epileptiform discharges replicated by electrical stimulation.
      ]. Alternatively, WM tractography data might be more available in the future with the possible increase in clinical usefulness of white matter tractography as a clinical tool, such as to help understand epilepsy networks [
      • Alizadeh M.
      • Kozlowski L.
      • Muller J.
      • Ashraf N.
      • Shahrampour S.
      • Mohamed F.B.
      • et al.
      Hemispheric regional based analysis of diffusion tensor imaging and diffusion tensor tractography in patients with temporal lobe epilepsy and correlation with patient outcomes.
      ,
      • Revell A.Y.
      • Silva A.B.
      • Mahesh D.
      • Armstrong L.
      • Arnold T.C.
      • John M.
      • et al.
      White matter signals reflect information transmission between brain regions during seizures.
      ].
      These conclusions must be tempered by an awareness that our sampling of the brain remains sparse in two respects. First, at maximum we are recording from ∼200 locations with most sites in frontal and lateral temporal areas, many in white matter and often separated by larger distances. Nuances of the effects of stimulation at different distances and at different subregions of the brain might be lost. Second, this also means our stimulation sites are not uniformly distributed across the brain. Because of clinical constraints, we have few stimulation examples from primary sensory or motor cortex or most subcortical structures and those regions may react different to stimulation or respond differently to stimulation elsewhere. Moreover, bipolar stimulation through macroelectrode contacts means that the electrical field generated is relatively large, spanning millimeters [
      • Herrington T.M.
      • Cheng J.J.
      • Eskandar E.N.
      Mechanisms of deep brain stimulation.
      ]. This large size of the field makes our localization along the grey-white continuum imprecise which could be complicated by possible brain shift [
      • Dykstra A.R.
      • Chan A.M.
      • Quinn B.T.
      • Zepeda R.
      • Keller C.J.
      • Cormier J.
      • et al.
      Individualized localization and cortical surface-based registration of intracranial electrodes.
      ,
      • LaPlante R.A.
      • Tang W.
      • Peled N.
      • Vallejo D.I.
      • Borzello M.
      • Dougherty D.D.
      • et al.
      The interactive electrode localization utility: software for automatic sorting and labeling of intracranial subdural electrodes.
      ] though we focused on sEEG electrodes which are less prone to brain shift compared to subdural grids and strips [
      • Parvizi J.
      • Kastner S.
      Human intracranial EEG: promises and limitations.
      ]. None-the-less, even with these caveats we would expect that the relationship we are seeing with respect to grey-white location to hold. Another point of consideration is the distances between bipolar contacts during stimulation which can have an effect on the spread of stimulation responses [
      • Paff M.
      • Loh A.
      • Sarica C.
      • Lozano A.M.
      • Fasano A.
      Update on current technologies for deep brain stimulation in Parkinson's disease.
      ,
      • Anderson D.N.
      • Anderson C.
      • Lanka N.
      • Sharma R.
      • Butson C.R.
      • Baker B.W.
      • et al.
      The μDBS: multiresolution, directional deep brain stimulation for improved targeting of small diameter fibers.
      ]. Varying the inter-contact distances and electrode sizes could improve efficiency of stimulation delivery [
      • Paff M.
      • Loh A.
      • Sarica C.
      • Lozano A.M.
      • Fasano A.
      Update on current technologies for deep brain stimulation in Parkinson's disease.
      ,
      • Anderson D.N.
      • Anderson C.
      • Lanka N.
      • Sharma R.
      • Butson C.R.
      • Baker B.W.
      • et al.
      The μDBS: multiresolution, directional deep brain stimulation for improved targeting of small diameter fibers.
      ,
      • Anderson D.N.
      • Osting B.
      • Vorwerk J.
      • Dorval A.D.
      • Butson C.R.
      Optimized programming algorithm for cylindrical and directional deep brain stimulation electrodes.
      ]. However, in this current data set, the overwhelming majority of the data we gathered had a peak stimulating electrode inter-contact distance at 3.5 mm. As we will be sharing these data with the public, an exciting future study could be combining these data with other curated data sets [
      • Mohan U.R.
      • Watrous A.J.
      • Miller J.F.
      • Lega B.C.
      • Sperling M.R.
      • Worrell G.A.
      • et al.
      The effects of direct brain stimulation in humans depend on frequency, amplitude, and white-matter proximity.
      ,
      • Lech M.
      • Berry B.
      • Topcu C.
      • Kremen V.
      • Nejedly P.
      • Lega B.
      • et al.
      Direct electrical stimulation of the human brain has inverse effects on the theta and gamma neural activities.
      ] to better address the effects of changing inter-contact distances and cortical stimulation. In addition, regarding different stimulation parameters and relative to studies in the field, a limitation of the work was due to hardware limitations regarding the pulses. It is important to note we were forced to have a 53 μs interval between charge balanced pulses in our paradigm, which contrasts from many studies which have no interval between pulses [
      • Keller C.J.
      • Honey C.J.
      • Mégevand P.
      • Entz L.
      • Ulbert I.
      • Mehta A.D.
      Mapping human brain networks with cortico-cortical evoked potentials.
      ,
      • Matsumoto R.
      • Kunieda T.
      • Nair D.
      Single pulse electrical stimulation to probe functional and pathological connectivity in epilepsy.
      ,
      • Keller C.J.
      • Honey C.J.
      • Entz L.
      • Bickel S.
      • Groppe D.M.
      • Toth E.
      • et al.
      Corticocortical evoked potentials reveal projectors and integrators in human brain networks.
      ,
      • Kunieda T.
      • Yamao Y.
      • Kikuchi T.
      • Matsumoto R.
      New approach for exploring cerebral functional connectivity: review of cortico-cortical evoked potential.
      ] though is not as separated in time as other studies which use monophasic stimulation to examine effects of stimulation polarity [
      • Donos C.
      • Mîndruţă I.
      • Ciurea J.
      • Mălîia M.D.
      • Barborica A.
      A comparative study of the effects of pulse parameters for intracranial direct electrical stimulation in epilepsy.
      ,
      • Kanno A.
      • Enatsu R.
      • Ookawa S.
      • Noshiro S.
      • Ohtaki S.
      • Suzuki K.
      • et al.
      Interhemispheric asymmetry of network connecting between frontal and temporoparietal cortices: a corticocortical-evoked potential study.
      ]. Indeed, we were hoping to emulate bipolar charge balanced stimulation that has no delay in the biphasic pulses but were limited by the hardware itself. However, future studies on effects of polarity with a larger inter-phase interval could add an additional parameter to the understanding of CCEP responses, particularly in relation to the grey and white matter. Another important caveat (and direction of research) is that there is likely to be an effect of brain state on the stimulation-response input-output relationship [
      • Stiso J.
      • Khambhati A.N.
      • Menara T.
      • Kahn A.E.
      • Stein J.M.
      • Das S.R.
      • et al.
      White matter network architecture guides direct electrical stimulation through optimal state transitions.
      ,
      • Scangos K.W.
      • Makhoul G.S.
      • Sugrue L.P.
      • Chang E.F.
      • Krystal A.D.
      State-dependent responses to intracranial brain stimulation in a patient with depression.
      ]. While we focused on data gathered while the participants were awake it is possible that during sleep, for example, the stimulation rules may be different [
      • Usami K.
      • Matsumoto R.
      • Kobayashi K.
      • Hitomi T.
      • Shimotake A.
      • Kikuchi T.
      • et al.
      Sleep modulates cortical connectivity and excitability in humans: direct evidence from neural activity induced by single-pulse electrical stimulation.
      ] or with varying cognitive awake cognitive states.
      Finally, of course, there are always questions surrounding conclusions drawn from findings obtained in the setting of pathology – in this case epilepsy. Epilepsy is clearly a network process and this could have an impact on the stimulation input/output relationship [
      • Usami K.
      • Matsumoto R.
      • Kobayashi K.
      • Hitomi T.
      • Shimotake A.
      • Kikuchi T.
      • et al.
      Sleep modulates cortical connectivity and excitability in humans: direct evidence from neural activity induced by single-pulse electrical stimulation.
      ,
      • Naftulin J.S.
      • Ahmed O.J.
      • Piantoni G.
      • Eichenlaub J.B.
      • Martinet L.E.
      • Kramer M.A.
      • et al.
      Ictal and preictal power changes outside of the seizure focus correlate with seizure generalization.
      ]. Medications could also alter the physiology. We attempted to avoid these potential confounds by excluding channels from either recording or stimulation which showed substantial epileptiform activity. In addition, by looking across many locations in many patients on different medications and with different etiologies, we should be ‘averaging out’ the influence of pathological since the pathology will be unique to individual patients.
      This work, alongside a growing number of systematic studies of DES and DBS [
      • Yih J.
      • Beam D.E.
      • Fox K.C.R.
      • Parvizi J.
      Intensity of affective experience is modulated by magnitude of intracranial electrical stimulation in human orbitofrontal, cingulate and insular cortices.
      ,
      • Mohan U.R.
      • Watrous A.J.
      • Miller J.F.
      • Lega B.C.
      • Sperling M.R.
      • Worrell G.A.
      • et al.
      The effects of direct brain stimulation in humans depend on frequency, amplitude, and white-matter proximity.
      ,
      • Crocker B.
      • Ostrowski L.
      • Williams Z.M.
      • Dougherty D.D.
      • Eskandar E.N.
      • Widge A.S.
      • et al.
      Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
      ,
      • Trebaul L.
      • Deman P.
      • Tuyisenge V.
      • Jedynak M.
      • Hugues E.
      • Rudrauf D.
      • et al.
      Probabilistic functional tractography of the human cortex revisited.
      ,
      • Gunalan K.
      • Howell B.
      • McIntyre C.C.
      Quantifying axonal responses in patient-specific models of subthalamic deep brain stimulation.
      ,
      • Grill W.M.
      • Snyder A.N.
      • Miocinovic S.
      Deep brain stimulation creates an informational lesion of the stimulated nucleus.
      ,
      • Grill W.M.
      • Wei X.F.
      High efficiency electrodes for deep brain stimulation.
      ,
      • Kent A.R.
      • Swan B.D.
      • Brocker D.T.
      • Turner D.A.
      • Gross R.E.
      • Grill W.M.
      Measurement of evoked potentials during thalamic deep brain stimulation.
      ,
      • Kanno A.
      • Enatsu R.
      • Ookawa S.
      • Ochi S.
      • Mikuni N.
      Location and threshold of electrical cortical stimulation for functional brain mapping.
      ] suggests that it may be possible to identify consistent stimulation parameter – output rules enabling a determination of brain region, where in the grey-white matter and with what amplitude, duration, and frequency a stimulus should be given to produce a specific local and distant output. This would be of immense assistance in developing targeted, effective, treatments for a wide range of neuropsychological challenges [
      • Mankin E.A.
      • Fried I.
      Modulation of human memory by deep brain stimulation of the entorhinal-hippocampal circuitry.
      ,
      • Basu I.
      • Robertson M.M.
      • Crocker B.
      • Peled N.
      • Farnes K.
      • Vallejo-Lopez D.I.
      • et al.
      Consistent linear and non-linear responses to electrical brain stimulation across individuals and primate species.
      ,
      • Stiso J.
      • Khambhati A.N.
      • Menara T.
      • Kahn A.E.
      • Stein J.M.
      • Das S.R.
      • et al.
      White matter network architecture guides direct electrical stimulation through optimal state transitions.
      ,
      • McIntyre C.C.
      • Grill W.M.
      • Sherman D.L.
      • Thakor N.V.
      Cellular effects of deep brain stimulation: model-based analysis of activation and inhibition.
      ]. Therefore, the main results of grey and white matter stimulation and local and distant effects in our study suggest that therapies using stimulation should be modified per targeted neurophysiological outcome. For instance, it might be worthwhile to target stimulation across the grey-white junction when large, local responses are needed to reach a neurophysiological and behaviorally relevant therapeutic goal. Alternately, if a therapeutic goal is to induce widespread, network-level changes which may be ideal in treating certain forms of epilepsy [
      • Nair D.R.
      • Laxer K.D.
      • Weber P.B.
      • Murro A.M.
      • Park Y.D.
      • Barkley G.L.
      • et al.
      ] or mapping network circuits [
      • Crocker B.
      • Ostrowski L.
      • Williams Z.M.
      • Dougherty D.D.
      • Eskandar E.N.
      • Widge A.S.
      • et al.
      Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
      ,
      • Keller C.J.
      • Honey C.J.
      • Mégevand P.
      • Entz L.
      • Ulbert I.
      • Mehta A.D.
      Mapping human brain networks with cortico-cortical evoked potentials.
      ,
      • Matsumoto R.
      • Kunieda T.
      • Nair D.
      Single pulse electrical stimulation to probe functional and pathological connectivity in epilepsy.
      ], then it may be preferable to target white matter in the lateral frontal cortex. Conversely, targeting grey matter such as in the cingulate might be useful when highly localized responses or inducing small circuit changes are needed such as in using microstimulation to impact memory formation [
      • Mankin E.A.
      • Fried I.
      Modulation of human memory by deep brain stimulation of the entorhinal-hippocampal circuitry.
      ,
      • Titiz A.S.
      • Hill M.R.H.
      • Mankin E.A.
      • Aghajan Z.M.
      • Eliashiv D.
      • Tchemodanov N.
      • et al.
      Theta-burst microstimulation in the human entorhinal area improves memory specificity.
      ]. Indeed, instead of proposing a “one stimulation parameter set fits all” approach, tailored therapeutic treatments driven by a growing body of knowledge of the complex, but knowable and mappable, relationship of stimulation parameters and different types of targeted neural dynamics may provide the most reliable DES treatments for individual patients.

      Declarations of interest

      None of the authors have conflicts of interest to disclose in relationship with the current work.

      Funding

      Support included NIH grants MH086400, DA026297, and EY017658 to ENE, MH109722, NS100548, and MH111872 to ASW, NS100548 to DDD, and ECOR, NINDS K24-NS088568 to SSC and Tiny Blue Dot Foundation to SSC, ACP, and RZ. A United States Department of Energy Computational Sciences Graduate Fellowship [DE-FG02-97ER25308] supported BC. Some of this research was sponsored by the U.S. Army Research Office and Defense Advanced Research Projects Agency (DARPA) under Cooperative Agreement Number W911NF-14-2-0045 issued by ARO contracting office in support of DARPA's SUBNETS Program. The views and conclusions contained in this document are those of the authors and do not represent the official policies, either expressed or implied, of the funding sources.

      CRediT authorship contribution statement

      Angelique C. Paulk: Conceptualization, Methodology, Software, Formal analysis, Investigation, Data curation, Writing – original draft, Writing – review & editing, Visualization. Rina Zelmann: Methodology, Software, Investigation, Data curation, Writing – review & editing. Britni Crocker: Methodology, Software, Investigation, Data curation. Alik S. Widge: Resources, Writing – review & editing, Funding acquisition, Investigation. Darin D. Dougherty: Resources, Writing – review & editing, Funding acquisition. Emad N. Eskandar: Resources, Funding acquisition, Investigation. Daniel S. Weisholtz: Resources, Writing – review & editing, Investigation. R. Mark Richardson: Resources, Writing – review & editing, Investigation. G. Rees Cosgrove: Resources, Investigation. Ziv M. Williams: Resources, Investigation. Sydney S. Cash: Conceptualization, Methodology, Investigation, Data curation, Writing – original draft, Writing – review & editing, Visualization, Supervision, Project administration, Funding acquisition.

      Declaration of interests

      The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

      Acknowledgments

      We would like to thank Giovanni Piantoni, Jean-Baptiste Eichenlaub, Erica Johnson, Gavin Belok, Mia Borzello, Kara Farnes, Dan Soper, Constantin Krempp, Jaquelin Dezha-Peralta, and Pariya Salami for help in data collection. We would like to especially thank the patients for participating in the study.

      Appendix A. Supplementary data

      The following is the Supplementary data to this article:

      References

        • Mayberg H.S.
        • Lozano A.M.
        • Voon V.
        • McNeely H.E.
        • Seminowicz D.
        • Hamani C.
        • et al.
        Deep brain stimulation for treatment-resistant depression.
        Neuron. 2005; 45: 651-660https://doi.org/10.1016/j.neuron.2005.02.014
        • Perlmutter J.S.
        • Mink J.W.
        Deep brain stimulation.
        Annu Rev Neurosci. 2006; 29: 229-257https://doi.org/10.1146/annurev.neuro.29.051605.112824
        • Bronstein J.M.
        • Tagliati M.
        • Alterman R.L.
        • Lozano A.M.
        • Volkmann J.
        • Stefani A.
        • et al.
        Deep brain stimulation for Parkinson disease: an expert consensus and review of key issues.
        Arch Neurol. 2011; 68: 165-171https://doi.org/10.1001/archneurol.2010.260
        • Lozano A.M.
        • Lipsman N.
        Probing and regulating dysfunctional circuits using deep brain stimulation.
        Neuron. 2013; 77: 406-424https://doi.org/10.1016/j.neuron.2013.01.020
        • Revell M.A.
        Deep brain stimulation for movement disorders.
        Nurs Clin North Am. 2015; 50: 691-701https://doi.org/10.1016/j.cnur.2015.07.014
        • Herrington T.M.
        • Cheng J.J.
        • Eskandar E.N.
        Mechanisms of deep brain stimulation.
        J Neurophysiol. 2016; 115: 19-38https://doi.org/10.1002/mds.10145
        • Widge A.S.
        • Ellard K.K.
        • Paulk A.C.
        • Basu I.
        • Yousefi A.
        • Zorowitz S.
        • et al.
        Treating refractory mental illness with closed-loop brain stimulation : progress towards a patient-specific transdiagnostic approach.
        Exp Neurol. 2017; 287: 461-472https://doi.org/10.1016/j.expneurol.2016.07.021
        • Widge A.S.
        • Malone D.A.
        • Dougherty D.D.
        Closing the loop on deep brain stimulation for treatment-resistant depression.
        Front Neurosci. 2018; 12: 175https://doi.org/10.3389/fnins.2018.00175
        • Cagnan H.
        • Denison T.
        • McIntyre C.
        • Brown P.
        Emerging technologies for improved deep brain stimulation.
        Nat Biotechnol. 2019; 37: 1024-1033https://doi.org/10.1038/s41587-019-0244-6
        • Kokkinos V.
        • Sisterson N.D.
        • Wozny T.A.
        • Richardson R.M.
        Association of closed-loop brain stimulation neurophysiological features with seizure control among patients with focal epilepsy.
        JAMA Neurol. 2019; 76: 800-808https://doi.org/10.1001/jamaneurol.2019.0658
        • Wozny T.A.
        • Wang D.D.
        • Starr P.A.
        Simultaneous cortical and subcortical recordings in humans with movement disorders: acute and chronic paradigms.
        Neuroimage. 2020; 217: 116904https://doi.org/10.1016/j.neuroimage.2020.116904
        • Laxton A.W.
        • Lozano A.M.
        Deep brain stimulation for the treatment of alzheimer disease and dementias.
        World Neurosurg. 2013; 80 (S28.e1-S28.e8)https://doi.org/10.1016/j.wneu.2012.06.028
        • Chiken S.
        • Nambu A.
        Mechanism of deep brain stimulation: inhibition, excitation, or disruption.
        Neuroscientist. 2016; 22: 313-322https://doi.org/10.1177/1073858415581986
        • Mankin E.A.
        • Fried I.
        Modulation of human memory by deep brain stimulation of the entorhinal-hippocampal circuitry.
        Neuron. 2020; 106: 218-235https://doi.org/10.1016/j.neuron.2020.02.024
        • Holtzheimer P.E.
        • Husain M.M.
        • Lisanby S.H.
        • Taylor S.F.
        • Whitworth L.A.
        • McClintock S.
        • et al.
        Subcallosal cingulate deep brain stimulation for treatment-resistant depression: a multisite, randomised, sham-controlled trial.
        Lancet Psychiatr. 2017; 4: 839-849https://doi.org/10.1016/S2215-0366(17)30371-1
        • Dougherty D.D.
        • Rezai A.R.
        • Carpenter L.L.
        • Howland R.H.
        • Bhati M.T.
        • O'Reardon J.P.
        • et al.
        A randomized sham-controlled trial of deep brain stimulation of the ventral capsule/ventral striatum for chronic treatment-resistant depression.
        Biol Psychiatr. 2015; 78: 240-248https://doi.org/10.1016/j.biopsych.2014.11.023
        • Sullivan C.R.P.
        • Olsen S.
        • Widge A.S.
        Deep brain stimulation for psychiatric disorders: from focal brain targets to cognitive networks.
        Neuroimage. 2021; 225: 117515https://doi.org/10.1016/j.neuroimage.2020.117515
        • Boccard S.G.J.
        • Pereira E.A.C.
        • Moir L.
        • Hartevelt T.J.V.
        • Kringelbach M.L.
        • Fitzgerald J.J.
        • et al.
        Deep brain stimulation of the anterior cingulate cortex: targeting the affective component of chronic pain.
        Neuroreport. 2014; 25: 83-88https://doi.org/10.1097/WNR.0000000000000039
        • Sankar T.
        • Lipsman N.
        • Lozano A.M.
        Deep brain stimulation for disorders of memory and cognition.
        Neurother J Am Soc Exp Neurother. 2014; 11: 527-534https://doi.org/10.1007/s13311-014-0275-0
        • Jacobs J.
        • Miller J.
        • Lee S.A.
        • Gorniak R.
        • Kahana M.J.
        • Rizzuto D.S.
        • et al.
        Direct electrical stimulation of the human entorhinal region and Hippocampus impairs memory.
        Neuron. 2016; 92: 983-990https://doi.org/10.1016/j.neuron.2016.10.062
        • Ezzyat Y.
        • Kragel J.E.
        • Burke J.F.
        • Levy D.F.
        • Lyalenko A.
        • Wanda P.
        • et al.
        Direct brain stimulation modulates encoding states and memory performance in humans.
        Curr Biol. 2017; 27: 1251-1258https://doi.org/10.1016/j.cub.2017.03.028
        • Ezzyat Y.
        • Wanda P.A.
        • Levy D.F.
        • Kadel A.
        • Aka A.
        • Pedisich I.
        • et al.
        Closed-loop stimulation of temporal cortex rescues functional networks and improves memory.
        Nat Commun. 2018; 9: 365https://doi.org/10.1038/s41467-017-02753-0
        • Rao V.R.
        • Sellers K.K.
        • Wallace D.L.
        • Lee M.B.
        • Bijanzadeh M.
        • Sani O.G.
        • et al.
        Direct electrical stimulation of lateral orbitofrontal cortex acutely improves mood in individuals with symptoms of depression.
        Curr Biol. 2018; 28 (e4): 3893-3902https://doi.org/10.1016/j.cub.2018.10.026
        • Basu I.
        • Robertson M.M.
        • Crocker B.
        • Peled N.
        • Farnes K.
        • Vallejo-Lopez D.I.
        • et al.
        Consistent linear and non-linear responses to electrical brain stimulation across individuals and primate species.
        Brain Stimulat. 2019; 12: 877-892https://doi.org/10.1016/j.brs.2019.03.007
        • Bick S.K.
        • Patel S.R.
        • Katnani H.A.
        • Peled N.
        • Cash S.S.
        • Eskandar E.N.
        Caudate stimulation enhances learning.
        Brain. 2019; (–7): 2930https://doi.org/10.1093/brain/awz254
        • Widge A.S.
        • Zorowitz S.
        • Basu I.
        • Paulk A.C.
        • Cash S.S.
        • Eskandar E.N.
        • et al.
        Deep brain stimulation of the internal capsule enhances human cognitive control and prefrontal cortex function.
        Nat Commun. 2019; 10: 1-11https://doi.org/10.1038/s41467-019-09557-4
        • Basu I.
        • Yousefi A.
        • Crocker B.
        • Zelmann R.
        • Paulk A.C.
        • Peled N.
        • et al.
        Closed-loop enhancement and neural decoding of cognitive control in humans.
        Nat Biomed Eng. 2021; https://doi.org/10.1038/s41551-021-00804-y
        • Yih J.
        • Beam D.E.
        • Fox K.C.R.
        • Parvizi J.
        Intensity of affective experience is modulated by magnitude of intracranial electrical stimulation in human orbitofrontal, cingulate and insular cortices.
        Soc Cognit Affect Neurosci. 2019; 14: 339-351https://doi.org/10.1093/scan/nsz015
        • Mohan U.R.
        • Watrous A.J.
        • Miller J.F.
        • Lega B.C.
        • Sperling M.R.
        • Worrell G.A.
        • et al.
        The effects of direct brain stimulation in humans depend on frequency, amplitude, and white-matter proximity.
        Brain Stimulat. 2020; 13: 1183-1195https://doi.org/10.1016/j.brs.2020.05.009
        • Crocker B.
        • Ostrowski L.
        • Williams Z.M.
        • Dougherty D.D.
        • Eskandar E.N.
        • Widge A.S.
        • et al.
        Local and Distant responses to single pulse electrical stimulation reflect different forms of connectivity.
        Neuroimage. 2021; 237: 118094https://doi.org/10.1016/j.neuroimage.2021.118094
        • Yang Y.
        • Qiao S.
        • Sani O.G.
        • Sedillo J.I.
        • Ferrentino B.
        • Pesaran B.
        • et al.
        Modelling and prediction of the dynamic responses of large-scale brain networks during direct electrical stimulation.
        Nat Biomed Eng. 2021; https://doi.org/10.1038/s41551-020-00666-w
        • Rizzone M.
        • Lanotte M.
        • Bergamasco B.
        • Tavella A.
        • Torre E.
        • Faccani G.
        • et al.
        Deep brain stimulation of the subthalamic nucleus in Parkinson's disease : effects of variation in stimulation parameters.
        J Neurol Neurosurg Psychiatry. 2001; 71: 215-219
        • Anderson C.J.
        • Anderson D.N.
        • Pulst S.M.
        • Butson C.R.
        • Dorval A.D.
        Neural selectivity, efficiency, and dose equivalence in deep brain stimulation through pulse width tuning and segmented electrodes.
        Brain Stimulat. 2020; 13: 1040-1050https://doi.org/10.1016/j.brs.2020.03.017
        • Schor J.S.
        • Nelson A.B.
        Multiple stimulation parameters influence efficacy of deep brain stimulation in parkinsonian mice.
        J Clin Invest. 2019; 130: 3833-3838https://doi.org/10.1172/JCI122390
        • Lech M.
        • Berry B.
        • Topcu C.
        • Kremen V.
        • Nejedly P.
        • Lega B.
        • et al.
        Direct electrical stimulation of the human brain has inverse effects on the theta and gamma neural activities.
        IEEE Trans Biomed Eng. 2021; 68: 3701-3712https://doi.org/10.1109/TBME.2021.3082320
        • Solomon E.A.
        • Kragel J.E.
        • Gross R.
        • Lega B.
        • Sperling M.R.
        • Worrell G.
        • et al.
        Medial temporal lobe functional connectivity predicts stimulation-induced theta power.
        Nat Commun. 2018; 9: 1-13https://doi.org/10.1038/s41467-018-06876-w
        • Rolston J.D.
        • Desal S.A.
        • Laxpati N.G.
        • Gross R.E.
        Electrical stimulation for epilepsy: experimental approaches.
        Neurosurg Clin. 2011; 31: 425-442https://doi.org/10.1109/TMI.2012.2196707.Separate
        • Bourne S.K.
        • Eckhardt C.A.
        • Sheth S.A.
        Mechanisms of deep brain stimulation for obsessive compulsive disorder: effects upon cells and circuits.
        Front Integr Neurosci. 2012; 6: 29https://doi.org/10.3389/fnint.2012.00029
        • Mcintyre C.C.
        • Foutz T.J.
        Computational modeling of deep brain stimulation.
        Handb Clin Neurol. 2013; 116: 55-61https://doi.org/10.5588/ijtld.16.0716.Isoniazid
        • Caldwell D.J.
        • Ojemann J.G.
        • Rao R.P.N.
        Direct electrical stimulation in electrocorticographic brain-computer interfaces: enabling technologies for input to cortex.
        Front Neurosci. 2019; 13: 1-16https://doi.org/10.3389/fnins.2019.00804
        • Eisinger R.S.
        • Cernera S.
        • Gittis A.
        • Gunduz A.
        • Okun M.S.
        A review of basal ganglia circuits and physiology: application to deep brain stimulation.
        Park Relat Disord. 2019; 59: 9-20https://doi.org/10.1016/j.parkreldis.2019.01.009
        • Boëx C.
        • Vulliémoz S.
        • Spinelli L.
        • Pollo C.
        • Seeck M.
        High and low frequency electrical stimulation in non-lesional temporal lobe epilepsy.
        Seizure. 2007; 16: 664-669https://doi.org/10.1016/j.seizure.2007.05.009
        • Brocker D.T.
        • Grill W.M.
        first ed. Principles of electrical stimulation of neural tissue. 116. Elsevier B.V., 2013https://doi.org/10.1016/B978-0-444-53497-2.00001-2
        • Meador K.J.
        • Kapur R.
        • Loring D.W.
        • Kanner A.M.
        • Morrell M.J.
        Quality of life and mood in patients with medically intractable epilepsy treated with targeted responsive neurostimulation.
        Epilepsy Behav. 2015; 45: 242-247https://doi.org/10.1016/j.yebeh.2015.01.012
        • Donos C.
        • Mîndruţă I.
        • Ciurea J.
        • Mălîia M.D.
        • Barborica A.
        A comparative study of the effects of pulse parameters for intracranial direct electrical stimulation in epilepsy.
        Clin Neurophysiol. 2016; 127: 91-101https://doi.org/10.1016/j.clinph.2015.02.013
        • Muller L.
        • Rolston J.D.
        • Fox N.P.
        • Knowlton R.
        • Rao V.R.
        • Chang E.F.
        Direct electrical stimulation of human cortex evokes high gamma activity that predicts conscious somatosensory perception.
        J Neural Eng. 2018; 15https://doi.org/10.1088/1741-2552/aa9bf9
        • Miller K.J.
        • Müller K.R.
        • Hermes D.
        Basis profile curve identification to understand electrical stimulation effects in human brain networks.
        PLoS Comput Biol. 2021; 17: 1-20https://doi.org/10.1371/journal.pcbi.1008710
        • Trebaul L.
        • Deman P.
        • Tuyisenge V.
        • Jedynak M.
        • Hugues E.
        • Rudrauf D.
        • et al.
        Probabilistic functional tractography of the human cortex revisited.
        Neuroimage. 2018; 181: 414-429https://doi.org/10.1016/j.neuroimage.2018.07.039
        • Klooster M.A.
        • van ’T
        • Zijlmans M.
        • Leijten F.S.S.
        • Ferrier C.H.
        • Van Putten M.J.A.M.
        • Huiskamp G.J.M.
        Time-frequency analysis of single pulse electrical stimulation to assist delineation of epileptogenic cortex.
        Brain. 2011; 134: 2855-2866https://doi.org/10.1093/brain/awr211
        • Matsuzaki N.
        • Juhász C.
        • Asano E.
        Cortico-cortical evoked potentials and stimulation-elicited gamma activity preferentially propagate from lower- to higher-order visual areas.
        Clin Neurophysiol. 2013; 124: 1290-1296https://doi.org/10.1016/j.clinph.2013.02.007
        • Keller C.J.
        • Honey C.J.
        • Mégevand P.
        • Entz L.
        • Ulbert I.
        • Mehta A.D.
        Mapping human brain networks with cortico-cortical evoked potentials.
        Philos Trans R Soc Lond B Biol Sci. 2014; 369: 20130528https://doi.org/10.1098/rstb.2013.0528
        • Trebaul L.
        • Rudrauf D.
        • Job A.S.
        • Mălîia M.D.
        • Popa I.
        • Barborica A.
        • et al.
        Stimulation artifact correction method for estimation of early cortico-cortical evoked potentials.
        J Neurosci Methods. 2016; 264: 94-102https://doi.org/10.1016/j.jneumeth.2016.03.002
        • Matsumoto R.
        • Kunieda T.
        • Nair D.
        Single pulse electrical stimulation to probe functional and pathological connectivity in epilepsy.
        Seizure. 2017; 44: 27-36https://doi.org/10.1016/j.seizure.2016.11.003
        • Yukihiro Y.
        • Kengo S.
        • Takeharu K.
        • Riki M.
        • Yoshiki A.
        • Takuro N.
        • et al.
        Clinical impact of intraoperative CCEP monitoring in evaluating the dorsal language white matter pathway.
        Hum Brain Mapp. 2017; 38: 1977-1991https://doi.org/10.1002/hbm.23498
        • Boulogne S.
        • Ryvlin P.
        • Rheims S.
        Single and paired-pulse electrical stimulation during invasive EEG recordings.
        Rev Neurol (Paris). 2016; 172: 174-181https://doi.org/10.1016/j.neurol.2016.02.004
        • Patel B.
        • Chiu S.
        • Wong J.K.
        • Patterson A.
        • Burns M.
        • Zeilman P.
        • et al.
        Deep brain stimulation programming strategies: segmented leads, independent current sources and future technology.
        Expet Rev Med Dev. 2021; (0)https://doi.org/10.1080/17434440.2021.1962286
        • Kuneida T.
        • Yamao Y.
        • Kikuchi T.
        • Matsumoto R.
        New approach for exploring cerebral functional connectivity: review of cortico-cortical evoked potential.
        Neurol Med Chir (Tokyo). 2015; 55: 374-382https://doi.org/10.2176/nmc.ra.2014-0388
        • Stoney S.D.
        • Thompson W.D.
        • Asanuma H.
        Excitation of pyramidal tract cells by intracortical microstimulation: effective extent of stimulating current.
        J Neurophysiol. 1968; 31: 659-669https://doi.org/10.1152/jn.1968.31.5.659
        • Gunalan K.
        • Howell B.
        • McIntyre C.C.
        Quantifying axonal responses in patient-specific models of subthalamic deep brain stimulation.
        Neuroimage. 2018; 172: 263-277https://doi.org/10.1016/j.neuroimage.2018.01.015
        • Anderson D.N.
        • Duffley G.
        • Vorwerk J.
        • Dorval A.D.
        • Butson C.R.
        Anodic stimulation misunderstood: preferential activation of fiber orientations with anodic waveforms in deep brain stimulation.
        J Neural Eng. 2019; 16016026https://doi.org/10.1088/1741-2552/aae590
        • Stiso J.
        • Khambhati A.N.
        • Menara T.
        • Kahn A.E.
        • Stein J.M.
        • Das S.R.
        • et al.
        White matter network architecture guides direct electrical stimulation through optimal state transitions.
        Cell Rep. 2019; 28 (e7): 2554-2566https://doi.org/10.1016/j.celrep.2019.08.008
        • Mahlknecht P.
        • Limousin P.
        • Foltynie T.
        Deep brain stimulation for movement disorders: update on recent discoveries and outlook on future developments.
        J Neurol. 2015; 262: 2583-2595https://doi.org/10.1007/s00415-015-7790-8
        • Riva-Posse P.
        • Choi K.S.
        • Holtzheimer P.E.
        • Crowell A.L.
        • Garlow S.J.
        • Rajendra J.K.
        • et al.
        A connectomic approach for subcallosal cingulate deep brain stimulation surgery: prospective targeting in treatment-resistant depression.
        Mol Psychiatr. 2017; 23: 843
        • Matsumoto R.
        • Nair D.R.
        • LaPresto E.
        • Najm I.
        • Bingaman W.
        • Shibasaki H.
        • et al.
        Functional connectivity in the human language system: a cortico-cortical evoked potential study.
        Brain. 2004; 127: 2316-2330https://doi.org/10.1093/brain/awh246
        • Matsumoto R.
        • Nair D.R.
        • LaPresto E.
        • Bingaman W.
        • Shibasaki H.
        • Lüders H.O.
        Functional connectivity in human cortical motor system: a cortico-cortical evoked potential study.
        Brain. 2007; 130: 181-197https://doi.org/10.1093/brain/awl257
        • Keller C.J.
        • Honey C.J.
        • Entz L.
        • Bickel S.
        • Groppe D.M.
        • Toth E.
        • et al.
        Corticocortical evoked potentials reveal projectors and integrators in human brain networks.
        J Neurosci. 2014; 34: 9152-9163https://doi.org/10.1523/JNEUROSCI.4289-13.2014
        • Reuter M.
        • Rosas H.D.
        • Fischl B.
        Highly accurate inverse consistent registration: a robust approach.
        Neuroimage. 2010; 53: 1181-1196https://doi.org/10.1016/j.neuroimage.2010.07.020
        • Reuter M.
        • Schmansky N.J.
        • Rosas H.D.
        • Fischl B.
        Within-subject template estimation for unbiased longitudinal image analysis.
        Neuroimage. 2012; 61: 1402-1418https://doi.org/10.1016/j.neuroimage.2012.02.084
        • Reuter M.
        • Fischl B.
        Avoiding asymmetry-induced bias in longitudinal image processing.
        Neuroimage. 2011; 57: 19-21https://doi.org/10.1016/j.neuroimage.2011.02.076
        • Dykstra A.R.
        • Chan A.M.
        • Quinn B.T.
        • Zepeda R.
        • Keller C.J.
        • Cormier J.
        • et al.
        Individualized localization and cortical surface-based registration of intracranial electrodes.
        Neuroimage. 2012; 59: 3563-3570https://doi.org/10.1016/j.neuroimage.2011.11.046
        • Felsenstein O.
        • Peled N.
        • Hahn E.
        • Rockhill A.P.
        • Folsom L.
        • Gholipour T.
        • et al.
        Multi-modal neuroimaging analysis and visualization tool (MMVT).
        ArXiV. 2019; 1: 1-29
        • Peled N.
        • Gholipour T.
        • Paulk A.C.
        • Felsenstein O.
        • Dougherty D.D.
        • Widge A.S.
        • et al.
        Invasive electrodes identification and labeling.
        GitHub Repos. 2017; https://doi.org/10.5281/zenodo.1078789
        • Desikan R.S.
        • Ségonne F.
        • Fischl B.
        • Quinn B.T.
        • Dickerson B.C.
        • Blacker D.
        • et al.
        An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest.
        Neuroimage. 2006; 31: 968-980https://doi.org/10.1016/j.neuroimage.2006.01.021
        • Valentin A.
        • Anderson M.
        • Alarcon G.
        • Garcia Seoane J.J.
        • Selway R.
        • Binnie C.D.
        • et al.
        Responses to single pulse electrical stimulation identify epileptogenesis in the human brain in vivo.
        Brain. 2002; 125: 1709-1718https://doi.org/10.1093/brain/awf187
        • David O.
        • Job A.S.
        • De Palma L.
        • Hoffmann D.
        • Minotti L.
        • Kahane P.
        Probabilistic functional tractography of the human cortex.
        Neuroimage. 2013; 80: 307-317https://doi.org/10.1016/j.neuroimage.2013.05.075
        • Rosenberg D.S.
        • Mauguière F.
        • Catenoix H.
        • Faillenot I.
        • Magnin M.
        Reciprocal thalamocortical connectivity of the medial pulvinar: a depth stimulation and evoked potential study in human brain.
        Cerebr Cortex. 2009; 19: 1462-1473https://doi.org/10.1093/cercor/bhn185
        • Sven
        Inpolyhedron - are points inside a triangulated volume? n.d.
        • Oostenveld R.
        • Fries P.
        • Maris E.
        • Schoffelen J.-M.
        FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data.
        Comput Intell Neurosci. 2011; 2011: 156869https://doi.org/10.1155/2011/156869
        • Janca R.
        • Jezdik P.
        • Cmejla R.
        • Tomasek M.
        • Worrell G.A.
        • Stead M.
        • et al.
        Detection of interictal epileptiform discharges using signal envelope distribution modelling: application to epileptic and non-epileptic intracranial recordings.
        Brain Topogr. 2015; 28: 172-183https://doi.org/10.1007/s10548-014-0379-1
        • Bastos A.M.
        • Schoffelen J.-M.
        A tutorial review of functional connectivity analysis methods and their interpretational pitfalls.
        Front Syst Neurosci. 2016; 9https://doi.org/10.3389/fnsys.2015.00175
        • Mercier M.R.
        • Bickel S.
        • Megevand P.
        • Groppe D.M.
        • Schroeder C.E.
        • Mehta A.D.
        • et al.
        Evaluation of cortical local field potential diffusion in stereotactic electro-encephalography recordings: a glimpse on white matter signal.
        Neuroimage. 2017; 147: 219-232https://doi.org/10.1016/j.neuroimage.2016.08.037
        • Chang J.Y.
        • Pigorini A.
        • Massimini M.
        • Tononi G.
        • Nobili L.
        • Van Veen B.D.
        Multivariate autoregressive models with exogenous inputs for intracerebral responses to direct electrical stimulation of the human brain.
        Front Hum Neurosci. 2012; 6: 1-14https://doi.org/10.3389/fnhum.2012.00317
        • Parmigiani S.
        • Mikulan E.P.
        • Russo S.
        • Sarasso S.
        • Zauli F.M.
        • Rubino A.
        • et al.
        Simultaneous stereo-EEG and high-density scalp EEG recordings to study the effects of intracerebral stimulation parameters.
        bioRxiv. 2021; (11.15.468625): 2021https://doi.org/10.1101/2021.11.15.468625
        • Mikulan E.
        • Russo S.
        • Parmigiani S.
        • Sarasso S.
        • Zauli F.M.
        • Rubino A.
        • et al.
        Simultaneous human intracerebral stimulation and HD-EEG, ground-truth for source localization methods.
        Sci Data. 2020; 7: 1-8https://doi.org/10.1038/s41597-020-0467-x
        • Paff M.
        • Loh A.
        • Sarica C.
        • Lozano A.M.
        • Fasano A.
        Update on current technologies for deep brain stimulation in Parkinson's disease.
        J Mov Disord. 2020; 13: 185-198https://doi.org/10.14802/jmd.20052
        • Anderson D.N.
        • Anderson C.
        • Lanka N.
        • Sharma R.
        • Butson C.R.
        • Baker B.W.
        • et al.
        The μDBS: multiresolution, directional deep brain stimulation for improved targeting of small diameter fibers.
        Front Neurosci. 2019; 13: 1-11https://doi.org/10.3389/fnins.2019.01152
        • Anderson D.N.
        • Osting B.
        • Vorwerk J.
        • Dorval A.D.
        • Butson C.R.
        Optimized programming algorithm for cylindrical and directional deep brain stimulation electrodes.
        J Neural Eng. 2018; 15https://doi.org/10.1088/1741-2552/aaa14b
        • Miocinovic S.
        • de Hemptinne C.
        • Chen W.
        • Isbaine F.
        • Willie J.T.
        • Ostrem J.L.
        • et al.
        Cortical potentials evoked by subthalamic stimulation demonstrate a short latency hyperdirect pathway in humans.
        J Neurosci. 2018; 38: 9129-9141https://doi.org/10.1523/JNEUROSCI.1327-18.2018
        • Milosevic L.
        • Kalia S.K.
        • Hodaie M.
        • Lozano A.M.
        • Popovic M.R.
        • Hutchison W.D.
        • et al.
        A theoretical framework for the site-specific and frequency-dependent neuronal effects of deep brain stimulation.
        Brain Stimulat. 2021; 14: 807-821https://doi.org/10.1016/j.brs.2021.04.022
        • Aubert-Broche B.
        • Evans A.C.
        • Collins L.
        A new improved version of the realistic digital brain phantom.
        Neuroimage. 2006; 32: 138-145https://doi.org/10.1016/j.neuroimage.2006.03.052
        • Schilling K.G.
        • Rheault F.
        • Petit L.
        • Hansen C.B.
        • Nath V.
        • Yeh F.C.
        • et al.
        Tractography dissection variability: what happens when 42 groups dissect 14 white matter bundles on the same dataset?.
        Neuroimage. 2021; 243: 118502https://doi.org/10.1016/j.neuroimage.2021.118502
        • Holmes C.J.
        • Hoge R.
        • Collins L.
        • Woods R.
        • Toga A.W.
        • Evans A.C.
        Enhancement of MR images using registration for signal averaging.
        J Comput Assist Tomogr. 1998; 22: 324-333
        • Amunts K.
        • Mohlberg H.
        • Bludau S.
        • Zilles K.
        Julich-Brain: a 3D probabilistic atlas of the human brain's cytoarchitecture.
        Science. 2020; 369: 988-992https://doi.org/10.1126/science.abb4588
        • Paquola C.
        • Royer J.
        • Lewis L.B.
        • Lepage C.
        • Glatard T.
        • Wagstyl K.
        • et al.
        BigBrainWarp: toolbox for integration of BigBrain 3D histology with multimodal neuroimaging.
        bioRxiv. 2021; https://doi.org/10.1101/2021.05.04.442563
        • Wang F.
        • Dong Z.
        • Tian Q.
        • Liao C.
        • Fan Q.
        • Hoge W.S.
        • et al.
        In vivo human whole-brain Connectom diffusion MRI dataset at 760 μm isotropic resolution.
        Sci Data. 2021; 8: 122https://doi.org/10.1101/2020.10.05.327395
        • Rosen B.Q.
        • Halgren E.
        A whole-cortex probabilistic diffusion tractography connectome.
        ENeuro. 2021; 8: 1-21https://doi.org/10.1101/2020.06.22.166041
        • Alarcón G.
        • Martinez J.
        • Kerai S.V.
        • Lacruz M.E.
        • Quiroga R.Q.
        • Selway R.P.
        • et al.
        In vivo neuronal firing patterns during human epileptiform discharges replicated by electrical stimulation.
        Clin Neurophysiol. 2012; 123: 1736-1744https://doi.org/10.1016/j.clinph.2012.02.062
        • Creutzfeldt O.D.
        • Watanabe S.
        • Lux H.D.
        Relations between EEG phenomena and potentials of single cortical cells. I. Evoked responses after thalamic and epicortical stimulation.
        Electroencephalogr Clin Neurophysiol. 1966; 20: 1-18https://doi.org/10.1016/0013-4694(66)90136-2
        • Vatsyayan R.
        • Cleary D.
        • Martin J.R.
        • Halgren E.
        • Dayeh S.A.
        Electrochemical safety limits for clinical stimulation investigated using depth and strip electrodes in the pig brain.
        J Neural Eng. 2021; 18046077https://doi.org/10.1088/1741-2552/ac038b
        • Borchers S.
        • Himmelbach M.
        • Logothetis N.
        • Karnath H.
        Direct electrical stimulation of human cortex — the gold standard for mapping brain functions?.
        Nat Rev Neurosci. 2012; 13: 63-70
        • Paulk A.C.
        • Yang J.C.
        • Cleary D.R.
        • Soper D.J.
        • Halgren M.
        • O'Donnell A.R.
        • et al.
        Microscale physiological events on the human cortical surface.
        Cerebr Cortex. 2021; 31: 3678-3700https://doi.org/10.1093/cercor/bhab040
        • Tchoe Y.
        • Bourhis A.M.
        • Cleary D.R.
        • Stedelin B.
        • Lee J.
        • Tonsfeldt K.J.
        • et al.
        Human brain mapping with multi-thousand channel PtNRGrids resolves novel spatiotemporal dynamics.
        Sci Transl Med. 2022; 14eabj1441
        • Mankin E.A.
        • Aghajan Z.M.
        • Schuette P.
        • Tran M.E.
        • Tchemodanov N.
        • Titiz A.S.
        • et al.
        Stimulation of the right entorhinal white matter enhances visual memory encoding in humans.
        Brain Stimulat. 2020; : 104743https://doi.org/10.1016/j.brs.2020.11.015
        • Nowak L.G.
        • Bullier J.
        Axons, but not cell bodies, are activated by electrical stimulation in cortical gray matter. II. Evidence from selective inactivation of cell bodies and axon initial segments.
        Exp Brain Res. 1998; 118: 489-500https://doi.org/10.1007/s002210050305
        • Nowak L.G.
        • Bullier J.
        Axons, but not cell bodies, are activated by electrical stimulation in cortical gray matter. I. Evidence from chronaxie measurements.
        Exp Brain Res. 1998; 118: 477-488https://doi.org/10.1007/s002210050304
        • Yang J.C.
        • Paulk A.C.
        • Salami P.
        • Heon Lee S.
        • Ganji M.
        • Soper D.J.
        • et al.
        Microscale dynamics of electrophysiological markers of epilepsy.
        Clin Neurophysiol. 2021; 32: 2916-2931https://doi.org/10.1016/j.clinph.2021.06.024
        • Alizadeh M.
        • Kozlowski L.
        • Muller J.
        • Ashraf N.
        • Shahrampour S.
        • Mohamed F.B.
        • et al.
        Hemispheric regional based analysis of diffusion tensor imaging and diffusion tensor tractography in patients with temporal lobe epilepsy and correlation with patient outcomes.
        Sci Rep. 2019; 9: 1-8https://doi.org/10.1038/s41598-018-36818-x
        • Revell A.Y.
        • Silva A.B.
        • Mahesh D.
        • Armstrong L.
        • Arnold T.C.
        • John M.
        • et al.
        White matter signals reflect information transmission between brain regions during seizures.
        bioRxiv. 2021;
        • LaPlante R.A.
        • Tang W.
        • Peled N.
        • Vallejo D.I.
        • Borzello M.
        • Dougherty D.D.
        • et al.
        The interactive electrode localization utility: software for automatic sorting and labeling of intracranial subdural electrodes.
        Int J Comput Assist Radiol Surg. 2017; 12: 1829-1837https://doi.org/10.1007/s11548-016-1504-2
        • Parvizi J.
        • Kastner S.
        Human intracranial EEG: promises and limitations.
        Nat Neurosci. 2018; 21: 474-483https://doi.org/10.1038/s41593-018-0108-2.Human
        • Kunieda T.
        • Yamao Y.
        • Kikuchi T.
        • Matsumoto R.
        New approach for exploring cerebral functional connectivity: review of cortico-cortical evoked potential.
        Neurol Med Chir (Tokyo). 2015; 55: 374-382https://doi.org/10.2176/nmc.ra.2014-0388
        • Kanno A.
        • Enatsu R.
        • Ookawa S.
        • Noshiro S.
        • Ohtaki S.
        • Suzuki K.
        • et al.
        Interhemispheric asymmetry of network connecting between frontal and temporoparietal cortices: a corticocortical-evoked potential study.
        World Neurosurg. 2018; 120: e628-e636https://doi.org/10.1016/j.wneu.2018.08.137
        • Scangos K.W.
        • Makhoul G.S.
        • Sugrue L.P.
        • Chang E.F.
        • Krystal A.D.
        State-dependent responses to intracranial brain stimulation in a patient with depression.
        Nat Med. 2021; 27: 229-231https://doi.org/10.1038/s41591-020-01175-8
        • Usami K.
        • Matsumoto R.
        • Kobayashi K.
        • Hitomi T.
        • Shimotake A.
        • Kikuchi T.
        • et al.
        Sleep modulates cortical connectivity and excitability in humans: direct evidence from neural activity induced by single-pulse electrical stimulation.
        Hum Brain Mapp. 2015; 36: 4714-4729https://doi.org/10.1002/hbm.22948
        • Naftulin J.S.
        • Ahmed O.J.
        • Piantoni G.
        • Eichenlaub J.B.
        • Martinet L.E.
        • Kramer M.A.
        • et al.
        Ictal and preictal power changes outside of the seizure focus correlate with seizure generalization.
        Epilepsia. 2018; 59: 1398-1409https://doi.org/10.1111/epi.14449
        • Grill W.M.
        • Snyder A.N.
        • Miocinovic S.
        Deep brain stimulation creates an informational lesion of the stimulated nucleus.
        Neuroreport. 2004; 15: 19-22https://doi.org/10.1097/01.wnr.0000125783.35268.9f
        • Grill W.M.
        • Wei X.F.
        High efficiency electrodes for deep brain stimulation.
        in: Proc 31st Annu int conf IEEE eng med biol soc eng future biomed EMBC 2009. 2009https://doi.org/10.1109/IEMBS.2009.5333774 (3298–301)
        • Kent A.R.
        • Swan B.D.
        • Brocker D.T.
        • Turner D.A.
        • Gross R.E.
        • Grill W.M.
        Measurement of evoked potentials during thalamic deep brain stimulation.
        Brain Stimulat. 2015; 8: 42-56https://doi.org/10.1016/j.brs.2014.09.017
        • Kanno A.
        • Enatsu R.
        • Ookawa S.
        • Ochi S.
        • Mikuni N.
        Location and threshold of electrical cortical stimulation for functional brain mapping.
        World Neurosurg. 2018; 119: e125-e130https://doi.org/10.1016/j.wneu.2018.07.059
        • McIntyre C.C.
        • Grill W.M.
        • Sherman D.L.
        • Thakor N.V.
        Cellular effects of deep brain stimulation: model-based analysis of activation and inhibition.
        J Neurophysiol. 2004; 91: 1457-1469https://doi.org/10.1152/jn.00989.2003
        • Nair D.R.
        • Laxer K.D.
        • Weber P.B.
        • Murro A.M.
        • Park Y.D.
        • Barkley G.L.
        • et al.
        Nine-year prospective efficacy and safety of brain-responsive neurostimulation for focal epilepsy. 95. 2020https://doi.org/10.1212/WNL.0000000000010154
        • Titiz A.S.
        • Hill M.R.H.
        • Mankin E.A.
        • Aghajan Z.M.
        • Eliashiv D.
        • Tchemodanov N.
        • et al.
        Theta-burst microstimulation in the human entorhinal area improves memory specificity.
        Elife. 2017; 6: 1-18https://doi.org/10.7554/eLife.29515