UFDC Home  myUFDC Home  Help 



Full Text  
DATA MINING AND TIME SERIES ANALYSIS OF BRAIN DYNAMICAL BEHAVIOR WITH APPLICATIONS IN EPILEPSY By MICHAEL ANDREW BEWERNITZ A DISSERTATION PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLORIDA IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY UNIVERSITY OF FLORIDA 2008 2008 Michael A. Bewernitz To my family, my loving fiancee Teddi, and all those whom have helped me along the way of this challenging journey. ACKNOWLEDGMENTS I would first like to thank Panos Pardalos for his guidance, wisdom, and his persistent drive towards excellence which helped me and numerous students to think big, aim high, and repeatedly achieve great feats throughout the years. Most of all, I thank Dr. Pardalos for the effort he exerted to assist me during a difficult portion of my graduate schooling. I would also like to thank Dr. Basim Uthman for teaming up with me to share his brilliant ideas, time, energy, and financial support. The benefits of his impact on my graduate experience are beyond measure. I'm very grateful for opportunity to work with Dr. Georges Ghacibeh and for the large positive impact he has had on my career as a Ph.D. student. I would also like to thank Dr. Mingzhou Ding, Dr. Steven Roper, and Dr. Hans Van Oostrom for serving on my graduate committee and providing valuable feedback. I thank Dr. J. Chris Sackellares for his guidance and support throughout the years, especially when we worked together at the Brain Dynamics Laboratory at the University of Florida. In addition, I commend Dr. DengShan Shiau for his continual assistance in all areas of my graduate career for the last five years. I'm also grateful for the guidance of my BDL labmates, Dr. Wanpracha Chaovalitwongse, Linda Dance, ChangChia Liu, Dr. Sandeep Nair, and Wichai Suharitdamrong as well as Dr. Wendy Norman for their assistance with work and just keeping my bearings during this challenging chapter of my life. I would also like to thank Dr. Paul Carney for his guidance throughout the years during meetings, conferences, seminars, or just in passing on campus. He has helped me in numerous ways and I extend sincere thanks. I am also grateful for Dr. Kevin Kelly for providing me the privilege of a fruitful and engaging experience working at his facility. I thoroughly enjoyed the summer of 2005 working in his Pittsburgh lab on our challenging task. I am grateful to have made the acquaintance of Peter Jukkola, Dr. Elena Kharlamov, Kathy Schmitt, and all the AlleghenySinger Research Institute staff that helped me along the way. I'm very grateful for my most recent group of friends in the Center for Applied Optimization at the University of Florida. The broad spectrum of research experience available my CAO colleagues such as Ashwin Arulselvan, Dr. Vladimir Boginski, Nikita Boyko, Dr. Stanislav Busygin, Dr. Altannar Chinchuluun, Alla Kammerdiner, O. Erhun Kundakcioglu, Dr. Antonio Mucherino, Dr. Oleg Prokopyev, Steffen Rebennack, Dr. Onur Seref, Oleg Shylo, and Petros Xanthopoulos helped provide me with rapid answers to many research questions, numerous perspectives to attacking a problem, as well some tasty ethnic food, drink and insider information for world travel! Short of becoming a United Nations ambassador, I doubt I will ever work with such a unique and diverse group of friends ever again. I also appreciate the efforts of Scott Bearden, David Juras, and all the staff at the Malcom Randall VA Medical Center of the North Florida/South Georgia Veterans Health System who have collaborated with our University of Florida research team and provided invaluable support for my Ph.D. studies. I would also like to thank Professor Jens Timmer, Professor Andreas SchulzeBonhage, Dr. Bjorn Schelter, Dr. Michael Jachan, Hinnerk Feldwisch, Armin Brandt, Jakob Nawrath, Raimar Sandner, Johannes Wohlmuth, Thomas Maiwald, Christiane Lehmann, Carolin Gierschner, Dr. Matthias Winterhalder, Dipl. Ing. Richard AschenbrennerScheibe, Dr. Henning Voss of the Freiburg Center for Data Analysis and Modeling, University of Freiburg, Germany, for providing publicly available deidentified EEG signals for research purposes. Their generosity has greatly benefited my studies. In addition, General Clinical Research Center, Grant # MO 1RR00082 has provided the means to conduct a portion of the research conducted in this dissertation. I would like to acknowledge the efforts of AprilLane Derfinyak, Anide PierreLouis, Laura Studstill, Kristi Wagner, Kathryn Whitesides, as well as Tifiny Dyer, Michelle Griffin, Danielle Wise, and Cindy Hansen for helping keep me on schedule with graduate school deadlines and comply with all the university guidelines that were a challenge to keep track of. Outside of my professional contacts, I would like to thank all my friends and my entire family, Howard, Noreen, Julie, and Mark Bewernitz for countless hours of encouragement in good and bad times. They have shared my ups and downs and maintained a steady supply of loving support throughout it all. I thank my loving fiancee, Teddi, for her continued support throughout the various phases of my graduate career. You mean everything to me Teddi. Above all, I thank The Father, The Son, and The Holy Spirit for the grace and blessings to persevere throughout the greatest challenge of my life thus far. TABLE OF CONTENTS page ACKNOWLEDGMENT S .........4.... ...............4 A C K N O W L E D G M E N T S ............................................................................................................... 4 L IST O F T A B L E S ......... .... .............. ..................................... ...........................10 LIST OF FIGURES .................................. .. .... ..... ................. 12 LIST OF ABBREVIATION S ........................... ........................... .... .................. 17 A B S T R A C T ......... ....................... ............................................................ 18 1 INTRODUCTION ............... .......................................................... 20 Computational Therapeutic Approaches: a New Frontier in Medical Treatment ..................21 Establishm ent of N eural States in Epilepsy....................................... ......................... 24 D ynam ical D isorders in N eurology ............................................... ............................ 25 Objectives and Contributions of this Dissertation......................................................27 Organization of Chapters ................................................. ...... ................. 28 2 AN OVERVIEW OF EPILEPTIC DISORDERS AND EPILEPSY RESEARCH D IR E C T IO N S ...................................... .................................................... 32 In tro d u c tio n ...................... .....................................................................................3 2 C classification of Seizure Types ........................................... .................. ............... 34 P partial S eizu res ................................................................ 34 G en eraliz ed S eizu re s ................................................................................................. 3 5 A absence seizures ....................... ......................... .. .. ................ 35 S tatu s ep ilep ticu s ................................................................................ 3 6 E p ilep sy T reatm ent ............... ........................ .................................... ................... 3 7 The Electroencephalogram as a Diagnostic Tool................................. ...... ............ ...38 Antiepileptic Drugs ......................... ........... .. .. .......... ..... ..... 39 Sodium channel blockers .............. ................................................................40 GABA agonists, reuptake inhibitors, and transaminase inhibitors ........................40 G lutam ate blockers ................... .. ................ ................ .. ...... .. ........ .... 41 Pharmacologicallyresistant epileptic seizures..................................................41 E p ilep sy Su rg ery ....................................................... ................ 4 2 G ene T therapy ............................................................................ 42 Electrical Stim ulation Therapy ............................................. .............................. 42 D eep brain stimulation .......................... ........... ........ ............ 44 C e reb e llu m ...............................................................................................................4 5 Subcortical structures ........................ ................ ................... .. ...... 46 C au date nu cleu s............................................................................... ............... 4 6 T h alam u s ............................................................................ 4 6 Centrom edian nucleus ............................................. .......... ............... 47 A interior thalam ic nu cleu s ............................................................. .....................47 Subthalam ic nucleus.............................................................. ...........................48 H ip p o cam p u s ........................................... ....................................4 8 V agus nerve stim ulation ................................................. .............................. 48 Future Therapeutic D directions ................................................... ........................ 51 Complex nature of epileptic dynamics .............. .............................................. 52 Dynamical diseases and disorders...................................................................... 52 Epilepsy as a dynamical disorder of brain systems...............................................54 Compensating for impaired neural control mechanisms: system control therapy ...54 3 TIME SERIES ANALYSIS AND DATA MINING TECHNIQUES: THEORY AND A P P L IC A T IO N .......................................................................................................5 6 Glossary of Term s ...................... ... .............................................56 Tim e Series A analysis ............... .. ........................................................... .. .... 57 Methods Applied in the Time Domain....................... ......................... 58 Autoregressive moving average modeling............................................................58 Autoregressive integrated moving average modeling............................................59 C ross correlation ............................................ ....... ................. 59 M methods Applied in the Frequency Domain ....................................... ............... 61 C oherence .............................................................................................................6 1 D iscrete Fourier transform ............................................... ............................ 62 W av e let a n aly sis ................................................................................................. 6 4 Inform action B asked M methods ......................................................................... ....................65 A pproxim ate Entropy ................................................. .. .... ........ ........ 65 Pattern M atch R egularity Statistic.............................................................................. ...66 M mutual Inform action ......................... ........... .. .. ......... ..... ..... 67 Chaotic System A analysis Techniques.......................................................... ............... 68 Phase Space M apping ................................................. ...... .. .............. .. 70 The M ethod of D elays .................. .................................... .. ...... .... 71 F ractal D im en sion ................ ............................................ ................ .......... ...... 72 B ox counting dim ension (D O) ........................................................ ............... 74 Inform ation dim ension (D )........................................... .............................. 74 Correlation dim ension (D2) .................................. .....................................75 The Lyapunov Exponent ............................................................. ............... 75 Computing ShortTerm Maximum Lyapunov Exponents.............................................77 M ean Angular Frequency in Phase Space................................................. ............... 85 D ata M in in g ...............................86............................. C lu stern g ................................................................8 7 K m ean s clu sterin g ............................................................................................. 8 7 B iclu steering ................................................................... 87 C on sistent b iclu sterin g ....................................................................................... 89 Data Classification..........................................................92 Machine learning ................... ..............................92 Mahalanobis distance classification ...................................... 93 Support vector m machines ............................................................... ............. 94 8 4 INVESTIGATION OF EEG BIOMARKER EXISTENCE FOR VAGUS NERVE STIMULATION THERAPY: A DATA MINING APPROACH ........................................102 M motivation for VN S Therapy Improvement .......... ..... ....... ...... .. .... .................... 103 EEG Markers for Treatment of Neurological Diseases and Disorders .......................103 M odeling Brain D disorder D ynam ics .......................... .............. ................. .... 104 Biclustering Analysis of EEG Dynamics in Patients undergoing VNS Therapy for E pilep sy ....... ..........................................................107 D ata D description ................................................... ............... ........... 107 STLm ax Feature Extraction ................................................ .............................. 109 Experim mental Setup .................. ...................................... ................ 110 R e su lts .............................................................. ................................................1 1 1 D iscu ssion ..... .......... ............. ....... ................. ............ ...............112 SVM Analysis of EEG Phase Space Patterns in Patients undergoing VNS Therapy for E p ilep sy ....... ..........................................................1 13 D ata D e scrip tio n ...................................................................................................... 1 14 SVM Application D description ......................................................... .............. 114 Experim mental D design .................. ...................................... ................. 115 R e su lts ................... ...................1...................1.........7 Discussion............................ ........ ....... ...... ...... ...............117 Data Mining Analysis of EEG Dynamics Patients undergoing VNS Therapy for E epilepsy ...... ..........................................................120 D ata D e scrip tio n ...................................................................................................... 12 0 Feature Extraction .............................................. .. .. .... ........ ......... 121 SVM Analysis of EEG Dynamics ...... .......................... .............................. ....... 121 Logistic Regression Analysis of EEG Dynamics.......... ...................................122 Experim mental Setup .......................... ...................... ... .... ......... ......... 124 R e su lts ........................................................................12 4 D discussion ............................................. 125 C onclusions.....................................................................127 5 ANALYSIS OF INTERSTIMULATION BRAIN DYNAMICS IN VAGUS NERVE STIM U L A TIO N TH ER A PY .......................................................................................... 142 Further Characterizations/Investigations of EEGEffects in VNS Therapy .........................142 Dynamical EEG Measures as Markers for Neurological Diseases and Disorders........ 143 Data Description ......................................145 The Surrogate Analysis Method ..........................................146 The Role of Surrogate Data Analysis in EEG studies ....... ..........................148 Nonlinearity Analysis of Interstimulation EEG ...................................................149 C choosing a T est Statistic ............................................................150 E xperim mental D design ...............................................................15 1 R e su lts ........................................................................1 5 2 D isc u ssio n ................................. ........ ................................................ ............... 1 5 3 Temporal Evolution of Interstimulation EEG Dynamics ..... ......... .... ...............156 D ata D e scrip tio n ............. .. ............. ...................................................................... 1 5 6 E E G D ynam ical M measures ...................................................................................... 157 9 A pproxim ate entropy ............................................ ....................................... 157 C correlation sum ..................................... ..................... .. ........ .... 158 M ean angular frequency in phase space............... .............................................. 159 Shortterm maximum Lyapunov exponent .................................... ............... 159 Experim mental D design ........................ ...................... ... .... ......... ......... 160 R e su lts ........................................................................1 6 2 D discussion ............................................. 163 C onclusions.....................................................................166 6 A NOVEL GENERALIZED ABSENCE SEIZURE DETECTION ALGORITHM ........... 199 M e th o d s .......................................................................................................................... 2 0 0 Energy M ethod for SW D Detection ................................ ...................... ....... 200 Fanselow M ethod for SW D D election ....................................................... 201 Westerhuis Method for SWD Detection............................... ..... ........ 201 Dynamic Time W arping .................................... ............... ...................202 TeagerKaiser Energy ......... .......................................................203 E m p iric al S tu d y .............................................................................................................. 2 0 4 E E G D ata A acquisition ..............................................................204 Data Sampling and Feature Extraction ........................... .............. 205 SVM Training and Testing ................................. .......................... ... ....... 206 Detector Performance Evaluation............................................................207 R e su lts ................... ...................2.............................8 D iscu ssion .......... ..........................................................208 7 DISCUSSION AND CONCLUDING REMARKS .................................... ....217 Towards RealTime EEG Analysis Tools for the Bedside and Implantation ...................217 Data Mining Approaches to Characterizing EEG Patterns .............................................218 Analysis of Interstimulation Dynamics ............... .............. ... ..... ........ 222 R em arks on V N S R results ...............................................................225 Seizure D election and Stratification ............................................. ............... 226 F in al R em ark s ................................................................................ 22 7 L IST O F R E F E R E N C E S ...................................................................................................229 BIO GRA PH ICA L SK ETCH ...............................................................247 LIST OF TABLES Table page T able 41. V N S stim ulation param eters................................................................................. 133 Table 42. Patient information for epilepsy patients with the VNS implant. .............................136 Table 43. SVM separation accuracy and seizure information................ ....... ........... 136 10 Table 44. Mean SVM and LR separation accuracy and patient seizure information................. 141 Table 51. Surrogate analysis results summary for all six patients with the VNS implant.........176 Table 52. Control patient surrogate analysis results summary .............................................177 Table 53. Approximate entropy analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H1 using the ApEnt m measure ........................................................ .................................187 Table 54. Approximate entropy analysis results for the control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H1 using the A pE nt m measure. ....................................................................... ...................188 Table 55. Correlation sum analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H2 using the correlation sum m measure. ........................................................................ ................... 189 Table 56. Correlation sum analysis results for the control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H2 using the correlation sum m measure. ...................................................................... ..................... 190 Table 57. Mean angular frequency in phase space analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H3 using the Q measure. ................................... .. .. ........ .. ............191 Table 58. Mean angular frequency in phase space analysis results for control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H3 using the Q m measure. ........................................................................193 Table 59. Shortterm maximum Lyapunov exponent analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H4 using the STLmax measure.............. ............................... ...............194 Table 510. Shortterm maximum Lyapunov exponent analysis results for the control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H4 using the STLmax measure............... ......... ................. 196 Table 61. Classification performance using the first second of each seizure.............................213 Table 61. Classification performance using the last second of each seizure..............................213 LIST OF FIGURES Figure page Figure 21. Seizure classification ruling as designated by the Epilepsy Foundation (2008).........34 F figure 22. V N S pulse sequence ................................................................................. .......... 49 Figure 23. Closedloop seizure control device using electroencephalogram or electrocorticogram signals as an input to a feature extraction algorithm, which supplies the extracted features to a controller which makes a decision regarding the action of a stim ulator. .......................... ...... ..................... .... ............... 55 Figure 31. A 15 second segment depicting the 200 Hz EEG of an absence seizure viewed from channel F p lF 7............. ....................................................................... .......... ... 98 Figure 32. A 15 second segment depicting the spectrogram of an absence seizure viewed from channel FplF7. The vertical lines represent the onset and offset of the seizure. ....99 Figure 33. Example angular frequency evolution in phase space. ...........................................100 Figure 34. Biclustering result of a toy dataset. The dataset produced three distinct classes.....100 Figure 41. Rationale for studying EEG patterns which may be associated with the effect of V N S o n th e b ra in ............................................................................................................13 1 Figure 42. Conceptual EEG dynamics model in threedimensional feature space for testing stimulation parameter configurations in newlyimplanted VNS patients. Adjusting the stimulation parameters results in an altered dynamical 'state' of the brain denoted by the coordinates in threedimensional feature space. The model's colored regions relate the EEG dynamical state to its predicted clinical outcome..................................132 Figure 43. EEG electrode placement. Electrodes were positioned according to the 1020 electrode placement system which assigns locations proportionally spaced locations (e.g. 10%20%) with respect to the size of the patient's head............... ... .................133 Figure 44. STLmax class designation for biclustering analysis..........................................134 Figure 45. Biclustering heatmap of STLmax from A) patient A and B) patient B ..................135 Figure 46. Mean SVM separation accuracy value across the stimulations for each individual intrastim ulation w window ....................................................................... ....................137 Figure 47. VNS output current and the corresponding mean SVM separation accuracy over 2 4 h ou rs......... ....... .. ........... .............. ...............................................13 7 Figure 48. VNS pulse width and the corresponding mean SVM separation accuracy over 24 h o u rs ................... ........................................................................... 13 8 Figure 49. VNS signal frequency and the corresponding mean SVM separation accuracy o v er 2 4 h o u rs....................................................................... 13 8 Figure 410. SVM Separation accuracy throughout the VNS epoch, averaged across all epochs. Stimulation begins at t=0 seconds. ........................................ ............... 139 Figure 411. Overall mean SVM separation averaged across intraepoch time points and all epoch s ......................................................... ..................................139 Figure 412. LR separation quality throughout the VNS epoch, averaged across all epochs. Stimulation begins at t=0 seconds. ...........................................................................140 Figure 413. Overall mean LR AUC averaged across intraepoch time points and all epochs...140 Figure 51. Map of EEG electrode location for the VNS patients. The electrodes were positioned according to the 1020 electrode placement system which assigns locations proportionally spaced locations (e.g. 10%20%) with respect to the size of the patient's head. ............... ........... ..................................................... 171 Figure 52. Electrode positions for the control patient from A) an inferior and right view and B) axial slice view of the brain. Red circles indicate focal electrodes (TBa4, TBb6, HR7), blue circles indicate nonfocal electrodes (TLb2, TLb3, TLc2). Images provided for this publication courtesy of the Freiburg Center for Data Analysis and Modeling at the AlbertLudwigs Universitat Freiburg (University of Freiburg), Freiburg, G erm any .................. .................................................... ... ......... 171 Figure 53. Comparison of pulse width parameter to the fraction of epochs displaying a nonlinear signature in the six patients treated with VNS. The fraction of epochs displaying a nonlinear signature in control patient using the 3minute and 5minute off pseudo stimulation times are represented by the column of six triangles (3 minute off times) and six squares (5 minute off times). ................................... ............... 172 Figure 54. Patient A surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis................172 Figure 55. Patient B surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. The red lines indicate seizures ........................................................ 173 Figure 56. Patient C surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis................173 Figure 57. Patient D surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis................174 Figure 58. Patient E surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis................174 Figure 59. Patient F surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. .............................................174 Figure 510. The fraction of all interstimulation epochs per channel which rejected the null hypothesis HO using ApEnt for A) patient A, B) patient B, C) patient C, D) patient D E ) patient E F ) patient F ............................................................................... .... 175 Figure 511. Control patient (with 5minute artificial stimulation times) surrogate data analysis results over 24 hours for all artificial interstimulation epochs. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis........... ........ ...... .. ............. ............... 177 Figure 512. Control patient (with 3minute artificial stimulation times) surrogate data analysis results over 24 hours for all artificial interstimulation epochs. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis........... ........ ...... .. ............. ............... 177 Figure 513. Experimental setup for characterizing the temporal evolution EEG dynamics during interstimulation intervals in patients undergoing VNS therapy for epilepsy. The double head arrows indicate a statistical comparison is made between the EEG feature segments represented by the shaded rectangles...............................178 Figure 514. Patient A temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) 0, and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. ......................................................................... 179 Figure 515. Patient B temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) 0, and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. The red lines indicate seizures .......................................... .................180 Figure 516. Patient C temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) 0, and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. ......................................................................... 18 1 Figure 517. Patient D temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) 0, and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. ......................................................................... 182 Figure 518. Patient E temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) 0, and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. ......................................................................... 183 Figure 519. Patient F temporal evolution of dynamics analysis results for A) ApEnt, B) correlation sum, C) 0, and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. ......................................................................... 184 Figure 520. Control patient (with 5minute artificial stimulation times) temporal evolution of dynamics analysis results for A) ApEnt, B) correlation sum, C) 0, and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. .....................................185 Figure 521. Control patient (with 3minute artificial stimulation times) temporal evolution of dynamics analysis results for A) ApEnt, B) correlation sum, C) 0, and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. .....................................186 Figure 522. Approximate entropy analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H1 using the A pE nt m easure............................................................................................ . 188 Figure 523. Correlation sum analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H2 using the correlation sum m measure. ........................................................................ ................... 190 Figure 524. Mean angular frequency in phase space analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H3 using the Q m measure. ........................................................................192 Figure 525. Shortterm maximum Lyapunov exponent analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H4 using the STLmax measure............................................. ...............195 Figure 526. ApEnt results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation ........................................................ ................................ 196 Figure 527. Correlation sum results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation ........................................................ ................................ 197 Figure 528. Q results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation. ........197 Figure 529. STLmax results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation ........................................................................................ 198 Figure 61. Approximately 6 seconds of scalpEEG demonstrating the 2.53.5 Hz spike wave discharge that defines an electrographic absence seizure (data provided courtesy of D r. Gregory H olm es). ............................................ ........................... 210 Figure 62. DTW comparison of two different SWD segments. The top signal is a 300 ms SWD segment. Bottom signal is a 300 ms segment of a different SWD. The DTW distance is about 2.4 x 10................... ................ ..... ............ 211 Figure 63. DTW comparison of a SWD segment with a random interictal segment. Top signal is a 300 ms EEG segment of a SWD. Bottom signal is 300 ms of interictal EEG. The DTW distance is about 5.1 x 10 ...................................... ............... 212 Figure 64. Seizure classification evaluation framework. ................................ ..................212 Figure 65. Seizure detection performance for RBF parameter sigma=20 using the first second of each seizure. ............................................. .. .. ............... ....... 214 Figure 66. Seizure detection performance for RBF parameter sigma=40 using the first second of each seizure. ............................................. .. .. ............... ....... 214 Figure 67. Seizure detection performance for RBF parameter sigma=80 using the first second of each seizure. ............................................. .. .. ............... ....... 215 Figure 68. Seizure detection performance for RBF parameter sigma=20 using the last second of each seizure. ............................................. .. .. ............... ....... 215 Figure 69. Seizure detection performance for RBF parameter sigma=40 using the last second of each seizure. ............................................. .. .. ............... ....... 216 Figure 610. Seizure detection performance for RBF parameter sigma=80 using the last second of each seizure. ............................................. .. .. ............... ....... 216 LIST OF ABBREVIATIONS AED Antiepileptic drug ApEnt Approximate entropy DNA Deoxyribonucleic acid DTW Dynamic time warping EEG Electroencephalogram FN False negative FP False positive GCRC General Clinical Research Center IID Independent and identically distributed IRB Institutional Review Board LR Logistic regression PLED Periodic lateralized epileptiform discharge STLmax Shortterm maximum Lyapunov exponent SVM Support vector machine SWD Spikeandwave discharge TN True negative TP True positive VNS Vagus nerve stimulation Q Mean angular frequency in phase space Abstract of Dissertation Presented to the Graduate School of the University of Florida in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy DATA MINING AND TIME SERIES ANALYSIS OF BRAIN DYNAMICAL BEHAVIOR WITH APPLICATIONS IN EPILEPSY By Michael Andrew Bewernitz May 2008 Chair: Panagote M. Pardalos Major: Biomedical Engineering Epilepsy is a neurological disorder characterized by recurrent seizures. Approximately 30% of patients with epilepsy have seizures that are resistant to antiepileptic drug (AED) therapy. If these patients are unable to undergo epilepsy surgery, they may choose to utilize the Vagus Nerve Stimulator (VNS) implant. The VNS therapy system has been approved by the FDA to electrically stimulate the left vagus nerve for epilepsy treatment. Patients with newly implanted VNS systems undergo an adjustment period of several months involving numerous medical checkups to fine tune the electrical stimulation parameters based on clinical response. This suboptimal adjustment method leaves the patient at risk of seizures and imposes financial burden. Identification of a marker of desired VNS operation would greatly expedite this adjustment process. The utility of noninvasive electroencephalogram (EEG), success of neural state classification research for diagnosis and treatment of neurological disorders, and the potential for realtime application due to advances of computer technology motivate this study. This dissertation outlines data mining approaches involving biclustering, logistic regression, and support vector machines as well as statistical comparisons of a range of relevant EEG dynamical measures for the characterization of electroencephalographic patterns associated with VNS therapy. The preliminary results are consistent with biological processes and clinical observations. One explanation for the electroencephalographic behavior is that VNS mimics a theorized therapeutic seizure effect where a seizure "resets" the brain from an unfavorable preictal state to a more favorable interictal state. The preliminary results suggest a connection between the EEG patterns and the stimulation parameters which may require a range of linear and nonlinear measures for adequate characterization. In addition, support vector machines are utilized to create a seizure detection and stratification algorithm in patients with generalized absence epilepsy. The algorithm utilizes dynamic time warping distance and TeagerKaiser energy as the representative EEG features. The algorithm performed slightly better at seizure onset detection than for seizure offset. This is likely due to increased waveform consistency shortly after onset compared to offset. Such an algorithm may benefit clinicians and researchers by providing a means to rapidly annotate EEG signals as well as a means to provide a clinically interesting measure of therapeutic efficacy for drug evaluation studies (e.g. distribution of seizure durations may vary before and after drug therapy, and thus a measure of this distribution may find clinically relevant information which a raw seizure count would miss). A future direction of this project is to test additional EEG feature inputs and assess how the algorithm copes with the challenges presented in online EEG analysis. CHAPTER 1 INTRODUCTION Recent advances in mathematics provide new tactics for the analysis of complex datasets. These advances provide new options for analyzing and modeling seemingly complex system behavior such as that seen in biological systems. In addition, the rapid growth of computational capabilities in the modern computer provides the possibility for realtime computational analysis of biological datasets. Such scientific milestones have revolutionized the direction of scientific research in many disciplines, among them, the study of epilepsy. In recent decades, a growing body of evidence has surfaced in research reports suggesting the existence of a preictal state has resulted in a great interest in quantitatively characterizing this theorized "seizure imminent" state. Due to the superior time resolution and large availability of the electroencephalographs, much research has been devoted to characterizing the preictal state in terms of electroencephalogram (EEG) datasets. Advances in the understanding of nonlinear system dynamics have lead to massive breakthroughs for the challenging task of characterizing the dynamics governing the behavior of complex systems. In many instances, these novel system modeling approaches can achieve better results than were previously attainable with standard linear approaches. One major premise for the characterization of neural states is that the dynamics directing brain function are often best examined within a nonlinear deterministic framework (Savit et al., 2003). Such a framework can provide a useful means to analyze systems that that exhibit adaptive behavior and are nonautonomous (both of which are traits of biological systems). For the example of seizure prediction, this method bypasses the explicit underlying neurophysiological processes involved in seizure generation and instead focuses on predicting "undesirable" neural states (e.g. seizures) by measuring and modeling the temporal progression of various observable features of brain behavior. Whether predicting seizure or other neural state changes, such features may currently include brain electrical or magnetic field fluctuations, blood flow, neurochemical concentration profiles. Of these measures, electrical activity as measured in EEG data sets is the most commonly used feature for describing neural state in epilepsy. Computational Therapeutic Approaches: a New Frontier in Medical Treatment The computational power and memory storage abilities of modern computational age have revolutionized the way that scientists and engineers approach problems. One of the most exciting achievements of the 20th century is the invention of the semiconductor transistor, which was followed by a cascade of computational advances throughout the last 50 years. Moore's Law is a famous model of the observed growth rate of computational abilities and has remained astonishingly accurate for several decades (Intel Corporation, 2005). The state of modern technology provides modern researchers the ability to not only solve problems that could be not practically be solved a few decades ago, but now we are in a unique position to solve many such problems in realtime applications. While the benefits of such technology are manifesting at an almost alarming pace in every aspect of life, the fields of biology and medicine have capitalized in ways that may have seemed inconceivable only decades ago. Necessity is the mother of invention, and such is the driving force for many of the numerous serendipitous medical discoveries. One prime example is a solution to the many problems plaguing the functionality of hospital bedside cardiac regulation devices. The original device utilized an external bedside machine which regulated the cardiac pacing. Among the many difficulties included impeded patient mobility due to the size and mass of the equipment, alternating current power requirement, as well as skin burns at electrode sites (Nelson, 1993). The advent of implantable devices forever revolutionized the field of medical treatment when a Swedish group first implemented the previously unheardof idea of utilizing an implantable device for cardiac pacing (Nelson, 1993). The success of cardiac pacemakers opened the eyes of physicians and engineers alike that were seeking new solutions to the challenge of improving the state of medical treatment. The cardiac pacemaker was highly sophisticated solution to the treatment of damaged and diseased hearts and helped pave the way for a revolution in medicine; the use of computational devices (implantable or bedside) to help regulate the physiology of patients afflicted with some chronic condition. This new engineering direction added numerous challenges such a biocompatibility and safety issues, as well as new concepts (e.g. designing implantable devices with the expectation that the treatment device is likely to or guaranteed to fail in lifetime of the patient). In recent years, microelectromechanical devices (MEMs) have been able to strongly capitalize on the advancements of computers. As computers became smaller, faster, and more efficient, savvy engineers were able to capitalize on the new options available to them. For example, the combination of MEM sound sensors, processors, and transcutaneous transmitters provides the possibility of mimicking the role of the cochlea in patients with a specific cause of hearing impairment (Chapin and Moxon, 2001). While the device is far from being as precise or accurate as the original brain tissue, such a device helped pioneer a new research direction for augmenting impaired brain function. Additionally, retinal implants are being heavily researched to compensate for certain types of blindness (Schanze et al., 2007). The device is able to mimic some of the tasks of a function retinal including photo detection and the directing preprocessing phase output to the optic nerve. Despite the astonishing milestones of progress in these brain machine interfaces (BMI), these two implantation devices are still being heavily researched. Another intensely researched field of BMI aims to integrate the state of the art computational technology combined with the modern marvels of neuroscience in order to overcome certain types of paralysis (Nicolelis et al., 2001; Kim et al., 2007). Such an apparatus provides the ability of the brains muscle movement signals to execute actions in a prosthetic limb. The above BMIs face numerous challenges which must be overcome before such devices can become a mainstay of treatment. For one, adequate input data acquisition is massive challenge in and of itself. All such devices assume that obtaining samples of the brain's electrical signals can serve as sufficient inputs (as the specific knowledge of neurotransmitter chemistry and exact neuronal connectivity cannot currently be obtained as successfully as the electrical signals can be recorded). Also, while our understanding of the roles of the secondary and primary motor cortices in the planning and execution of motor movements have sufficed to provide exciting preliminary results for such BMIs, the time and spatial resolution of such recordings required for optimal external limb control remains uncertain. In addition, one massive challenge of itself is to extract useful features from such signals in order to serve as the proper inputs to the underlying model governing the action of such a device. Furthermore, the proper choice of model is a field of heavy research in and of itself. As is expected, the available models of brain function have numerous advantages and disadvantages compared one another that can depend on the particular states of the brain to be modeled, the range of brain states considered, quality of recordings, feature extraction methods and so on. While the state of the art of neuroscience has made progress relevant to the development of BMIs, there is still much room for improvement in understanding the basic and advanced mechanisms of normal brain function as well as impaired brain function in various neurological disorders. While the impaired neural functions of interest in the previously described BMI applications may in some cases seem rather straight forward, the specific neural impairment processes of some other neurological disorders are at the present moment less explicitly understood. For such disorders, such as epilepsy, the extraction of suitable biomarkers for any type of advanced therapeutic scheme is hampered by the apparent mysterious nature of the disorder. Epilepsy is a disorder that not only has symptoms that are not fully understood (e.g. the specific cause and purpose of an epileptic seizure), but also the occurrence of seizures often does not appear to follow any known behavioral pattern with a sufficient degree of accuracy. There is much room for improvement. Establishment of Neural States in Epilepsy Extensive research has been conducted in the last four decades with the focus of unveiling and modeling the mechanisms that lead up to a seizure. It has been said that only approximately 3% of epilepsy cases present seizures that are initiated by some external stimulus whereas for the vast majority of patients there are no such clear events associated with seizure initiation (Le Van Quyen et al., 2001). However, there is a large body of clinical evidence suggesting that seizures are preceded by a physiologic state change that occurs prior to seizure onset. Documented clinical changes preceding a seizure include increase in heart rate (Delamont et al., 1999; Novak et al., 1999; Kerem and Geva, 2005), cerebral blood flow (Weinand et al., 1997; Baumgartner et al., 1998), the availability of oxygen (Adelson et al., 1999), magnetic resonance imaging of the blood oxygenleveldependent signal (Federico et al., 2005) as well as changes visible in single photon emission computed tomographic patterns (Baumgartner et al., 1998). Thus, one of the most profound discoveries in this field of research is postulation of a physiologic "preseizure" state (Mormann et al., 2007). This theory is supported by a large volume of documented physiologic changes occurring prior to seizure onset within and outside of the brain. This transition from a "normal" state into a preseizure or "preictal" state is one of the major theories regarding seizure initiation that has affected the direction of epilepsy research. On a neuronal level, the preictal state results in an abnormal synchronized "bursting" involving large populations of neurons in various brain structures. Depending on the type of epilepsy, these discharges can begin locally and possibly spread to various regions of the brain or can begin multiple regions nearly simultaneously. Dynamical Disorders in Neurology The epileptic disorder exhibits traits similar to a class of diseases termed "dynamic diseases" which demonstrate particular complex behavior patterns that evolve over time. Specifically, these "dynamic diseases" have been broadly described as a class of diseases which undergo a temporal disruption of underlying physiological control mechanisms leading to period of abnormal dynamical behavior (Mackey and Glass, 1977; Mackey and an der Heiden, 1982; Milton and Mackey, 1989; Belair et al., 1995; Milton and Black, 1995; Milton, 2000; Lopes Da Silva et al., 2003; Colijn and Mackey, 2005). Examples of these phenomena include the oscillation of blood cell populations in hematological diseases (Colijn et al., 2006), tremor in Parkinson's Disease (Beuter and Vasilakos, 1994), as well as several neurological disorders such as epilepsy, migraine, and multiple sclerosis (Milton and Black, 1995). Within the perspective of control mechanisms (e.g. feedback or feed forward control systems), dynamical diseases can be viewed as an undesirable alteration of a standard biological control scheme (Mackey and Glass, 1977; Mackey and an der Heiden, 1982; Milton and Mackey, 1989; Belair et al., 1995; Milton and Black, 1995; Milton, 2000; Lopes Da Silva et al., 2003). Such dynamical disorders often undergo state transitions that bear resemblances to bifurcations in mathematical systems, for example. The overall significance of identifying dynamic diseases is that it may be possible to develop therapeutic approaches based on the manipulation of the identified critical control parameters (Mackey and an der Heiden, 1982; Milton and Black, 1995). Numerous studies present models utilizing linear and nonlinear dynamical EEG time series analysis measures to model the transition into a seizure (lasemidis and Sackellares, 1991; lasemidis et al., 1993; Lehnertz and Elger, 1995; Casdagli et al., 1996; Lehnertz, 1999; Le Van Quyen et al., 2001; Osorio et al., 2001; lasemidis et al., 2003, 2004; Chaovalitwongse et al., 2005). Often the long term goal is to utilize these measures to serve as inputs for a dynamical disease model used in a closedloop therapeutic control device (lasemidis et al., 2003; Good et al., 2004, 2005; Fountas and Smith, 2007). Thus, if a seizure represents a period of aberration in a dynamical epileptic disorder which is characterized by nonlinear EEG measures such as STLmax (lasemidis et al., 2000), then nonlinear dynamical measures (such as STLmax) could conceivably provide a useful framework for characterizing the effect of therapeutic intervention (Good et al., 2004, 2005; Ghacibeh et al., 2005). Aside from such practical applications, quantitative EEG analysis from a nonlinear dynamical framework has also helped provide some novel insight towards defining a physiological role of seizures in epileptic disorders. For example, one theory states that a seizure is the manifestation of the brain's mechanism for "resetting" the brain when it enters an undesirable state. Such a state has been characterized by an unhealthy similarity in the rate of information production among critical brain sites, a process referred to as dynamicall entrainment" (lasemidis et al., 2004). Physiologically, such a resetting effect may follow a proposed therapeutic mechanism similar to that of ECT induced seizures (Fink, 2000; Gwinn et al., 2002; Taylor, 2007). The theorized existence of neural states that are indicative of the current status of the epileptic disorder forms the basis for many modelbased seizure control therapy research projects. A common belief of researchers in this field is that a therapeutic dosage of drug or electrical stimulation can be applied at the proper location of the central nervous system and at the proper time to mitigate and possibly prevent seizure occurrence. In essence, this line of therapy embraces a philosophy that a welltimed, "minor" therapeutic action in the proper location will abort a seizure by means of fulfilling the therapeutic action for which the seizure was intended. Much like the cardiac pace maker described earlier, a "brain pacemaker" is becoming more of a realistic possibility (Savit, 2003) for providing a means to dispense localized electrical stimulation or drug dispensing treatment "on demand" when preictal transition state changes are detected (Stein et al., 2000; Theodore and Fisher, 2004; Good et al., 2004, 2005; Morell, 2006). Objectives and Contributions of this Dissertation A team of leading scientists, health care providers, and leaders of voluntary health organizations came together to discuss what it would take to find a cure for epilepsy in March, 2000. The milestone WhiteHouse initiated conference, "Curing Epilepsy: Focus on the Future," was sponsored by the National Institute of Neurological Disorders and Stroke in collaboration with the American Epilepsy Society, Citizens United for Research in Epilepsy, Epilepsy Foundation, as well as the National Association of Epilepsy Centers. The conference stressed the importance of scientists throughout the nation to investigate methods of studying and treating seizures. The conference produced a national agenda for epilepsy research which has served as a community guide towards a cure. Since then, the epilepsy research community has progressed substantially in updating the research benchmarks to be aligned with current research developments. As a result, a primary goal of the 2007 conference was to assess the original benchmarks and discuss new research directions. The attendees voted on which areas were most promising, as well as those in need of attention. The Epilepsy Benchmark Stewards gathered in October 2007 to finalize a hierarchy of epilepsy research benchmarks. Of particular interest to this dissertation are the following specific benchmarks: * Develop valid screening strategies and biomarkers and surrogate markers (e.g., genetic, pharmacogenomic, electrophysiologic, imaging, biochemical) to identify patients who are likely to respond to, or develop adverse effects from specific therapies. * Develop higherthroughput costeffective models for screening pharmacotherapies for specific types of epilepsy. * Optimize existing therapies The main goal of this dissertation is to extract useful features from the EEG signal of patients afflicted with epilepsy in order to further the understanding of the disorder and work towards improvements to existing therapies. The first portion of this research addresses the desire to identify EEG markers of optimal VNS therapy for the purpose of expediting the parameter adjustment phase in newlyimplanted patients. The final chapter introduces a novel approach to seizure detection and stratification algorithm which may provide a useful tool for evaluation drug efficacy. Organization of Chapters The research presented in this dissertation is organized into seven chapters. Chapter one provides an overview of the document. The overview consists of a brief introduction to the field of quantitative EEG analysis in epilepsy as well as the scope of research presented in this dissertation from the context of federallyestablished epilepsy research guidelines. Chapter two describes an extensive overview of various epileptic disorders, symptoms, diagnosis, and a range of relevant clinical and biological information. In addition, an overview of diagnostic tools and current treatment modalities is presented as well the direction of future treatment research. Chapter three overviews the broad range of methods utilized in quantitative EEG analysis. The described methods are broadly classified as time series analysis and data mining methods. Relevant mathematical theory is and biological interpretations in experimental situations are explained. Chapter four begins with a description of epilepsy from a dynamical disorder perspective and outlines some key EEG data mining analysis methods applied within this framework. Based on these observations from scientific literature, the aforementioned dynamical EEG analysis methods are employed to study the effect of vagus nerve electrical stimulation therapy in order to characterize the relationship of the stimulation parameters with the EEG behavior in terms of dynamical measures. The results are discussed in terms of their relationship to relevant clinical research observations and the underlying biological processes. The work described in chapter four is has been published in three journal articles: * "Biclustering EEG data from epileptic patients treated with vagus nerve stimulation", authored by Stanislav Busygin, Nikita Boyko, Panos Pardalos, Michael Bewemitz, and Georges Ghacibeh (Busygin, 2007). * "Quantification of the Impact of Vagus Nerve Stimulation Parameters on electroencephalographic Measures" with authors Michael Bewemitz, Georges Ghacibeh, Onur Seref, Panos Pardalos, ChangChia Liu, Basim Uthman (Bewemitz, 2007). * "A Data Mining Approach to the Investigation of EEG Biomarker Existence for Vagus Nerve Stimulation Therapy Patients", with authors Nikita Boyko, Michael Bewemitz, Vitaliy Yatsenko, Panos Pardalos, Georges Ghacibeh, Basim Uthman, submitted to Computing and Optimization in Medicine and Life Sciences Vol. 3, (Boyko et al., 2008). Chapter five provides additional quantitative EEG analysis in patients undergoing VNS therapy for epilepsy. This chapter closely examines the interstimulation EEG dynamics using numerous EEG dynamical measures commonly applied in neural state classification studies. Specifically, this chapter assesses the nonlinearity of EEG dynamics and characterizes time dependent dynamical behavior and compares these features to stimulation parameters. The results are discussed in the context relevant clinical research findings as well as relevant physiologic processes. The potential application of such results for use in realtime seizure control applications and rapid parameter tuning apparatus is presented. A paper related to these interstimulation dynamics studies was published under the title "Optimization of epilepsy treatment with vagus nerve stimulation" with authors Basim Uthman, Michael Bewernitz, ChangChia Liu, and Georges Ghacibeh (Uthman et al., 2007). Chapter six begins with an introduction into generalized absence epilepsy. A novel seizure detection and stratification algorithm is presented as a means to help physicians and researchers rapidly annotate EEG signals as well as provide online diagnostic tools. In particular, such a seizure stratification algorithm may provide a clinically interesting measure of therapeutic efficacy for drug evaluation studies (e.g. the distribution of seizure duration distribution before and after drug therapy may provide clinically relevant information which a raw seizure count would miss). A manuscript related to this work was published under the title "Support vector machines in neuroscience" with authors Onur Seref, O. Erhun Kundakcioglu, and Michael Bewernitz (Seref et al., 2007). Chapter seven summarizes the findings of this dissertation. Concluding remarks regarding the overall significance of the findings are discussed. Future research directions in light of these results are presented. CHAPTER 2 AN OVERVIEW OF EPILEPTIC DISORDERS AND EPILEPSY RESEARCH DIRECTIONS Introduction The term epilepsy is derived from the Greek word epilamvanein which means "to be seized", "to be attacked", "to be taken hold of". This disorder has been well documented throughout historical texts for thousands of years in numerous civilizations. Ancient Greeks referred to people "being seized" and "having an attack" as if the person were under the influence of a supernatural force. This idea comes from the ancient notion that disease was a form of punishment from the gods or evil spirits (Engel, 1989). These descriptions likely refer to the abrupt, complex timing of seizure onset and how the symptoms could be described as almost a supernatural "seizing" of the individual for certain types of seizure. Hippocrates was the first person documented as having suggested that epilepsy was a disorder of the brain around 400 B.C. (Parker and Parker, 2003). Epilepsy is not a disease, though, but rather a symptom of a disorder of the brain. Normally, the tens of billions of brain cells making up the brain communicate with one another via small bursts of electrical activity. An unexpected, erratic electrical discharge of a group of brain cells is referred to as a seizure. A seizure can be brought on by a variety of insults such as toxins, drugs, metabolic disturbances, or trauma, flashing lights, or hyperventilation (Wilner, 2003). Such a provoked seizure is separate from Epilepsy, which is a disorder distinguished by recurrent seizures (Lothman et al., 1991). The epileptic condition can arise from numerous causes. Typically, the common element in all causes of epilepsy are events that result in a disturbance of neuronal functionality such as extreme illness, chemical or physical brain damage, or abnormal brain development resulting from genetic or other triggers (Parker and Parker, 2003). Specific brain features resulting from such brain alterations that could be responsible for epilepsy include altered neuronal connectivity, excessive levels of excitatory neurotransmitters, deficiencies of inhibitory neurotransmitters, or possibly a combination thereof. It has also been observed that the brain's attempts to repair itself after injury can lead to irregular nerve connectivity patterns which eventually lead to epilepsy (Parker and Parker, 2003). Recent estimates of worldwide epilepsy prevalence for a wide range of age groups indicated between 3 and 8 reported cases of epilepsy per 1000 people (Shorvon et al., 2004). The hallmark of epilepsy is recurrent seizures caused by the sudden development of synchronous neuronal firing. Seizure symptoms can include uncontrollable shaking, loss of awareness, visual and aural hallucinations, phantom odors, and other sensory disturbances depending on the location and spread of electrical activity in the brain (Weaver, 2001; Wilner, 2003). Electroencephalogram (EEG) recordings show that these discharges begin either locally in one or more portions of a cerebral hemisphere or simultaneously in both cerebral hemispheres (Binnie et al., 1997; Niedermeyer et al., 1993). These seemingly unpredictable seizures can cause a variety of motor symptoms and have a major effect on the patient's quality of life by imposing restricted driving privileges, adverse effects on social and career opportunities, selfesteem, education, and psychiatric issues (Goldstein and Harden, 2001; Manford, 2003; Wilner, 2006). In addition, recurrent seizures may cause progressive neuronal damage, leading to impaired memory and cognition. A 1995 study estimated that epilepsy imposed an economic burden of $12.5 billion in associated health care costs and losses in employment, wages, and productivity in the U.S. (Begley et al., 2000). Classification of Seizure Types All types of seizures are broadly classified depending on whether the seizure arises in a restricted portion of the brain within one hemisphere or if the onset involves both hemispheres (Shorvon et al., 2004). Seizures that do not fit into these categories are referred to as unclassified. Figure 21 outlines a basic framework for seizure classification as designated by the Epilepsy Foundation (2008). Epileptic Seizure Types S Partial Status Epilepticus Generalized Infantile Tonic Clonic Spasms Complex Simple Absence Myoclonic Atonic Figure 21. Seizure classification ruling as designated by the Epilepsy Foundation (2008). Partial Seizures Partial seizures are those that occur in a localized region of the brain known as a "focus". Partial seizures can be roughly broken down into simple partial, complex partial, and secondary generalized seizures. A simple partial seizure may materialize with rhythmic twitching of a limb, cessation of speed, strange sensations in the body, or hallucinations (Shorvon et al., 2004). The particular symptoms vary from patient to patient and depend on the region of the brain in which the seizure is occurring. Simple partial seizures begin suddenly, cease quickly, and do not involve an impairment of consciousness. In a complex partial seizure a person will temporarily undergo an impairment of consciousness are often preceded by a premonitory sensory or psychic aura (Shorvon et al., 2004). During the seizure the person appears unresponsive and may make purposeless limb movements called "automatisms". Automatisms can include such behavior as eye blinks, twitches, chewing motions of the mouth, and possibly walking in a circular pattern (Parker and Parker, 2003). Patients can often be amnesic about the events occurring in complex partial seizures. Some partial seizures can spread to both hemispheres resulting in tonic (muscle tensing) and clonic (rhythmic muscle twitching) symptoms. This type of spreading of seizure activity after focal onset is referred to as secondary generalization. These seizures were once referred to as "grand mal" seizures, though this terminology is now discouraged. Conversely, atonic seizures produce a sudden reduction in muscle tone. Generalized Seizures Generalized seizures refer to seizures initiate in both brain hemispheres simultaneously. These seizures are often accompanied with impaired consciousness. Two important types of generalized absence seizures are absence seizures and status epilepticus. Absence seizures Absence seizures are a type of generalized seizure where seizures are initiated by an abrupt rapid onset as well as an abrupt rapid offset. These seizures have an off and on nature where the duration of the seizure is rarely longer than 30 seconds in duration and most often less than 5 seconds in duration (Shorvon et al., 2004). Often the patient will not provide explicit symptoms of having experienced a seizure, but rather may continue the behavior or movement pattern that was active at seizure onset. The impaired consciousness combined with a general amnesia about the experience means that absence seizures can interfere with schooling and may even be misinterpreted as daydreaming. Status epilepticus Status epilepticus is a serious, potentially fatal condition in which seizures persevere for significantly longer durations than other seizure types. One of the challenges in diagnosing status epilepticus is to provide a definition that is theoretically sound as well as useful in the emergency room as neuronal damage can occur after sufficient time (Costello and Cole, 2007). In addition to the brain, prolonged seizures can damage to numerous body systems including heart, lung, and kidney tissue (Wilner, 2003). A recent review article suggests a hybrid of operational definitions including 5 minutes of persistent, generalized, convulsive seizure activity or two or more distinct seizures between which there is incomplete recovery of consciousness (Lowenstein et al., 1999) where the seizure activity also persists after sequential administration of appropriate doses of appropriate first and second lineAEDs (Costello and Cole, 2007). Nonconulsive status epilepticus (NCSE) refers to the cases of status epilepticus associated with ictal EEG activity yet without convulsive motor activity (Uthman and Bearden, 2008). Patients in the NCSE state may appear to be in a confused stuporous state or a comatoselike state (Costello and Cole, 2007). While status epilepticus can take on many electroencephalographic characteristics, "clear cut" nonconvulsive status epileptic cases will present the following properties: * Frequent or continuous focal electroencephalographic seizures demonstrating changes in amplitude, frequency, or localization * Frequency or continuous generalized spike and wave discharges (SWDs) in patients whom do not have a history of epilepsy * Frequent or continuous generalized SWDs which show significant amplitude or frequency differences in relation to previous SWDs (in patients with a history of epileptic encephalopathy) * Periodic lateralized epileptiform discharges (PLEDs) in patients which have become comatose after convulsive status epilepticus (Korff and Nordli, 2007). The challenge of treating NCSE cases is that both the electroencephalographic characteristics and the clinical symptoms can appear very similar to those exhibited by metabolic disorders. For example, cases of positive NCSE diagnosis have been reported where patients initially demonstrated extended periods of diffuse rhythmic delta activity before any ictal waveforms were presented (Uthman and Bearden, 2008). Triphasic waves can be present in both NCSE as well as the nonepileptic encephalopathies such as metabolic encephalopathies, though triphasiclike waves must be highly persistent to be considered as possibly arising from NCSE (Kaplan and Birbeck, 2006). Currently, one of the most reliable diagnostic strategies is to administer a dosage of a benzodiazepine class drug and to observe any changes in the EEG signal. Though a small portion of patients (15%) will be resistant to benzodiazepine therapy, the drug will often result in improved mental status and suppression of ictal waveforms in patients that were undergoing NCSE (Shneker and Fountain, 2003). The absence of clinical improvement after benzodiazepine dosage does not necessary rule out NCSE. Epilepsy Treatment Surprising as it may be the plethora of modem medical imaging technologies that have developed in the recent decades, though useful for supplementing available information about the brain, are no substitute for a medical imaging modality invented over 80 years ago. EEG recordings are relatively cheap to acquire, relatively safe, are often noninvasive (except in more severe epilepsy cases), and provide exceptional time resolution. The Electroencephalogram as a Diagnostic Tool EEG recordings as well as other related electrophysiological measures are the most commonly used diagnostic tools for the treatment of epilepsy. Though numerous people made significant technological contributions, Richard Caton is established as the first physician to observe the brain's continuous spontaneous electrical activity in 1875 (Goldensohn, 1997). Hans Berger is credited as the father of electroencephalography due to his 1932 report containing four photographic EEG segments of a patient's postictal recovery (Goldensohn, 1997). The measurement of the brain's electrical field potentials via EEG is the cornerstone for epileptic diagnosis and classification of epileptic seizures (Speckmann et al., 1997). Field potentials are detectable in the space surrounding nervous system tissue. Field potentials arise from the changes in membrane potential of neurons and glial cells. An excitatory post synaptic potential (EPSP) occurs when an excitatory afferent fiber is stimulated and the resulting inflow of cations (e.g. sodium) lead to a membrane depolarization. The spread of the membrane depolarization results in an intracellular current as well as an extracellular current. The extracellular current induces the field potential which is perceived by a nearby electrode as a negative charge (due to the influx of cations) and a distant electrode perceives a positive charge (due to the out flux of cations) (Speckmann et al., 1997). A similar yet opposing process occurs for an inhibitory post synaptic potential (IPSP), where the stimulation of an inhibitory afferent fiber induces an outflow of cations perceived by a nearby electrode as a local positive charge. Field potentials generated by epileptic processes exceed the potentials generated by nonepileptic processes because the epileptic activity is highly synchronized (and thus have relatively elevated amplitude due to a summation effect). Furthermore, experiments have demonstrated a close temporal relationship between the paroxysmal depolarization of a neuron in superficial cortex and EEG sharp waves (an indicator of epileptic activity) during the development of an epileptic focus in a seizure model (Speckmann et al., 1997). Due to the large degree of synchrony in epileptic outbursts the behavior of this neuron can be extrapolated to provide a suitable representation of the epileptic neuronal network. Though sharp waves have an important role in epilepsy diagnosis, there are numerous types of epilepsy with differing characteristic EEG patterns. For example, absence seizures are often associated with 3hz generalized spike and wave patterns yet tonicclonic seizures are often associated with a variety of rhythms of generalized spiking and polyspike bursting (Chabolla and Cascino, 1997). Beyond the handful of examples of epileptiform EEG patterns listed here, there are numerous EEG properties that the trained electroencephalographer takes into consideration before arriving at a diagnosis. Such diagnostic details are beyond the scope of this dissertation, however, an excellent overview can be found in Chabolla and Cascino (1997). Once the proper diagnosis is made, there are numerous methods used to treat epilepsy. The methods are treating a specific cause (if one can be identified), avoiding precipitants of seizures (if any can be identified), antiepileptic drugs (AED), behavior modification, surgery, electrical stimulation, and diet control (Oxley and Smith, 1991). Use of AEDs is the most common form of treatment. Antiepileptic Drugs AEDs can treat seizures in numerous ways. Some AEDs make brain cells less excitable. Others make brain cells less likely to pass messages. Still other AEDs increase the amount of a inhibitory neurotransmitters such as gamma amino butyric acid (GABA) (Oxley and Smith, 1991). One way to classify AEDs is by their main therapeutic mechanism (though there are some drugs that utilize numerous mechanisms and others may even have unknown mechanisms). From this organizational framework, the main groups include sodium channel blockers, calcium current inhibitors, gammaaminobutyric acid (GABA) enhancers, glutamate blockers, carbonic anhydrase inhibitors, hormones, and drugs with unknown mechanisms of action (Ochoa and Riche, 2007). While an indepth review of antiepileptic drugs is beyond the scope of this dissertation, an executive summary of some of the basic antiepileptic drug categories will be outlined. Sodium channel blockers This class of drug is well characterized. As the name implies, sodium channel blocking drugs inhibit sodium channel operation which prevents the affected neuron from depolarizing and thus inhibits neuronal firing (Ochoa and Riche, 2007). Prominent examples of sodium channel blockers include carbamazepine, lamotrigine and zonisimide. Lamotrigine is a drug commonly used to treat absence seizures. GABA agonists, reuptake inhibitors, and transaminase inhibitors yaminobutyric acid (GABA) is an inhibitory neurotransmitter and popular target for antiepileptic drug action. This is because there are numerous ways to enhance the functionality of the GABA system, many of which demonstrate a clinically useful antiepileptic effect. GABA A receptors control the influx of Cl ions and GABAB receptors are connected with potassium channel function (Ochoa and Riche, 2007). The effect of GABA can be enhanced several ways: * direct binding to GABAA receptors, * blocking presynaptic GABA uptake, * inhibiting the metabolism of GABA by GABA transaminase, * increasing the synthesis of GABA (Ochoa and Riche, 2007). Benzodiazepines (BZDs) are an important class of shortacting drugs whose anticonvulsant effect is due to binding with GABAA receptors, where they then enhance inhibitory neurotransmission (Shorvon et al., 2004). BZDs are commonly used in epilepsy treatment as well as anesthetic applications. They are most often used for treating status epilepticus and clusters of seizures rather than long term treatment. For example, the BZD midazolam has demonstrated effectiveness the treatment of convulsive status epilepticus in patients for whom phenytoin, and/or phenobarbital had failed (Kumar and Bleck, 1992). One difficulty in with this drug class is the sedative effects which are a major factor limiting the use of benzodiazepines in long term seizure therapy. Thus, benzodiazepines tend to be used most often for acute seizure treatment. Glutamate blockers Glutamate is more of the most important excitatory neurotransmitters in the brain (along with aspartate). The glutamate neurotransmission system is highly intricate and the major classification scheme for ionotropic glutamate receptors is to name them after the agonist that activates the binding site (e.g. AMPA, kainite, and NMDA). AMPA and kainite sites control channels that pass sodium and a small amount of calcium. NMDA sites control channels that pass large amounts of calcium in addition to sodium (Ochoa and Riche, 2007). Felbamate and Topiramate are examples of antiepileptic drugs that mitigate glutamate excitatory transmission. Pharmacologicallyresistant epileptic seizures AED therapy can be very effective in preventing seizures. Primary generalized epilepsy and benign partial epilepsy are two classes of epilepsy that respond well to AEDs. Patients with temporal lobe epilepsy are not so fortunate, though. These unfortunate people can usually expect to take AEDs their entire life. The odds of gaining complete control over temporal lobe epilepsy seizures are not as good as primary generalized or benign partial epilepsy (Oxley and Smith, 1991). Approximately 30% of patients with epilepsy have seizures that are resistant to AED therapy, and must resort to alternative therapies (Theodore and Fisher, 2004). Epilepsy Surgery Surgical treatment may be considered in extreme cases where the patient does not achieve adequate benefit from AED therapy (Engel et al., 1993). The mean duration of inpatient hospital stay for presurgical EEG monitoring ranges from 4.7 to 5.8 days and costs over $200 million each year (Begley et al., 2000). In order to be a candidate for surgery, the first criterion is that the patient must have seizures arising from a single seizure focus in the brain. In addition, the excision procedure cannot be performed on brain regions that are essential for normal functioning of the patient (Roper, et al., 1993; Velasco et al., 2000; Durand and Bikson, 2001). Even if as many as 50% of these patients were to benefit from surgical resection (an optimistic estimate), many patients still require new therapeutic approaches (Theodore et al., 2004). Gene Therapy Gene therapy is an innovative approach to providing antiepileptic therapy to patients with pharmacologically resistant seizures. From the perspective of treating epilepsy by correcting an imbalance in excitatory and inhibitory neuronal transmission, a vector can be used to insert neuropeptide genes in certain brains which lead to intracranial creation of therapeutic peptides. For example, the neuropeptide Y gene inserted into rat hippocampus with adenoassociated viral vectors resulted in reduced generalization, delayed seizure initiation, and provided neuroprotection in a rat seizure model (Noe' et al., 2007). Additionally, the lentivirus may be used as a vector, or to graft genetically engineered cells which produce therapeutic substances (Vezzani, 2004). Though these as well as other results are very promising, gene therapy for epilepsy treatment is still at the preclinical research stage. Electrical Stimulation Therapy Brain stimulation is becoming one of the main alternative therapeutic approaches for patients whom are suffering for pharmacologically intractable epilepsy and are not surgical candidates. While the force can have a strong influence on the weakminded (Kenobi, 1977), conventional electrical stimulation therapy remains a more widelyused form of brain stimulation. Numerous forms of electrical stimulation therapy have been utilized for the treatment of epilepsy. One such method of brain stimulation is membrane polarization by uniform direct current (DC) electric fields. This form of stimulation comes from the basic principle that electrical current can generate an electric field when then results in generation of electric current. Specifically, electric fields generated by the nervous system can directly modulate the activity of neurons and often can recruit neighboring cells. DC electric fields have a unique property compared to other stimulation paradigm in that they can cause either excitation or inhibition of neuronal activity depending on the orientation of the field with respect to dendrite. (Durand and Bikson, 2001). While DC field stimulation utilizes a relatively low current amplitude (only a few microamperes), there are several drawbacks to this method: 1) irreversible chemical reactions can result the dc field which often result in tissue and/or electrode damage; 2) the efficacy of stimulation is highly sensitive on DC field orientation; 3) either excitation or inhibition can be induced depending cell location and orientation (thus, improper DC field orientation can induce the "opposite" of the intended effect); 4) the termination of the DC pulse induces an excitation which results in a rebound of spontaneous activity; and 5) DC fields application must typically be applied for the entire duration of an ictal event for desired efficacy and thus may require long pulses (Durand and Bikson, 2001). Low frequency stimulation paradigms (e.g. stimulation frequencies less than 10 Hz) provide robustness over DC electric field stimulation. Unlike DC field stimulation, low frequency stimulation is not orientation dependent and thus its effects are less variable. In addition, lowfrequency and single pulse stimulation have longlasting effects which remain long after the duration of the pulse. This after effect helps minimize the electrochemical damage as well as the amount of energy required for stimulus. Periodic low frequency stimulation applied via transcranial magnetic stimulation (TMS) is a noninvasive method to induce electric fields in the brain. A study investigating the susceptibility of amygdala for kindling in rats demonstrated a 55% higher threshold for the induction of epileptic after discharges two weeks after a single TMS train (120A/Ls, 20 Hz for 3 s) (Ebert, 1999). The mechanism underlying this type of antiepileptic effect for lowfrequency stimulation is unknown, but suspected to be longterm depression (LTD). LTD is a persistent decrease in synaptic strength caused by low frequency (e.g. 1 Hz) stimulation (Purves et al., 2004). Lowfrequency stimulation paradigms for establishing LTD could decrease neuronal firing rate which may in an antiepileptic effect (Durand and Bikson, 2001). Deep brain stimulation Deep brain stimulation (DBS) attracted great attention in 1996 for its use in the treatment of tremor related to Parkinson's disease and essential tremor (Gross, 1994). DBS offers several advantages over PNS (e.g. vagus nerve) stimulation. Specifically, electrodes implanted in the brain can directly stimulate the targeted structure with far greater accuracy than PNS stimulation. Also, the coarse action of PNS stimulation risks activation of afferent (such as pain or sensory) and efferent fibers (such as those modulating cardiovascular and abdominal visceral functions) (Durand and Bikson, 2001). Naturally, a major DBS disadvantage is that the implantation of intracranial electrodes has a greater extent of invasiveness and associated risk than PNS stimulation. There are presently four general hypotheses explaining the therapeutic mechanism of DBS: 1) stimulationinduced alterations in the activation of voltagegated currents block neural output near the stimulating electrode; 2) indirect inhibition of neuronal output by means of activation of axon terminals that make synaptic connections with neurons near the stimulating electrode; 3) synaptic transmission failure of the efferent output of stimulated neurons as a result of transmitter depletion; 4) stimulationinduced disruption of pathologic network activity (McIntyre et. al, 2004). Additional research utilizing microdialysis, neural recordings, modeling, and functional imaging will likely need to be conducted in order to fully characterize the effects of DBS (McIntyre et. al, 2004). Since DBS therapy relies on accurate positioning of electrodes, surgical implantation is assisted with several guiding tools. DBS electrodes are implanted into the brain using stereotaxic methods, MRI targeting, recording of extracellular unit activity, and electroencephalographic monitoring. Some typical stimulation parameters are 110 volts, 90 gts pulses in trains of 100 165 Hz, running either continuously or in intervals of 1 minute on and 5 minutes off (Theodore and Fisher, 2004). Clinically useful and tolerable stimulation parameters can vary from patient to patient as well as across different sections of the brain. Thus, a common strategy of DBS is to exploit the natural behavior of various brain structures in a manner to most effectively produce an antiseizure effect. Cerebellum Cerebellar stimulation can be performed to capitalize on the inhibitory outflow which is present in nearly all patients. Anterior stimulation decreased hippocampal formation discharges. However, cerebellar stimulation has had variable effects in animal models, which may have been related to variable stimulation parameters (Theodore and Fisher, 2004). An interesting phenomenon discovered in controlled DBS studies is the placebo effect. For example, in a controlled study of cerebellar DBS involving 14 control patients, 2 of the 14 patients showed improvements in seizure frequency (Hodaie et al., 2002). This placebo effect, defined as a reduction (or abolition) of symptoms with insertion of DBS alone, might be due to an initial lesioning resulting from the implantation procedure. Subcortical structures Interest in subcortical stimulation comes from its widespread, nonspecific, anterior and intralaminar nuclear connections to the mesial frontal, temporal, and limbic structures. In addition, it demonstrates progressive recruitment of substantial nigra, subthalamic nucleus, and midline thalamic nuclei in animal models of epilepsy. Stimulation of the subthalamic nucleus, anterior, thalamus, and substantial nigra have been shown to inhibit limbic seizures in animal models of epilepsy (Theodore and Fisher, 2004). In addition, stimulation of the basal ganglia structure may modify propagation of seizures (Deransart et al., 1998). Some of the most important subcortical structures will now be discussed. Caudate nucleus The effect of caudate nucleus stimulation has demonstrated antiepileptic effects in an aluminumhydroxide seizure focus model, though the efficacy is highly dependent on stimulation frequency (Theodore and Fisher, 2004). An inhibitory seizure protection effect was demonstrated for stimulation at 10100 Hz, whereas 100 Hz stimulation increased seizure frequency. The antiseizure effects of the caudatenucleus are hypothesized to be due to activation of the substantial nigra under the presumption that lowfrequency stimulation is excitatory and high frequency stimulation is inhibitory (Theodore and Fisher, 2004). Since these results are from uncontrolled studies, it is uncertain if "micro ablation" resulting from electrode implantation is contributing to the antiseizure effect. Thalamus The thalamus is seen as a strategic stimulation site on the basis that it is the pacemaker of the cortex, with widespread connections between the two structures. There is electrophysical and anatomical evidence suggesting that midline thalamic nuclei may participate in modulation and spread of limbic seizures. Experimentally, thalamic stimulation has been shown to terminate seizures in a primate epilepsy model. Studies of human thalamic stimulation have been published with favorable results (Theodore and Fisher, 2004). Centromedian nucleus The centromedian nucleus (CN) has been classified as part of the nonspecific thalamus. The CN's major difference from the thalamus in terms of stimulation for epileptic seizures is that the CN's output is more strongly related with the caudate nucleus than with the cortex (Theodore and Fisher, 2004). In a placebocontrolled doubleblind study involving 7 patients, CN stimulation resulted in a 30% decrease with respect to baseline when the stimulator was on versus an 8% decrease when the stimulator was off (Fisher et al., 1992). CN stimulation appeared safe and well tolerated by the patients. Anterior thalamic nucleus The anterior nucleus of the thalamus (ATN) may help influence the propensity of seizures due on its connectivity and functional relations with the cortex and limbic structures. High frequency stimulation of the ATN leads to EEG desynchronization, which is believed to render the cortex less susceptible to seizures (Hodaie et al., 2002). Specifically, 100 Hz had an anti seizure effect whereas stimulation at 1050 Hz lowered the seizure threshold. A controlled study of 5 patients resulted in a mean seizure reduction of 54%. An interesting observation was that the results did not differ from the stimulation on and stimulation off periods (Theodore and Fisher, 2004). This is thought to be due to a "microthalamotomy" placeboeffect. This phenomenon of a reduction or abolition of symptoms due to insertion of DBS electrodes alone has been seen in over 53% of DBS electrode implantations for tremor, and can last up to a year in some cases (Hodaie et al., 2002). Subthalamic nucleus The subthalamic nucleus (STN) was chosen based on encouraging responses in patients with movement disorders as well as highfrequency stimulation in animal epilepsy models. In a study utilizing STN high frequency stimulation in 5 patients, 3 patients showed reduction in seizure frequency of 6780%, one patient had approximately 50% seizure reduction, and the fifth showed no improvement. In this study, the recording of epileptiform activity in the STN suggests that it is part of a corticosubcortical network involved in the epileptogenic process (Chabardes et al., 2002). Hippocampus Human studies of hippocampal stimulation have demonstrated that highfrequency stimulation, rather than low frequency, can be inhibitory. This is contradictory to several preclinical investigations of hippocampal stimulation. One theory for this phenomenon is that the antiseizure effect is due to the activation or inhibition of downstream structures (as opposed to the hippocampus itself). Nevertheless, 7 patients that participated in a hippocampal stimulation study involving 23 weeks of 130 Hz electrical stimulation for 23 hours per day responded very well. Stimulation halted clinical seizures and decreased the number of interictal EEG spikes at the focus after 56 days. However, no observable antiepileptic effects (or no effects at all) were found in three patients when stimulation was either interrupted or given elsewhere just outside of the hippocampus (Theodore and Fisher, 2004). Vagus nerve stimulation VNS therapy has been the subject of many studies before and after its approval for treatment of intractable seizures in 1997 (Uthman et al., 1993; BenMenachem et al., 1994; Theodore et al., 1997; Schachter et al., 2002; Cyberonics, 2006; Ardesch et al., 2007; Ramani, 2008). VNS is licensed in several countries as an adjunctive epilepsy therapy with a rare occurrence of serious side effects. Studies suggest that VNS treatment results in a much lower incidence of adverse cognitive, neurological, and systemic effects than AED treatments (George, 2001). Over 40,000 epilepsy patients have VNS therapy implants (Cyberonics, 2008). VNS is a useful therapy for patients with medically refractory and localizationrelated epilepsy characterized by complex partial and secondary generalized seizures (Theodore and Fisher, 2004). The apparatus consists of an electric stimulator which is implanted subcutaneously in the left side of the chest and connected to the left cervical vagus nerve using subcutaneous electrical wires. The device is programmed to provide neurostimulation at a set duration, frequency, intensity, and pulse width for the treatment of epilepsy. Figure 22 provides an example of the VNS pulse sequence. On time 1 Ramp up Ramp down (2 sec) (2 sec) mA Output mA Current 1/frequency Pulse Width Figure 22. VNS pulse sequence. The vagus nerve was chosen as the site for stimulation because of its diffuse and widespread projections to the thalamus, amygdala, and forebrain through the nucleus tractus solitarius and to other cortical areas via the medullary reticular formation. Though VNS therapy has demonstrated seizure treatment efficacy, the therapeutic mechanism is still uncertain (BenMenachem et al., 1994; Fisher et al., 1999; Groves, 2005; Ramani, 2008). However, a physiologic framework for the VNS therapy mechanism has been described (Upton et al., 1991; Ramani, 2008). The vagus nerve is the 10th cranial nerve and is comprised of approximately 80% afferent fibers, which carry sensory information to the brain. The vagus nerve is highly involved in the regulations of numerous autonomic systems such as the heart, the intestines, and provides and integral role in respiration. Studies suggest that the metabolic activation of thalamic, brainstem, and limbic regions may be integral in the mediation of VNS effects (Fisher et al., 1999). It has been shown that depletion of norepinephrine in the locus coeruleus attenuates the AEDlike effect of VNS (Krahl et al., 1998). Recent studies also suggest that the VNS may exert its effect through the locus coeruleus (Groves, 2005; Ramani, 2008). Experiments in which cat vagus afferent neurons were stimulated were able to produce either cortical synchronization or desynchronization, depending on the fibers' conduction velocity (Upton, 1991). Recent studies have determined that vagus A and B fiber activation can lead to EEG synchronization whereas vagus C fiber activation results in EEG desynchronization (Groves, 2005). Electrical stimulation of the vagus nerve resulted in a reduction of interictal epileptiform spike frequency during and up to three minutes after stimulation in a rat seizure model (McLachlan, 1993). Overall, in lieu of these and other reported VNS effects there is no consensus as to how these empirical effects relate to epilepsy. Though studies have examined how vagus A, B, and C fiber stimulation affects synchronization, the overall VNSinduced effects of these fibers and other relevant brain structures on EEG, reports suggest that these effects not explicitly visible in the time domain (Fisher et al., 1999) or in frequency domain (Salinsky et al., 1993). Numerous studies report little success in quantifying immediate EEG effects corresponding with VNS (Hammond et al., 1992; Salinsky et al., 1993; Koo, 2001; Rizzo et al., 2004; Marrosu et al., 2005). The only reported scalpEEG effects of VNS are reported to occur numerous months after VNS implantation. Studies involving longterm EEG monitoring have shown that longterm VNS produces a delay in interspiking activity and a reduction in the occurrence of epileptic interictal spikes (Koo, 2001; Olejniczak et al., 2001). Marrosu et al. reported no noticeable changes after one month but an increase in gamma activity and desynchronization one year after VNS implantation compared to baseline recordings (2005). Studies have demonstrated VNS effects on interictal epileptiform discharges (Santiago Rodriguez and AlonsoVanegas, 2006) and that the absence of bilateral interictal epileptiform discharges may be an electroencephalographic predictor of seizure freedom (Janszky et al., 2005). In addition, longterm VNS effects have been reported on the spectral content of sleep EEG after 1018 months of VNS compared to a baseline at 3 months prior to implantation (Rizzo et al., 2004). Future Therapeutic Directions One major epilepsy research direction is to enhance therapeutic effectiveness of electrical stimulation or drug therapy though the application of implantable controlled therapy systems. For patients which are currently undergoing therapy from the available electrical stimulation implants (such as the vagus nerve stimulator), research in this direction may help to enhance efficacy, mitigate side effects, reduce therapeutic tolerance, and prolong battery life. Along these lines, such a framework could be adapted to an implantable drug delivery system that would dispense drug at "right" and the right place (e.g. in proximity of a seizure focus or in a location to rapidly circulate medication such as the ventricles). One framework from which this strategy can be visualized is from a system control perspective. Thus, the basic theory behind this strategy is that the transition from a normal interictal state into a preictal state can be conceptualized as a deviation of a control parameter from its set point. Numerous researchers have invested in this idea using EEG signals as controlled measure (Osorio et al., 2001; lasemidis, 2003; lasemidis et al., 2003; Osorio et al., 2005). While the basic example of deviation from a set point does not do justice to the enormous complexity of the brain's electrical activity, recent advances in mathematical theory of complex nonlinear dynamical systems provide an interesting perspective from which to examine and interpret EEG signals. Complex nature of epileptic dynamics One of the most challenging aspects of epilepsy treatment is that despite the major milestones in biological research, there is still an inadequate knowledge of the underlying biological processes governing the epileptic condition that describes how, where, when, and for what purpose a seizure will occur. One perspective is that the epileptic brain is exposed to at least two states, a normal (interictal) state and a seizure imminent (preictal state). A natural approach for studying any aspect of brain behavior is to create mathematical model of some brain function using measurable quantities, such as electrical signals. Such models allow predictions to be made about the behavior of sections of the brain. Due to the massive complexity of the interacting neurons in the brain, direct models are most often achieved for small groups of neurons and small brain structures (Hodgkin and Huxley, 1952; Breakspear, 2001; Chauvet and Berger, 2002). The enormous complexity of electrical brain signals often means exact modeling approaches are insufficient. However, despite the observed dynamical complexity of the epileptic brain there certain behavioral characteristics it possess which can provide analytical guidance. Dynamical diseases and disorders One important diagnostic aspect of many diseases and disorders is the physiologic behavior in the temporal dimension. In the 1980's many studies addressed the temporal behavior of biological systems with and without a disease state. Experts within this field often focused their attention on the time scales involved in the clinical aspects of the disorder. This includes characterization of the disease or disorder onset (acute or subacute) as well the succeeding clinical course (selflimiting, relapsingremitting, cyclic, or chronic progressive) (Belair et al., 1995). The term Dynamical Disease or Dynamical Disorder refers to the general class of diseases and disorders that are characterized by sudden changes in physiological dynamics that lead to state of morbidity characterized by abnormal dynamics (Belair et al., 1995). Such dynamical disorders arise as a result of abnormalities in underlying physiological control mechanisms. There are many instances of disease and disorder models where the apparent shift of control parameters to region results in pathological behavior of an observable which bears a resemblance to experimental data. Mackey and Glass demonstrated adaptive respiratory disease behavior that displayed a wide range of behaviors such as limit cycle oscillations with periodic chaotic solutions (Mackey and Glass, 1977). This particular example exhibited a bifurcation in the systems dynamics that was associated with disease onset. The unstable dynamical realm achieved by altering a "normal" hematopoiesis model bears qualitative similarities to actual hematopoietic data from a leukemia patient (Mackey and Glass, 1977). Thus, there are biological examples to support the claim that mathematical models of physiologic systems may be able to predict the existence of dynamical regimes corresponding to the status of a dynamical disease. Whether the dynamical behavior is periodic, irregular, or apparently random, the significance of dynamical disease identification is that it may be possible to develop therapeutic strategies based on manipulation of critical control parameters (Milton and Black, 1995). Taking into account the temporal rhythm of the disorder as well as an understanding that certain dynamical rhythms may respond better to some treatments rather than others can help provide a foundation for a suitable therapy (Belair et al., 1995). Epilepsy as a dynamical disorder of brain systems Neurological disorders can take on a wide range of complex and abnormal rhythmic behavior over time (Milton et al., 1989). Milton and Black reported observations of recurring sets of symptoms and oscillatory behavior in 32 "periodic" diseases of the nervous system including, ankle clonus in corticospinal tract disease, movement disorders such as essential tremor and Parkinson's disease, as well as paroxysmal oscillations in neuronal discharges in epileptic seizures (Milton and Black, 1995). The cluster of symptoms occurring with a distinct temporal pattern could represent the clinical manifestation of dynamical state changes in these patients. In the context of neural tissue, one view of the abnormal dynamical behavior in neurological patients may arise because of altered control parameters (e.g. nerve conduction time, number of receptors, etc.) and/or alterations in neuronal network structure (Milton et al., 1989). Compensating for impaired neural control mechanisms: system control therapy Currently, the biological mechanisms driving transitions into and out of dynamical rhythms (e.g. oscillatory behavior) in neurological disorders are in general poorly understood. A study examining a tremor simulation by inducing delay and amplification in a visual motor task suggests there tremor could be an alteration of numerous interacting control loops or possibly a timedelay statedependent control system (Milton et al., 1989). One major difficultly whether dealing with tremor or other neurological disorders is to uncover the complex interactions of various interconnected control loops and determine how each contributes to the observed dynamical behavior. Understanding the origins of the dynamical behaviors seen in neurological disorders can provide a foundation for designing any type of patientspecific therapeutic control system. An example of such a device is shown in figure 23. ECoG Stimulator / EEG Feature extraction algorithm Closed loop Controller < Figure 23. Closedloop seizure control device using electroencephalogram or electrocorticogram signals as an input to a feature extraction algorithm, which supplies the extracted features to a controller which makes a decision regarding the action of a stimulator. One of the major themes of quantitative EEG analysis in epilepsy as well as other neurological disorders is the identification of signal features that are sensitive to neural state changes. Chapter 3 provides an overview of the rich spectrum of feature extraction strategies employed for quantification of brain dynamics in neurological disorders such as epilepsy. CHAPTER 3 TIME SERIES ANALYSIS AND DATA MINING TECHNIQUES: THEORY AND APPLICATION The wealth of epilepsy research conducted via quantitative analysis of EEG signals comprises a rich history. Numerous mathematical models have been applied for the purpose of modeling the progression of disease and inferring the biological significance of the underlying the observed EEG signal patterns. The EEG is a time series of voltage measurements acquired between a scalp or intracranial location of interest and a reference electrode point (e.g. an electrode placed on the ear). Naturally, time series analysis techniques were among the first methods applied for quantifying brain dynamics and constitute a significant portion of quantitative EEG research. In addition, data mining tools are becoming increasingly popular for the extraction and classification of patterns in biological datasets such as EEG signals. The following literature review provides a general overview of the tools used in quantitative EEG research. Glossary of Terms Attractor. An attractor is defined as a set of points mapped into a phase space representation which is a target region which adjacent states within a neighborhood (see: basin of attraction) will converge towards as the system evolves towards infinity. An attractor is established to be the smallest region for which the entire volume cannot be further split into two or more attractors having corresponding basins of attraction (as a system may have multiple attractors each with a basin of attraction). Basin of Attraction. A set of points in phase space such that initial conditions existing in this set evolve over time into a corresponding attractor. Bifurcation. A bifurcation is defined as a sudden appearance of a qualitative change in dynamics resulting from an alteration in a parameter of a nonlinear system. Bifurcations can occur in both continuous systems as well as discrete systems. Degrees of Freedom. The dimensions of a phase space mapping. Limit Cycle. In a phase space, a limitcycle is a closed trajectory which possesses the characteristic that at least one other trajectory will traverse into it as time approaches infinity. Phase Space. Phase space is the group of potential states for a dynamical system. Phase space is typically identified with a topological manifold. Each point in the phase space represent an instantaneous and unique state of the system. Strange Attractor. Strange attractors have a noninteger dimension. The descriptive term 'strange' refers to the geometrical structure of the attractor, whereas the term 'chaotic' refers to the dynamics on the attractor (Grebogi, 1984). Trajectory. The trajectory of a dynamical system is the orbit connecting points in chronological order in the phase space that is traversed by a solution of an initial value problem. If the state variables are within a realvalued continuum, then the orbit of a continuous time system is a curve. Discreet system trajectories consist of a sequence of points. Time Series Analysis Time series analysis is the field of study that aims to extract useful information from time series datasets. A time series is a series of measurements that are acquired at successive times often with a constant time interval. Many aspects of our universe can be represented and studied as time series datasets. This field of study has been extensively applied to financial decision making as well as numerous scientific disciplines. One major goal of time series analysis is to extract useful information about the system that generated the time series dataset. An additional aim of time series analysis is to model the system dynamics in order to make predictions about future behavior. Methods Applied in the Time Domain Numerous linear EEG processing techniques have been implemented in the history of quantitative analysis. This section reviews some of the most utilized measures for the analysis of discrete time series data within the time domain. Autoregressive moving average modeling The autoregressive moving average model (ARMA) is standard time series analysis tool used to model univariate datasets. This method is also known as the BoxJenkins model as the iterative BoxJenkins procedure it often used to estimate model coefficients (Box and Jenkins, 1976). The model is comprised of two parts, an autoregressive component and a moving average component. For a univariate time series dataset Xt, autoregressive component at time t is defined as: P X, =C+ ,Xt + E, (31) where C is a constant, .. p are the parameters of the model of order p and c, is the error term. The moving average component is defined as: q Xt = Oit1 + t i=1 (32) where O0...Op are the parameters of the model of order q, and E, and E, are the previous and current error terms, respectively. Combining the autoregressive term with the moving average term produces the ARMA model of order p (autoregressive terms), and q (moving average terms): P q =1 =1 (33) Such methods have been utilized in modeling functional brain network organization using spectral analysis of local field potentials (Bressler et al., 2007). Autoregressive integrated moving average modeling The autoregressive integrated moving average (ARIMA) process is a wellknown method for making predictions in nonstationary time series datasets (Box and Jenkins, 1976). As the name implies, this measure is a generalization of the ARMA process. The ARIMA approach to working with nonstationary time series works by utilizing the dth difference to convert the nonstationary time series to a stationary ARMA process. Naturally, the ARIMA method assumes that a time series can be reduced to a stationary time series through the process of differencing. The statistical properties of the stationary time series remain constant in time, and residuals (errors between the original time series and the ARIMA model) are assumed to be the result of noise. Let {y, } be an ARIMA process of order p,d,q where the dth difference of y, is a stationary ARMA process of order p,q. The model ARIMA model is then expressed as: D(B)(1 B)d t = (B)zt (34) where D and 0 are polynomials of degree p and q (respectively) having roots outside the unit circle, B is the backward shift operator, and zt is white noise. Cross correlation Crosscorrelation analysis is one of the oldest and most standard time series analysis techniques (Bendat and Piersol, 1986). This method measures the linear coupling between two signals. Let X be some represent an identically distributed stationary stochastic process where X(t) is the value of X at time t. Crosscorrelation function representing the coupling between two time series functions X(t) and Y(t) is defined with a time lag, T, as follows: (r) = x(t + r)y(t)dt. (35) Crosscorrelation is often applied to data from a physical system which typically takes on a discrete form. Let xo,...,xM and 0,...,_ Y represent two simultaneously acquired stationary time series of length M, zero mean, and unit standard deviation. The discrete unbiased estimate of the cross correlation function is then defined as a function of time lag , r = M ),...,,...,M las follows: x C r<0 <(r)= (36) The normalized crosscorrelation function outputs values within the range of negative one (maximum antisynchronization) to one (complete synchronization). The maximum T of equation 3.5 is understood to be an estimation of the delay between two signals (assuming this signals have a linear relationship to one another). The crosscorrelation of a function to itself is called autocorrelation. As the crosscorrelation value approaches zero, the signals of interest are increasingly linearly independent. Often a significance threshold is applied to prevent the possible occurrence of a nonzero crosscorrelation value for two linearly independent systems (Box and Jenkins, 1976). Methods Applied in the Frequency Domain Frequency representation is a standard format for visualizing signal characteristics. This perspective provides a clear visualization of a signal's periodic behavior which may not be evident in the time domain. Thus, frequency domain analysis can help uncover important properties of the system of interest. Coherence Coherence is a measure of coupling between two signals as a function of frequency. The signal coherence can take on values between zero and one that provide a relative indicator of how well the signal X corresponds to signal Y at each frequency. The Fourier transform is performed on each signal to convert the signal into the frequency domain (calculate the power spectral density). The cross power spectral density is calculated by multiplying one signal by the complex conjugate of the other signal. The coherence measure is a function of the power spectral density of the individual signals and the cross power spectral density. This measure is typically expressed in terms of its square magnitude and is derived by normalizing the cross power density by the product of power spectral density for the two signals, c (f)= p. (f (37) c() P(f)P ( f ) where P1 and P, represent the power spectral densities for signals X and Y respectively and P1 is the cross power spectral density (Fuller, 1976). A coherence of zero indicates no coupling between the two signals at the particular frequency whereas a coherence of one implies linear relationship with constant phase shifts between each frequency component. Coherence has been implemented in electrophysiology experiments for several years and more information can be found in literature (Shaw, 1984; Leocani, 1999). Discrete Fourier transform The Fourier transform has been implemented in extensively in numerous fields such as mathematics, physics and natural sciences. The Fourier transform is an especially attractive algorithm due to the development of the streamlined Fast Fourier Transform (FFT) (Cooley and Tukey, 1965). In recent years, additional developments have been implemented in the FFTW subroutine library developed by a team of MIT researchers (Frigo and Jonhnson, 2005). This free software package provides a means to optimize the FFT algorithm using various heuristic approaches for each unique problem and platform combination. This subroutine library has been utilized by many researchers and is even implemented in the Matlab function library. Fourier analysis decomposes a signal into linear component parts. The analysis involves to concepts: * Linear combination of different waveforms. * A time series of any shape can be sufficiently represented by the summation of ample simple sine waves of different frequencies, phases, and amplitudes. Given a signal x(t), Fourier analysis models the signal as a linear combination of sine and cosine waves for frequency f where: x(t)= X(f)e2'*df (38) and X(f)= x(t)e '22'dt. (39) Equation (38) is the continuous Fourier transform which is comprised of the complex coefficients representing the contributions of each frequency, f, to the overall representation of the original time series x(t). Equation (37) is often referred to as the inverse Fourier transform. For a discrete signal, x = txo,..., x',_}, (310) where x, is sampled at the time t, = to + jA, the discrete Fourier transform (DFT) is represented as: N 1 z 2,*n X(k)= x(n)e N (311) n0 for the discrete frequencies k fk =N (312) where the inverse Fourier transform is expressed as: i N_1 Ni2kn x(n)= 1 X(k)e N (313) While Fourier analysis is useful for capturing periodic waveforms in nontransient signals, this measure is not suited for extracting transient features. This is because time information is no longer available in the frequency domain as the DFT coefficients are representative of the entire signal duration. The Fourier transform has been extensively applied to the analysis of EEG waveforms in epileptic patients. Diagnostically, it can help determine the presence of specific brain wave rhythms which may be indicative of certain types of epileptic behavior. Often the time series of interest is broken down into nonoverlapping segments in which the Fourier transform is calculated to give a rough estimate of the frequency behavior over time. An example of an a single channel of EEG acquired during an absence seizure and its corresponding windowed Fourier transform is shown in figures 31 and 32, respectively. In figure 32, the absence seizure onset is characterized by a sudden energy increase in the 030 Hz frequency band with the strongest effect around 3 Hz (which is the typical rhythm of spike wave discharges in absence seizures). Wavelet analysis Wavelet analysis is a signal processing tool which models a times series signal in terms of shifted and scaled "mother" wavelet. Wavelet analysis is similar in some aspects to Fourier analysis, which models a signal using sinusoids. Instead of sinusoids, wavelet analysis models a signal using an applicationspecific waveform called a wavelet which has an effectively limited duration and a mean value of zero (Misiti et al., 1996). Wavelet analysis is very useful for performing localized analysis in a subregion of a larger signal. In addition, wavelet analysis is capable of revealing aspects of data that traditional signal analysis techniques may miss such as trends, breakdown points, discontinuities in higher derivatives, and selfsimilarity (Misiti et al., 1996). For a particular mother wavelet function Y(t), the subspace at time t for a scale, a, and a position, b is represented by ,bt) W= I tb. (314) C^a I If x(t) represents the time series signal, then the continuous wavelet transformation at scale, a, and position b is defined as: 1 (tb Cb = x(t) I a dt, (315) where Y denotes the complex conjugate of the wavelet and a,b e R,a # 0. For low values of the scaling factor a, the wavelet becomes compressed and becomes sensitive to rapidlychanging details and high frequency waveforms. For high values of a, the wavelet becomes stretched and is more sensitive to coarse slowlychanging features and low frequency waveforms. The parameter b localizes the wavelet function in time. Wavelet analysis has demonstrated utility for the analysis of nonstationary signals such as EEG (Geva et al., 1998, Giler and Ubeyli, 2005; Glassman et al., 2005). Information Based Methods Information theory is based on the 1948 publication by Claude Shannon which was the first paper to quantify the concepts involved in communication. Information quantified in units of bits and concepts such as entropy and mutual information were used to describe the transfer of information (Shannon, 1948). Information theory concepts have been extended to time series analysis in biological series such as the EEG. Under the proper statistical conditions, these measures provide useful information about the behavior of the brain. Approximate Entropy Approximate entropy (ApEnt) is a statistical measure used to quantify system regularity/complexity from a time series dataset. This measure has been extensively utilized in physiological time series data (Pincus, 1995). The ApEnt measure has been utilized to study the EEG signals acquired from Alzheimer's disease patients (Abasolo et al., 2005), as a measure of anesthetic depth (Bruhn et al., 2000, 2001, 2003), epileptic seizures detection (Abasolo et al., 2007; Srinivasan, 2007), and studies characterizing EEG nonlinearity patterns (Thomasson et al., 2000; Burioka et al., 2003,2005; Ferenets et al., 2006). The ApEnt measure has demonstrated the ability to quantify system complexity using as few as 1000 data points based on theoretical analyses of stochastic and deterministic chaotic processes (Pincus, et al., 1991; Pincus and Keef, 1992) as well as clinical and clinical applications (Pincus 1995; Bruhn et al., 2000). In this dissertation, ApEnt is used as a measure for quantifying the VNS effect on EEG recordings. Let U be a signal oflengthN. For positive integer m and a positive real number rf., extract Nm+1 create vectors xm(i)= u(i),u(i + ),...,u(i+m1)}. For all i, 1 the quantity Cm is computed as follows: number ofj such that c (r)= number of j such that d[x (i), (j)] r (316) Nm+1 where d is the maximum absolute difference between the respective scalar components of the two vectors xm (i), x () defined as : d(xm(i),xm(j))= max mx,(i + k1) (j + k 1)) (317) Using these results, the value of Om can be calculated as: m N 1 Nm+l O ry )logCM Nm+ ,= (318) ApEnt is calculated as: ApEn(m, r,N)= Dm(r ) ml (r). (319) In this manner, the value of the positive real number rf corresponds distance between the neighboring point that is often designated as some fraction of the signal's standard deviation. For this reason, the positive real number rf can be thought of as a filtering level for the process. The parameter m is the dimension at which the signal is embedded for calculation. Pattern Match Regularity Statistic Pattern match regularity statistic (PMRS) is a method used to extract the nonlinear characteristics (complexity) of a time series over time. This measure has been for the quantifying the complexity of an input EEG signal and further detecting EEG state changes such as seizure onset (Shiau, 2001; Shiau et al., 2004). This measure estimates the likelihood of pattern similarity for a given time series. PMRS has the attractive feature that it can be interpreted in both stochastic and chaotic models. The steps to calculate PMRS include reconstruction of the state space, searching for the pattern matched state vectors, and the estimation of pattern match probabilities. Specially, given an EEG signal U = {ul,u2,..., u }, let (^ be the sample standard deviation for U. For an integer m (embedding dimension), phase space vectors U are reconstructed as x, ={u,,u 1,...,u,+}, lKiinm+l (320) then for a given positive rf x, and x, are considered pattern match to each other if: I u, u, 1 (321) where rf corresponds distance between the neighboring point that is often designated as some fraction of the signal's standard deviation. PMRS can then be calculated as: PMRS = In(p) (322) n m = where p, = Pr ob {sign (u ,m u ,+) = sign (u +, u j,,)  x, and x, are pattern matched } (323) Mutual Information Information theory measures such as mutual information have shown utility for estimating high order statistical dependencies between signals. In contrast to linear coupling measures (e.g. crosscorrelation), mutual information is sensitive to nonlinear dependencies. For continuous variables X and Y with probability density function of f(x) and f(y), respectively, and f(x, y) is the joint density function, mutual information can be calculated as follows: I(X,Y)= f(x,y)log f(x,) dxd (324) r x f (x)f (y) Mutual information between two discrete random variables having marginal probabilities p (x) = prob(X=x) and p, (y) = prob(Y=y) and joint probability p (x)= prob(X = x,Y = y) is defined as: I(X,Y)= p(x, y)log p(xy) (325) x,y PX(x p (y) A common approach to calculating mutual information is to first partition X and Y into bins (e.g. a histogram). An estimation of I(X,Y) Ibn(X,Y) is obtained by replacing the probability functions f(x), f(y), and f(x,y) with an approximations based on the histogram. Thus, if bx and by are the number of points from X within the xth bin and number of points from Y within the yth bin, respectively, and b is the number of points in the intersection of the two bins, then px(x),b /N, p,(y)G by/N, and p(x,y)= b I/N. Mutual information has been successfully used to quantify statistical couplings in biological applications such as sleep studies (Na et al., 2006) Alzheimer's disease (Abasolo et al., 2007) and epileptic seizures (Varma et al., 1997; Palus et al., 2001; Netoff et al., 2002). Chaotic System Analysis Techniques One approach for quantifying the behavior of a complex system such as the brain is to create a mathematical model of the system behavior using measurable quantities. Electrical signal measurements are often used to model the brain modeling the brain's behavior. Such models allow predictions to be made about the behavior of sections of the brain. Due to the massive complexity of the interacting neurons in the brain, direct models have only been achieved for small groups of neurons and small brain structures (Breakspear et al., 2001; Chauvet and Berger, 2002; Hodgkin and Huxley, 1952). The enormous complexity of electrical brain signals often means exact modeling approaches are insufficient. Edward Lorenz is often credited as the discoverer of chaos for the fruits of his efforts to devise a longterm weather prediction scheme (Lorenz, 1963). Though Lorenz's model did not turn out to aid in forecasting weather, his results directed his attention to research which helped give rise to research in the area of chaos theory. Chaotic systems have the interesting property of displaying apparent random behavior but are actually governed by deterministic laws. Specifically, chaotic systems demonstrate a large degree of sensitivity to initial conditions to the point at which minor fluctuations in initial parameters give rise to extremely altered outcomes (to the extent that prediction of such events may even be hampered by sensitivity to computer precision rounding). Since chaotic systems have characteristic similar to noise as well as a broad range of frequency components, linear measures may fail to provide meaningful results. When exact knowledge of the system governing dynamics is unknown, such as in the brain, an alternative method is a macroscopic modeling approach based on empirical measures of the system as a whole (lasemidis et al., 1996). After such information is extracted, it may be possible to derive useful empirical models of the global behavior of the system as a whole. A wellknown method to study complex system behavior is to observe the system from a phase space representation (Hively et al., 2005; lasemidis et al., 1996). Phase space mapping is a process of applying some transformation on a dataset, often into a higher dimensional space, from which system behavior characteristics can be quantified. Some classic transformations applied in EEG analysis include time delay mapping, (Breakspear, 2001; Hively et al., 2005; lasemidis et al., 1996; Da Silva et al., 2003; Marino et al., 2003) derivative mapping (Aksenova et al., 1999, 2003; Letellier et al., 1998; Sceller et al., 1999; Tetko et al., 1999). Phase space mapping provides a means to help distinguish random, noisy signals from signals generated from a system governed by deterministic chaos. Phase Space Mapping Generate of a timedelay phase space portrait of the system is one of the most established methods for visualizing the dynamical behavior of a multivariable system such as the brain (lasemidis et al., 1996; Hively et al., 2005). Timedelay phase space maps are a particularly useful phase space mapping variant and are often used for the study of nonlinear deterministic systems. The phase space portrait is created by assigning each timedependent variable of the observed from the system as a vector element in a multidimensional phase space. Each vector mapped into the phase space represents a unique and instantaneous state of the system. By plotting the phase space vectors in chronological order a representation of the temporal evolution of a discrete system can be visualized. In principle, the analysis of an individual measured variable can provide dynamical information about other system variables which are related to the measured variable (lasemidis et al., 2003). A relevant example of this concept is that EEG recorded from one electrode can be related to the activities located at distant electrode sites. Thus, important features of a dynamical system can often be quantified through analysis of a single variable's behavior over time in terms of geometrical attractor properties. From the reconstructed phase space, measurements can be made to extract useful system information from a single variable (lasemidis et al., 1996; Pardalos et al., 2003; Chaovalitwongse et al., 2006). Such information can often be used in data classification algorithms for determining neural state (Tetko et al., 1999, Hively et al., 2005). The method of quantifying phase space properties has been extensively applied to EEG signals analysis for the purpose of studying neurological disorders (Chaovalitwongse et al., 2006; Hively et. all, 2000, 2005; lasemidis et al., 1996, 2004, 2005; Pardalos et al., 2003, 2004). The Method of Delays Timedelay embedding is performed as follows: x(tn) x(tn r) x(t, 2r) x > (326) x(, (m 2)r) x(tf (m 1)r) where r is the time delay and m is the embedding dimension (Takens, 1981). For a discrete system, every instantaneous state of the system is represented by the vector x, in m dimensional phase space. Numerous studies have addressed the problem of determining proper parameters for the embedding dimension m and r. The first zero of the autocorrelation function (Rapp et al., 1988) or the first minimum of the mean automutual information (Fraser et al., 1986) are two of the most common approaches to obtain the time delay, r. Takens recommended a minimum embedding dimension m = (2D+1) to ensure complete unfolding of the attractor, where D is the fractal dimension (Takens, 1981). Fractal Dimension The term "fractal" was coined by Benoit Mandelbrot in 1975 to describe selfsimilarity characterized as a jagged geometric shape which can be split into parts which are approximately reducedsize copies of a whole (Mandelbrot et al., 1983). The fractal dimension is a statistical measure of the extent to which a fractal appears to fill space. A noninteger fractal dimension is said to originate from fractal geometry. Strange attractors often have a complex structure with fractallike properties. Thus, the fractal dimension is a logical measure to use for quantifying strange attractor dimension. Determining the dimension of an attractor is an important step in the characterization of a system's properties. A proper dimensionality estimate can enhance the accuracy at which the location of a point on an attractor can be specified. Furthermore, the dimension value provides a lower bound on the number of variables required to model the system dynamics. A standard technique for estimating attractor dimension is from the framework of measuring the changes in the number of points occupying a sphere of radius r as it approaches zero (Grassberger and Procaccia, 1983a; 1983b). Geometrically, the relevance of this observation is that volume occupied by a sphere of radius r in dimension dbehaves as rd For most attractors the dimension d would be the dimension of the attractor, regardless of the origin of the sphere. For a chaotic attractor, however, the dimension will vary depending on which point is selected for the estimation. If the particular system's dynamics do not result in dimensional variation, then the mean of the surrounding points can be used. Obtaining the dimension in this method can be obtained by determining the number of point y(k) within a sphere positioned at the phase space location x as follows: 1 N n(x,r)= (r y(k)x), (327) N k=1 Nk1 where 0 represents the Heaviside Step Function where: O(n)= n (328) 1, n>0 Equation (326) returns a counts of all the points on the orbit y(k) located within a radius r from point x and normalizes this quantity by N, the number of points in the dataset. The point density, p(x), on an attractor does not need to be uniform to utilize this method (for a strange attractor). If equation (327) is raised to the power of q1, the function C(q,r) is established in terms of q and r and the mean of n(x, r)1 over the attractor weighted with the natural density p(x) as: C(q,r)= dxxp(x)n(x,r)q1 =_ I (r y(n) y(ki) (329) M k=1 M n=1,n.k This quantity is referred to as the correlation function or correlation integral. This function estimates the probability that two points on the attractor lie within a distance r of each other. M and K are large in value (but not infinite). Though this function is invariant on the attractor, it is conventional to only look at the variation of C(q, r) when r is small. At that scale, it is assumed that: C(q,r) r(q 1)Dq, (330) which defines the fractal dimension Dq. The quantity Dq is estimated in the case of small r as: Sli log[C(q, r) (331) ro (q 1)log(r) Using this method, C(q,r) needs to be calculated over a small range of r in order to achieve a nearlinear range for selection of the slope of log[C(q,r)] over log(r). Box counting dimension (DO) Box counting dimension (DO) is the title given to the measure when q=O. DO can be estimated as the amount of spheres of radius r or the number of "boxes" required to envelop all points in the dataset. If N(r) represent the amount of Ddimensional spheres needed to cover the attractor for relatively small values of r, then the box counting dimension can be estimated as: S log[N(r)] lmlog[N(r)] (32) ro> (q )log(r) ro log(r) Equation (331) is often represented as: D,= limD,. (333) q0O Information dimension (Dl) Information dimension (Dl) is the name of the measure when q=l. Dl is a generalization of the box counting dimension that takes into account the relative probability of cubes used to cover the dataset. Let I represent the information function: N I ~P,(r)log[P,(r)] (334) 1=1 and P(r) represent the probability that an element i is populated, normalized such that: N (r)= 1. (335) Information dimension is thus defined as: N = P(r)log[P(r] (336) S log(r)36) 1 log(r) Correlation dimension (D2) Correlation dimension (D2) is title of the measure when q=2 (Grassberger and Procaccia, 1983a, 1983b; Kantz and Schreiber 1997). Under this condition, Dq takes on special form which tends towards reliable computation. Correlation dimension is estimated as the slope of the log log plot generated by: D2 =lim lg[C(2r (337) rO log(r) The correlation dimension can be challenging to quantify in time series data as it can result in highly nonlinear slopes for small r. Correlation dimension has been extensively utilized for neural state classification studies using EEG (Tirsch et al., 2000; 2004) and has been utilized extensively in analysis of physiological data (Kantz and Schreiber, 1995) such as seizure prediction applications (Elger et al., 1998; Martinerie et al., 1998). As correlation sum can demonstrate a high sensitivity to EEG amplitude when using a fixed radius (Osorio, 2001), many authors have implemented a relative radius (with respect to the dataset diameter in vector space) to strengthen their findings (Casdagli et al., 1996, 1997, Merkwirth et al., 2002). The Lyapunov Exponent The Lyapunov exponent is an important measure for the quantification of dynamical systems. This measure quantifies the degree of system chaoticity by quantifying the rate of divergence or convergence between two points initially in close proximity (lasemidis et al., 1999). Lyapunov exponents provide a generalization of linear stability analysis due to steady state solution perturbation to timedependent solution perturbations. The measure also provides a meaningful characterization of asymptotic behavior in nonlinear dynamical systems. Lyapunov exponents are a collection of invariant geometric measures that characterize describe a system's dynamics. Specifically, they provide a measure of predictability for the particular system. Lyapunov exponents provide a global measure of the rate of convergence or divergence or of two trajectories initially in close proximity to one another for a dynamical system. Positive Lyapunov exponents measure represent the mean exponential divergence rate of two trajectories, whereas negative Lyapunov exponents measure represent the mean exponential convergence of two trajectories. As Lyapunov exponents becomes more positive, trajectories move apart more rapidly. Similarly, as Lyapunov exponents become more negative, the trajectories move together more rapidly. A system with positive exponents has positive entropy as trajectories that are initially in close proximity to one another separate over time. If a discrete nonlinear system is dissipative then the sum of all the Lyapunov exponents is zero. A system with both a positive and negative Lyapunov exponents is said to be chaotic. Thus, Lyapunov exponents provide a measure of linear stability (or instability) of the attractor or an asymptotically long orbit for a dynamical system. For a chaotic system with initial conditions a and b which are initially in close proximity, the distance between these two trajectories at successive time points will exponentially increase over time. If this is written as e"' for a time duration ofn iterations, then A is the Lyapunov exponent. For a system to be chaotic, at least one Lyapunov exponent needs to be positive. Thus, at each point in the series the derivative of the timeadvanced equation is evaluated. The Lyapunov exponent is expressed as the mean value of the log of the derivative. If the Lyapunov exponent is negative, the iteration is stable. It is important to note that by summing the logs of the derivatives the result corresponds to multiplying the derivatives. Thus, if the product of the derivatives has magnitude less than 1, points will attract together as they go through the iteration. Though an ndimensional system will produce n Lyapunov exponents, the maximum exponent is usually most important. The maximum Lyapunov exponent represents the time constant, ,, in the expression for the change in distance between the two initial orbits, e" If, is negative, then the orbits converge over time, and thus the dynamical system is insensitive to the choice of initial conditions. However, if, is positive, then the distance between the initial orbits increases exponentially over time and the system displays sensitivity to initial conditions. Calculation of the spectrum of Lyapunov exponents can be derived analytically for systems in which process dynamical equations are known aprioi (Shimada et al., 1979). Numerous algorithms have been developed which compute this measure on experimental datasets. One of the most wellknown algorithms was developed by Wolf et al. (1985), though other algorithms have been established (Eckman et al., 1986; Ellner et al., 1991). Short comings of the Wolf algorithm have been identified as sensitivities to the number of observations as well as measurement noise. Numerous researchers have proposed updated versions of Wolf s algorithm with increased robustness to the number of observations (Ellner et al., 1991; lasemidis et al., 1991; lasemidis and Sackellares, 1992; Abarbanel, 1996). The following section will provide an executive overview of the Lyapunov exponent estimation. Additional details can be found in (lasemidis et al., 1991, 2000; Wolf et al., 1985). Computing ShortTerm Maximum Lyapunov Exponents A phase space mapping is performed by embedding a signal x(t) of duration T using the method of delays (326). The phase space representation provides the proper perspective for measuring the degree of chaoticity of the attractor. An attractor is chaotic if on average the two trajectories with similar initial conditions (two points in close proximity in phase space) diverge at an exponential rate (expansion process). If these trajectories are members of a finite attractor, they will fold back into the attractor as time progresses (folding process). A result of these two processes may be the generation of a stable and topologically layered attractor. If the expansion process outweighs the folding process in some of the attractor's eigendirections, the attractor is said to be chaotic. If the phase space is Ddimensional then theoretically up to D Lyapunov exponents can be estimated. However, as expected, only (D +1) of them will be real (Abarbanel, 1996). If L represents the short term largest Lyapunov exponent estimate STLmax, then: 1 No HX, (At L = N 1lg, A (338) NAt 9A, (0) where ,,(0)= X(t,) X(t), (339) X, (At) = X(t, + At) X(tJ + At) (340) for the following conditions: 1. X(t) is the point of the fiducial trajectory ([X(t()] having t = t X(tQ) = [x(tQ),..., x(tQ + (D 1)r) (, T denotes the transverse, and X(t ) is a properly chosen vector adjacent to X(t,) in the phase space. 2. 5XJ (0) = X(t,) X(t) is the displacement vector t, i.e., a perturbation of the fiducial order at t, and X,J (At) = X(t, + At) X(tJ + At) is the evolution of this perturbation after time At. 3. t, = to + (i 1)At and t, = t, + (j )At, where i e [1,N] and j e [1,N] for j > i. 4. At is the evolution time for 5XAJ (the time provided for 5XJ to evolve in phase space). If the evolution time At is given in seconds, then the Lyapunov exponent is measured in bits/sec. 5. t, is the initial time point of the fiducial trajectory and coincides with the time point of the first data in the data segment of analysis. In the estimation of L, for a complete scan of the attractor, to should move within [0, At]. 6. N, is the number of local Lmax 's that will be estimated within a duration T data segment. Therefore, if t, is the sampling period of the time domain data, then T = (N )t, = N At +(D ) . The method proposed by Iasemidis et al. (Iasemidis et al., 1999) was used to estimate the short term maximum Lyapunov exponent (STLmax). This method is a modification of Wolf s algorithm (Wolf et al., 1985). The measure is denoted as "short term" to distinguish it from the variants used to study autonomous dynamical systems. Modification of Wolf s algorithm is necessary to enhance STLmax estimate robustness to transients in small data segments such as interictal spikes. The main modification is in the replacement vector searching procedure along the fiducial trajectory. One of the most crucial parameters affecting STLmax's ability to distinguish interictal from preictal states is the adaptive estimation in time and phase space of the magnitude bounds of the candidate displacement vector (lasemidis 1999), though evolution time At, and the angular separation V,,, between the evolved displacement vector 6X,i,,(At) and the candidate displacement vector 6X,1,,(0) are important components as well (Frank et al., 2005). The modifications proposed by lasemidis and Sackellares (1991) can be summarized as follows: 1. To help ensure that L is a reliable estimate of STLmax, the candidate vector X(t) should be chosen such that the previously evolved displacement vector 56X_,_ (At) is nearly parallel to the candidate displacement vector 6X,,(0), that is, V = (,XJ (0), Xj 1, (At) < Vmax (341) where Vmax should be relatively a small value and (y,0) denotes the absolute value of the angular separation between two vectors y and 0 in phase space. 2. Also, 6X,,(0) should also be relatively small in magnitude. This constraint helps avoid computer overflow in the future evolution within very chaotic regions and also reduces the probability of starting up with points on separatrices (Wolf et al., 1986). Mathematically, this corresponds to, '(XJ (0) = X(t ) X() < Am (342) where Ama takes on a small value. Thus, the parameters involved in the estimation of L are: (i) The embedding dimension p and the time lag T for the reconstruction of the phase space (ii) The evolution time At (iii) The constraint parameters for selecting X(t,; Vmax and Amax ) (iv) The duration of the data segment T It is worth nothing that since only vector differences are involved in the estimation of L, any direct current (DC) present in analyzed data segment does not influence the value of L. In addition, only vector difference ratios participate in the estimation ofL. Thus, L is not influenced by data scaling (provided the parameters involved in the estimation procedure, i. e. Ama are expressed in values relative to the scale of each analyzed data segment). Both of the above points are consistent with the fact that L is related to the entropy rate of the data (Palus et al., 1993). Selecting D and T. The selection of the embedding dimension D is such that the dimension of the epileptic attractor in phase space is clearly defined. For an epileptic attractor, v z3 (lasemidis et al., 1988, 1990; lasemidis, 1991). Thus, according to Takens theorem a value of D > (2 3 + 1) = 7 can be viewed as adequate for the embedding of the epileptic attractor in the phase space. This value of D may not provide a large enough phase space to embed all interictal brain states, but has demonstrated success in detecting the transition of the brain toward the ictal stage (lasemidis and Sackellares, 1991). The parameter T should be small enough to characterize the shortest signal changes (i.e., highest frequency component) in the data. However, T should be large enough to result in the maximum feasible independence between the vectors components in the phase space (with the method of delays). These two conditions are typically addressed by selecting T to be the first minimum of the mutual information or as the first zero of the time domain autocorrelation function of the data (Abarbanel, 1996). Since the time span (Dl) T of each vector in the phase space theoretically represents the duration of a system state, (Dl) T has been recommended to be (at the greatest) equal to the period of the maximum (or dominant) frequency component in the data (Abarbanel, 1996). As an example, a sine wave (or a limit cycle) has v = 1, then D = 2 1 + 1 = 3 is required the phase space embedding and (Dl) T = 2 T should equal the sine wave's period. In such a case, the value of T would then correspond to the Nyquist frequency of the sine wave. In addition, for the epileptic attractor the highest frequency considered is 70 Hz (as EEG data are often lowpass filtered at 70Hz) which would require a maximum T of about 7 ms according to the above rationale for D = 3. However, since a typical epileptic attractor (i.e., during the ictal period) in temporal lobe epilepsy has described to have a maximum dominant frequency of about 12 Hz (lasemidis and Sackellares, 1991), according to the above rationale, an adequate T value for phase space reconstruction of the epileptic attractor is (7 1) T 84 ms, and thus, T should be about 14 ms (for additional details see lasemidis and Sackellares, 1991). Selecting At. If the evolution time At is too large, the folding process within the attractor distorts L. If At is too small, 6Xi,j(0) may not follow the direction of the maximum rate of information change. One option is to obtain At as a fraction of timedelay mapping of the maximum frequency component of interest in the data, fo. Specifically, the At is usually chosen to correspond to 0.5*fo (lasemidis and Sackellares, 1991). Therefore, according to the previous discussions about the selection of D and T At z ((D 1) T)/2, which results in At z 42 ms which is within a range that can distinguish the ictal state from the preictal state (lasemidis and Sackellares (1991). Selecting Amax. In Wolfs algorithm (1986), Amax is selected as Amax = max3Xgk (0O (343) where j = 1,...,N and i = 1,...,Na Thus, Amax represents the global maximum distance between any two phase space vectors in a segment of data. This value suffices as long as the data is stationary and distributed relatively uniformly in phase space. Rarely is this the case with real data, especially with the brain's electrical activity which is strongly nonstationary and nonuniform (Barlow et. al, 1985; Feber et. al, 1987; Jansen and Cheng, 1988). Such statistical fluctuations combined with noise may adversely influence the predictive power of STLmax (Lai et al., 2003, 2004). Thus it is essential to perform a searching procedure modification in order to locate the proper X(tj). The first step is obtain an adaptive estimation of Amax for each point X(ti) as Amax =max XJ (0), (344) where j = 1,...,N. Estimating Amax in this manner can help compensate for the nonuniformity of phase space (Amax is now a spatially local quantity of the phase space at a point X(t,) ). Another technique for managing nonstationary data is to estimate Amax with a temporal constraint on top of the spatial constraint. From this perspective, Amax is A ,max max gX, (0); j # i (345) IDIST1 for which IDIST, = (346) IDIST2 = (D )r (347) where IDISTI and IDIST2 upper and lower bounds fort tt which help enforce temporal constraints when searching for a maximum spatial distance. In other words, these parameters establish a neighborhood in time around each point in the fiducial trajectory for the estimation of the parameter Ai,max, which establishes a spatial search neighborhood around this point in the phase space. Thus, the search for Ai,max is always made temporally about the state X(ti) and its changes within a period of the time span (D 1) z of a state. According to the previous formulae, the values for the parameters involved in the adaptive estimation of Ai,max for the neural state classification studies are: IDIST = T = 14 msec and IDIST2= (D 1) T 84 msec. Selecting Vmax. Starting with an initial Vmax,initia = 0.1 rad, if a replacement vector X(t) is not found with 0 < V < Vmax,initial and X,, (0) < 0.1*Amax, the bound is relaxed for X,, (o0. At this point the process is repeated with bounds up to 0.5* Amax. If it is not successful, we relax the bounds for VJ by doubling Vmax and then repeat the process with bounds for Vmax up to 1 rad. It should be noted that values of Vmax larger than 0.8 rad did not occur in the reported results (lasemidis and Sackellares, 1991). If Vmax does grow this large, the replacement procedure halts, a local L(ti) is not estimated at time ti the entire procedure beings again at the next point in the fiducial trajectory. Selecting X(tj). It is important that the replacement vector X(tj) should be spatially close to X(ti) in phase space (with respect to angle deviation and magnitude), yet with sufficient temporal distance from X(ti) to allow selecting X(tj) from a nearby (but not the same) trajectory. Otherwise, by replacing one state with one that shares "too many" common components would lead to a false underestimation of L. The arguments described above are represented by the following expressions: 0 < V, < V,, ,zl = 0. rad (348) bA max < SX, (0)< cA, max (349) t, t > IDIST, (D l)r (350) The parameter c at a value of 0.1 and increases with a step of 0.1 up to 0.5 in order to locate a replacement vector X(tj) satisfying (348) through (350). The parameter b (which must be less than parameter c) is used to account for possible noise contamination of the data. Thus, b is the distance below which the estimation of L is considered to be inaccurate. A value ofb = 0.05 provided is recommended (Wolf et al., 1985; lasemidis and Sackellares, 1991). To clarify, the temporal bound IDIST2 should not be confused with the temporal bound IDIST3. The variable IDIST2 places an upper temporal bound for locating an appropriate Ai,max at each point X(ti), whereas IDIST3 is a lower temporal bound for locating an appropriate X(tj) within a Ai,max spatial distance from X(ti). Selecting T. For data obtained from a stationary system state, the time duration T of the analyzed data segment may be large for estimating of L. For nonstationary data, there are two competing requirements: T is desired to be as small as possible to provide local dynamic information yet the algorithm requires a minimum length of the data segment to stabilize the STLmax estimate. Previous studies have deemed that for 200 Hz, a window of 2048 points (corresponding to 10.24 seconds) is a sufficient length for the algorithm to converge and yet is able to distinguish the two extreme cases (preictal and ictal) (lasemidis, 1991; lasemidis and Sackellares, 1991; lasemidis et al., 2000). These studies also point to the IDIST2 parameter as being the most critical parameter in the above algorithm. The STLmax seizure prediction algorithm identifies progressively increasing similarity in the information production rate (termed dynamicall entrainment") between critical electrode sites prior to seizures. In other words, long before the onset of an epileptic seizure, critical brain sites begin to display similar dynamics. The progressive STLmax convergence prior to a seizure is thought to reflect dynamical dependence because 1) the critical sites share direct or indirect anatomical connections that are conducive to physiologic interaction, and 2) occurrence of the progressive STLmax entrainment prior to a seizure (lasemidis et al., 2004). This concept is indirectly supported by the therapeutic effect of neurostimulation therapies such as ECTinduced seizures and the potential longterm anticonvulsant effect (for a recent review of ECT therapy see Taylor, 2007). A potential physiologic basis for brain resetting could be a release of neuromodulators after seizures (Gwinn et al., 2002). In addition, lasemidis et al. (2004) suggest that the lack of an observed timereverse of the resetting phenomenon is consistent with hysteresis, a characteristic observed in epilepsy as well as other dynamical disorders (Lopes Da Silva et al., 2003). Mean Angular Frequency in Phase Space One modification of the Lyapunov exponent was proposed by lasemidis to measure a quantity related to the STLmax measure (lasemidis et al., 2002, 2003). The mean angular frequency in phase space ( ) measure quantifies the angular frequency of the phase space evolution of two nearest neighbor points relative to a reference point. Conceptually, this measure quantifies the rate of change in stability of a dynamical system. The measure is related to the Lyapunov exponent, which measures the local stability of a system. Consider the vectors X(t ) and X(t, + At) as two states in phase space separated by the time delay At. The difference in phase between these two states in phase space is AO( (lasemidis et al., 2002). The mean (AO) of the local phase changes AO( in state space is denoted as: 1 NT A =  YAD (351) N,  where N, is the total number of phase differences calculated from the evolution of X(tj) to X(t + At) in state space, according to: A = arccos (tX(t, +At) (352) \X(tj X(t, +At\ The mean angular frequency in phase space Q can then be defined as: 1= AO. (353) At If the units of At are seconds, Q has units of radians per second (an alternative is to divide by 2n resulting in units of sec1 or Hz for expression of rate of system state change). Figure 33 illustrates the concept of the phase change measure as it is applied to data with the same phase space mapping with STLmax where At = k x dt is the evolution time allowed for the vector X(t ) to evolve to X(t, + At) where dt is the sampling period of the original time series. Data Mining Data mining refers to the application of algorithms to extracting patterns from and modeling large databases (Flexer et al., 2000) and provides reasonable tools for extracting useful patterns in datasets from complex systems. Data mining techniques have demonstrated successful detection of scalp EEG patterns which may be difficult for the human eye to visualize (Acir et al., 2005; Chaovalitwongse et al., 2006; Thulasidas et al., 2006). Often such algorithms or the patterns they reveal can be utilized in real time applications, providing a basis for realtime EEG analysis tools (Chaovalitwongse et al., 2005; lasemidis et al., 2005; Sackellares et al., 2006; Thulasidas et al., 2006). Typical data mining tasks are described by the following categories: * Dimensionality reduction: the process of mapping of a highdimensional data set into a lowerdimensional space in order to facilitate data exploration * Reduction of noise: correction or removal of measurement artifacts and significantly atypical samples from the data set. * Clustering: creation of a partition of a given set of samples into classes according to similarities that are relevant to the particular analysis One of the more important instances of dimensionality reduction is called feature selection. This process results in the generation of a lowerdimensional space by eliminating a subset of dimensions from the original space. Feature selection is an important process for reducing computation time as well potentially improving accuracy. Reduction of noise is an important procedure which is universally applied in applications spanning numerous disciplines. Finally, clustering refers to a broad class of data mining applications which are highly relevant to the work done in this dissertation. Clustering Clustering problems can be subdivided into unsupervised or supervised clustering. Unsupervised learning methods divide data into natural groupings. Supervised clustering methods are also referred to as classification, which is described later in this chapter. The following represents a nonexhaustive listing of some basic clustering techniques. Kmeans clustering The kmeans algorithm is one of the most basic and commonly applied cluster algorithms. The method clusters a set of N data points into K partitions based on the similarity between the pattern and the cluster centers, where K< N (Jain et al., 1999). A random initial partition is selected after which the patterns are repeatedly reassigned some convergence (e.g. squared error threshold) is achieved. The kmeans algorithm is especially attractive due to its O(n) complexity as well as its ease of implementation (Jain et al., 1999). One deficit of this method is a high sensitivity to initial conditions, which can result in convergence at local minima. Biclustering Biclustering is a data mining technique which provides the ability to not only cluster data samples, but also the data features. The procedure is performed in a manner that each class of data features created within the biclustering is related to a class of data samples by a particular property that distinguishes it from samples in other classes and is said to be the "cause" of its creation. In other words, the biclusters are subsets of samples which exhibit similar characteristics across a subset of features, or vice versa. The biclustering methodology has been used extensively in numerous biomedical research applications such as DNA microarray analysis and drug design as well as others (Madeira and Oliveira, 2004; Shamir et al., 2005; Busygin et al., 2006). The output of biclustering algorithms is especially useful for feature extraction, a crucial procedure in many biomedical studies. Analogous to the ability of biclustering to reveal up regulation and down regulation of genes in dna microarray datasets, biclustering is a data mining tool wellsuited for revealing spatial and temporal subsets of EEG features that are indicative of neural states (Busygin, 2007). A dataset containing m features and n samples is arranged as a rectangular matrix A = (a )m n, where a,, represents the ith feature of thejth sample. Consider the assignment of the samples into classes as follows S ,S2,...,S,,Sk c {1,...n},k =1,...,r, S, S2 U...uS, = {1,...,n}, Sk nS, =0,k,l= ,...,r,k l This method intends to assign samples such that samples from the same class share specific common properties. Similarly, a feature i may be assigned to one of the features classes F,,F2,..., Fr, Fk {1,...,m},k = 1,...,r, F uF2 ... u F, = (,...,m, Fk rF, = 0,k,l = l,...,r,k l in such a manner that the features of class Fk are "responsible" for the creation of the class of samples Sk. Such a simultaneous classification of samples and features is termed biclustering. Definition 1: A biclustering of a dataset is a group of sample /feature pair subsets B= ((S,,IF1), (S2F2),F),... SF) such that the group (S ,,S2,,Sr) forms a partition of the set of samples, and the collection (F F2 ., F) forms a partition of the set offeatures. A pair (Sk Fk will be called a bicluster. Various criteria may be used for relating sample clusters to feature clusters. Most commonly, it is required that the subset corresponding to a bicluster is either includes a certain amount of values above the mean of the dataset, or has a lower variance than that of the dataset. In general, it is acceptable for biclustering to rely on any type of common pattern among the elements of the bicluster. Consistent biclustering: The following biclustering framework utilizes feature selection based on 01 fractional programming (Busygin, 2005). Let each sample be arbitrarily assigned to one of the classes S, S,,..., S,. A 01 matrix S = (sjk), r is introduced such that sjk = 1 if j e Sk and sjk = 0 otherwise. The sample class centroids are represented by the matrix C = (ck )m : C = AS(STS) (354) whose kth column represents the centroid of class Sk. Consider a row i of the matrix C. Each element in the row is the mean expression of the i th feature in one of the sample classes. Each feature is then assigned to the class where it is among the largest number of features with a similar value as is shown in figure 34. Let the ith feature be classified as a member of the class k with the maximal value ck i E F :> Vk = 1,...,r,k k:cki> ck (355) Using the acquired feature classification (F F2,' 2' F ), let a classification of samples be constructed using the same principle of maximal average expression and test whether this arrives at the same classification as when using features. This is performed by constructing a 01 matrix F = (fk )mr such that fk =1 if i e Fk and fk = 0 otherwise. The feature class centroids can be represented by a matrix D = (djk )n D= A'F(F F)1, (356) whose kth column represents the centroid of the class Fk. The requirement for sample classification is j S> Vk = 1,...,r,k # k: d > d, (357) The feature selection and supervised biclustering framework proposed in (Busygin, 2005) is grounded in the following definition. Definition 2: A biclustering B will be called consistent if both relations (355) and (357) hold, where the matrices C and D are defined as in (354) and (356). Unlike other biclustering schemes, this definition of consistent biclustering is justified by the fact that consistent biclustering implies class separability with convex cones (Busygin, 2005). Theorem 1: Let B be a consistent biclustering. Accordingly, there exist convex cones P1, P,,..., PI c 9" such that every sample from Sk belongs to the cone P. and no other sample belongs to it, k = ,...,r. Similarly, there exist convex cones Q1, ,,..., Qr C 9" such that every feature from Fk belongs to the cone Qk and no other feature belongs to it, k = ,..., r. It follows from the theorem of conic separability that convex hulls of the classes are separated and thus do not intersect. The term biclusteringadmitting is used to describe a dataset for which some consistent biclustering exists. In addition, the data set will be called conditionally biclusteringadmitting with respect to a given (partial) classification of certain samples and / or features if a consistent biclustering exists which preserves the given (partial) classification. Given a training set A = (aJ) where the samples are assigned to classes (SS.;.,S ) the corresponding classification of features can be constructed according to expression (355). If the obtained biclustering is not consistent, features are then excluded from the dataset so that the biclustering with respect to the cropped feature set is consistent. Let a vector of 01 variables x = (x, )=, be introduced where the ith feature is selected if x, =1 and is not selected otherwise. When only the selected features are applied, the condition of biclustering consistency in expression (357) becomes m m I a, fkx Zafkx 11 > Vj S,,k = ,...,r,k # k (358) =1 1 The expressions in (358) are utilized as constraints of a feature set optimization problem. Though the objective function may take on various functions of x depending on the desirable properties of the features, a general choice is to aim for the maximal number of features. This formulation helps minimize the amount of lost information provided during training. In this scenario, the objective function is expressed as m max X, (359) i=1 Expressions (358) and (359) comprise a specific type of fractional 01 programming problem which can be solved using the approach laid out in (Busygin et al., 2005). Data Classification Classification can be described as the process of categorizing an unknown dataset. First, a socalled training set of samples wherein sample classes are known a priori is provided to the algorithm. The preclassified training data is used to train the algorithm to recognize the specified patterns. Training is typically an iterative process where the parameters affecting classification are systematically adjusted until the classification error bound is decreased below a specified threshold. This specific process is referred to as machine learning. Machine learning Machine learning refers to a collective group of methods which are utilized to enable computers to "leam". There have been very successful implementations such as finding genes in a DNA sequence, filtering email, financial analysis, detecting or recognizing objects in machine vision, language processing, and medical diagnosis (Cristianini and ShaweTaylor, 2000). Many of these applications rely on pattern recognition which is essentially concerned with object classification based on characteristics. An object's characteristics or features can be described as the qualitative and quantitative measures which can distinguish it from other objects. The amount of similarity between two objects can be quantified as a function of the differences in the objects' set of features. Object similarity can be used as a basis for grouping objects into classes. Please note, while the content of a person's character may be a useful feature of a person, the color of a person's skin is not a good feature for classification. Classes may be represented in various ways such as approximation functions or functions that define borders between classes. Arranging objects into classes based on their location relative to these functions is referred to as classification. Machine learning from the classification perspective can be organized into two main categories. Supervised learning refers to the process where a system learns from an example data set in the form of input/output pairs. In such an example dataset, the input is typically a vector of representing an object's features and the output is the object's class label. A set of objects each with a corresponding feature vector and class label is more formally referred to as a training set. The training set is used to derive a classification function. Once trained, a classification function is capable of predicting an object's label. The term "supervised" stems from the nature of the training scheme where the training set's object labels are determined by an outside source and provided as an input. Therefore, this training method requires supervisory guidance to train the classifier. Unsupervised learning is the other machine learning category where objects are not labeled with any class information a priori. Thus, unsupervised learning forms object classes based on inherent feature similarities determined during training. Supervised learning systems applications have found extensive use in biological applications (see Tarca et al., 2007 for a review). Briefly, some biological and medicinal applications include detection of cancer prone tissues, mapping tissue gene expression profiles to disease groups, and protein folding based on the DNA sequence. In addition, a broad range of machine learning algorithms have provided a means for successful neural state classification and neurological disorder diagnosis using EEG signal features (Flexer, 2000; Lotte et al., 2007; Seref et al., 2007). There are several wellknown machine learning algorithms, including decision trees, neural networks, and support vector machines. These base algorithms can be used in combination with other algorithms for improved accuracy often at the cost of hindered performance. One of the most widely used measures in classification problems is the Mahalanobis distance metric. Mahalanobis distance classification Mahalanobis distance is a statistical distance measure which factors in correlations between variables. The mahalanobis distance is a useful method of quantifying similarity of an unknown sample set to a known sample set. The square of the mahalanobis distance measure has been applied to the classification of neural states using EEG signal patterns (Scher et al., 2003; Le Van Quyen et al., 2005; Piccini et al., 2005). The squared mahalanobis distance, D2ref,t, between a 25dimensional EEG data point vector X(t) where X(t)= (Xl,,t, Xh2z,, Xh3,t,..., Xchs,t (360) and the centroid of the reference class [ref where "ref = ( ohl, cch2, ch3 ..., ch25 )T (361) is equal to: D2ef, = X(t) ef C (X(t) / f,) (362). The Cref term is the covariance matrix for the reference class. The mahalanobis distance measure D2comparison,t refers to distance between the same EEG data point, X(t), and the centroid of the comparison class, Pcomparison The EEG data point X(t) is assigned to the class with the closest centroid (e.g. the class from which the point is at the minimum Mahalanobis distance) to X(t) (Le Van Quyen et al., 2005). If the EEG data point is equidistant between the two classes, the point is considered misclassified. The accuracy of the minimum Mahalanobis distance classifier is equal to the number of correctly classified points divided by the total number of points. Support vector machines Support Vector Machines (SVMs) are a class of data classification algorithms first introduced by Vapnik and Lerner (1963) which are used to model and classify large volumes of multivariate data. The SVM algorithm determines the optimal separating hyper surface between two multidimensional datasets (Burgess et al., 1998). SVMs have been demonstrated success in numerous biomedical applications such as magnetic resonance imaging (MRI), functional MRI (fMRI), positron emission tomography (PET), and Singlephoton emission computed tomography (SPECT) (Seref et al., 2007) in addition to applications where neural states were classified from EEG data (Acir et al., 2005; Chaovalitwongse et al., 2006; Lehmann et al., 2007; Thulasidas et al., 2006). The SVM formulation for linearly separable data quantifies the distance from the hyper surface for each data point in the positive class and each data point in the negative class. In this context, the term "margin" will refer to the distance between the separating hyper surface and the nearest point for a class. The margin of the function output is referred to as the functional margin. The geometric margin is the functional margin of a normalized weight vector. Hence the geometric margin can be optimized by fixing the functional margin to be equal to one and then minimizing the norm of the weight vector (Cristianini and ShaweTaylor, 2000). If w is the weight vector for a functional margin of distance equal to one from a positive (reference) class point, x+ and a distance equal to one from a negative (comparison) class point, x, then the geometric margin can be determined as follows. For a functional margin equal to one: iw, x+ +b= +1 (363) (w,x +b =1 (364). To calculate the geometric margin, w must be normalized. The geometric margin, y, is then the functional margin of the resulting classifier 1 w w 1I (WX w, ) (365) 1~ iI Thus, the interclass margin is maximized by min w (366) w,b subject to y ((w,x)+ b)>1 Vi =1,,n (367) where the constraints are that all points are properly classified for positive and negative classes, as stated in (367). For nonseparable data, the objective function (368) combines the term for maximizing interclass margin with a term for minimizing misclassification error (Cristianini and ShaweTaylor, 2000). n minll II: + i=,2,...,n (368) y,((wx,)+b )> Vi=l,.,n (369) S> 0 Vi = 1,...,n (370) The cost term, C, in (368) is the weight assigned to the error. Expressions (369) and (3 70) represent the constraints that each misclassified point is assigned a linear penalty (slack variable) and that all slack variables are nonnegative, respectively. An example of such a soft margin classifier is shown in figure 35. The SVM formulation in equations (368), (369), and (370) utilizes a linear hyper surface for discrimination. A common practice for improving separation accuracy is to perform a transformation to remap the data from input space into feature space using a kernel function. The inner product is then performed on the transformed feature space data (see equation (371)). K(x,,x )= (x, ), (x )) (371) The concept of a kernel function is identical to that of phase space mapping. The purpose is to view the data in a transformed space to unmask patterns which may have been hidden in input space. The radial basis function (RBF) is a standard choice as a kernel function in neuroscience applications (Acir and Giizelis, 2005; Bewernitz et. al., 2006; Lehmann et. al., 2007; Thulasidas et. al., 2006; Seref et al., 2006). The RBF function is expressed as K(x,,x )= exp x, J (372) The SVM is trained using a set of data features with a known classification. The SVM's performance is measured in terms of the accuracy at which it is able to classify a test data set. 300 I o I 200 100 aio E 100 2 LU 200 300  I 00 0 5 10 15 seconds Figure 31. A 15 second segment depicting the 200 Hz EEG of an absence seizure viewed from channel FplF7. 70 I0 70 60 60 o I I 50   : 40 40 CD 30 .I / It 20 10 10 . 5 10 15 0 5 10 15 seconds Figure 32. A 15 second segment depicting the spectrogram of an absence seizure viewed from channel FplF7. The vertical lines represent the onset and offset of the seizure. (0) kodt= t t2 xo to A(D2 Figure 33. Example angular frequency evolution in phase space. VI"Y'U'; ;" o'."lXUUrullI~~"E~"; s~ur~ e~i~E; L" U"" r"F Figure 34. Biclustering result of a toy dataset. The dataset produced three distinct classes. 100 Ma.lli>l \ I i\ \ N /ii i /Iw 0 l1w 0 * Figure 35. Linear hyperplane classifier applied to nonseparable data. Origin CHAPTER 4 INVESTIGATION OF EEG BIOMARKER EXISTENCE FOR VAGUS NERVE STIMULATION THERAPY: A DATA MINING APPROACH Patients with newly implanted vagus nerve stimulation (VNS) systems in VNS therapy undergo a calibration period of several months. With little knowledge of the mechanism of action (see chapter 2) or a rapid measure of efficacy, the current process of tuning VNS stimulation parameters in newly implanted patients is essentially based on the physician's experience and trialanderror. This process consists of setting initial stimulation parameters then iteratively adjusting stimulation parameters based on patient reports of clinical efficacy (seizure frequency) and tolerability since the previous visit to the doctor. It is known that "high" settings for stimulation parameters (such as output current, frequency, and pulse width) are shown to result in greater seizure reduction than "low" settings (BenMenachem et. al, 1994), but there is no available means for determining the proper set of stimulation parameters for a particular patient without numerous visits to the neurologist. This period involves numerous medical checkups to fine tune the electrical stimulation parameters based on clinical response. This suboptimal adjustment method leaves the patient at risk of seizures and imposes financial burden. The purpose of this study is to address this problem using data mining analysis. This chapter is organized as follows. First, the rationale for this study is introduced in terms of clinical relevance. Next, the experimental strategy is outlined and justified with examples from the literature. Afterwards, the four experiments comprising this chapter are presented in the following format: introduction, data description, experimental setup, results, and discussion. Finally, an overall conclusion is presented which comments on all the findings as a whole. Motivation for VNS Therapy Improvement It is desirable to establish a method to rapidly predict the efficacy of the various combinations of VNS parameters newlyimplanted patients in order to mitigate doctor's visits and perhaps expedite the process of optimizing therapeutic efficacy. A first step towards this goal is to investigate the existence of a physiologic metric that is sensitive to the EEG stimulation parameters and then the patient's clinical response to VNS therapy. Such an effect could be present in the EEG signal. EEG Markers for Treatment of Neurological Diseases and Disorders The utility of electroencephalogram (EEG) markers in treatment of neurological disorders motivates the examination of this treatment modality in terms of EEG effect (see chapters 2 and 3 for additional details). Electroencephalographic markers have demonstrated robust utility for the diagnosis, treatment, and evaluation of treatment for epilepsy (lasemidis et al.,1996; Pardalos et. al, 2003, 2004; Chaovalitwongse et al., 2005, 2006; Ding et al., 2007; Schevon et al., 2007) as well as other neurological disorders (Krystal et al., 1996, 1997, 2000; Asyali et al., 2007; Ding et al., 2007; Quintana et al., 2007). Specifically, there is has been an interest in the application of such analysis to the EEG signals of VNS patients to provide a better understanding of the therapy (Uthman et al., 2007). Recent studies have produced interesting findings of longterm VNS effects on epileptic interictal spikes (Koo, 2001), epileptiform sharp waves in the hippocampus (Olejniczak et al., 2001), interictal epileptiform discharges (Janszky et al., 2005; Santiago Rodriguez and AlonsoVanegas, 2006), gamma activity and desynchronization (Marrosu et al., 2005), and spectral content of sleep (Rizzo et al., 2004). The effects on interictal epileptiform discharges such as the studies by Koo and Olejniczak et al. suggest the presence of brain dynamical changes and further motivate the desire to examine VNSinduced EEG changes from the perspective of nonlinear dynamics since the existence dynamical changes are implied by changes in spiking patterns. In addition, no studies could be located which aimed to relate the EEG effects of VNS to the stimulation parameters. Aside from longterm epileptiform effect (Koo, 2001) or effects observed in hippocampal depth electrodes (Olejniczak et al., 2001), the lack of readilyavailable shortterm scalp electroencephalographic VNS effects reported in the literature (Hammond, 1992; Salinsky et al., 1993; Fisher et al., 1999; Koo, 2001; Rizzo et al., 2004; Marrosu et al., 2005), the benign non invasiveness of scalpEEG, state of the art techniques of modem knowledge discovery in database techniques (Flexer, 2000), and the potential for realtime application due to modern computer technology make EEG data mining analysis a desirable approach to studying VNS effect. These reasons motivate the current study which aims to identify electroencephalographic markers which are sensitive to VNS stimulation parameter configuration. If such electroencephalographic markers are identified, and if the electrographic markers are found to correlate with clinical efficacy then these findings could be applied to determine optimal VNS stimulation parameters on a patientbypatient basis. Modeling Brain Disorder Dynamics One approach for studying the brain's behavior is to generate a mathematical model of some subset the brain's activity using observable quantities, such as EEG recordings. Such models provide a means to make predictions about the behavior of one or more sections of the brain in response to various inputs. Due to the high degree of complex neuronal interaction in the brain, direct models have only been achieved for small neuronal networks small brain structures (Breakspear, 2001; Chauvet and Berger, 2002). The enormous complexity of electrical brain signals often means exact modeling approaches are insufficient. The challenge of direct modeling is compounded by the fact that no consistent immediate or shortterm VNSinduced effects have been identified in the raw EEG or its timefrequency profile (Salinsky et al., 1993; Fisher, et al., 1999; Koo, 2001; Rizzo et al., 2004; Marrosu et al., 2005). However, suppression of epileptiform sharp waves in the hippocampus has been observed (Olejniczak et al., 2001). This provides motivation for searching for dynamical scalpEEG effects of VNS. However, in a complex system such as the brain, it is often difficult if not impossible to obtain exact knowledge of system governing the observed dynamical behavior. In such a case, an alternative method to exact modeling is to develop a macroscopic modeling approach based on observable measures of the system in its entirety, such as EEG signals (lasemidis et al., 1996). Upon extraction of such information, it may be possible to generate useful empirical models of the system's global behavior. One such modeling scheme treats epilepsy as a dynamic disorder which is a class of disorders characterized by a sudden qualitative change in dynamics in response to an endogenous factor or a clinical maneuver (Milton, 2000). From this perspective, epileptic symptoms occur as a result of modifications to underlying physiologic control system parameters (Mackey and Glass, 1977; Mackey and an der Heiden, 1982; Milton and Mackey, 1989; Belair et al., 1995; Milton and Black, 1995; Milton, 2000; Lopes Da Silva et al., 2003). Such changes may manifest, for example, as a qualitative change in dynamics corresponding to bifurcations in mathematical systems. The importance of identifying a dynamic disorder is that a treatment possibility can focus on manipulating underlying control parameters back into a range of healthy dynamics (Milton, 2000). An example of this is the epileptic seizure control strategy of lasemidis et al. where the control focuses on maintaining a "healthy" range of STLmax tindex values (associated with seizure transition) by therapeutic intervention (lasemidis et al., 2003; Good et al., 2004, 2005). An analogous scenario may apply to VNS calibration in newly implanted patients where the VNS parameters are adjusted in order to elucidate a brain dynamical response or "state" that has been previously established as indicative of desired and even optimal seizure protection. Thus, the achieved neural state as described by dynamical EEG responses associated with different stimulation parameters over time may serve as "marker" for VNS treatment and facilitate rapid determination of optimal VNS parameters. See figure 42 for a threedimensional conceptual example of such a model. The example in 42 utilizes three measures only for the sake of example. In actuality, a real model may utilize dozens or even hundreds of such EEG features. Determining which EEG measures should be used in such model is a challenging task indeed. A common approach for revealing complex relationships among the features and samples from large a multidimensional dataset (such as an EEG recording) is to employ data mining methods. Data mining refers to the application of algorithms in order to extract patterns from complex databases (Flexer, 2000) and provides a means for identifying EEG features which may be sensitive to neural stimulation as well as neural stimulation parameters in the VNS implant. Previous work employing data mining techniques has demonstrated successful pattern detection from scalp EEG signals which is often difficult for the human eye to visualize (lasemidis et al., 1996; Pardalos et al., 2003; lasemidis et al., 2004; Acir et al., 2005; lasemidis et al., 2005; Chaovalitwongse et al., 2006; Sackellares et al., 2006; Thulasidas et al., 2006). Thus, such an algorithm may be useful in the case of VNS therapy where shortterm stimulation scalp EEG effects are not explicitly visible in the time or frequency domain (Hammond et al., 1992; Salinsky et al., 1993; Koo, 2001; Rizzo et al., 2004; Marrosu et al., 2005). Often such algorithms can be run in real time, providing a basis for an online EEG analysis tool (Sackellares et al., 1997; Chaovalitwongse et al., 2005; lasemidis et al., 2005; Thulasidas et al., 2006). The overall goal of this work is to investigate the existence of EEG feature patterns which may be related to clinical and biological aspects of a patient's VNS therapy. The underlying hypothesis of this work (stated as null) is "electroencephalographic effects in patients undergoing VNS therapy for epilepsy do not vary with differing VNS parameters". Expressing VNSrelated effects in terms of scalpEEG recordings is desirable considering its wide availability at medical facilities and utility in epilepsy diagnosis. Such EEG measures may one day find use as markers to help determine optimal VNS parameters more rapidly in newly implanted patients. Biclustering Analysis of EEG Dynamics in Patients undergoing VNS Therapy for Epilepsy Biclustering is a useful method for determining the existence of supervised binary classifications in multivariate datasets. The outputs of biclustering are particularly valuable for feature extraction purposes which are a significant concern in many biomedical studies. One of the most common applications is establishing connections between syndromes (e.g., signs and symptoms in cancer) and their corresponding gene expression patterns (Cheng et al. 2000; Kluger et al., 2003; Yoon et al., 2005). The biclustering algorithm's ability to distinguish two predefined states makes it a potentially useful tool for characterizing EEG dynamical alterations associated with VNS activation using EEG features (such as STLmax ) as an input. Data Description The scalpEEG recordings utilized in this study were obtained from patients with functioning VNS implants for the treatment of epilepsy. The recordings were performed at the General Clinical Research Center (GCRC) in Shand's Hospital at The University of Florida. EEG was acquired under GCRC protocol # 614, Institutional Review Board (IRB) protocol #6172004, "Neurophysiologic Measures of Vagus Nerve Stimulation". EEG data were obtained at 512 Hz sampling rate using 16bit precision with a 0.16 Hz high pass filter and 105 Hz low pass filter hardwired into the amplifier. The dataset contained 25 scalpEEG channels arranged in the standard international 1020 system (see Fig. 43). EEG channels included in the study were: Fpl, Fp2, F3, F4, C3, C4, P3, P4, 01, 02, F7, F8, T3, T4, T5, T6, Al, A2, Fz, Cz, Pz, Leye, Reye, Lmn, and Rmn ("mn" refers to an electrode placed on the mandibular notch positioned between the jaw bone and the skull, which provides information about the temporal lobe). The CPz electrode, which is positioned between Cz and Pz, is used as the reference for the 25 EEG channels and electrocardiogram (ECG). The ECG electrode was placed near the VNS pulse generator for two reasons. While this position provides a sufficient ECG signal, it is also close enough to the pulse generator to introduce a unique artifact in the ECG channel which corresponds to the pulse generator activation. This explicit VNS signature provides a means to determine stimulation times. Once stimulation times were obtained, the ECG channel was excluded the further study. This study included two patients. The VNS paradigm is configured to deliver stimulation for 30 seconds and halt stimulation for 5 minutes, a cycle which repeated regularly throughout the entire recording for both Patient A and Patient B. Patient A's VNS parameters were 1.75 mA output current, 30 Hz signal frequency, 500 tsec pulse width, 30 second signal duration, and a 5 minute VNS deactivation duration. Patient B's VNS stimulation parameters were 1.5 mA output current, 20 Hz signal frequency, 250 tsec pulse width, 30 second signal duration and 5 minutes VNS deactivation duration. The VNS implants allow manual activation of the device should the patient require an immediate stimulation (e.g. if the patient senses an imminent seizure). Patient A's manual stimulation parameters were 2 mA output current, 30 Hz signal frequency, 500 [tsec pulse width, and a 60 second stimulation duration. Patient A did not experience any seizures during the recording session, and did not initiate manual stimulations. Patient B's manual stimulation parameters were 1.75 mA output current, 20 Hz signal frequency, 500 [isec pulse width, and a 60 second signal duration. Patient B underwent 14 seizures during the recording session and manually activated the stimulator between 20 to 40 seconds after onset of each seizure (a total of 14 manual activations). Additional information on the patient's clinical status can be found in tables 41 and 42. Each patient underwent continuous scalpEEG recordings approximately 24 hours in duration. For Patient A, a total of 255 VNS were analyzed in this study. For Patient B, a total of 237 VNS cycles were used in the analysis. Some of Patient B's VNS cycles were excluded from the study due to their disruption by a manuallyactivated stimulation and/or occurrence during a seizure. Finally, the last VNS cycle was excluded from analysis for both patients because it was not a complete cycle (it began closer than a full cycle length to the end of the recording). STLmax Feature Extraction Modeling brain activity using chaos measures has been shown to be useful for providing dynamical information about the neural state of the epileptic brain. Studies involving human patients (lasemidis and Sackellares, 1990; lasemidis and Shiau et al., 1999; lasemidis et al., 2001; lasemidis and Pardalos et al. 2003; lasemidis and Shiau et al., 2003) and animal models of epilepsy (Nair et al., 2004, 2005, 2006; Talathi et al., 2008) suggest that occurrence of spontaneous seizures correlates with the evolution of the brain to a state of greater spatio temporal order. This phenomenon manifests as a progressive increase in intrachannel similarity as measured by Lyapunov exponents calculated from multichannel EEG recordings. The reported sensitivity of STLmax to neural state changes in epilepsy make the measure a reasonable choice for attempting to characterize the VNS effects. Additional information can be found on the STLmax measure in chapter 3. Briefly, as was described in chapter 3, the window duration for calculating STLmax needs to be short to provide temporally local information about the brain's dynamics yet contain enough points for the algorithm to converge. A window length of 2048 points (corresponding to 4 seconds) was selected as it was sufficient for providing a stabilized STLmax estimate in previous neural state classification studies in epilepsy (lasemidis and Sackellares, 1999). In addition, it is desirable to utilize the shortest window length possible for STLmax estimation in order to provide locally dynamic information. As such, while maintaining a window length of the recommended number of data points for algorithm convergence, the 512 Hz sampling frequency provides improved time resolution over previous studies (which utilized a 200 Hz frequency). Additional parameters for STLmax estimation were selected based on the successful neural state classification studies that utilized them (lasemidis and Sackallares, 1999): reconstructed dimension D = 7, phase space reconstruction delay T = 14 msec (7 samples), evolution time AT = 41 msec (21 samples). Experimental Setup The STLmax time series for 25 EEG channels were analyzed using a consistent biclustering framework to determine separability of EEG fragments corresponding to stimulation times versus VNS deactivation. Since stimulation duration was set to 30 second and a four second time window was used to estimate each STLmax value, each stimulation provided seven data points. In order to help compensate for EEG pattern changes over the recording session which may not be related to VNS, each point in the stimulation class was averaged with the corresponding samples across all other stimulation cycles. This procedure reduces the amount of features to seven STLmax values for each channel to represent the stimulation class. The nonstimulation class was comprised often STLmax points starting 250 seconds after each stimulation to represent the portion of the nonstimulation temporally furthest from the end of stimulation. This class size was utilized capture as much information about the non stimulation periods as possible while keep class sizes reasonably close to one another (<50% size difference in classes). Each STLmax point in the nonstimulation class was averaged across all VNS epochs (where an epoch consists of one stimulation and one nonstimulation period). Thus, the nonstimulation class consists often averaged STLmax samples from nonstimulation time intervals (see figure 44). Thus, with 25 EEG channels, there total dimensionality of the biclustering input is 25 x 17. This particular input size this problem could be solved without any relaxation using CPLEX (ILOG Inc., 2004). Crossvalidation by the leaveoneout method was performed for each sample. Results Patient A's data were conditionally biclusteringadmitting into a binary supervised classification for the designated nonstimulation and stimulation classes with inclusion of all features (see figure 45). All but one feature (channel P3) were classified into the nonstimulation class. The heatmap indicates that STLmax indicates during the stimulation with respect to nonstimulation for all but the P3 channel. The leaveoneout crossvalidation method resulted in consistent classification of all 17 samples for Patient A. Only five features in patient B were able to fulfill the supervised biclusteringadmitting sample class designation with respect to given stimulation and nonstimulation classes. Channels F7 and T6 were designated as belonging to the nonstimulation class, while channels T3, Leye and Reye were classified into the stimulation class. Thus, there is less similarity among the channels during stimulation and nonstimulation, and a less clear distinction between stimulation and nonstimulation in Patient B than Patient A. Patient A's stimulation parameters (1.75 mA, 30 Hz, and 500 t[s pulse width) were all greater than Patient B's (1.5 mA, 20 Hz, and 250 [ts pulse width) except for the 30 second on time and 5 minute off time, which were the same for both patients. Discussion The successful application of biclustering with Lyapunov exponents demonstrates the potential to distinguish during VNS stimulation from VNS deactivation epochs using the dynamical scalpEEG measure STLmax. There is a greater spatialtemporal similarity in EEG dynamics during stimulation in patient A than during nonstimulation. However, this phenomenon was not nearly as well defined in patient B. It should be noted that Patient A had no seizures during the recording, whereas Patient B underwent seizures which were accompanied by a manuallyinitiated VNS stimulation. Though epochs containing seizures or manual stimulations were excluded from the analysis, it is possible that the seizures may have affected the results. Studies have demonstrated EEG dynamical transitions (in terms of the STLmax measure) preceding seizures minutes to hours (lasemidis et al., 1988; lasemidis, 1991; lasemidis et al., 1994, 1996, 1997). It may be that EEG dynamical changes leading up to a seizure and/or persisting after the seizure lead to such a small amount of features selected in Patient B. Despite the seizures and manual stimulations, the signals arising from the frontal lobe (f7, leye, and reye) and temporal lobe (t3 and t6) of the brain were sufficiently altered between stimulation and nonstimulation to allow a biclustering of the during the stimulation class (from t3, leye and reye channels) and nonstimulation class (from f7 and t6 channels) for Patient B. This could mean that the EEG effects of VNS are most pronounced in the frontal and temporal lobes. Patient B has a right frontal lobe focus. The biological significance of these results may be related to study which discovered that VNSinduced acute suppression of epileptiform activity in a hippocampal depth electrode (Olejniczak et al., 2001). While the study by Olejniczak et al. utilized depth electrodes, its possible that scalp EEG recordings may display some manifestation of such an EEG effect observed at a hippocampal depth electrode. From this perspective, perhaps the STLmax behavioral differences between patients A and B are associated with enhanced suppression of epileptiform activity in patient A compared to patient B. Patient A's stimulation parameters were all higher than patient B's parameters, with the exception of stimulation duration and off time, which were 30 seconds and 5 minutes for both patients, respectively. In general, "high" stimulation parameters are associated with a greater clinical response than "low" settings (Ben Menachem et al., 1994). Thus, any enhancement to epileptiform activity suppression in patient A over patient B is likely attributed to patient A's higher stimulation parameter settings. This work was published in the paper "Biclustering EEG data from epileptic patients treated with vagus nerve stimulation", authored by Stanislav Busygin, Nikita Boyko, Panos Pardalos, Michael Bewernitz, and Georges Ghacibeh (Busygin, 2007). SVM Analysis of EEG Phase Space Patterns in Patients undergoing VNS Therapy for Epilepsy In light of the numerous successful neural state classification applications, often in real time (Chaovalitwongse et al., 2006; Thulasidas et al., 2006) it is possible that SVMs may be able to provide a computationally inexpensive yet robust similarity measure for quantifying stimulationinduced EEG effects. As was stated chapter 3, experimental evidence supports the idea of a therapeutic resetting effect of epileptic seizures in terms of preictal convergence and postictal divergence of the STLmax measure among critical EEG electrodes (lasemidis et al., 2004). Furthermore, recent experimental evidence suggests that therapeutic interventions such as neurostimulation and AEDs can mimics the electroencephalographic resetting effect of a seizure (Good et al., 2004, 2005; Ghacibeh et al., 2005). Thus, a reasonable approach for examining VNS therapy is from the framework that it mimics the effect of a seizure by comparing stimulation "artificial seizures" to nonstimulation ("postictal" or "interictal"). Thus, the EEG phase space of an EEG segment during VNS stimulation was compared to successive windows spanning the full stimulation / nonstimulation epoch with the intent of comparing the degree of separability to the stimulation parameters and the clinical status of the patient. The application of support vector machines for obtaining an estimate of EEG similarity during stimulation compared to subsequent EEG segments may provide a rapid means to investigate and quantify electroencephalographic effects of VNS. The goal of this study is to extract EEG patterns which could be used as an electroencephalographic marker of optimal VNS stimulation parameters. Data Description Approximately 24 hours of scalpEEG was recorded and analyzed from six epileptic patients being treated undergoing AEDs and VNS therapy and the control patient. The recording electrode placement scheme is described in figure 42. The VNS Patient information is summarized in tables 41 and 42. SVM Application Description SVM training and testing were performed using LIBSVM software package designed for Matlab (Chang et al., 2001). The RBF kernel transform (equation 372) is a useful feature space mapping technique successfully utilized in numerous neurophysiological studies (Acir et al., 2005; Lehmann et al., 2007; Thulasidas et al., 2006).The RBF kernel with C=39 was utilized for the feature space transformation and a cost parameter of C=1000 were employed based on studies utilizing RBF SVMs to classify neural states using scalp EEG data (Kaper et al., 2004; Acir et al., 2005; Lotte et al. 2007). Thus, In contrast to the traditional SVM application where a typical goal is to obtain maximal separation basis by adapting all parameters, this study fixes the a and C parameters in order to mitigate subjectivity when comparing stimulation epochs to the nonstimulation epochs. An SVM classification accuracy of 50% implies minimal separation between the reference class and comparison class whereas 100% separation implies maximal separation between the reference and comparison class. These two extremes are interpreted as maximal and minimal similarity, respectively. Experimental Design The progression of EEG pattern evolution was quantified as the amount of separation achieved with support vector machines between two EEG segments both mapped into feature space using the radial basis function kernel. This exploratory study aims to examine how the EEG feature space patterns evolve throughout VNS stimulation and to identify potential relationships to stimulation parameters. In addition, the results will be compared to the clinical status of the patient. The ECG electrode was positioned on the skin over the VNS pulse generator so that VNS stimulation waveform is introduced into the ECG channel (see figure 43). The VNS stimulation times were then obtained by examining the ECG channel, which was excluded from further analysis. The following experimental procedure was applied to each stimulation epoch (an epoch defined as a VNS "on" cycle and one "off cycle) in the continuous EEG recording for each patient (with the exclusion of the final stimulation epoch which began less than one full cycle before the EEG acquisition was deactivated). An EEG segment occurring from 10 seconds to 20 seconds after the start of the VNS stimulation is selected as the positive class (from here on this class will be referred to as the "reference class"). The duration of each class was set at 10 seconds because this time frame is suggested to be long enough to be able to quantify brain dynamics yet short enough to be sufficiently stationary (Casdagli et al., 1995, 1996, 1997). The reference class segment was selected to start at one full window length after the start of stimulation because that allows the stimulator to have finished the rampup phase and be at the steadystate stimulation phase. The first successive EEG window (the segment ranging from 20 seconds to 30 seconds) was selected as the first negative class (from here on this class will be referred to as the "comparison class"). The first preprocessing step was to down sample both classes by calculating the mean value of a movingaverage nonoverlapping window, a step which decreases SVM classification time often without a significant effect of results (Thulasidas et al., 2006). The smoothing window was set at 10 points in duration based on prior experience. Next, each data point is converted to a zscore by normalizing to zero mean and unit standard deviation. This procedure prevents channels with greater mean amplitudes from dominating the classification decision (Acir et al., 2005). The trained SVM was tested with a vfold cross validation scheme, as described in (Hsu et al., 2003). This process applied a resampling technique in which the two classes are first randomly shuffled then divided into v equallysized subsets. The SVM is trained using v1 segments and is tested using the remaining subset V. This process is repeated until all v subsets have been tested. The accuracy is the percentage of properly classified points from each of the v trials. Based on prior experience, v=2 folds were utilized for SVM training and testing in this study. Once the training accuracy is obtained for the particular reference class and comparison class combination, the comparison class advances one full window length and the process repeats. The process of calculating SVM accuracy then advancing the comparison class is repeated for all comparison segments which occur within one window length from the next stimulation (into the next VNS epoch). This process is performed for each VNS epoch in the approximately 24 hour continuous EEG recording for each patient (with the exception for the final stimulation epoch during which the EEG recording ended). Results The results for the six patients are shown in figures 46 through 49 and table 43. The vertical line at 30 seconds in figure 46 represents the time when the VNS stimulator deactivates. Patients D and F have fewer comparison segments due to their off time of 3 minutes (thus the time between stimuli is less than the rest of the patients, which have a 5 minute off time). Patients E and F are seizure free. Discussion The results suggest a correlation may exist between pulse width and SVM separation accuracy (figure 48) as well as between stimulation frequency and SVM separation accuracy (figure 49). Furthermore, less similarity (greater SVM separation accuracy) is observed between the reference class (10 second EEG segment during stimulation) and all subsequent comparison classes (all nonoverlapping 10 second EEG segments prior to the next stimulation) for higher values of pulse width and stimulation frequency than is observed with lower values of pulse width and stimulation frequency. The biological significance of these results may be related to studies demonstrating differences in cerebral blood flow related to stimulation parameters. Specifically, a study demonstrated that the 250 pts VNS pulse width caused reduced blood flow in significantly more brain regions (e.g. hippocampus and superior temporal lobe) than a 500 ps pulse width (Mu et al., 2004). It is possible that pulsewidthinduced blood flow changes in these brain regions may have altered neuronal activity and thus be responsible for covariation of EEG feature space dispersion with pulse width. Another study reported that a 20 Hz stimulation frequency produced significant blood flow increase over 5 Hz in numerous brain regions such as the orbitofrontal cortex, hypothalamus, and thalamus in VNS patients (Lomarev et al., 2002). These regions may brain regions may be responsible for observed covariation of EEG feature space dispersion with stimulation frequency. It may seem counterintuitive that output current (figure 47) did not appear to demonstrate a trend with the SVM separation measure as a study demonstrated that "higher" stimulation settings (such as output current, frequency, and pulse width) can result in greater seizure reduction than "lower" (BenMenachem et al., 1994). However, the output current increase in (BenMenachem, et al., 1994) was also accompanied by increases in frequency and pulse width parameters. Thus the outcomes of that study can not be attributed to changes in a single parameter. Fortunately, the other two parameters (frequency and pulse width) mentioned in (BenMenachem et al., 1994) may correlate with EEG pattern changes, though more patients are needed to verify such a claim. It is possible that VNS mimics the seizure effect of "resetting" the brain from an unfavorable preictal state to a more favorable interictal state (Sackellares et al., 1997; lasemidis et al., 2004) in which case the decrease in EEG similarity (signified by higher SVM separation accuracy) between the reference class and all subsequent comparison classes in an epoch may be an multidimensional analog to the brain dynamical resetting effect. The original effect was described as statistical convergence and divergence of STLmax values among critical electrode pairs (lasemidis et al., 2004). Thus, one explanation for the observed feature space similarity phenomenon is these measures are electroencephalographic evidence that VNS is in some manner "resetting" the brain more effectively (as denoted by the lower similarity measures after stimulation) in the patients with fewer seizures per month. Perhaps therapies such VNS provide ongoing gradual therapeutic action which suppresses the need for a large scale brain dynamical transition such as a seizure. It is worth stating that the time of each patient's last seizure prior to the EEG recording session for this study is not documented. The timing of the last seizure could prove to be important for patients who are not seizurefree (A, C and D). This is because there is a period of heightened seizure resistance during the period immediately following a generalized tonicclonic seizure. If patients A, C, and D had undergone a generalized tonic clonic seizure shortly before the EEG data were recorded for this study, then they may still have been under the influence of the reduced seizure susceptibility phenomenon. This may explain why they did not experience any seizures during this study. If Patient B had not experienced a generalized tonic clonic seizure recently, then reduced seizure susceptibility phenomenon may have been partially responsible for the large number of seizures reported this patient underwent during the study. These results should be viewed in the context that all six VNS patients are considered responders to the therapy defined as having at least 50% seizure reduction after one year of VNS therapy (Morell et al., 2006). Drug medication differences could also have an effect on the results. For example, patient D (whom demonstrated the lowest average similarity) is the only patient using either carbamazepine or zonisamide. On the other hand, Patient B (whom demonstrated the highest average similarity) is the only patient taking phenobarbital. Perhaps these differences in antiepileptic medications could have altered the observed electroencephalographic effects. As all patients have undergone VNS therapy for >1 year it may be regions of their nervous system such as the vagus nerve and/or brain may have adapted to VNS to such an extent that they do not demonstrate a significant acute EEG response to individual stimulations. However, it is premature to arrive at such a conclusion. The SVM training parameters utilized, though successful in similar studies, are not optimized for this particular application. In addition to non optimized SVM parameters, it is likely that improvements can be made in terms of feature selection for exposing VNS EEG effects. This study is published in an article titled "Quantification of the Impact of Vagus Nerve Stimulation Parameters on electroencephalographic Measures" with authors Michael Bewemitz, Georges Ghacibeh, Onur Seref, Panos Pardalos, ChangChia Liu, Basim Uthman (Bewernitz, 2007). Data Mining Analysis of EEG Dynamics Patients undergoing VNS Therapy for Epilepsy The fact that the resetting effect is described in terms of the STLmax feature motivates the use of the STLmax measure for investigating EEG patterns potentially associated with VNS and VNS stimulation parameters. Inspired by the notion that therapeutic interventions may replicate the therapeutic seizure resetting effect of a seizure without adverse symptoms, the following study computes and compares STLmax values before VNS to values during VNS and utilizes SVMs as well as logistic regression to provide measures of STLmax pattern evolution. The evolution of STLmax values among the EEG channels is one method to track global EEG dynamics over time. Data Description This study involved six patients undergoing VNS therapy for intractable epilepsy. The continuous scalpEEG recordings are 24 hour in duration and were obtained at the Shands Hospital GCRC protocol # 614, IRB protocol #6172004, "Neurophysiologic Measures of Vagus Nerve Stimulation" at the University of Florida, Gainesville. Clinical information for all six patients used in this study is summarized in tables 41 and 42. The electrode placement scheme is illustrated in figure 42.The stimulation times were obtained from the ECG channel, which was recorded in close proximity to the VNS pulse generator. The ECG channel was excluded from the EEG analysis. Feature Extraction The behavior of STLmax values calculated from EEG signals for seizure prediction has been extensively researched (see chapter 3). The embedded dimension of the reconstructed space D=7, lag step T=7 (14 msec), evolution time AT=21 (41 msec), and a window size N=2048 (4 sec) have provided useful neural state classification estimates (lasemidis and Sackellares, 1991; Casdaglil996; Casdaglil997; lasemidis et al., 1999). The interested reader may find the detailed explanation and justification of the algorithm and parameters in (lasemidis, 1991), (lasemidis and Sackellares, 1999) and (Wolf et al., 1985). STLmax was calculated for all 25 channels for the full EEG recording duration ( 24 hours) for all six patients. SVM Analysis of EEG Dynamics The LIBSVM software package for the Matlab environment was used for SVM training and testing (Chang et al., 2001). An RBF kernel with o=39 and a cost parameter of C=1000 were utilized based on studies utilizing RBF SVM to classifying neural states from scalp EEG data (Kaper et al., 2004; Acir et al., 2005; Lotte et al., 2007). The SVM parameters C and sigma are held constant in an effort to provide objectivity to this measure which can be used to study EEG signal evolution over time in feature space for all the patients. This study fixes the C and C parameters in order to mitigate subjectivity when comparing stimulation epochs to the non stimulation epochs. An SVM separation accuracy of 50% is interpreted as maximum measureable dynamical feature space similarity between reference class and comparison class features. An SVM separation accuracy of 100% is interpreted as the minimum dynamical feature space similarity between the reference class and comparison class features. Results are validated using a vfold cross validation scheme, as described in (Hsu et al., 2003) using 10 folds. This process applied a resampling technique in which the two classes are first randomly shuffled then divided into v equallysized subsets. The SVM is trained using v1 segments and is tested using the remaining subset V. This process is repeated until all v subsets have been tested. The accuracy is the percentage of properly classified points from each of the v trials. Logistic Regression Analysis of EEG Dynamics Logistic regression (LR) has seen number applications for the diagnosis of neurological diseases and disorders. Examples include Parkinson's Disease diagnosis using various clinical diagnostic measures (Leentjens et. al, 2002), diagnosis of Alzheimer's Disease (Lehmann et al., 2007), cognitive decline (Prichep et al., 2006), and Schizophrenia using electrophysiological features (Price et al., 2006), and epilepsy using EEG features (Alkan et al., 2005; Subasi et al., 2005). Thus, LR analysis is a suitable candidate for further characterizing the brain dynamics in patients undergoing VNS. LR is a statistical modeling technique utilized for probabilistic binary classification. As described in Subasi et al., 2005, the probability, Pt,ref, of a binary outcome event (EEG point at time "t" belonging to the reference class) is related to EEG value of channel "ch" at time "t", Xch,t in the form: P1,1f 25 (41) LOGIT(P,)= In r = P, +xhl, +...+ /25X ch25,t + ch(), (41) 1 (,ref ch=1 1 1 1 1 =(42) t.,refK ) t LOGIT(P,(X,))2(4 1+e ch 1 In equation (41), 30 is the intercept of the model and 31, 32, ..., 325 represent the coefficients for EEG channels one through 25. Once the logistic regression model is trained, the probability Pt,ref of an EEG data point Xt belonging to the reference class can be calculated in equation (42). The performance of the logistic regression model is measured using the area under the curve (AUC) approach (Komaraek, et al., 2005). The AUC is equal to the area under the receiver operating characteristics (ROC) curve. The AUC metric is simply the ratio of the area of an ROC curve to the area under a perfect ROC curve. Let "NR" be the number of points in the reference class, and "NC" be the number of points in the comparison class. NR = NC for this study, but do not have to be equal. The ROC curve is generated by first calculating Pt,ref for each EEG data point Xt in both the reference class and the comparison class. Then, the Pt,ref values are sorted in decreasing order. The ROC curve creation begins at the lower left hand corner of a blank curve plot. Each point with Pt,ref > 0.5 (most likely that the EEG point is from the reference class) results in the creation of an upward line segment of length one unit. Each point with Pt,ref < 0.5 (most likely that the EEG point is from the comparison class) in the creation of a line segment of length one unit to the right. The AUC metric is the ratio of the area under the generated ROC curve divided by the area under a perfect ROC curve (which climbs from (0,0) to (0, NR), then moves laterally from (0, NR) to (NC, NR) and is equal to one in this case). An AUC=0.5 (or ROC=0.5) is equivalent negligible dynamical feature space similarity between the reference class and comparison class. AUC=1.0 (or ROC=0) refers to the maximum measurable dynamical feature space similarity between the reference class and comparison class. Experimental Setup The following procedure was applied to each stimulation epoch (an epoch defined as a VNS "on" cycle and one "off" cycle) for each patient using SVMs and then repeated for LR. The EEG segment occurring 8 seconds (two window lengths) prior to stimulation start is selected as the "reference class". The reference class was represented as an n x m array of STLmax values where n is the number of channels and m is one less than the total number of stimulations occurring during the EEG recording. Setting m as one less than the total number of detected stimulations ensures that only complete VNS epochs are included in the analysis (as the last stimulation intersected with the end of the recording for all six patients). For each patient, the reference class utilized STLmax estimates from all n=25 channels from the time period of 8 seconds (two full window lengths) prior to stimulation start, for all m stimulations. The "comparison class" was initially established as an n x m array of STLmax values occurring at the start of the stimulation for all m stimulations included for each patient. The SVM and LR classifiers are trained and tested for separation of the reference and comparison class combination. Once the accuracies are obtained, the reference class is advanced 4 seconds (one full window length) and the process is repeated throughout the epoch with the last comparison class occurring 200 seconds after stimulation start. The end point corresponds to the end of the 3 minute interstimulation cycle, which is the final endpoint which Results Figures 410, 411, 412, and 413 as well as table 44 demonstrate a similar performance between the LR and SVM results. Using both methods, the same two patients which produced the greatest STLmax feature separation between nonstimulation and stimulation epochs (patients A and D) also possessed the greatest stimulation frequency, 30 Hz, whereas the patient with the lowest separation (patient B) also possessed the lowest stimulation frequency, 20 Hz. In addition, patient D produced the second greatest separation while possessing highest stimulation frequency of 30 Hz. On the other hand, Patient F also had the greatest stimulation frequency of 30 Hz yet only achieved an intermediate separation value compared to the other patients (though patient F is seizurefree whereas patients A, B, and D are not). The final noteworthy observation the width was the lowest (250 microseconds) and Patient B who demonstrated the least separation. There was no apparent trend regarding the degree of separation using either LR or SVM and output current. One interesting connection with the clinical status was that the patients whom experienced the greatest amount of separation (patients A and D) were also taking more types of AED medications (patients A and D each were on four medications, patient B was on three medications, all other patients were only taking two medications). Another interesting connection to the clinical status is that the patient with the largest number of monthly seizures (patient B) also demonstrated the least amount of STLmax feature separation between non stimulation and stimulation. Discussion The LR and SVM classification results suggest that EEG dynamical pattern changes (in terms of the STLmax measure) between stimulation and nonstimulation may be related to the stimulation frequency parameter. Lomarev et al. reported that a 20 Hz stimulation frequency produced significant blood flow increase over 5 Hz in numerous brain regions such as the orbitofrontal cortex, hypothalamus, and thalamus in VNS patients (2002). These regions may brain regions may be responsible for observed covariation of STLmax dispersion with stimulation frequency. At a first glance it seems counterintuitive that the output current did not appear to demonstrate a similar LR or SVM classification accuracy trend as pulse width and stimulation frequency, as a study demonstrated that "higher" stimulation parameter settings (such as frequency, output current, and pulse width) are associated with greater seizure reduction than "lower" settings (BenMenachem et al., 1994). However, the output current increase mentioned in (BenMenachem et al., 1994) was accompanied by increases in frequency and pulse width and thus the observed therapeutic effect in that study can not be attributed to changes in an individual parameter. Furthermore, the values of the other two parameters mentioned in the study by Ben Menachem et al. (frequency and pulse width) did show indications of a connection with EEG dynamical changes, which is encouraging. Patient B's large amount of seizures accompanying the lowest LR and SVM separation is an interesting observation. It is difficult to draw preliminary conclusions about clinical connections to the brain dynamical behavior as Patient B's stimulator was set at the lowest pulse width and the lowest stimulation frequency of all six patients. However, a potential connection between this patient's clinical behavior and the observed EEG patterns can be viewed from an interesting perspective first described in seizure prediction research studies. Considering the electroencephalographic and clinical effects observed during seizures, it is possible that the VNS therapeutic effect is enacted by artificially replicating the theorized therapeutic seizure mechanism first suggested by lasemidis et al. (2004). By adopting this perspective, patient B's seizures could be seen as the result of the VNS failing to replicate the resetting function of a real seizure. Thus, the brain is then "permitted" to seize in order to reset itself. This observation is congruent with the notion that patient B has the lowest STLmax feature separation for both LR and SVM between the VNS on (which could be considered a VNS 'artificial' seizure) and VNS off class (which from an 'artificial' seizure perspective could be viewed as a 'postictal' period for the 'artificial' seizure). It is worth mentioning that all six patients are considered as responders to VNS therapy by a definition of experiencing at least a 50% seizure frequency reduction following one year of VNS therapy (Morell et al., 2006). The observation that patients A and D were taking the most types of AEDs and demonstrated the highest STLmax feature separation between nonstimulation and stimulation is reasonable. Again, from the view of a seizure's "resetting" mechanism described in the previous paragraph, the two additional AEDs could possibly be enhancing effectiveness of the VNS resetting phenomenon as characterized by increased STLmax separation between VNS on and VNS off. This study was submitted to Computing and Optimization in Medicine and Life Sciences Vol. 3, under the title "A Data Mining Approach to the Investigation of EEG Biomarker Existence for Vagus Nerve Stimulation Therapy Patients", with authors Nikita Boyko, Michael Bewernitz, Vitaliy Yatsenko, Panos Pardalos, Georges Ghacibeh, Basim Uthman (Boyko et al., 2008). Conclusions The interesting results of these studies may be indicative of EEG dynamical effects of VNS and suggest the LR, SVM and biclustering may serve as useful data classification tools for use in an online realtime seizure control application. Biologically, these results may be related to the trait pointed in a study by Olejniczak et al. which discovered a shortterm suppression of epileptiform sharp waves following VNS from a hippocampal depthelectrode (2001). While the scalp electrodes used to collect the EEG data for this chapter cannot achieve the fidelity of hippocampal depth electrodes, it is possible that the scalp EEG data mining analysis results may reflect the same therapeutic effect as observed in the hippocampus by Olejniczak et al. (2001). The biological significance of the potential covariation of the EEG patterns with the pulse width and stimulation frequency parameters may be related to studies which demonstrated cerebral blood flow patterns corresponding to the pulse width (Mu et al., 2004) and stimulation frequency (Lomarev et al., 2002) parameters in VNS patients. Additional patients are needed to validate such claims against possible type 1 error. However, additional patients would also provide the opportunity to potentially uncover any VNSinduced EEG dynamical changes which may have been missed in this small sample (thus reducing the chance of type 2 error). A difficulty for this type of clinical research is recruiting patients with similar clinical situations (e.g. similar stimulation parameter configurations) in order to strengthen any observed connections between EEG behavior and stimulation parameters. For example, if numerous patients with similar stimulation parameters could be recruited, the patients may be taking different medications in different doses, etc. While it may be tempting to consider altering drug paradigms to mitigate intersubject variability, practical and ethical concerns must be kept in mind at all times when attempting to alter patient treatment regimes for research purposes. In addition, the impact of epileptic seizures on these EEG features and classification techniques is important for generating a robust stimulationresponse model. Thus, as the clinical circumstances such seizure occurrence can affect observed EEG dynamical patterns, it is worth mentioning that each patient's last seizure time prior to this study's EEG recording session is unknown. The time at which the last seizure occurred may be important factor for the patients which are not seizure free (patients A, B, C, and D) as there exists a period of reduced seizure susceptibility for a period of time following a generalized tonicclonic seizure. Thus, patients A, C, and D could have experienced generalized tonic clonic seizures prior to the study recording session and thus been influenced by this period of reduced seizure susceptibility. Such an scenario could have contributed to the lack of seizures occurring during the recording session and also influenced seizure dynamics. In addition, if patient B had not experience a generalized tonicclonic seizure prior to the study recording session then this patient's large number of seizures may have been partially induced due to the lack of said "seizure protection" phenomena following a seizure. Despite exclusion of stimulation epochs containing seizure activity from analysis, patient B's seizures during the recording session still may have altered the observed EEG patterns. The rationale for such as claim is the observation of dynamical EEG shifts (in terms of the STLmax measure) identified from minutes to hours prior to epileptic seizures (lasemidis et al., 1988; lasemidis, 1991; lasemidis et al., 1994, 1996, 1997). Thus, conclusions about patient B must be carefully considered as the seizures themselves could affect the observed EEG classification results. There is also a possibility of error in the monthly seizure rate as described by the patients. A 2007 study by Hoppe et al. demonstrated documentation inaccuracies in patient seizure counts (Hoppe et al., 2007). Thus, caution must be exercised in any epilepsy study which incorporates seizure information that was documented by patients. Thus, in an ideal study, additional consideration should focus on recruiting a group of patients with similar epilepsy cases (e.g. similar focus locations). By studying multiple patient groups each with similar variants of epilepsy, experimental findings are strengthened and the findings may help tailor resulting VNS therapy devices. In order further the understanding of EEG effects accompanying VNS it is important to track EEG feature patterns in patients before, immediately after, and for at least six months after implantation. A longitudinal study starting before VNS implantation and ending 612 months after implantation would provide insight into the evolution of EEG dynamical patterns before and after VNS parameter adjustment. In addition, such an analysis would help determine the presence of EEG characteristics present prior to VNS implantation for each individual patient. Thus, such a study design would add strength to postimplantation EEG patterns which are not observed prior to VNS implantation. In the case that preVNS data is not available for a particular patient of interest, patients whom are receiving VNS for depression treatment may serve as useful control subjects. Such patients could help determine how brain dynamics in VNS patients are influenced by epilepsy and seizures. The potential knowledge gained from these suggested studies could lead us one step closer to the creation of an EEG marker for optimal VNS parameters. In addition, as the relationship of EEG patterns stimulation parameters and clinical outcome in VNS patients is not clearly defined, then it is possible that the EEG measure parameters or perhaps the measures used in data classifiers are suboptimal. Thus, additional EEG features should be utilized for possible improvements in EEG dynamical comparisons. Complexity measures entropy measures have demonstrated success as data mining features for extracting brain dynamical information and classifying neural states (Chaovalitwongse et al., 2006). Clinical Literature Review / Future Experiments Stimulation parameters Experimental objective ' Ultimate A" goal EEG measures Figure 41. Rationale for studying EEG patterns which may be associated with the effect of VNS on the brain. Clinical effect OC = 0.75mA PW= 250 SF = 20 Hz On = 30 sec Off =5 min 1a _ ' 0.4  0.2 0.2 02 .8 ...... 0.4 . 0G6 ' 0.8  OC= 1.0mA OC = 1.25mA OC = 1.25mA PW= 250 PW = 250 PW= 500 SF = 20Hz SF = 20Hz SF = 20 Hz On = 30 sec On = 30 sec On = 30 sec Off= 5 min Off= 5 min Off 5 min _.  . ... 0.8 1 0.6 2 0.4 0.2 Figure 42. Conceptual EEG dynamics model in threedimensional feature space for testing stimulation parameter configurations in newlyimplanted VNS patients. Adjusting the stimulation parameters results in an altered dynamical 'state' of the brain denoted by the coordinates in threedimensional feature space. The model's colored regions relate the EEG dynamical state to its predicted clinical outcome. 132 4i i i i iil Table 41. VNS stimulation parameters Patient A Output Current (mA) 1.75 Stimulation Frequency (Hz) 30 Pulse Width (ps) 500 On Time (seconds) 30 Off Time (minutes) 5 Magnet Output Current (mA) 2 Magnet On Time (seconds) 60 Magnet Pulse width (ps) 500 20% Vertex B 1.5 20 250 30 5 1.75 60 500 C 2.5 25 500 30 5 2.75 60 500 D 2 30 500 30 3 2 30 500 E 1.25 20 500 30 5 1.5 60 500 F 0.75 30 750 30 3 0.75 60 750 Front S 20% ) P "" 10% : Nasioi Right side Back Figure 43. EEG electrode placement. Electrodes were positioned according to the 1020 electrode placement system which assigns locations proportionally spaced locations (e.g. 10%20%) with respect to the size of the patient's head. 40 sec, 10 samples 250 sec ,. St F5min Figure 44. STLmax class designation for biclustering analysis. 28 sec, 7 samples 28 sec, 7 samples A ZZZZZZZZZZcmmmcnfmw B ZZZZZZZzz00trnioA NAME f7 ts t3 leye reye Figure 45. Biclustering heatmap of STLmax from A) patient A and B) patient B. NAME fpl fp2 f3 f4 c3 c4 p4 ol o2 f7 fB t3 t4 t5 t6 al a2 fz 12 PZ leye Imn rnn p3 Table 42. Patient information for epilepsy patients with the VNS implant. Patient Age Focus Mean seizures per month # of seizures during recording Seizure Type Duration of VNS therapy (years) Medications* A 38 Right frontal Left frontal 3 C. Partial with infrequent secondary gen. > 1 year Gab Lam Lev Preg *Gab = Gabapentin, I Phenobarbital, Top = B 53 Right frontal 30 14 C. Partial with infrequent secondary gen. > 1 year Lev Phen Top Lam = Lamotrigine, Lev Topiramate, Carb = Carl C 54 Right temporal C. Partial with infrequent secondary gen. > 1 year Gab Top D 29 Left frontal C. Partial with infrequent secondary gen. > 1 year Carb Lam Lev Levetiracetam, Preg E 54 unknown C. Partial with infrequent secondary gen. > 1 year Chlor Gab F 54 Right temporal Left temporal 0 0 C. Partial with infrequent secondary gen. > 1 year Preg Lev Pregabalin, Phen bamazepine, Chlor = Chlorazepate Table 43. SVM separation accuracy and seizure information. Patient Mean SVM Average monthly seizure Seizures during recording separation rate A .9284 3 0 B .7788 30 14 C .8359 2 0 D .9807 3 0 E .9454 0 0 F .8982 0 0 *Average monthly seizure rate of zero indicates seizure freedom. 0 50 100 150 200 250 300 Time after reference segment (seconds) Figure 46. Mean SVM separation accuracy value across the stimulations for each individual intrastimulation window. 2.68 C 2.4 2.2 2 1.8 1.6 1.4 1.2 1  0.8 0 75 0.8 0.85 0 9 SVM accuracy (%) Figure 47. VNS output current and the corresponding mean SVM separation accuracy over 24 hours. 750 700 650 600 550 500 450 400 350 300 250 _ A E 0 75 0.8 0.85 0 9 0.95 1 SVM accuracy (%) Figure 48. VNS pulse width and the corresponding mean SVM separation accuracy over 24 hours. 30 o 28 V26 n C 24 g 22 20 0 75 Figure 49 F A 0.8 0.85 09 0.95 1 SVM accuracy (%) VNS signal frequency and the corresponding mean SVM separation accuracy over 24 hours. 0. 0.g Patients  B C D F __ w  9F 01 i0 i i i i time, sec Figure 410. SVM Separation accuracy throughout the VNS epoch, averaged across all epochs. Stimulation begins at t=0 seconds. 0.9 0.8 0.7 ~06 >,0.6  , 0.5 > 0.4 ~0 C) S0.3 0.2 0 0.1 0 0 D E F Patients Figure 411. Overall mean SVM separation averaged across intraepoch time points and all epochs. C Patients 6 A  B C  D )I E S F 0 20 40 60 time, sec Figure 412. LR separation quality throughout the Stimulation begins at t=0 seconds. 1 0.8 0.6 0.4 VNS epoch, averaged across all epochs. 0.2 0  r r r Patients Figure 413. Overall mean LR AUC averaged across intraepoch time points and all epochs. I r Table 44. Mean SVM and LR separation accuracy and patient seizure information. Overall mean SVM Overall mean LR Seizures per Seizures during Patient separation separation month recording A 0.8082 0.9701 3 0 B 0.4746 0.5104 30 14 C 0.6171 0.7571 2 0 D 0.7536 0.9658 3 0 E 0.7210 0.8878 0 0 F 0.6885 0.8319 0 0 CHAPTER 5 ANALYSIS OF INTERSTIMULATION BRAIN DYNAMICS IN VAGUS NERVE STIMULATION THERAPY The Identification of a marker of desired VNS operation would greatly expedite the VNS parameter adjustment process in newlyimplanted patients. This study faces two significant challenges: 1) the underlying therapeutic mechanism of VNS is still poorly understood, and 2) despite some interesting results reported in innovative research studies, the electroencephalographic effects of vagus nerve stimulation are not clearly defined. From the perspective of dynamical disorder (see chapter 2), there is reason to believe any such potential stimulationinduced EEG effects are likely to be elucidated from dynamical EEG analysis (Uthman et al., 2007). Further Characterizations/Investigations of EEGEffects in VNS Therapy Preliminary data mining results described in chapter four present interesting EEG dynamical phenomena with biological interpretations that are consistent with the theory about the physiological "resetting" role of a seizure. Of additional interest is the behavior of the brain between VNS stimulations. Viewing interstimulation brain behavior provides a means to determine how the brain recovers after VNS therapy (or 'artificial seizures'). In addition, this analysis duration also provides information about the brain while is not being actively influenced by a therapeutic action (e.g. VNS or the therapeutic effect of a seizure). Thus, as nonictal EEG can help provide information about the seizure imminent state, so to may the interstimulation EEG intervals provide information additional information about the brain's response to VNS which may not be available while the VNS is active. This chapter focuses on characterizing the temporal dynamical behavior of the EEG signals during the periods when the VNS is inactive. Building on the successes of the data mining approaches in chapter four, this chapter aims to further characterize EEG patterns which may be related to VNS. The brain's behavior will be characterized during all periods of respite from VNS. Dynamical EEG Measures as Markers for Neurological Diseases and Disorders The success of EEG markers for the treatment of neurological disorders is the primary motivation for this study. Such "signature" observations of pathological activity have greatly boosted diagnosis, treatment, and therapeutic evaluation of a range of neurological disorders (Krystal et al., 1996, 1997, 2000; Asyali et al., 2007; Ding et al., 2007; Quintana et al., 2007) including epilepsy (lasemidis et al., 1996; Pardalos et. al, 2003, 2004; Chaovalitwongse et al., 2005, 2006; Ding et al., 2007; Schevon et al., 2007). Additional details can be found in chapters 2 and 3. Despite reported interest in the application of such a technique to the EEG signals for improving VNS epilepsy therapy (Uthman et al., 2007), studies have been published which do not support the presence of VNSinduced EEG effects (Hammond et al., 1992; Salinsky et al., 1993; Koo, 2001; Rizzo et al., 2004; Marrosu et al., 2005). Though longterm VNSinduced EEG changes on epileptic interictal spikes (Koo, 2001) epileptiform sharp waves in the hippocampus (Olejniczak et al., 2001), interictal epileptiform discharges (Janszky et al., 2005; SantiagoRodriguez and AlonsoVanegas, 2006), gamma activity and desynchronization (Marrosu et al., 2005), and spectral content of sleep (Rizzo et al., 2004) have been reported, the time frame for observing such an effect renders it less useful the current task of expediting VNS parameter calibration in newlyimplanted patients. Physiological behavior such as alterations in the interitical spiking rate is congruent with the characteristics dynamical diseases and disorders. The class of disorders termed "dynamic disorders" demonstrates complex behavior patterns which evolve over time. Specifically, these disorders have been broadly described as undergoing a temporal disruption in the underlying physiological control mechanisms which results in a period of abnormal dynamical behavior (Mackey and Glass, 1977; Mackey and an der Heiden, 1982; Milton and Mackey, 1989; Belair et al., 1995; Milton and Black, 1995; Milton, 2000; Lopes Da Silva et al., 2003; Colijn and Mackey, 2005). Thus, studying epilepsy therapy from the vantage point of a dynamical disorder is a rational approach. Koo's observation of the VNS effect on interictal spiking rate (2001) demonstrates that relatively shortterm EEG effects (such as interictal spikes) are the manifestation of longterm modulatory VNS effects (e.g. after several months). Thus, this observation raises the possibility of less obvious shortterm manifestations of VNS modulatory effects existing in the EEG. Such EEG effects may be detectable using EEG measures that have demonstrated successful neural state characterization such as preictal transitions in seizure prediction studies (Casdagli et al., 1996; Chaovalitwongse et al., 2005; lasemidis and Sackellares, 1991; lasemidis et al., 1993; lasemidis et al., 2003, 2004; Le Van Quyen et al., 2001; Lehnertz, 1999; Lehnertz and Elger, 1995; Osorio et al., 2001). The purpose of identifying dynamic disorders is that successful treatment may result from manipulation of some physiologic control parameter into a range associated with healthy dynamics of the observed variables (Milton, 2000). One example of this is a seizure control strategy where the"healthy" range of STLmax tindex values (associated with seizure transition) in maintained by therapeutic intervention (lasemidis et al., 2003; Good et al., 2004, 2005). An analogous scenario may apply to VNS parameter adjustment in newlyimplanted patients where the VNS parameters may be adjusted in order to elucidate a brain dynamical response or "state" that has been previously established as indicative of desired or even optimal seizure protection. Thus, the achieved neural state as described by dynamical EEG responses associated with different stimulation parameters over time may serve as "marker" for VNS treatment and facilitate rapid determination of optimal VNS parameters. An example of this concept is illustrated for a brain dynamics model involving three dynamical measures in chapter 4, figure 42. Realistically, mapping the clinical outcome to subregions of a multidimensional feature space will likely be very complex and require numerous additional features for adequate characterization. While determining the proper features to best represent the brain behavior and its relationship to stimulation parameters in VNS is a daunting task, this study aims to provide an indepth evaluation of a number of EEG measures which have demonstrated sensitivity to neural state changes in other studies. For these reasons, the current study aims to identify electroencephalographic markers which are sensitive to the stimulation parameter configuration in patients with the VNS implant. If such electroencephalographic markers are identified, and if the electrographic markers are found to correlate with clinical efficacy then these findings could be applied to determine optimal VNS stimulation parameters on a patientbypatient basis. Data Description This study utilized EEG data from six patients undergoing VNS therapy for epilepsy. Extensive patient information can be found in chapter four. The recordings were acquired under GCRC protocol # 614 / IRB protocol #6172004, "Neurophysiologic Measures of Vagus Nerve Stimulation" GCRC in Shand's Hospital at The University of Florida. EEG data was acquired from channels Fpl, Fp2, F3, F4, C3, C4, P3, P4, 01, 02, F7, F8, T3, T4, T5, T6, Al, A2, Fz, Cz, Pz, Leye, Reye, Lmn, and Rmn using CPz (located between Cz and Pz) as a reference. The data were acquired at 512 Hz sampling rate using 16bit precision from an amplifier with 0.16 Hz high pass filter and 105 Hz low pass hardwired filters. The mandibular notch channel near the location where the jaw and skull contact one another provides information about the nearby temporal lobe. See figure 51 for electrode locations. The ECG electrode was placed near the pulse generator to introduce the VNS waveform in the ECG channel when the stimulator is active. Thus, the VNS signature waveform was introduced into the ECG (see figure 44) to provide an effective means to identify stimulation times by modifying a channel that is not used in the quantitative analysis. A summary of patient clinical information can be found in tables 41 and 42. Ideally, the baseline recording from each involved patient should be compared to their own EEG after implantation in order to strengthen claims that observed EEG patterns are the result of VNS and thus were not present prior to implantation. However, baseline EEG data was not available for this set of patients. As no baseline data was available for the VNS study, an interictal EEG recording from a temporal lobe epilepsy patient of 24 hours in duration provided courtesy of the Freiburg Center for Data Analysis and Modeling at the AlbertLudwigs Universitat Freiburg (University of Freiburg), Freiburg, Germany (Winterhalder et al., 2006) was utilized as a control dataset. The interictal EEG data came from patient p012 and was acquired at 512 Hz. The data were acquired from three focal channels (TBa4, TBb6, HR7) and three non focal channels (TLb2, TLb3, TLc2). The patient has a right hippocampal seizure focus which gives rise to simple partial, complex partial, and generalized tonicclonic seizures. The control dataset was utilized with artificial stimulation times based on both a 5 minute interstimulation interval and a 3 minute interstimulation interval. The Surrogate Analysis Method The surrogate data analysis method is a statistical approach for identifying nonlinearity in a time series. The best expression of the surrogate data method is from a statistical hypothesis testing framework (Theiler et al., 1992). This formulation requires a null hypothesis to test against and some test statistic. The null hypothesis is a possible description of system output which is tested to determine how well it models the observed data. The test statistic is a quantity calculated from the sample data to determine whether or not to reject the null hypothesis. Surrogate data analysis typically defines the null hypothesis such that the time series data are described by a specific process belonging to a broader class of processes (Schreiber and Schmitz, 2000). A common null hypothesis asserts that the time series data are generated by a general Gaussian linear stochastic process (Theiler et al, 1992). However, different realizations that fit within this broad category can result in surrogates with different power spectra and distributions. This scenario and may cause the test statistic may mistake such variations for deviations from the null hypothesis and falsely reject the null hypothesis (Schreiber and Schmitz, 2002). The can be approach using pivotal statistics or using constrained realizations (Theiler and Prichard, 1996). Pivotal statistics are measure created such that do not depend on mean or standard deviation under the null hypothesis. The "constrained realization" method enforces a requirement that all surrogates display the same power spectrum and distribution of values as the original data (Theiler and Prichard, 1996; Schreiber and Schmitz, 2000). Under the constrained realization approach the randomization method covers the "pivotal" requirement and thus opens up the possibility to use numerous nonpivotal test statistics for testing the null hypothesis. While the surrogate method is useful for suggesting the presence of nonlinear signal components, this technique cannot be used to characterize the specific type of observed nonlinear behavior. For example, while it is valid to utilize a Lyapunov exponent to test the null hypothesis, surrogate analysis cannot indicate that an observed nonlinear signal is the result of lowdimensional chaos (Pritchard et al., 1995; Palus, 1997; Schreiber and Schmitz, 2000). Surrogate data sets were generated using the algorithm proposed by Schreiber and Schmitz to produce same power spectrum and amplitude distribution as the original dataset (1996). The algorithm runs as follows. Let {s, } represent an EEG signal of length n. Store sorted list of the raw EEG values, (s ,,, ), and the absolute value of the amplitudes of the discrete Fourier transform (equation 311) of {s, which is denoted as {Sk First the original data {s, are randomly shuffled {s ()}. Each iteration consists of two actions. At iteration step i, the signal from the previous iteration {s ('j1) is brought to the desired power spectrum by computing the Fourier transform and replacing the amplitudes {Sk (1) with those of the original signal {Sk }, and performing the inverse Fourier transform. The original complex Fourier phase values of the signal from the previous iteration {s( 1)} remain unchanged when reconstructing the signal s ('} having the desired power spectrum. While this step enforces the correct power spectrum, it usually disrupts the signal amplitude distribution. Thus, the second step in an iteration is to rank order the resulting time series {s(') and replace the ranked indices with the ranked amplitudes from the original signal {s,;st }. Performing the rank ordering will thus alter the power spectrum calculate in step i+1, thus requiring the entire procedure to repeat. After each iteration, the deviation from the original power spectrum is checked and the process repeats until a given accuracy is achieved. The Role of Surrogate Data Analysis in EEG studies Nonlinear measures such as complexity, chaoticity, and informationbased measures can be useful in the analysis of the output of complex systems such as the brain (Lehnertz and Elger, 1995; Pincus, 1995; Lehnertz, 1999; Le Van Quyen et al., 2001; Osorio et al., 2001; lasemidis et al., 2003, 2004). However, analysis of less complex systems may not require the application of 148 nonlinear methods as they may provide the same (or perhaps less) information about the system at hand while often resulting in increased computational cost. Thus, an original application of surrogate analysis was to provide partial justification for the use of nonlinear analysis methods in EEG studies. Surrogate data analysis has provided support for the presence of nonlinear components of EEG signal in various types of epilepsy (Casdagli et al., 1995; 1996, 1997; Lopes Da Silva et al., 1999; Jung et al., 2003; Liu et al., 2007). Additionally, observations have been made regarding the different neural states in epilepsy such as interictal, preictal, ictal, and postictal the corresponding occurrence of significant nonlinearity (Pijn et al., 1997; Jung et al., 2003) as well as a measure of the "amount" of nonlinearity (e.g. the magnitude of the pvalue when comparing original to surrogate data) (Liu et al., 2007). In addition, surrogate data analysis has demonstrated changes in nonlinear signal component expression following various brain stimuli such as transcranial magnetic stimulation (Jing and Takigawa, 2002), drug treatment (Ferenets et al., 2006) compared to baseline EEG. As any similar studies regarding VNS was could not be located, such an analysis may provide a means for quantifying EEG effects related to VNS parameters and perhaps clinical outcome. In addition the following analysis may provide an improved understanding of the brain's EEG response to VNS and potentially provide insight into how it delivers its therapy. Nonlinearity Analysis of Interstimulation EEG The following study is motivated by a desire to characterize the interstimulation EEG dynamics in VNS patients and identify potential covariation with stimulation parameters using surrogate EEG analysis. The underlying hypothesis (stated as null) which motivates this study is "EEG dynamics during the interstimulation period are unrelated to the stimulation parameters in VNS patients". The interstimulation period is targeted in order to track the brain's post stimulation response which may contain useful EEG dynamical information relating to the stimulation parameter configuration. Under this experimental setup, it is logical to compare to the results to a control patient which utilizes artificial stimulation times. Resulting EEG dynamical differences between the VNS patient interstimulation epochs and the control patient artificial interstimulation epochs could provide convincing support for the existence of VNSinduced EEG effects which may be related to the VNS parameters. Choosing a Test Statistic By utilizing the "constrained realization" approach to surrogate data analysis, the options for a test statistic become more plentiful as the requirement for a pivotal test statistic is now relinquished (Theiler and Prichard, 1996). Based on the successful application of entropy measures in EEG nonlinearity test studies (Thomasson et al., 2000; Burioka et al., 2003,2005; Ferenets et al., 2006), as well as the general success in classifying neural states from EEG (Bruhn, 2000; Bruhn, 2001; Bruhn, 2003; Abasolo, 2005; Ferenets et al., 2006), the approximate entropy (ApEnt) measure will serve as the test statistic. The ApEnt measure was calculated within nonoverlapping windows of size 2048 points (4 seconds). A window of this size falls within a reasonable range utilized for computing ApEnt in terms of clinical and theoretical relevance (Pincus, 1995). The noise threshold r=0.2*std was selected as a result of studies which successfully correlated the ApEnt EEG measure to clinical drug anesthesiology levels (Bruhn, 2000; Bruhn, 2001; Bruhn, 2003; Ferenets et al., 2006), as well as a study which used ApEnt to characterize background EEG in patients with Alzheimer's Disease (Abasolo, 2005). The phase space mapping process utilized an embedding dimension of 7 is used based on previous EEG complexity studies quantifying neural state transitions in patients with mesial temporal lobe epilepsy (lasemidis et al. 1988; lasemidis et al., 1990; lasemidis et al., 1999). The time delay embedding process utilized a delay T=7 corresponding tol4 ms (lasemidis et al., 1990; Zaveri et al., 1993; lasemidis et al., 1996). Experimental Design The amount of surrogates were selected based on a model proposed by Schreiber and Schmitz which considers a residual probability a of a false rejection by random chance with a corresponding significance level of ( a) x 100 % (2000) The proposal suggests creating an amount of surrogates M=2*K/a 1 such that the probability that the data will reject the null hypothesis by chance is a for a twotailed test (Schreiber and Schmitz, 2000). Due to the intensive computational complexity of this procedure, this preliminary analysis utilizes K=l and a=0.1 for the purposes of selecting the amount of surrogate data copies. Thus, this study uses 19 surrogates. EEG surrogates were calculated in nonoverlapping windows of length 2048 points (4 seconds). This window size is considered to be within a reasonable range for surrogate data generation (Schreiber and Schmitz, 1996). This is also used as the window length utilized in the calculation of the ApEnt measure used as the test statistic. The mean value of each ApEnt point across all 19 surrogates is computed to the surrogate datasets to a single time series which is then compared to the original signal (Casdagli et al., 1996; 1997; Liu et al., 2007). For patients with a 5 minute interstimulation time a window of 73 points represented the interstimulation period. For patients with a 5 minute interstimulation time a window of 73 points represented the interstimulation period. For patients with a 3minute interstimulation time, a 43 point window represented the interstimulation time. Statistical testing was performed using a twotailed pairedt test. For 95% certainty and 72 degrees of freedom and 42 degrees of freedom the critical tvalues are t= 1.993 and t=2.018, respectively. This preliminary study assesses the dynamical structure of EEG signals during VNS interstimulation periods. The dynamical structure is evaluated by testing each interstimulation epoch against a null hypothesis of a Gaussian linear process using surrogate datasets for all epochs for all six patients. The hypothesis, stated as null is: S HO: EEG dynamics during an interstimulation epoch are described by a Gaussian linear stochastic process. Results For each patient and for each channel, the hypothesis was tested using approximate entropy of the EEG of VNS deactivation epoch (see figure 53 through 512 and tables 51 through 53). Patients A and B showed a notable increase in the amount of interstimulation epochs demonstrating a nonlinear signature occurring across most channels occurring between 11 pm until 7 am. The control patient showed a decrease in a nonlinear fingerprint occurrence in nonfocal channels during the same time of day. The fraction of epochs across the entire recording and all channels which displayed a nonlinear signature (could reject HO at the given significance) displayed a potential negative correlation with the pulse width parameter for all six patients. In addition, patient F showed nonlinear signatures in fewer epochs than any other patient (35.1% of all epochs could reject HO at the given significance), followed by patient E (39.0%). Both of these patients are seizure free. Patient B's EEG showed the most nonlinear fingerprints having 52.3% of the epochs rejecting HO at the given significance level. While patient F showed the most nonlinearity, patient F had the greatest stimulation frequency (30 Hz) and the greatest pulse width (750 us). Patient B had the lowest stimulation frequency (20 Hz) and the shortest pulse width (250 [ts). The fraction of epochs which displayed nonlinear signatures for the control patient with 5minute and 3minute interstimulation times were 42.5% and 37.2%, respectively. In general, the lower the monthly seizure rate, the less nonlinear signatures were observed. According figure 53, patient F (seizurefree) produced a smaller fraction of nonlinear interstimulation epochs than the 3minute control whereas patient D (3 seizures per month) produced a larger fraction of nonlinear epochs than the 3minute control. A similar trend was observed in the patients with the 5minute interstimulation time. Patients C and E (seizure free and seizures per month, respectively) generated a smaller fraction of nonlinear epochs than the 5minute control whereas patients A and B (3 seizures per month and 30 seizures per month, respectively) displayed a larger fraction of nonlinear epochs than the 5minute control. Patients A, B, D, and F showed noticeably higher expressions of nonlinearity in channels located near foci than nonfocal channels. The control patient demonstrated a high density of nonlinear behavior in nonfocal channels during waking hours which is diminished around 11 pm 7 am, except for the TLc2 channel which shows a greater fraction of epochs demonstrating nonlinear signatures than other channels. Discussion In regards to the connection of EEG patterns stimulation parameters, the most obvious observation was the potential relationship between the fraction of epochs which displayed nonlinearity and the pulse width parameter. In addition, Patient F produced the smallest fraction of epochs presenting a nonlinear signature (35.1% of epochs could reject HO at the given significance level) and patient had the highest stimulation frequency (30 Hz) and the highest pulse width (750 ks) of all six VNS patients. Patient B's EEG presented the greatest fraction of epochs presenting a nonlinear fingerprint (52.3% of epochs could reject HO) whereas the patient had the lowest stimulation frequency (20 Hz) and the lowest pulse width (250 [ts) of all six VNS patients. The underlying biology driving this EEG behavior could be related to a study which demonstrated an acute suppression of epileptiform activity in the hippocampus during VNS (Olejniczak et al., 2001). Perhaps enhanced suppression of epileptiform activity is responsible for the diminished nonlinearity in patients with fewer seizures. Also, a study has demonstrated that the 250 [ts pulse width parameter results in blood flow mitigation to significantly more brain regions (e.g. hippocampus, sup. temp. lobe) than a 500 [ts pulse width in VNS patients (Mu et al., 2004). Perhaps pulse width related bloodflow reductions reported by Mu et al. are responsible for any such changes in epileptiform activity suppression which may have been detected by the surrogate data analysis. In addition, patients E and F demonstrated the lowest fraction of epochs presenting a nonlinear signature (39% and 35.1%) and also happen to be the only two patients which are seizurefree. This may be aligned with the clinical observation that the absence of bilateral interictal epileptiform discharges was the only EEG predictor of seizure freedom (Janszky et al., 2005). Future studies should include characterizing the profile of interictal epileptiform discharges for relationship to linear and nonlinear measures. In patients A and B there was a notable increase in the amount of interstimulation epochs demonstrating a nonlinear signature occurring across most channels at times around 11 pm until 7 am. The increase in the occurrence of nonlinear signature may have been partially resulted from the patient being drowsy or asleep. A surrogate analysis study by Shen et al. demonstrated a considerable number of EEG segments displaying a nonlinear signature during stage 2 sleep and may be the result of Kcomplexes (Shen et al., 2003). The control patient demonstrated a high density of nonlinear behavior in nonfocal channels during waking hours which is diminished around 11 pm 7 am, except for the TLc2 channel which shows a greater fraction of epochs demonstrating nonlinear signatures than other channels. Patients A, B, D, and F showed a greater fraction of epochs presenting nonlinear signatures in channels located near foci than nonfocal channels. This observation is aligned with the literature where focal electrodes demonstrated higher nonlinearity than nonfocal electrodes (Casdagli et al., 1995, 1996, 1997). While the control patient provides information from a patient with a similar epileptic condition and recorded at the same frequency as the VNS patients, the depth electrode recordings from the control patient provide limits to what can be suggested to conclusions about VNS induced scalpEEG patterns. The ideal control would be use baseline from each patient using an identical electrode setup. The fraction of epochs rejected the null hypothesis is a necessary condition for nonlinear dynamical, however, these results are not sufficient to suggest a particular type of nonlinearity (e.g. surrogate analysis cannot prove the existence of lowdimensional chaos). Changing parameters (e.g. the dimensionality or noise threshold) for ApEnt may improve sensitivity to potential VNSinduced EEG effects and thus provide the possibility to relate said effects to stimulation parameters and ultimately to the clinical outcome. The results, combined with studies documenting the ability of various nonlinear measures to quantify neural states motivates the usage of nonlinear as well as linear measures to examine EEG dynamical behavior which could be associated with VNS stimulation. Temporal Evolution of Interstimulation EEG Dynamics The results of the previous experiment characterized the presence of nonlinear EEG signal components throughout each of the interstimulation epochs for each of the six patients undergoing VNS therapy for epilepsy. However, as surrogate analysis does not provide characterization of nonlinear signal components, it is possible that the properties of the detected nonlinear components may distinguish the control patient from the VNS patient. Thus, additional characterization signal dynamics would enhance the findings from the surrogate analysis. This experimental perspective aims to analyze the observed nonlinear signal components and further characterize how brain dynamical patterns behave during the period between stimulations. This study is motivated by an underlying hypothesis (stated as null) "HO: Interstimulation EEG dynamics are time invariant in patients undergoing VNS therapy for epilepsy". While VNS is believed to induce its therapeutic effect via longterm modulation (Koo, 2001), this longterm effect may manifest as changes in shortterm temporal dynamical behavior compared to baseline which would be consistent with the traits of a dynamical disorder such as epilepsy (Mackey and Glass, 1977; Mackey and an der Heiden, 1982; Milton and Mackey, 1989; Belair et al., 1995; Milton and Black, 1995; Milton, 2000; Lopes Da Silva et al., 2003). Thus, it is possible that the brain dynamics during the interstimulation epochs in VNS patients will be distinguishable from a control patient, which would provide support for the use of EEG dynamical analysis for the study of VNS effects. Furthermore, EEG dynamical behavior during the interstimulation period may be related to stimulation parameters. Data Description Six patients undergoing VNS therapy for intractable epilepsy were analyzed in this study. The continuous scalpEEG recordings are approximately 24 hours in duration and were obtained at the Shands Hospital GCRC protocol # 614, IRB protocol #6172004, "Neurophysiologic Measures of Vagus Nerve Stimulation" at the University of Florida, Gainesville. Available clinical information for the six patients is summarized in tables 41 and 42. The electrode positions are described in figure 51. VNS activation times were obtained from the ECG channel, which was recorded from an electrode placed in close proximity to the VNS pulse generator. The ECG channel was otherwise excluded from this study. EEG Dynamical Measures Quantitative EEG analysis is a broad field incorporating numerous methods for quantifying various properties of EEG signals (see chapter 3). In order to improve the characterization of the dynamical evolution, this study utilized multiple EEG measures. Each of the EEG analysis techniques first applies a phase space transformation after which the relevant information is extracted. The phase space mapping procedure of Takens (1981) was applied using an embedding dimension of 7 is used based on previous studies in which the epileptic attractor was characterized from EEG recordings of patients with mesial temporal lobe epilepsy (lasemidis et al. 1988; lasemidis et al., 1990; lasemidis et al., 1999). For an embedding dimension of 7, a time delay of T=7 samples corresponding tol4 ms is applied. This time delay value has demonstrated success in characterizing the rhythm of a typical seizure in temporal lobe epilepsy (lasemidis et al., 1990; Zaveri et al., 1993; lasemidis et al., 1996;). Approximate entropy This ApEnt measure (see equations 316 to 319) has been utilized to study EEG patterns in Alzheimer's disease patients (Abasolo, 2005), as a surrogate marker for anesthesia depth (Bruhn 2000, Bruhn 2001, Bruhn 2003), detecting epileptic seizures (Abasolo 2007; Srinivasan, 2007), and as a test statistic for characterizing EEG nonlinearity (Thomasson et al., 2000; Burioka et al., 2003,2005; Ferenets et al., 2006). Thus, it may be useful for characterizing brain dynamics during interstimulation intervals. The noise threshold was set at 20% of the signal's standard deviation r=0.2*std was applied based on studies which successfully correlated ApEnt with drug anesthesia levels (Bruhn, 2000; Bruhn, 2001; Bruhn, 2003; Ferenets et al., 2006) and a study characterizing background EEG in patients with Alzheimer's Disease (Abasolo, 2005). The 2048 point (4 second) window selected for this study is within a range that has been described as being clinically and theoretically appropriate (Pincus, 1995). Correlation sum For a collection of points in some vector space, the correlation sum is the fraction of all possible vector pairs which are closer than a given distance r for a particular norm distance norm (see equation 32). The correlation sum is estimated after mapping the EEG into phase space. The correlation sum is often used to estimate the correlation dimension (equation 327) which has been extensively utilized in physiological data (Kantz and Schreiber, 1995) such as neural state classification studies using EEG (Tirsch et al., 2000, 2004), as well as seizure prediction (Elger et al., 1998; Martinerie et al., 1998). However, since use of an absolute radius can result in a heavy EEG amplitude sensitivity (Osorio et al., 2001), this study utilizes a relative radius measure (with respect to the diameter of the dataset in phase space) for brain dynamics characterization (Casdagli et al., 1996, 1997, Merkwirth et al., 2002). Correlation sum was estimated using the TSTOOL package (Merkwirth, 2002) for Matlab. Theiler recommends application of an exclusionary window to a range of points surrounding each reference point in order to avoid embedding vectors on the same trajectory (Theiler et al., 1986). Based on the results of similar studies, a 250 ms (128point) exclusion window around reference points and a search radius r=0.2 (10% of attractor diameter) were implemented (Casdagli et al., 1996, 1997). Mean angular frequency in phase space A modification to the Lyapunov exponent measures, the mean angular frequency in phase space measure (0) quantifies the angular frequency of the phase space evolution of two nearest neighbor points relative to a reference point (lasemidis et al., 2001, 2002, 2003). Conceptually, this measures the average rate of change of a system state. The measure is related to the Lyapunov exponent, which measures the local stability of a system. A study quantifying neural states in epilepsy found that preictal, ictal, and postictal states corresponded with medium, high, and lower values of 0, respectively (lasemidis et al., 2002, 2003). In addition, the dynamic entrainment / disentrainment and seizure resetting phenomena observed before and after epileptic seizures using the STLmax measure has also been described with Q (lasemidis et al., 2003). Thus, the sensitivity of Q to changes in neural state makes it a candidate for quantifying any EEG dynamics changes which may be associated with VNS. The window length selected for this study, 2048 points, is the same window length as was used in lasemidis et al. (2001, 2002, 2003). Shortterm maximum Lyapunov exponent The STLmax measure has been shown to be useful for providing dynamical information about the neural state of the epileptic brain. Studies performed on EEG from human patients (lasemidis and Sackellares, 1990; lasemidis and Shiau et al., 1999; lasemidis et al., 2001; lasemidis and Pardalos et al. 2003; lasemidis and Shiau et al., 2003) and animal models of epilepsy (Nair et al., 2004, 2005, 2006; Talathi et al., 2008) imply that the evolution of the brain to a state of greater spatiotemporal order correlates with spontaneous seizures. This phenomenon is presented as a temporally progressive increase in the similarity among socalled critical channels measured by STLmax calculated from multichannel EEG recordings. Thus, sensitivity of STLmax to neural state changes in epilepsy indicated by the above studies makes the measure a reasonable candidate for identification and characterization of potential VNS induced EEG effects. The window duration for calculating STLmax needs to be short to provide temporally local information about the brain's dynamics yet contain enough points for the algorithm to converge (additional information about this can be found in chapter 3). The 2048 point (4 second) window size chosen for this study is suggested to provide a sufficiently stable STLmax estimate in previous neural state classification studies in epilepsy (lasemidis and Sackellares, 1999). Also, use of the shortest window length possible for STLmax estimation can help provide a stationary segment for estimating local dynamical information. As such, while maintaining a window length of the recommended number of data points for algorithmic convergence, the 512 Hz sampling frequency provides improved time resolution over previous studies (which utilized a 200 Hz frequency). The evolution time parameter was set to AT = 41 msec (21 samples) based on successful neural state classification studies that utilized them (lasemidis and Sackallares, 1999). Experimental Design This preliminary investigation into the temporal evolution of the EEG between stimulations will start searching for coarse dynamics transitions between the first and second halves of each epoch where the VNS is deactivated. The rationale for this class designation is to assess the existence of any shortterm transitions, to characterize the temporal evolution where it exists, compare with a similar experimental setup in a control patient and determine any correlation to clinical parameters. The underlying hypothesis (stated as null) which motivates this study is "EEG dynamics during the interstimulation period are unrelated to the stimulation parameters in VNS patients". Figure 513 shows an illustration indicating how the measures were grouped to examine the temporal evolution of these dynamical measures during VNSOFF. As shown in figure 513, EEG measures corresponding to the first half of an epoch are compared to EEG measures corresponding to the second half of an epoch for each channel, for all channels (except ECG). Using 4 second windows to calculate the various EEG measures, the The preliminary hypotheses (stated as null) are formulated for the purpose of characterizing the EEG behavior associated with stimulation in the VNS patients: * HI: The EEG dynamics as quantified by approximate entropy are time invariant while VNS is deactivated. * H2: The EEG dynamics as quantified by correlation sum are time invariant while VNS is deactivated. * H3: The EEG dynamics as quantified by mean angular frequency in phase space are time invariant while VNS is deactivated. * H4: The EEG dynamics as quantified by shortterm maximum Lyapunov exponent are time invariant while VNS is deactivated. These hypotheses aim to answer the question of how the dynamical brain behavior as described by these four nonlinear EEG measures evolves over time between stimulations. Such an analysis may identify EEG patterns which are sensitive to particular stimulation parameter configurations as well as the candidate measures for detecting such patterns. The control patient underwent two similar tests; one which utilized stimulation times with a 3 minute 'off duration, and a second test which utilized stimulation times with a 5 minute 'off duration. The hypotheses were tested with a twotailed unpooled twosample ttest with a=0.05 using the Matlab Statistics Toolbox. The tests were performed assuming unequal variances and utilized Satterthwaite's approximation for the effective degrees of freedom. For a measure window size of 2048 points (4 seconds), the first and second halves of the interstimulation epoch each contain 36 values of each measure for patients A,B,C,E (whom have a 5 minute interstimulation duration) and 21 values of each measure for patients D and F (whom have a 3 minute interstimulation duration). The same statistical testing method was used to test the control patient. The control patient was tested with artificial stimulation times using 3minute and 5minute interstimulation duration. Results As figures 522 and 524 show, for all patients the ApEnt and Q measures resulted in a larger fraction of epochs rejecting H1 and H3 (respectively) than the control patient for the majority of the 25 EEG channels. When using the correlation sum measure, the majority of electrodes had a greater fraction of epochs reject H2 for patient A than the control patient. However, the correlation sum did not show any such trend for any other patients. For all four measures, patient C rejected the four hypotheses in 23 times more interstimulation epochs than the control patient. For all four measures, patient F produced the fewest amount of interstimulation epochs that rejected the null hypothesis than any other patient. Numerous observations can be made regarding focal and nonfocal electrode behavior according to tables 53, 55, 57, 59. In terms of the ApEnt measure, the focuses of patients A,B,C, and F produced significant dynamical complexity fluctuations during more interstimulation epochs than their corresponding nonfocal areas, and greater than the control focus. This phenomenon could be related to studies where electrodes in the vicinity of an epileptogenic focus displayed more prominent nonlinear behavior (Casdagli et al., 1995, 1996, 1997). The correlation sum measure suggested that the focus and nonfocus of patient A demonstrated significant time varying dynamics in more interstimulation epochs than the control. For all six patients, the Q showed significant temporal dynamics variation in more epochs than the corresponding control patient. With regards to the spatial comparison of focal and nonfocal electrodes, the STLmax measure did not show any obvious trends. The main finding in regards to the dynamical behavior throughout the day (see figures 5 14 through 521) is the overall trend of diminished dynamical variance between approximately 11 pm and 7 am for all four measures in patients A (epoch 130) and C (epoch 140). Patient B's seizures were accompanied by significant temporal fluctuation in the Q dynamical measure before and after seizures. As stimulation epochs which overlapped with seizures were excluded from the study, these dynamical alterations occurred within about 10 minutes of the seizure. Discussion This study aimed to characterize the interstimulation EEG periods using a range of dynamical EEG measures which have demonstrated sensitivity to neural state changes such as those observed in epilepsy. Patient C had highest output current (2.5 mA) as well as the greatest amount of epochs (45.6%, 36.8%, 36.1%, and 21.8%) showing time varying dynamics of all the patients as measured by the ApEnt, correlation sum, Q, and STLmax measures, respectively (see figures 526 through 529). Patient A showed similar ApEnt and Q behavior (35.7% and 31.0% of interstimulation epochs demonstrated significant temporal variance for both measures, whereas control values were 21.8%, 10.5%, respectively) compared to patient C and had the second highest output current (1.75 mA). Patient F showed an opposite trend having the lowest output current (0.75 mA) where ApEnt, 0, and STLmax produced the smallest fraction epochs rejecting H1, H3, and H4 (23.8%, 20.2% and 14.3% whereas control values produced 16.9%, 7.9%, and 19.4%, respectively). The ApEnt measure quantifies the regularity in a time series (Pincus, 1995; Abasolo et al., 2007), the Q measure provides an estimate of the stability of the reconstructed attractor in phase space (lasemidis et al., 2002, 2003), and STLmax provides a measure of chaoticity of a signal (lasemidis et al., 1991). Thus, the similar behavior of these three measures implies the EEG could be undergoing fewer changes in the regularity, stability and observed chaoticity in patient F than patients A and C. Overall, the ApEnt and Q measures demonstrated the greatest deviation from the control patient, the broadest range of the fraction of epochs showing time varying dynamics, and a potential covariation with output current. For these reasons, the ApEnt and Q measures may potentially find use as EEG biomarkers for VNS. Biologically, these results may be related to the findings of studies which identified a current threshold for suppression of chemically induced seizure models. For example, seizures induced in a low Ca2+ model could be suppressed with currents greater than 1 tA (Warren and Durand, 1998). In addition, seizures induced in a high K+ model could be suppressed with currents greater than 4tA (Nakagawa and Durand, 1991). Yet patient F has been seizure free for at least one year at the time of recording, while patients A and C have mean seizure rates of 3 and 2 seizures per month (respectively). In general, higher values of VNS parameters are associated with improved seizure protection (BenMenachem et al., 1994). So while at first it may seem counterintuitive that the patient with the lowest output current (patient F) is seizure free, keep in mind that the aforementioned study is referring to collective impact of output current, pulse width, and stimulation frequency. So even though patient F's output current (0.75 mA) is less than patient A's (1.75 mA) and patient C's (2.5 mA), patient F has higher pulse width (750 [ts) than patients A and C (both 500 [as). In addition, patients A and F have the greatest stimulation frequency of all the patients in the study (30 Hz) whereas patient C has a 25 Hz stimulation frequency. In addition, patient F has a shorter interstimulation interval (3 minutes) compared to patients A and C (both 5 minutes). It is tempting to attribute patient F's seizure freedom to this patient having a greater amount of stimulation cycles over time, however patient E is also seizure free and has a 5 minute interval. It is interesting that all four measures behaved in a similar manner for patient F whom had the lowest output current and was seizure free. Perhaps when the output current raises above a particular threshold value the neuronal activity is affected in such a manner that it becomes more erratic and thus results in more rapid dynamical transitions. The minimum current threshold for suppression of epileptiform activity in seizure observed by Nakagawa and Durand (1991) as well as Warren and Durand (1998) may be responsible for this. This could explain why patients A, B, C, D and E whom had greater output currents than patient F produced results less consistent with the other dynamical measures than for patient F. Regarding the relationship to the time of day to EEG dynamical effects, the most obvious trend was the period corresponding to 11 pm and about 7 am (see figures 514 and 516). The reduced dynamical temporal variance for all four measures in A (epoch 130) and C (140) during this period compared to other times of day is likely related to the fact that the patients are drowsy or asleep. A recent study by Rizzo et al. (2004) demonstrated that an overall increase in EEG total power both in sleep and wakefulness after longterm VNS treatment compared to pre treatment EEG, so it is plausible that the dynamical measures during sleep were influenced by the VNS. However, EEG sleep studies have demonstrated a decrease in the mean and standard deviation of the ApEnt measure (Acharya et al., 2005; He et al., 2005) during sleep compared to wakefulness, which is aligned with the observation of diminished variation of the ApEnt measure during times when the patient is presumed to be asleep. In addition, a study by Acharya et al. showed an increase in mean and a decrease in standard deviation for most sleep stages (2005). Thus, the observation of STLmax behavior during sleep is aligned with the literature. Therefore, while VNS has been shown to affect the sleep EEG signal (Rizzo et al., 2004), the behavior of the nonlinear measures during a period when the patient is drowsy or asleep is consistent with sleep patterns in people without VNS implants. Conclusions The results from the surrogate EEG analysis show a potential between the fraction of epochs which displayed nonlinearity and the pulse width parameter. In addition, Patient F produced the smallest fraction of epochs presenting a nonlinear signature (35.1% of epochs could reject HO at the given significance level) and patient had the highest stimulation frequency (30 Hz) as well as highest pulse width (750 ts) of all six VNS patients. Patient B's EEG presented the greatest fraction of epochs presenting a nonlinear fingerprint (52.3% of epochs could reject HO) whereas the patient's stimulator was programmed with the lowest stimulation frequency (20 Hz) and the lowest pulse width (250 [ts) of all six VNS patients. In addition, patient B demonstrated the greatest amount of monthly seizures. It is possible that neuronal modulation may be sensitive to the duration of the individual pulses in a manner which may manifest as increased linearity of neuronal output. For example, Mu et al. (2004) demonstrated that 250 ts showed blood flow reduction to significantly more brain regions than 500 [as. However, such an observation requires additional patients for verification. Also, patients E and F demonstrated the lowest fraction of epochs presenting a nonlinear signature (39% and 35.1%) and are also the only two patients which are seizurefree. This observation may be aligned with the clinical observation that the absence of bilateral interictal epileptiform discharges was the only EEG predictor of seizure freedom (Janszky et al., 2005). While interictal epileptiform discharge detection was not included in this study, future studies should include the spatiotemporal distribution of interictal epileptiform discharges in the characterization process. Comparison with linear and nonlinear EEG measures may provide additional information relevant to the connection between stimulation parameters and EEG patterns. The results from the temporal analysis of interstimulation dynamics demonstrate a potential manifestation of the VNS longterm modulation effect in terms of the interstimulation dynamics behavior. In particular, the ApEnt and Q measures displayed a potential covariation the output current parameter, demonstrated the greatest deviation from the control patient, the broadest range of the fraction of epochs showing time varying dynamics. For these reasons, the ApEnt,and Q measures could serve as EEG biomarkers for VNS. In light of this result, its possible that when the current reaches a threshold level the neuronal activity intensifies such that the summed output (the EEG) behaves more erratically (in terms of more rapidly fluctuating dynamical measures such as ApEnt and Q,). This phenomena could be related to the observation of minimum stimulation current thresholds were needed to suppress epileptiform activity in low Ca2+ (Warren and Durand, 1998) and high K+ (Nakagawa and Durand, 1991) seizure models. Overall, the two interstimulation analysis experiments (analysis of nonlinearity and analysis of temporal variation) showed potential connections EEG covariation with the pulse width, output current, and signal frequency parameters. Such effects may be useful as an EEG biomarker of optimal VNS settings. Additional studies should be performed on a larger sample of patients in order to validate these claims. In addition, baseline EEG recordings obtained prior to VNS implantation are crucial for determining which EEG effects in the VNS patient could be associated with VNS and which effects appeared to be present in the EEG prior to VNS implantation. The EEG measures were likely suboptimal as they were selected based on similar studies. Though it is difficult to select the proper parameters in measures used in an expeditionary study such as this one, a good place to start may be to calibrate the measures such that they are able to capture and unfold an epileptic attractor in phase space. From this perspective, future VNS studies which utilize phase space embedding transformations should utilize a patient's own seizures to determine the dimension and delay for embedding signals. In addition, study of the VNS in this setup is limited by the fact that the stimulator is programmed for chronic regular stimulation. Thus, though these studies aim to characterize the shortterm EEG effects after stimulation, the shortterm affect is produced by the cumulative effect of a large number of stimulations. Thus, an interesting study to help truly elucidate the effects of an individual stimulation or a group of stimulations would be to record prestimulation baseline for a group of patients, perform a single VNS stimulation, and perform an additional EEG recording while keeping output current at zero milliamps to examine any poststimulation effects. Such an analysis may be one of the best ways to provide the most objective insight into the EEG effects of VNS without concern of any longterm modulatory effects. In addition, tracking the progression of such measures over time (e.g. 3 months, 6 months, 12 months after implantation) and comparing with the patients own baseline EEG recording are a desirable approach to examining EEG dynamics in patients with VNS. The seizures that patient B underwent during the recording session could likely have had a far reaching impact on the observed dynamics patterns, as EEG dynamical transitions have been documented as occurring several minutes to several hours prior to seizures (lasemidis et al., 2004). One potential improvement to this study is to record multiple days of recordings in order to compare a sufficient amount of 'interictal' data, which has been defined as being at least 8 hours away from a seizure (Pardalos et al., 2003; Hively et al., 2005; Chaovalitwongse et al., 2006). This would eliminate preseizure dynamical transitions as an additional variable to influence results. If this were not possible, one other possibility would be to examine only the EEG data that occurs at least 8 hours away from any detected seizure in a patient. One challenging aspect this approach is that the amount of EEG that would be allowed in the study would be diminished significantly (e.g. twothirds of a single day would be excluded due to a single seizure), and with only a handful of seizures at the 'wrong' time would render this approach infeasible. Though sleep staging was not included in this research protocol obtaining the precise sleep times with manual and/or computer automated sleep staging for each patient should be included in future work. This would help to further examine the observation that the four EEG measures underwent less variation over time during the periods between about 11 pm and about 8 am. The preliminary study of temporal evolution of dynamics used a two tailed test to determine the means are different or not. A future study should look at the direction of the two way test to determine if regularity, stability, or chaoticity are increasing or decreasing throughout the duration of the interstimulation interval. Such information may provide additional insight into the dynamical behavior and the stimulation parameters (e.g. a trend of decreasing or increasing the dynamical measures may be related to the stimulation parameters, the clinical status of the patient, or even the time of day). Ultimately this study may lead to a method of surgical VNS testing, e.g. surgically exposing the left vagus nerve so a diagnostic vagus nerve stimulation device could be temporarily attached to the patient, stimulations could be applied in the operating room and the EEG signal can be analyzed. If this setup were to prove successful, it may provide a method to prescreen patients for responsiveness to VNS therapy prior to undergoing the implantation process. An article related to these studies was published under the title "Optimization of epilepsy treatment with vagus nerve stimulation" with authors Basim Uthman, Michael Bewernitz, ChangChia Liu, and Georges Ghacibeh (Uthman et al., 2007). 20% Vertex F  C ,. C '20% C D Z 10% i Nasio! Front Right side Back Figure 51. Map of EEG electrode location for the VNS patients. The electrodes were positioned according to the 1020 electrode placement system which assigns locations proportionally spaced locations (e.g. 10%20%) with respect to the size of the patient's head. Figure 52. Electrode positions for the control patient from A) an inferior and right view and B) axial slice view of the brain. Red circles indicate focal electrodes (TBa4, TBb6, HR7), blue circles indicate nonfocal electrodes (TLb2, TLb3, TLc2). Images provided for this publication courtesy of the Freiburg Center for Data Analysis and Modeling at the AlbertLudwigs Universitat Freiburg (University of Freiburg), Freiburg, Germany. 800 700 600 S500  400 01 ' 300 200 100 0 0.3 * Patients 5 min off A Patients 3 min off * Control 5 min off A Control 3 min off 0.35 0.4 0.45 0.5 Fraction of interstimulation epochs displaying a nonlinear signature (rejecting HO at 95% significance) Figure 53. Comparison of pulse width parameter to the fraction of epochs displaying a nonlinear signature in the six patients treated with VNS. The fraction of epochs displaying a nonlinear signature in control patient using the 3minute and 5minute off pseudo stimulation times are represented by the column of six triangles (3 minute off times) and six squares (5 minute off times). 100 150 200 250 Interstimulation Epoch Figure 54. Patient A surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. A F E D, C A B A m A  2601 20 40 60 80 100 120 140 160 180 200 220 Interstimulation Epoch Figure 55. Patient B surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. The red lines indicate seizures. o 15 Interstimulation Epoch Figure 56. Patient C surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. 200 Interstimulation Epoch 5 15 Figure 57. Patient D surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. o 15 20 25 50 100 150 200 Interstimulation Epoch Figure 58. Patient E surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. 20 25 Interstimulation Epoch Figure 59. Patient F surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. A  D E 02 F 01 Figure 510. The fraction of all interstimulation epochs per channel which rejected the null hypothesis HO using ApEnt for A) patient A, B) patient B, C) patient C, D) patient D, E) patient E, F) patient F. Table 51. Surrogate analysis results summary for all six patients with the VNS implant. % of epochs where the ApEnt measure rejected HO channel fplCPz fp2CPz f3CPz f4CPz c3CPz c4CPz p3CPz p4CPz olCPz o2CPz f7CPz f8CPz t3CPz t4CPz t5CPz t6CPz alCPz a2CPz fzCPz czCPz pzCPz leyeCPz reyeCPz ImnCPz rmnCPz # epochs A * 58.27% * 61.42% * 56.30% * 44.49% 27.56% 29.92% 38.98% 28.35% 27.17% 28.74% * 57.09% *66.14% 46.46% 42.13% 24.02% 24.80% 53.54% 44.49% * 71.65% 60.63% 61.81% 51.97% 53.54% 56.30% 43.70% 254 * denotes focal EEG channel B 42.37% * 38.56% 62.71% * 60.17% 31.36% 77.54% 24.58% 50.00% 39.41% 36.02% 85.17% * 78.39% 48.31% 78.81% 48.73% 46.19% 56.78% 47.88% 30.08% 51.69% 47.88% 43.64% 61.44% 59.75% 61.02% 236 C 42.15% 40.61% 57.85% 49.04% 52.11% 50.57% 48.66% 41.76% 47.89% 51.34% 35.25% 35.25% 32.95% * 44.83% 36.78% * 45.98% 37.16% 51.34% 36.78% 27.59% 21.46% 33.33% 30.65% 25.29% 23.37% 261 150 Interstimulation Epoch D * 29.31% 32.76% * 64.53% 42.12% 30.05% 38.18% 31.53% 39.66% 42.86% 55.17% * 36.45% 33.50% 39.16% 43.10% 38.42% 50.25% 34.24% 35.22% 44.33% 34.98% 41.63% 41.38% 61.08% 30.79% 27.83% 406 E 38.89% 36.90% 30.95% 36.11% 37.70% 49.21% 32.94% 34.92% 36.11% 44.05% 27.38% 37.70% 39.29% 42.06% 31.35% 33.33% 42.86% 40.87% 40.48% 47.62% 56.35% 42.06% 44.84% 30.16% 39.68% 252 F 36.27% 31.62% 31.13% 35.05% 34.80% 27.45% 19.61% 22.55% 33.33% 33.82% 39.95% 41.67% * 55.64% * 54.66% * 48.77% * 35.05% 32.60% 32.60% 27.94% 26.72% 22.30% 47.79% 34.31% 42.16% 30.15% 408 Figure 511. Control patient (with 5minute artificial stimulation times) surrogate data analysis results over 24 hours for all artificial interstimulation epochs. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. 300 350 Figure 512. Control patient (with 3minute artificial stimulation times) surrogate data analysis results over 24 hours for all artificial interstimulation epochs. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. Table 52. Control patient surrogate analysis results summary. % of epochs where the ApEnt measure rejected HO channel Control 5 minute 'off time Control 3 minute 'off time TBA4 *22.65% 19.41% TBB6 29.27% 22.85% HR7 *27.18% *26.54% TLB2 43.21% 40.05% TLB3 51.57% 44.72% TLC2 81.53% 70.02% # epochs 261 406 denotes focal EEG channel Ep VN on/ EE fea cha EE fea cha EE fea cha och I 1 I S off G ture for nnel 1 I I I G ture for annel 2 I G ture for nnel 26 SEpoch "n" Second half of an interstimulation period ........................ First half of an interstimulation period For the purposes of this study, a full stimulation epoch consists of 30 seconds of stimulation and either a 3 or 5 minute 'off period. Figure 513. Experimental setup for characterizing the temporal evolution EEG dynamics during interstimulation intervals in patients undergoing VNS therapy for epilepsy. The double head arrows indicate a statistical comparison is made between the EEG feature segments represented by the shaded rectangles. 2UU A B C D 50 100 Interstimulation Epoch Figure 514. Patient A temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) 0, and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. 5 10 15 20 25 50 100 150 200 250 A 10 20 25 20 40 60 80 100 120 140 160 180 200 220 5 B 10 20 25 20 40 60 80 100 120 140 160 180 200 220 5 2 10 C g 15 20 25 20 40 60 80 100 120 140 160 180 200 220 S20 25 20 40 60 80 100 120 140 160 180 200 220 Interstimulation Epoch Figure 515. Patient B temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) Q and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. The red lines indicate seizures. 20 25 50 100 150 200 250 6 B 10 15 20 26 50 100 160 200 250 C 10 20 25 50 100 150 200 250 D 10 6 20 26 50 100 160 200 250 Interstimulation Epoch Figure 516. Patient C temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) Q and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. 181 A io 15 20 25 50 100 150 200 250 300 350 400 5 B ~10 2 15 20 25 50 100 150 200 250 300 350 400 5 C 10 20 25 5 S10 D 15 20 25 50 100 150 200 250 300 350 400 Interstimulation Epoch Figure 517. Patient D temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) 0, and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. 5 10 ~ 16 20 25 50 100 150 200 250 6 B 10 20 5 50 100 150 200 250 C 20 25 50 100 150 200 250 5 10 D 15 20 25 50 100 150 200 250 Interstimulation Epoch Figure 518. Patient E temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) 0, and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. S10 A 5 15 20 25 50 100 150 200 250 300 350 400 6 10 B c 15 20 26 60 100 160 200 260 300 360 400 6 C 10 15 20 25 50 100 150 200 250 300 350 400 6 2 10 20 25 50 100 150 200 250 300 350 400 Interstimulation Epoch Figure 519. Patient F temporal evolution of dynamics analysis results for A) ApEnt, B) correlation sum, C) 0, and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. 2 A 4 6 50 100 150 CB c 250 CD u 2UU 25U D J4 C) 150 Interstimulation Epoch 250 Figure 520. Control patient (with 5minute artificial stimulation times) temporal evolution of dynamics analysis results for A) ApEnt, B) correlation sum, C) 0, and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. I A 11 1 1 11''110 A 50 100 150 200 250 300 350 400 2 B 4 50 100 150 200 250 300 350 400 2 C 4 50 100 150 200 250 300 350 400 2 50 100 150 200 250 300 350 400 Interstimulation Epoch Figure 521. Control patient (with 3minute artificial stimulation times) temporal evolution of dynamics analysis results for A) ApEnt, B) correlation sum, C) 0, and D) STLmax. Yellow indicates that particular interstimulation epoch abscissaa) for the channel of interest ordinatee) rejected the null hypothesis. Table 53. Approximate entropy analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H1 using the ApEnt measure. % of epochs rejecting H1 channel fplCPz fp2CPz f3CPz f4CPz c3CPz c4CPz p3CPz p4CPz olCPz o2CPz f7CPz f8CPz t3CPz t4CPz t5CPz t6CPz alCPz a2CPz fzCPz czCPz pzCPz leyeCPz reyeCPz lmnCPz rmnCPz # epochs Patient A * 40.94% * 40.94% * 44.09% * 40.55% 42.13% 29.53% 27.17% 26.38% 38.98% 38.58% * 36.22% * 38.98% 42.91% 33.46% 33.86% 37.80% 40.55% 35.43% 37.40% 29.92% 20.47% 37.40% 32.68% 37.80% 29.92% 254 * denotes focal EEG channel Patient B 31.78% * 43.64% 49.58% * 41.53% 38.14% 33.47% 35.59% 25.42% 41.53% 37.29% 54.24% * 54.24% 50.85% 43.22% 52.54% 41.10% 50.42% 50.00% 34.32% 23.31% 26.69% 29.24% 37.71% 46.61% 47.88% 236 Patient C 47.13% 43.30% 52.11% 49.43% 42.53% 50.57% 47.89% 50.57% 47.51% 49.81% 50.96% 47.89% 43.30% * 40.23% 39.08% * 41.38% 34.10% 41.00% 46.74% 48.28% 36.78% 50.19% 50.96% 44.83% 44.06% 261 Patient D * 18.23% 20.20% * 21.67% 24.14% 20.44% 24.14% 22.41% 22.41% 24.14% 22.91% 27.34% * 25.37% 29.80% 23.65% 20.94% 25.86% 31.53% 28.08% 19.21% 17.49% 21.67% 24.38% 24.88% 24.38% 21.43% 406 Patient E 34.92% 32.94% 31.75% 30.95% 28.57% 29.37% 24.60% 26.59% 24.21% 30.16% 38.49% 37.70% 34.92% 37.70% 32.14% 35.32% 35.71% 36.11% 28.97% 25.40% 18.65% 34.92% 35.71% 40.48% 36.90% 252 Patient F 24.75% 24.26% 25.00% 29.90% 23.53% 26.72% 19.36% 20.59% 22.55% 22.79% 24.51% 28.43% * 30.39% * 30.88% *30.15% * 28.43% 24.75% 23.28% 21.08% 18.87% 17.65% 17.40% 18.87% 19.85% 21.81% 408 A 05 B S03 D 02 F  I [ ' Figure 522. Approximate entropy analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H1 using the ApEnt measure. Table 54. Approximate entropy analysis results for the control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H1 using the ApEnt measure. % of epochs rejecting H1 channel Control 5 minute 'off time Control 3 minute 'off time TBA4 22.65% 18.18% TBB6 25.44% 17.94% HR7 23.34% 15.23% TLB2 20.91% 17.69% TLB3 23.69% 19.66% TLC2 14.63% 13.02% TBA4 261 406 * denotes focal EEG channel Table 55. Correlation sum analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H2 using the correlation sum measure. % of epochs rejecting H2 channel fplCPz fp2CPz f3CPz f4CPz c3CPz c4CPz p3CPz p4CPz olCPz o2CPz f7CPz f8CPz t3CPz t4CPz t5CPz t6CPz alCPz a2CPz fzCPz czCPz pzCPz leyeCPz reyeCPz ImnCPz rmnCPz # epochs Patient A * 25.98% * 26.38% * 19.29% * 18.11% 19.29% 15.75% 13.39% 12.99% 15.35% 17.32% * 16.93% * 16.14% 22.44% 16.54% 15.35% 11.81% 11.81% 16.54% 22.05% 17.32% 14.57% 14.96% 16.54% 13.78% 12.60% 254 Patient B 18.64% * 16.10% 12.71% * 10.17% 13.98% 15.25% 11.86% 8.47% 8.90% 8.47% 9.75% * 9.32% 10.59% 6.78% 10.17% 9.32% 13.56% 13.56% 12.71% 8.05% 7.63% 13.56% 12.71% 7.20% 8.47% 236 * denotes focal EEG channel Patient C 34.10% 29.12% 24.90% 26.05% 21.84% 19.92% 14.94% 13.79% 13.03% 13.79% 31.80% 29.50% 22.22% * 21.07% 13.41% * 17.24% 23.37% 22.22% 25.67% 11.11% 9.96% 27.97% 32.57% 21.84% 24.90% Patient D * 12.07% 12.81% * 9.85% 12.81% 10.59% 12.07% 11.58% 12.32% 11.82% 14.29% * 11.82% 12.32% 11.08% 13.30% 9.85% 12.07% 11.08% 15.27% 11.33% 9.61% 11.33% 10.10% 13.55% 9.36% 11.58% 406 Patient E 20.24% 19.84% 18.65% 18.25% 17.86% 18.25% 15.48% 15.87% 13.49% 11.90% 21.43% 18.65% 18.65% 21.83% 12.30% 21.83% 21.03% 18.25% 17.46% 18.65% 15.08% 17.06% 17.06% 17.46% 16.27% 252 Patient F 10.54% 8.82% 11.52% 11.52% 10.54% 9.31% 9.80% 9.31% 10.29% 13.73% 10.54% 10.29% * 12.25% * 11.52% *9.31% * 8.33% 10.29% 11.03% 12.01% 12.25% 6.13% 10.05% 8.33% 11.03% 9.56% 408 B C D E F 0^ 0^ 0^ 0^ 0< C, C, j 0 j 0 j 0 0 C) C) cj C, C 1 Figure 523. Correlation sum analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H2 using the correlation sum measure. Table 56. Correlation sum analysis results for the control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H2 using the correlation sum measure. % of epochs rejecting H2 channel Control 5 minute 'off time Control 3 minute 'off time TBA4 *11.50% *8.60% TBB6 10.80% 8.85% HR7 *8.71% *8.11% TLB2 9.76% 7.13% TLB3 8.71% 8.35% TLC2 5.57% 7.37% # epochs 261 406 denotes focal EEG channel Table 57. Mean angular frequency in phase space analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H3 using the 0 measure. % of epochs rejecting H3 channel Patient A Patient B Patient C Patient D Patient E Patient F fplCPz *38.19% 30.51% 37.93% 23.89% 39.68% 20.10% fp2CPz 35.83% 22.46% 38.70% 22.66% 32.94% 24.02% f3CPz 29.53% 26.27% 41.00% 24.88% 34.92% 19.36% f4CPz 27.95% 27.12% 41.76% 23.65% 33.73% 21.32% c3CPz 30.31% 26.27% 38.70% 22.17% 36.51% 18.38% c4CPz 34.25% 35.17% 31.80% 26.11% 41.67% 19.61% p3CPz 31.89% 27.54% 35.25% 27.83% 33.33% 17.89% p4CPz 26.38% 22.88% 32.95% 22.91% 33.73% 18.14% olCPz 29.53% 23.73% 39.46% 25.62% 28.97% 19.12% o2CPz 29.92% 20.34% 34.87% 26.85% 33.33% 21.81% f7CPz 34.25% 25.00% 43.68% 24.38% 33.73% 19.12% f8CPz *31.10% 23.73% 39.46% 27.34% 35.32% 20.10% t3CPz 39.37% 24.58% 41.00% 23.40% 38.10% 19.85% t4CPz 29.92% 22.46% 31.42% 27.59% 34.13% *21.08% t5CPz 28.74% 25.00% 31.42% 26.35% 26.59% *21.08% t6CPz 25.59% 21.61% 31.42% 22.41% 37.30% 20.098% alCPz 24.80% 19.92% 31.03% 26.60% 31.35% 18.87% a2CPz 27.56% 22.03% 31.80% 30.30% 32.54% 18.38% fzCPz 27.95% 36.02% 39.46% 23.40% 34.52% 20.83% czCPz 29.53% 23.73% 40.61% 20.94% 30.16% 21.57% pzCPz 31.10% 24.58% 34.48% 25.37% 29.37% 19.61% leyeCPz 37.80% 29.66% 42.53% 26.60% 34.92% 20.83% reyeCPz 32.68% 28.81% 37.93% 26.85% 31.35% 21.57% ImnCPz 32.68% 23.31% 34.10% 19.70% 34.92% 18.38% rmnCPz 29.13% 22.88% 37.93% 25.12% 30.16% 23.77% # epochs 254 236 261 406 252 408 denotes focal EEG channel A  B D 02 Figure 524. Mean angular frequency in phase space analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H3 using the Q measure. Table 58. Mean angular frequency in phase space analysis results for control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H3 using the Q measure. % of epochs rejecting H3 channel Control 5 minute 'off time Control 3 minute 'off time TBA4 12.20% *7.13% TBB6 13.59% 8.60% HR7 9.41% 8.85% TLB2 8.01% 7.13% TLB3 8.36% 6.88% TLC2 11.50% 9.09% # epochs 261 406 denotes focal EEG channel Table 59. Shortterm maximum Lyapunov exponent analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H4 using the STLmax measure. % of epochs rejecting H4 channel fplCPz fp2CPz f3CPz f4CPz c3CPz c4CPz p3CPz p4CPz olCPz o2CPz f7CPz f8CPz t3CPz t4CPz t5CPz t6CPz alCPz a2CPz fzCPz czCPz pzCPz leyeCPz reyeCPz ImnCPz rmnCPz # epochs Patient A *29.13% * 28.35% *29.13% * 24.41% 24.80% 21.26% 19.69% 17.72% 23.23% 20.47% * 24.41% * 26.77% 40.94% 29.53% 25.20% 17.32% 24.41% 30.71% 24.41% 15.75% 21.65% 26.38% 23.23% 16.93% 20.08% 254 Patient B 30.08% * 32.20% 27.54% * 15.25% 15.25% 14.41% 16.10% 15.25% 19.07% 16.95% 22.88% * 30.51% 27.12% 15.25% 19.92% 15.68% 31.78% 28.81% 19.07% 15.25% 15.25% 23.73% 19.07% 17.80% 20.76% 236 Patient C 40.23% 33.72% 35.25% 37.55% 44.06% 39.85% 35.63% 37.55% 35.25% 31.80% 42.53% 37.16% 43.68% * 40.61% 32.95% * 38.70% 32.95% 38.31% 25.29% 26.44% 25.67% 44.83% 38.31% 34.87% 30.27% 261 Patient D * 18.23% 16.50% * 17.49% 15.52% 14.78% 16.75% 16.26% 16.01% 15.52% 17.00% * 17.73% 17.00% 24.88% 20.94% 17.49% 16.26% 24.88% 21.18% 18.97% 11.82% 14.04% 14.29% 18.97% 12.81% 14.04% 406 Patient E 31.35% 29.37% 28.97% 22.22% 26.98% 23.81% 19.84% 19.84% 21.43% 25.40% 28.17% 19.84% 26.98% 27.78% 23.41% 22.62% 30.16% 17.06% 26.19% 21.83% 25.79% 25.40% 19.05% 19.84% 15.87% 252 Patient F 17.65% 17.89% 15.93% 19.12% 18.63% 12.50% 10.54% 11.27% 13.48% 11.76% 13.97% 15.69% * 14.95% * 21.57% * 20.34% * 15.93% 13.24% 12.25% 10.54% 10.78% 11.52% 15.20% 12.50% 12.01% 9.56% 408 * denotes focal EEG channel A 0 B E F Figure 525. Shortterm maximum Lyapunov exponent analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H4 using the STLmax measure. Table 510. Shortterm maximum Lyapunov exponent analysis results for the control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H4 using the STLmax measure. % of epochs rejecting H4 channel Control 5 minute 'off time Control 3 minute 'off time TBA4 *26.13% 20.88% TBB6 32.06% 26.78% HR7 *27.87% *22.11% TLB2 21.60% 14.25% TLB3 19.86% 16.95% TLC2 15.68% 15.72% # epochs 261 406 denotes focal EEG channel 3 A C S2.5 A SA D S2 A *A m Patients 5 min off A 0 U B A Patients 3 min off 1.5 A Control 5 min off F A Control 3 min off = 1 O E A 0 A E 0.5 A I 0 0.1 0.2 0.3 0.4 0.5 Fraction of epochs showing significant temporal variation Figure 526. ApEnt results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation. * Patients 5 min off A Patients 3 min off * Control 5 min off A Control 3 min off Fraction of epochs showing significant temporal variation Figure 527. Correlation sum results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation. AU C A A A F B E A A 0 0.1 0.2 0.3 0.4 0. Fraction of epochs showing significant temporal variation m Patients 5 min off A Patients 3 min off * Control 5 min off A Control 3 min off Figure 528. Q results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation. C AU A D A A U AF A B UE A 0 A A C < 2.5 A  D A 2 A Patients 5 min off A A Patients 3 min off 1.5 A Control 5 min off A B E A Control 3 min off 0 1 A F A 0.5 A, 0.1 0.2 0.3 0.4 0.5 Fraction of epochs showing significant temporal variation Figure 529. STLmax results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation. 198 CHAPTER 6 A NOVEL GENERALIZED ABSENCE SEIZURE DETECTION ALGORITHM Absence epilepsy makes up about 8% of child epilepsy cases with peak occurrence between 67 years of age (Berkovic, 1996). Absence seizures are clinically characterized by brief, transient loss of awareness, responsiveness, and memory. These paraxoysmal discharges have a sudden onset, are often less than 5 seconds in duration, cease abruptly without postictal effects and can occur multiple times per day. Absence seizures are generalized with regular and symmetrical 2.53.5 Hz SWDs (Panayiotopoulos et al., 1994). Figure 61 shows an example of an electrographic absence seizure. The antiepileptic drugs valproic acid and ethosuximide are the most commonlyused drugs for treating absence epilepsy. For additional information on absence epilepsy, see chapter 2. Seizure detection is an important procedure for the treatment of epilepsy. In particular, there are areas wherein seizure detection can benefit epilepsy treatment; rapid seizure annotation and online realtime EEG analysis. Seizure detection algorithms can greatly improve the rate at which physicians analyze EEG recordings by providing a tool to help point out EEG waveforms which are likely to be epileptiform discharges. Such an algorithm can improve the efficiency of health care for epilepsy treatment. The other popular application of seizure detection algorithms is for online realtime analysis. Such analysis is useful in the research field for enhancing the understanding of how EEG activity correlates to the clinical status of the patient or for cognitive testing in animal models of epilepsy. For some epilepsy variants, such as mesial temporal lobe epilepsy, seizure detection may provide a basis for an implantable seizure control device (e.g. utilizing a drug pump and/or neural stimulation apparatus). For generalized absence epilepsy, it is possible that someday an online realtime absence seizure detection algorithm may be integrated with scalp EEG recordings as part of medical checkups in patients with generalized absence epilepsy. In addition to seizure detection, such an algorithm can be extended to perform seizure stratification and provide a histogram of seizure count versus seizure duration. The ability to automatically stratify seizures may provide additional useful information for evaluating therapeutic effect (e.g. compare the seizure stratification histogram profile before and after therapeutic intervention). For these reasons, the purpose of this study is examine a novel method for expediting detection and stratification of SWDs such as those found in generalized absence epilepsy. Methods Previous automated SWD detection algorithms typically relied on thresholding methods and performed well in animal seizure models (Westerhuis et al. 1996; Fanselow et al., 2000; Van Hese et al., 2003). Energy Method for SWD Detection One method calculates the signal energy (Van Hese et al., 2003) and establishes a threshold energy level which designates spike and wave activity or nonspike and wave activity. In each window, the signal energy is calculated as L1 E(k)= x (n + (k )S) (61) n=0 where a detection is signified if the calculated energy exceeds a chosen threshold value for four consecutive windows. 200 Fanselow Method for SWD Detection The Fanselow method (Fanselow et al., 2000) establishes a voltage threshold which allows classification of SWDs. The method is based on the maximum absolute value of the EEG amplitude within a window A(k)= max x(n + (k i)S). (62) n=0, ,L1 A threshold is set for each subject. If three consecutive windows are above the threshold, a SWD detection is made. Westerhuis Method for SWD Detection The Westerhuis method (Westerhuis et al., 1996) estimates the first derivative of the EEG signal which is referred to as the steepness of signal. The maximum value of this steepness in consecutive, nonoverlapping windows is evaluated as D(k)= max d(n+(k1)S) (63) n=0, ,L1 where d(n) x(n+) x(n) (64) A positive detection is made if D exceeds a certain threshold value in four consecutive windows. The threshold is automatically determined on the basis of the EEG during wakefulness. This method showed strong performance in Genetic Absence Epilepsy Rats from Strasbourg (GAERS). This study aims to address improvements in the following areas; minimize detection lag (which is critical for online utilization of such a seizure detection device), decreasing window size (to help increase detection time resolution), increasing robustness to noise, and simplified detection calibration. For these reasons, supervised machine learning algorithms were utilized with the intention of providing a robust seizure detector. The two features selected for this algorithm are TeagerKaiser energy and dynamic time warping distance. Dynamic Time Warping Dynamic time warping (DTW) is one of the most wellstudied temporal pattern similarity measures (Rabiner et al., 1978). This method utilizes a dynamic programming approach to align a test time series to a template time series and provides an alignment distortion measure to ascertain pattern similarity. For two time series X and Y of equal length X = Y = n, pattern similarity is established by aligning time series X with time series Y using the minimum computed alignment distortion Dag, (X, Y). The distortion path is obtained by warping time for each signal such that the minimum alignment distance between the two signals is achieved. This study applies the DTW measure to two EEG signals of equal length though the signals do not need to be the same length. DTW has been used extensively in biological applications such as ECG analysis (Jen and Hwang, 2007; Kotas, 2008), EEG spiking pattern recognition (Chi et al., 2007), analysis of eventrelated potentials (Casarotto et al., 2005), fingerprint recognition (KovacsVajna, 2000), and medical imaging reconstruction (Okumura et al., 2007). The DTW measure has demonstrated utility as a kernel function for support vector machine based seizure prediction algorithms in temporal lobe epilepsy (Chaovalitwongse and Pardalos, 2008). The minimum DTW distance can be obtained using the following dynamic programming technique. First, an n x n alignment array is generated where each element of the array represents a distance metric for all combinations of points between the two signals. In this array the (i,j)th element is the distance between points x, and y. Euclidean distance d(x,,y )= ( y )2 is 202 typically used as the distance measure. A warp path W = w,,..., wK is then constructed where K is the length of the warp path for which max(XI, Y)<< K < X + YI. Element k of the warping path represents Element k of the warp path represents a matching point w = (i, j) of the two time series, where (i,j) corresponds to index i of time series X and index of time series Y. A warping path must begin at the first sample of both time series, w, = (1,1) and must finish at the last sample of both time series, w, = (n,n). An additional constraint requires the warping path indices i andj to increase monotonically. That is, wk = (i,j) and wk = (',j), where i < i < i +1 and j < j < j +1. The optimal warp path possesses the minimum warping cost defined as 1 K) DIg, (X, Y)= minm d(w,, k). (65) This problem can be approached from a dynamic programming perspective where the path is advanced by one unit on the i axis, one unit on thej axis, or both. Thus, this approach only requires evaluation of cumulative distance found in adjacent elements, D(i,j)= d(x,,x,)+min, D(i1, j) (66) D(i 1, 1) TeagerKaiser Energy In 1990, Kaiser first derived Teager's nonlinear energy algorithm in discrete time domain to calculate the energy of a sound (Kaiser, 1990). The TeagerKaiser energy (TKE) operator has demonstrated sensitive to both amplitude and frequency changes in time series signals. This measure has demonstrated utility feature for the detection of seizures and high frequency 203 epileptiform activity (Zaveri et. al., 1993; Smart et. al., 2005; Gardner et. al., 2006). This study utilizes the mean value of the TKE operator across a window, 1 N1[ TKE(X) = [x(k)2 X(k 1)X(k +1) (67) N k=2 where N is the length of the window of interest. Empirical Study In order to investigate the possibility of seizure detection and stratification, two experiments are presented, each classifying a different subset of the seizure: * Separate the beginning of each seizure from randomlyselected nonseizure segments * Separate the end of each seizure from randomlyselected nonseizure segments. Separating the beginning of the seizure from nonseizure segments (experiment one) tests the seizure detection abilities of the detector whereas distinguishing the end of a seizure from nonseizure segments (experiment two) is a critical task in seizure stratification. These two experiments provide an initial framework for testing the SVM classifier's ability to stratify generalized SWDs. This empirical study is motivated by an underlying hypothesis that SVM's are capable of distinguishing neural states (seizure and nonseizure) in a newlydiagnosed patient with typical absence seizures. The signal features consist of the DTW distances between a template SWD signal the test window to be classified, both of which are 0.3 seconds in duration. This section describes the EEG data acquisition, data sampling and feature extraction, SVM training and testing, and results. EEG Data Acquisition Approximately 24 hours of scalp EEG data were acquired from a SleepMed DigiTrace ambulatory EEG recording device. The data were acquired at 200 Hz with an input range of 0.6 204 mV with builtin filter of 0.570 Hz. A bipolar, longitudinal, chain electrode recording montage was employed to provide 16 EEG channels (FplF3, F3C3, C3P3, P301, Fp2F4, F4C4, C4 P4, P402, FplF7, F7T3, T3T5, T501, Fp2F8, F8T4, T4T6, T602) as well as two auxiliary channels which were not utilized. This EEG study utilized the F3C3 and F4C4 channels because provide highquality representations of the SWDs yet are located reasonably far away from facial muscles. The patient underwent 93 seizures during the 24 hour continuous EEG recording. Seizure times were verified by a boardcertified clinical electroencephalographer. Data Sampling and Feature Extraction Each data sample consists of extracted features from an EEG window one second in duration. Within the onesecond data sample window, a subwindow of 0.3 seconds in duration is advanced with 50% overlap from the start of the data sample window to the end of the data sample window (providing 5 subwindows and thus 5 features per data sample window per EEG channel). Thus for channels F3C3 and F4C4 there are ten features representing each data sample window. For each subwindow within the data sample, the DTW similarity feature is obtained via comparison with an archetypical SWD template. Figures 62 and 63 illustrate the DTW distance metric in this application. The study uses 93 SWD templates (one selected from each seizure) which are centered on the spike and 0.3 seconds in duration. SWD templates are reassigned randomly such that no seizure uses its own template for feature extraction. The seizure class consists of data sample windows from all 93 seizures. The nonseizure class consists of a total of 93 nonseizure data sample windows randomly selected from 24 hour continuous EEG recording with the following constraints: 205 * Must be at least 60 seconds away from any seizure onset or offset * Must be at least 0.1 seconds away from another nonseizure sample The training dataset consists of the 93 seizure and 93 nonseizure data sample windows. SVM Training and Testing The softmargin SVM classifier with a RBF kernel is applied to this problem based on success in other neural state classification problems (Kaper et. al., 2004; Acir and Giizelis, 2005; Bewernitz et. al., 2006; Lehmann et. al., 2007; Seref et al., 2006). A range of SVM parameters which demonstrated satisfactory results in similar EEG classification studies were applied to this study. Thus, each SVM cycle was performed for all nine combinations of cost=10,100,1000 (Kaper et al., 2004; Acir and Giizelis, 2005) and the RBF parameter sigma=20,40,60 (Kaper et. al., 2004; Lehmann et al., 2007). SVM training is performed using a 10fold cross validation scheme. This scheme employs a resampling technique in which the seizure and nonseizure classes are first randomly shuffled. Next, 10 % (9 samples) of the shuffled seizure class and 10% (9 samples) of the shuffled non seizure class are extracted (individually for each class) and combined to form the test set. In general, SVM training is optimal for training datasets with equal numbers of data points from each class. Otherwise, the classifier can be biased towards the class which had more training points. The remaining 90% of each class is used to train the SVM classifier which is then tested on the extracted testing dataset. Upon testing the SVM, the test dataset is replaced in the shuffled training data and the succeeding 10% block of each shuffled class is extracted to form the next test set. This validation scheme repeats until the last 10% block of each shuffled class is extracted and tested. This study repeats the sampling, feature extraction, resampling, training and testing cycle 1000 times. 206 Detector Performance Evaluation The detection sensitivity and specificity are used to evaluate the performance of the SVM seizure detector. This involves categorizing the classification results into one of four possible outcomes: * True positives (TPs) refer to the correct classification of seizure segment * True negatives (TNs) refer to the correct classification of a nonseizure segment * False positives (FPs) refer to the incorrect classification of a nonseizure segment as a seizure * False negatives (FNs) refer to the incorrect classification of seizure segment as a non seizure The four possible detection outcomes may be illustrated in the context of figure 64. A classification result is considered a TP if a seizure EEG sample is classified as a seizure sample. A classification result is considered a TN if a nonseizure EEG sample is classified as a non seizure sample. A classification result is considered a FP if a nonseizure EEG sample is classified as a seizure sample. Finally, a classification result is considered a FN if a seizure EEG sample is classified as a nonseizure sample. The sensitivity and specificity measures often used for evaluating detector performance can be derived from these four outcome quantities. Sensitivity is the fraction of positive samples that are classified as positive: TP Sensitivity = (68) TP + FN where 'positive' refers to the seizure class. Specificity refers to the fraction of negative samples that are classified as negative: TN Specificity = (69) TN + FP 207 where 'negative' refers to the nonseizure class. Results The mean value of sensitivity and specificity are reported for 100 SVM detection trials, where each trial underwent 10fold cross validation for one of the nine combinations of SVM parameters. The results for experiment one, seizure detection of the first second of each seizure are shown in table 61. Results from experiment two, seizure stratification experiment performing detection on the last second of each seizure are summarized in table 62. Discussion As is shown in table 61 and figures 65, 66, 67, the SVM classifier's overall best performance is experiment one's application where the SVM is function as a seizureonset detector (classifying the first second of each seizure). This result makes sense in comparison with experiment two where the last second of the seizure is classified as a first step towards a seizure stratification application (figures 68, 69, 610). The beginnings of the seizures appear more visually similar to one another than the ends of the seizures. Even still, the performance of the classifier in the experiment two setup demonstrated high sensitivity and specificity for numerous parameter combinations. The observation that classification is less affected by SVM parameters in experiment one compared to experiment two is a reasonable phenomena. Due to stronger electroencephalographic similarity among various seizures at onset compared to offset, then the beginning of the seizures may be more regular in feature space than the seizure offset. Thus, the alterations in SVM parameters do not seem to have as large of an effect on the results of experiment one as with experiment two. In particular, the classifier varied more with changes in cost for experiment two than experiment one, which could be due to a loss of generality resulting from "over fitting" the more variant seizure offset period. 208 These results show promise for the SVM application to seizure detection and stratification. Such a tool may provide benefit to clinicians and researchers by providing a means to rapidly annotate as well as provide a clinically interesting measure of drug effect on a histogram of seizure durations. Thus, this line of work may lead to a greater understanding of the therapeutic effects of AEDs. Future studies will provide a more comprehensive evaluation of features. While the DTW measure performed well, other similarity measures (such as similarity index) may be worth implementing. In addition, adding more EEG channels may improve classification performance though channel addition imposes a computational burden increase. These results should be validated in additional patients. Finally, an important future step is to implement this algorithm in a pseudoonline fashion to assess the robustness to noise. While SVMs provide exceptional generalization abilities, a sliding window classifier will provide an interesting assessment of how the classifier copes with the challenges of realtime EEG acquisition. An expansive review article regarding support vector machines in neuroscience applications was accepted for publication under the title "support vector machines in neuroscience" with authors Onur Seref, O. Erhun Kundakcioglu, and Michael Bewemitz (Seref et al., 2007). 209 Figure 61. Approximately 6 seconds of scalpEEG demonstrating the 2.53.5 Hz spikewave discharge that defines an electrographic absence seizure (data provided courtesy of Dr. Gregory Holmes). 210 0 10 20 30 40 50 60 Figure 62. DTW comparison of two different SWD segments. The top signal is a 300 ms SWD segment. Bottom signal is a 300 ms segment of a different SWD. The DTW distance is about 2.4 x 107. 0 10 20 30 40 50 60 Figure 63. DTW comparison of a SWD segment with a random interictal segment. Top signal is a 300 ms EEG segment of a SWD. Bottom signal is 300 ms of interictal EEG. The DTW distance is about 5.1 x 107. Reality /~A Seizure Nonseizure Prediction Seizure Nonseizure Figure 64. Seizure classification evaluation framework. 212 Table 61. Classification performance using the first second of each seizure. Sigma 20 20 20 40 40 40 80 80 80 Cost 10 100 1000 10 100 1000 10 100 1000 Sensitivity 97.11% 96.45% 96.37% 97.18% 96.56% 96.19% 97.10% 96.82% 96.04% Specificity 96.94% 96.46% 96.43% 97.04% 96.49% 96.37% 97.04% 96.62% 96.31% Mean 97.02% 96.45% 96.40% 97.11% 96.53% 96.28% 97.07% 96.72% 96.18% Table 61. Classification performance using the last second of each seizure. Sigma 20 20 20 40 40 40 80 80 80 Cost 10 100 1000 10 100 1000 10 100 1000 Sensitivity 94.85% 91.98% 90.25% 95.04% 93.03% 89.91% 94.93% 93.86% 90.74% Specificity 93.46% 93.10% 92.07% 93.34% 93.27% 92.13% 93.29% 93.29% 92.63% Mean 94.16% 92.54% 91.16% 94.19% 93.15% 91.02% 94.11% 93.58% 91.69% 213 Sigma = 20 Cost= 10 Sigma = 20 Cost= 100 Sigma = 20 Cost= 1000 100.00% 90.00% 80.00% 70.00% 60.00% 50.00% 40.00% 30.00% 20.00% 10.00% 0.00% Figure 65. Seizure detection performance for RBF each seizure. * Sz Detection * NSz Detection parameter sigma=20 using the first second of Sigma = 40 Cost= 10 Sigma = 40 Cost= 100 Sigma = 40 Cost= 1000 Sz NSz Sz NSz Sz NSz * Sz Detection * NSz Detection Figure 66. Seizure detection performance for RBF parameter sigma=40 using the first second of each seizure. 214 Sz NSz Sz NSz Sz NSz 100.00% 90.00% 80.00% 70.00% 60.00% 50.00% 40.00% 30.00% 20.00% 10.00% 0.00% Sigma = 80 Cost = 10 Sigma = 80 Cost = 100 Sigma = 80 Cost = 1000 100.00% 90.00% 80.00% 70.00% 60.00% 50.00% 40.00% 30.00% 20.00% 10.00% 0.00% Sz NSz Sz NSz Sz NSz Figure 67. Seizure detection performance for RBF each seizure. * Sz Detection * NSz Detection parameter sigma=80 using the first second of Sigma = 20 Cost= 10 Sigma = 20 Cost= 100 Sigma = 20 Cost= 1000 100.00% 90.00% 80.00% 70.00% 60.00% 50.00% 40.00% 30.00% 20.00% 10.00% 0.00% Sz NSz Sz NSz Figure 68. Seizure detection performance for RBF each seizure. NSz NSz * Sz Detection * NSz Detection parameter sigma=20 using the last second of 215 Sigma = 40 Cost = 10 Sigma = 40 Cost= 100 Sigma = 40 Cost = 1000 100.00% 90.00% 80.00% 70.00% 60.00% 50.00% 40.00% 30.00% 20.00% 10.00% fn nno/ Sz NSz Sz NSz Figure 69. Seizure detection performance for RBF each seizure. Sigma = 40 Sigma =40 Cost = 10 C.nst = 100 * Sz Detection * NSz Detection S NSz parameter sigma=40 using the last second of Sigma = 40 Cost = 1000 100.00% 90.00% 80.00% 70.00% 60.00% 50.00% 40.00% 30.00% 20.00% 10.00% 0.00% Sz NSz Sz NSz S NSz Figure 610. Seizure detection performance for RBF parameter sigma of each seizure. * Sz Detection * NSz Detection =80 using the last second 216 L h i V 10 m = 1 CHAPTER 7 DISCUSSION AND CONCLUDING REMARKS Epilepsy is a disorder of the brain which is characterized by intermittent synchronized discharges of large populations of neurons. This disorder can greatly impact a patient's life in numerous ways including financial, social, professional, and psychiatric effects. While AED therapy may help keep seizures at bay in some patients others are not so fortunate. In the last few decades, savvy researchers have taken advantage of the rapid progression of computer technology, biomaterials, signal analysis advances and medical knowledge advancement to extract relevant EEG features in order to enhance epilepsy treatment. Computational neuroscience is an exciting frontier which is providing numerous options for addressing neurological disorders which may have been inconceivable decades ago. The ability to map the brain's states in terms of the status of a dynamic neurologic disorder will likely be a highly soughtafter research goal for years to come. This dissertation has helped provide preliminary data mining and dynamical EEG analyses to help uncover patterns which may be related to stimulation parameters and ultimately improve our understanding of the mechanisms that produce the VNS therapeutic effect. In addition, a study outlining a novel generalized spike wave detection algorithm was outlined here as well. These projects aim towards creation of bedside and/or implantable realtime seizure control devices. Towards RealTime EEG Analysis Tools for the Bedside and Implantation The exciting progress made in the characterization of sophisticated disease and disorders modeling schemes is part of the driving force this research. The characteristics of the class of disorders known as dynamic disorders provide an interesting framework to approach the problem of improving existing and creating new therapeutic approaches. This perspective treats such disorders as deviations from a range of healthy dynamics in the underlying physiologic control 217 systems. Such a perspective implies therapeutic approaches which involve a fusion of medicine, biology, and engineering. Numerous researchers are investigating the possibility of applying a systems control approach to the epileptic brain in order to reduce the burden of epileptic seizures. Some of the studies presented in this dissertation are geared towards such an approach and aim to improve the VNS therapy modality. Patients with newlyimplanted VNS systems undergo a period often lasting several months of suboptimal therapy. During this period, patients may need to undergo numerous visits to the doctor's office in order to finetune the stimulation parameters for clinical efficacy and tolerance. Such a process results in increased medical treatment costs and all the while the patients may be at a higher risk to seizures due to suboptimal stimulation parameters. One of the goals of the work presented it to examine the possibility of an EEG marker of optimal VNS therapeutic efficacy to help expedite the process of tuning parameters in newlyimplanted patients. The main focus of the research on the VNS data is to characterize EEG characteristics in numerous VNS patients in order to assess any relationships to stimulation parameters. If such a relationship can be established and if the effects could then be geared towards a final outcome, then such EEG characteristics may find use in a bedside device for rapid VNS calibration or even in an implantable control system for optimal VNS therapy. The studies presented in chapter four represent data mining approaches to characterizing such EEG effects. Data Mining Approaches to Characterizing EEG Patterns Data mining tools have demonstrated an extensive capacity to discover patterns in biological datasets including EEG signals. Data mining is the process of applying algorithms to extract patterns in large datasets. While the human eye is often the best pattern detector of all, data mining algorithms can work on exceedingly large datasets and examine complex multidimensional datasets. One of the most attractive features of data mining tools are their 218 ability to perform clustering data subsets according to inherent similarities or in a supervised manner. For the purpose of characterizing EEG patterns in patients undergoing VNS therapy for epilepsy, data mining methods provide a useful tool for elucidating preliminary patterns which incorporate an expansive representation of features from all channels. The biclustering experiment provided a characterization of the EEG patterns which may be related to VNS therapy. The observations were based on patterns of the STLmax measure, which assumes a chaotic framework and provides a measure of the sensitivity of the signal to initial conditions. Though the brain's behavior may not always be consistent with a lowdimensional chaos model, the chaoticity measure has provided an ability to classify neural states in epilepsy (e.g. interictal or far from a seizure, preictal or seizure imminent, ictal or during a seizure, and postictal or the period of altered consciousness following a seizure). Thus, the measure was selected as a candidate for detecting EEG patterns which may be related to VNS therapy. The study demonstrated separability between the VNS on and off states for which all of patient A's electrodes contributed to and only a few frontal and temporal electrodes in patient B contributed to. The biological relevance of these results may be related to study which discovered that VNSinduced acute suppression of epileptiform activity in a hippocampal depth electrode (Olejniczak et al., 2001). Though the study by Olejniczak et al. utilized depth electrodes, it is possible that scalp EEG recordings may display some manifestation of such an EEG effect observed at a hippocampal depth electrode. From this perspective, perhaps the STLmax behavioral differences between patients A and B are associated with enhanced suppression of epileptiform activity in patient A compared to patient B. An interesting future application of biclustering would be to examine the EEG effects during nonstimulation in an unsupervised manner. Such an experiment would provide a highly objective method to determine spatio 219 temporal patterns of EEG features. Based on the results of chapter 5, future experiments should include both linear and nonlinear features to help ensure proper characterization of the wide range of EEG dynamical behavior patterns observed during these studies. This work was published in the paper "Biclustering EEG data from epileptic patients treated with vagus nerve stimulation", authored by Stanislav Busygin, Nikita Boyko, Panos Pardalos, Michael Bewernitz, and Georges Ghacibeh (Busygin, 2007). The next experiment examined the patterns of the raw EEG behavior in feature space using support vector machines. The accuracy at which the SVM's could separate the raw EEG between two adjacent EEG segments, a reference segment during stimulation and successive non overlapping windows was interpreted as a robust measure of EEG similarity (or dissimilarity) and compared with stimulation parameters. The study determined observed a potential covariation between the EEG and the pulse width and stimulation frequency parameters. A study by Mu et al. showed that a 250 ps VNS pulse width caused reduced blood flow in significantly more brain regions (e.g. hippocampus, sup. temp. lobe) than 500 pts (2004). Perhaps these regions may be responsible for covariation of EEG feature space dispersion with pulse width parameter. Furthermore, a recent study demonstrated that a 20 Hz stimulation frequency produced significant cerebral blood flow increases (e.g. in the orbitofrontal cortex, hypothalamus, and thalamus) compared to 5 Hz in VNS patients (Lomarev et al., 2002). It is possible that the altered blood flow in these regions may be responsible for the observed covariation of EEG feature space dispersion with stimulation frequency. In addition, patients where seizure free and patients which experienced a small number of seizures per month resulted in greater separation accuracy between the reference class and all subsequent comparison classes in a VNS epoch. The patient with the most seizures per month 220 resulted in the poorest separation between the reference class and all adjacent classes. This phenomenon could be the multichannel analog of the dynamic resetting effect between two EEG channels postulated by lasemidis et al. which states that a seizure resets the brain from an unfavorable state to a more favorable state (Sackellares and lasemidis, 1997; lasemidis et al., 2004). Thus, the results were interpreted as electroencephalographic evidence that the VNS mimics the therapeutic resetting effect of a seizure. Future studies involving SVM would apply the algorithm in an unsupervised manner to help provide unbiased information about patterns in the data. Also, modification of the support vector machine algorithm, such as adaptive feature scaling (Grandvalet et. al., 2003) can help provide insight into the relevance of each input feature for SVM classification. This study is published in an article titled "Quantification of the Impact of Vagus Nerve Stimulation Parameters on electroencephalographic Measures" with authors Michael Bewernitz, Georges Ghacibeh, Onur Seref, Panos Pardalos, ChangChia Liu, Basim Uthman (Bewernitz, 2007). The final study utilized SVMs and LR to analyze the timevarying feature space separation of the STLmax dynamical measure in patients undergoing VNS therapy. With an eye towards the VNS replicating the resetting effect of a seizure, this study aimed to characterize potential relationships between the EEG and stimulation parameters using an experimental setup similar to lasemidis et al. (2004). Thus, a reference class was selected at 8 seconds prior to the stimulation onset and was comprised of the STLmax value of all channels for all stimulations combined. Similarly, each succeeding nonoverlapping window for all channels for all epochs was compared with the reference class. The study demonstrated that the observed pattern changes may be related to the stimulation frequency parameter. Lomarev et al. demonstrated that a 20 Hz stimulation frequency produced significant cerebral blood flow increases (e.g. in the orbitofrontal cortex, hypothalamus, and thalamus) compared with the 5 Hz stimulation frequency in VNS patients (Lomarev et al., 2002). The brain regions which showed a pulsewidth dependent blood flow in the study by Lomarev et al. may be the source of the observed covariation of EEG feature space dispersion with stimulation frequency. Also, it was speculated that the poor STLmax separation between VNS on (which may be considered as a VNS 'artificial' seizure) and VNS off in patient B combined with patient B's high seizure frequency (compared with the other patients) is aligned with the dynamic seizure resetting effect described by lasemidis et al. (2004). In addition, this experiment demonstrated the concept previously observed by Bewemitz et al. (2007) except while using the STLmax measure. Thus, the connection between the observed effect and the observations of lasemidis et al (2004) are stronger. This study was submitted to Computing and Optimization in Medicine and Life Sciences Vol. 3, under the title "A Data Mining Approach to the Investigation of EEG Biomarker Existence for Vagus Nerve Stimulation Therapy Patients", with authors Nikita Boyko, Michael Bewemitz, Vitaliy Yatsenko, Panos Pardalos, Georges Ghacibeh, Basim Uthman (Boyko et al., 2008). In regards to the biological impact, these results may be related to the phenomenon discovered in a study by Olejniczak et al. where a shortterm suppression of epileptiform sharp waves was observed following VNS from a hippocampal depthelectrode (2001). While the scalp electrodes used to collect the data in these analyses cannot achieve the recording quality of hippocampal depth electrodes, it is possible that the scalp EEG data mining analysis results may reflect the same therapeutic effect as observed in the hippocampus by Olejniczak et al. (2001). Analysis of Interstimulation Dynamics The studies described in chapter 5 focus analysis on the EEG dynamics occurring during interstimulation epochs. While the comparisons of stimulation to nonstimulation epochs 222 provided interesting results with clinical significance, the advantage of this experimental setup is that the possibility of direct neural modulation is eliminated. Thus, the results are more likely to be due to an "aftereffect" of stimulation rather than due to immediate neuronal modulation. The first experiment performed an extensive nonlinearity characterization using surrogate EEG analysis. Each epoch was compared to 19 surrogate datasets using the ApEnt measure. The most obvious connection of the EEG with the stimulation parameters was a covariation with the pulse width. In addition, the two seizurefree patients (E and F) produced the lowest fraction of epochs which displayed a nonlinear fingerprint (e.g. rejected the null hypothesis at the given significance level). These results may be related to a study by Olejniczak et al. which reported an acute VNSinduced suppression of epileptiform activity in the hippocampus (2001). Though the effect was observed from a hippocampal depth electrode in the study by Olejniczak et al., it is possible that some manifestation of the effect is present in the scalpEEG signal analyzed in the present study. The VNSenhanced suppression of epileptiform activity reported in the literature may be responsible for the diminished nonlinearity in patients with fewer seizures. The cause of any epileptiform activity suppression may be related to a pulsewidth dependency of blood flow to various brain regions (e.g. hippocampus and superior temporal lobe) reported by Mu et al., 2001. The observation that the seizurefree patients expressed the least amount of nonlinearity may be congruent with the findings of Janszky et al. where the absence of bilateral interictal epileptiform discharges was the only EEG predictor of seizure freedom (2005). Thus, future studies should include epileptiform discharges in order to help further characterize the EEG effect associated with VNS. Shen et al. demonstrated that Kcomplex expression patterns can affect nonlinearity in surrogate analysis of sleep EEG (2003). The observed nonlinearity increases in patients A and B 223 during late night (11pm until 7am) may be the result of altered kcomplex expression during sleep (though other patients did not show this trend). The VNS is known to cause an increase in the overall EEG power during sleep (Rizzo et al., 2004). The nature of surrogate data analysis is to provide a yes/no answer to the question of nonlinearity, but does not provide information on what type of nonlinearity is observed. All in all, these results suggest that nonlinear measures may someday demonstrate sensitivity to the outcome of VNS effect. In addition, this study motivates the usage of linear and nonlinear measures in conjunction with one another as well as specific waveforms such as epileptiform discharges in order to characterize the complex signal patterns present in EEG. The second study in chapter five aimed to characterize any time dependence of the EEG dynamics during the interstimulation epochs. This preliminary study was executed by performing a statistical comparison of the first half of each interstimulation epoch to the second half. The study utilized four measures which have demonstrated success in classifying neural state changes in epilepsy; ApEnt, correlation sum, Q, and STLmax. The study showed that the patient with the greatest amount of interstimulation epochs demonstrating significant time variation (for Apent, correlation sum, and Q ) also had the highest output current (2.5 mA for patient C). Patient A showed a similar trend and had the second highest output current (1.75 mA). Patient F showed an opposing trend with 0.75 mA output current and the smallest fraction of interstimulation epochs showing time variation. The ApEnt and Q measures demonstrated a noticeably larger deviation from the control in all six patients than the other two measures, as well as sensitivity to the output current. These two observations suggest that the ApEnt and Q measures may be good candidates for EEG biomarkers in VNS patients. Biologically, these results may be related two studies which demonstrated an electrical current threshold for 224 epileptiform activity suppression when stimulating the hippocampus in a low Ca2+ seizure model (Warren and Durand, 1998) and a high K+ seizure model (Nakagawa and Durand, 1991). A paper related to these interstimulation dynamics studies was published under the title "Optimization of epilepsy treatment with vagus nerve stimulation" with authors Basim Uthman, Michael Bewernitz, ChangChia Liu, and Georges Ghacibeh (Uthman et al., 2007). Remarks on VNS Results The variation in observed sensitivity in these measures to the various VNS parameters suggest that different EEG measures are better suited for providing different information about the EEG signal than other measures. Intuitively, it seems logical that a complex system such as the epileptic brain may require several EEG measures for adequate characterization for therapeutic intervention purposes. This observation is underscored in light of the intermittent expression of nonlinear signatures in various interstimulation epochs. Future studies should address the characterization task using a blend of linear and nonlinear measures. In addition, future studies require additional patients to validate the interpretation of these results. Baseline EEG recordings would provide additional support for the existence of EEG induced VNS effects by providing an opportunity to demonstrate the absence of such patterns prior to implantation. After acquisition of the necessary baseline data, an interesting study would be to examine the changes induced by the first stimulation. Thus, after the first stimulation, a subsequent VNS deactivation and EEG acquisition may be applied. This would provide a highly objective experimental setup possible for identifying shortterm VNS effects. Subsequent followup recording sessions may provide additional characterization of the summed modulatory effect of chronic VNS. The time of the last seizure should be obtained from the patient for all such studies. The reason for this is that the patient undergoes a brief period of increased seizure protection after 225 some seizures (e.g. generalized tonicclonic seizures). Thus, if the patient is under the influence of this particular neural state, then that would provide a reduced chance of seizure which is not consistent with the patient's standard behavior. This information would be helpful for interpreting results. In addition, caution must be exercised when interpreting the results of patients whom undergo seizures. As dynamical transitions can occur several minutes to several hours prior to a seizure, many researchers operationally define the interictal period as being a minimum of 8 hours away from a seizure (Pardalos et al., 2003; Hively et al., 2005; Chaovalitwongse et al., 2006). Thus, the occurrence of a handful of seizures may produce an unknown amount of influence on EEG dynamics. For this reason, future studies may withhold analysis of EEG signals occurring within 8 hours of a seizure. Seizure Detection and Stratification The final project of this dissertation applied SVM classification in a preliminary experiment geared towards a seizure detection and stratification system in patients with generalized absence epilepsy. The seizure detection system utilized DTW distance with a reference vector centered on a spike as the extracted feature. As spike and wave discharges in absence epilepsy are generalized and often have a highly characteristic pattern. The first experiment in this study performed SVM training and testing for the detection of the first second of the seizure versus randomly selected nonseizure EEG which was located at least one minute away from a seizure and at least 0.1 second away from another nonseizure segment. Though both experiments present high sensitivity and specificity, the SVM classifier performed better at classifying the first second of the seizure than final second o the seizure. This is likely due to stronger electroencephalographic similarity among the different seizures at onset compared to offset. Alteration of the RBF kernel bandwidth did not appear to appear the results much. Variation of the cost parameter produced a greater effect on accuracy in experiment two than 226 experiment one. This is likely due to a loss of generality resulting from rigid "over fit" models which may occur when the cost is sufficiently high. Such an algorithm may benefit clinicians and researchers by providing a means to rapidly annotate EEG signals as well as a means to provide a clinically interesting measure of therapeutic efficacy (e.g. distribution of seizure durations may vary before and after drug therapy, and thus a measure of this distribution may find clinically relevant information which a raw seizure count would miss). A future direction of this project is to implement the classifier in a realtime situation to test how the algorithm deals with the challenges presented in realtime EEG analysis. This study was submitted to a 2008 volume of the "Optimization and Its Applications" book series under the title "A Novel Algorithm for the Detection and Stratification of Generalized Absence Seizures" with authors Michael Bewernitz, Onur Seref, Basim Uthman, and Panos M. Pardalos. In relation to this work, a review article regarding support vector machines in neuroscience applications was accepted for publication under the title "support vector machines in neuroscience" with authors Onur Seref, O. Erhun Kundakcioglu, and Michael Bewernitz (Seref et al., 2007). Final Remarks The collection of studies presented address preliminary challenges involved with development of online realtime EEG analysis systems for bedside and/or implantable therapy or diagnosis enhancement tools. The choice of EEG source and extracted features for such a tool is one of the greatest challenges presented to researchers in this field. Brain activity can be measured on numerous scales from individual neurons up to macroscopic field potentials representing large regions of the cerebral cortex. In addition, ensuring highfidelity recordings is an additional challenge requiring careful consideration for preprocessing tasks such as artifact 227 rejection and filtering. In addition to the complex nature of EEG analysis, the EEG data source itself is limited in what it can tell a person about the brain. As technology improves and electronic components become smaller, faster, and more efficient, future implantable therapeutic control prostheses may also implement chemical sensors for quantifying neurotransmitter concentrations, for example. Inclusion of additional information related to brain function could greatly enhance the characterization of brain's behavior and potentially augment the performance of implantable therapeutic control devices. 228 LIST OF REFERENCES Abarbanel H, Brown R, Kennel M. Variation of Lyapunov exponents in chaotic systems: Their importance and their evaluation using observed data. Journal of Nonlinear Science, vol. 2, pp. 343365, 1992. Abarbanel H. Analysis of observed chaotic data. New York: SpringerVerlag, 1996. Abasolo D, Hornero R, Espino P, Poza J, Sanchez CI, de la Rosa R. Analysis of regularity in the EEG background activity of Alzheimer's disease patients with Approximate Entropy. Clin Neurophysiol. 2005 Aug;116(8):182634. Abasolo D, James CJ, Hornero R. Nonlinear Analysis of Intracranial Electroencephalogram Recordings with Approximate Entropy and LempelZiv Complexity for Epileptic Seizure Detection. Conf Proc IEEE Eng Med Biol Soc. 2007; 1:19536. Acharya U R, Faust O, Kannathal N, Chua T, Laxminarayan S. Nonlinear analysis of EEG signals at various sleep stages. Comput Methods Programs Biomed. 2005 Oct;80(1):3745. Acir N, Gizelis C. Automatic recognition of sleep spindles in EEG via radial basis support vector machine based on a modified feature selection algorithm. Neural computing and applications (2005) vol. 14: pp. 5665. Adelson PD, Nemoto E, Scheuer M, Painter M, Morgan J, Yonas H. Noninvasive continuous monitoring of cerebral oxygenation periictally using near infrared spectroscopy: a preliminary report. Epilepsia 1999; 40: 14849. Ardesch JJ, Buschman HP, WagenerSchimmel LJ, van der Aa HE, Hageman G. Vagus nerve stimulation for medically refractory epilepsy: a longterm followup study. Seizure. 2007 Oct;16(7):57985. Asyali MH, Berry RB, Khoo MC, Altinok A. Determining a continuous marker for sleep depth. Comput Biol Med. 2007 Nov; 37(11): 16009. Barlow J. Methods of analysis of nonstationary EEG with emphasis on segmentation techniques. J. Clin. Neurophysiol., vol. 2, pages 267304, 1985. Baumgartner C, Serles W,Leutmezer F, Pataraia E, Aull S,Czech T, et al. Preictal SPECT in temporal lobe epilepsy: regional cerebral blood flow is increased prior to electroencephalographyseizure onset. J Nucl Med 1998; 39: 97882. Begley CE, Famulari M, Annegers JF, Lairson DR, Reynolds TF, Coan S, Dubinsky S, Newmark ME, Leibson C, So EL, Rocca WA. The Cost of Epilepsy in the United States: An Estimate from PopulationBased Clinical and Survey Data. Epilepsia. 2000 Mar; 41(3):34251. Belair J, Glass L, An Der Heiden U, Milton J. Dynamical disease: Identification, temporal aspects and treatment strategies of human illness. Chaos. 1995 Mar;5(1):17. 229 Bendat JS, Piersol AG. Random Data: Analysis and Measurement Procedures, 2nd ed. New York: John Wiley, 1986. Berndt D, Clifford J. Finding patterns in time series: A dynamic programming approach. In Advances in knowledge discovery and data mining, U. Fayyad, G. PiatetskyShapiro, P. Smyth, and R. Uthursamy, editors, pages 229248. AAAI Press, 1996. Beuter A, Vasilakos K. Tremor: Is Parkinson's Disease a Dynamical Disease? Chaos 5, 1417 (1995). Bewernitz M, Ghacibeh G, Seref O, Pardalos PM, Liu CC, Uthman B. Quantification of the impact of vagus nerve stimulation parameters on electroencephalographic measures. Proceedings of the conference on Data Mining, Systems Analysis and Optimization in Biomedicine. Gainesville, (FL), 2830 March 2007, AIP Conference Proceedings, No. 953, pp. 206219. Binnie CD, Mizrahi EM. The epilepsy monitoring unit. in Epilepsy: A comprehensive textbook, Eds. J. Engel Jr. and T. A. Pedley, Philadelphia: LippincottRaven, 1997. Box GE, Jenkins GM. Time series analysis: Forecasting and control, San Francisco: Holden Day, 1976. Boyko N, Bewernitz M, Yatsenko V, Pardalos PM, Ghacibeh G, Uthman B. A Data Mining Approach to the Investigation of EEG Biomarker Existence for Vagus Nerve Stimulation Therapy Patients. Submitted to: Computing and Optimization in Medicine and Life Sciences Vol. 3, editor: Eva K. Lee, (2008). Breakspear M. Perception of odors by a nonlinear model of the olfactory bulb. Int J Neural Syst. 2001 Apr; 11(2):10124. Bressler SL, Richter CG, Chen Y, Ding M. Cortical functional network organization from autoregressive modeling of local field potential oscillations. Stat Med. 2007 Sep 20;26(21):387585. Bruhn J, Ropcke H, Hoeft A. Approximate entropy as an electroencephalographic measure of anesthetic drug effect during desflurane anesthesia. Anesthesiology. 2000 Mar;92(3):715 26. Bruhn J, Bouillon TW, Shafer SL. Onset of propofolinduced burst suppression may be correctly detected as deepening of anaesthesia by approximate entropy but not by bispectral index. Br J Anaesth. 2001 Sep;87(3):5057. Bruhn J, Bouillon TW, Radulescu L, Hoeft A, Bertaccini E, Shafer SL. Correlation of approximate entropy, bispectral index, and spectral edge frequency 95 (SEF95) with clinical signs of "anesthetic depth" during coadministration of propofol and remifentanil. Anesthesiology. 2003 Mar;98(3):6217. 230 Burioka N, Cornelissen G, Halberg F, Kaplan DT, Suyama H, Sako T, Shimizu E. Approximate entropy of human respiratory movement during eyeclosed waking and different sleep stages. Chest. 2003 Jan;123(1):806. Burioka N, Cornelissen G, Maegaki Y, Halberg F, Kaplan DT, Miyata M, Fukuoka Y, Endo M, Suyama H, Tomita Y, Shimizu E. Approximate entropy of the electroencephalogram in healthy awake subjects and absence epilepsy patients. Clin EEG Neurosci. 2005 Jul;36(3): 18893. Busygin S, Prokopyev OA, Pardalos PM, Feature Selection for Consistent Biclustering via Fractional 01 Programming, Journal of Combinatorial Optimization, Vol. 10/1 (2005), pp. 721. Busygin S, Prokopyev OA, Pardalos PM, Biclustering in Data Mining, to appear in Computer and Operations Research, 2006. Busygin S, Boyko N, Pardalos PM, Bewernitz MA, Ghacibeh G. Biclustering EEG data from epileptic patients treated with vagus nerve stimulation. Proceedings of the conference on Data Mining, Systems Analysis and Optimization in Biomedicine. Gainesville, (FL), 2830 March 2007, AIP Conference Proceedings, No. 953, pp. 220231. Casdagli MC, lasemidis LD, Savit RS, Gilmore RL, Roper SN, Sackellares JC. Nonlinear analysis of mesial temporal lobe seizures using a surrogate data technique. Epilepsia, vol. 36, Suppl. 4, pp. 142, 1995. Casdagli MC, lasemidis LD, Sackellares JC, Roper SN, Gilmore RL, Savit RS. Characterizing nonlinearity in invasive EEG recordings from temporal lobe epilepsy. Physica D, vol. 99, pp. 381399, 1996. Casdagli MC, lasemidis LD, Savit RS, Roper SN, Gilmore RL, Sackellares JC. 1997. Nonlinearity in invasive EEG recordings from patients with temporal lobe epilepsy. Electroencephalogr. Clin. Neurophysiol. 102, 98105. Casarotto S, Bianchi AM, Cerutti S, Chiarenza GA. Dynamic time warping in the analysis of eventrelated potentials. IEEE Eng Med Biol Mag. 2005 JanFeb;24(1):6877. Chabardes S, Kahane P, Minotti L, Koudsie A, Hirsch E, Benabid AL. Deep brain stimulation in epilepsy with particular reference to the subthalamic nucleus. Epileptic Disorders. 2002 Dec;4 Suppl 3:S8393. Chabolla DR, Cascino GD. Interpretation of Extracranial EEG. In: The Treatment of Epilepsy: Principles and Practice, 2n ed. Elaine Wyllie, M.D. Baltimore, Williams and Wilkins, 1997. pp 264279. Chaovalitwongse, WA. Iasemidis, LD. Pardalos, PM. Carney, PR. Shiau, DS. Sackellares, JC. Performance of a seizure warning algorithm based on the dynamics of intracranial EEG. Epilepsy Res. 2005 May;64(3):93113. Chaovalitwongse, WA. Prokopyev, OA. Pardalos, PM. Electroencephalogram (EEG) time series classification: Applications in epilepsy. Ann Oper Res (2006) 148: 227250. Chaovalitwongse WA, Pardalos PM. ON THE TIME SERIES SUPPORT VECTOR MACHINE USING DYNAMIC TIME WARPING KERNEL FOR BRAIN ACTIVITY CLASSIFICATION. Cybernetics and Systems Analysis, Vol. 44, No. 1, 2008. Chapin JK, Moxon KA. Neural Prostheses For Restoration of Sensory and Motor Function. Pg. 333. SNUGGLE. Chauvet, GA. Berger, TW. Hierarchical Model of the Population Dynamics of Hippocampal Dentate Granule Cells. Hippocampus 12:698712 (2002). Chi Z, Wu W, Haga Z, Hatsopoulos NG, Margoliash D. Templatebased spike pattern identification with linear convolution and dynamic time warping. J Neurophysiol. 2007 Feb;97(2):122135. Colijn C, Fowler AC, Mackey MC. "High frequency spikes in long period blood cell oscillations", J. Math. Biol. (2006), 53(4), 499519. Cooley WJ, Tukey JW. An algorithm for the machine calculation of complex Fourier series. Mathematics of Computation, vol. 19 (90), pp. 297301, 1965. Costello DJ, Cole AJ. Treatment of Acute Seizures and Status Epilepticus. Journal of Intensive Care Medicine 22(6); 2007. Cristianini N, ShaweTaylor J. An introduction to Support Vector Machines and other kernel based learning methods. Copyright Cambridge University Press, 2000. Cyberonics, Inc. VNS Therapy I Vagus Nerve Stimulation. http://www.vnstherapy.com/epilepsy/patient/About Magnet.asp. Last accessed March 19th, 2008. Delamont R, Julu P, Jamal G. Changes in a measure of cardiac vagal activity before and after epileptic seizures. Epilepsy Res 1999; 35: 8794. Deransart, C. Vercueil, L. Marescaux, C. Depaulis, A. The role of the basal ganglia in the control of generalized absence seizures. Epilepsy Research. 32 pp 213223, 1998. Ding, Lei. Wilke, C. Xu, B. Xu, X. Van Drongelen, W. Kohrman, M. He, B. EEG Source Imaging: Correlating Source Locations and Extents with Electrocorticography and Surgical Resections in Epilepsy Patients. (J Clin Neurophysiol 2007;24: 130136). Durand, D. Bikson, M. Suppression and control of epileptiform activity by electrical stimulation: a review. Proceedings of the IEEE, vol. 89, no. 7, July 2001. Ebert, U. Ziemann. Altered seizure susceptibility after highfrequency transcranial magnetic stimulation in rats. Neuroscience Letters. Vol. 273, pp. 155158, 1999. 232 Eckman JP, Kamphorst SO, Ruelle D, Ciliberto S. Lyapunov exponents from time series. Physical Review A, 34:49714979, 1986. Ellner S, Gallent A, McCaffrey D, Nychka D. Convergence rates and date requirements for jacobianbased estimates of lyapunov exponents from data. Phys. Lett. A., 153:357363, 1991. Engel, J. Jr., Seizures and Epilepsy. Philadelphia, PA: F. A. Davis Co., 1989. Epilepsy Foundation. Seizures and Syndromes. http://www.epilepsyfoundation.org/about/types/types/index.cfm Last accessed, March 9th, 2008. Feber F. Treatment of some nonstationarities in the EEG. Neuropsychobiology, vol. 17, pages 100104, 1987. Federico P, Abbott DF, Briellmann RS, Harvey AS, Jackson GD. Functional MRI of the preictal state. Brain 2005; 128: 18117. Ferenets R, Lipping T, Anier A, Jantti V, Melto S, Hovilehto S. Comparison of entropy and complexity measures for the assessment of depth of sedation. IEEE Trans Biomed Eng. 2006 Jun;53(6):106777. Fink M. ECT has proved effective in treating depression. Nature. 2000 Feb 24;403(6772):826. Fisher RS, Uematsu S, Krauss GL, Cysyk BJ, McPherson R, Lesser RP, Gordon B, Schwerdt P, Rise M. Placebocontrolled pilot study of centromedian thalamic stimulation in treatment of intractable seizures. Epilepsia. 1992 SepOct;33(5):84151. Flexer, Arthur. Data mining and electroencephalography. Statistical Methods in Medical Research 2000; 9: 395413. Fountas KN, Smith JR. A novel closedloop stimulation system in the control of focal, medically refractory epilepsy. Acta Neurochir Suppl. 2007;97(Pt 2):35762. Frank W., Lookman T., Nerenberg M., Essex C., Lemieux J., Blume W., "Chaotic time series analyses of epileptic seizures," Physica D, vol. 46, pp. 427438, 1990. Frigo M, Johnson SG. The Design and Implementation of FFTW3. Proceedings of the IEEE 93 (2), 216231 (2005). Fraser AM, Swinney HL. Independent coordinates for strange attractors from mutual information. Phys Rev A, vol. 33, pp. 11341140, 1986. Fuller WA. Introduction to Statistical Time Series. New York: Wiley, 1976. Gardner AB, Krieger AM, Vachtsevanos G, Litt B. OneClass Novelty Detection for Seizure Analysis from Intracranial EEG. Journal of Machine Learning Research 7 (2006) 1025  1044. Geva AB, Kerem DH. Forecasting generalized epileptic seizures from the EEG signal by wavelet analysis and dynamic unsupervised fuzzy clustering. IEEE Trans Biomed Eng. 1998 Oct;45(10):120516. Georges A. Ghacibhen, DengShan Shiau, Linda Dance, Stephan Eisenschenk, J. Chris Sackellares. Influence of Antiepileptic Medications on EEG Dynamics. Epilepsia, Vol. 26 Suppl 8, 2005. Glassman EL. A waveletlike filter based on neuron action potentials for analysis of human scalp electroencephalographs. IEEE Trans Biomed Eng. 2005 Nov;52(11):185162. Goldensohn ES. Historical Perspectives and Future Directions. In: The Treatment of Epilepsy: Principles and Practice, 2nd ed. Elaine Wyllie, M.D. Baltimore, Williams and Wilkins, 1997. pp 191203. Goldstein MA, Harden CL. Epilepsy and Anxiety. Epilepsy Behav. 2000 Aug;1(4):228234. Goldstein MA, Harden CL. Continuing Exploration of the Neuropsychiatry of Seizures: a Review of Anxiety and Epilepsy. Epilepsy & Behavior., vol. 2 pp. 311317, 2001. Good LB, Sabesan S, lasemidis LD, Tsakalis K, Treiman DM. Brain dynamical disentrainment by antiepileptic drugs in rat and human status epilepticus. Conf Proc IEEE Eng Med Biol Soc. 2004; 1:1769. Good LB, Sabesan S, lasemidis LD, Treiman DM. Realtime control of epileptic seizures. The 3rd European Medical and Biological Engineering Conference Proc. 2005 11(1). Grassberger P, Procaccia I. Measuring the Strangeness of Strange Attractors. Physica D 9(12), pages 189208 (1983a). Grassberger P, Procaccia I. Characterization of Strange Attractors. Physical Review Letters 50(5), pages: 346349. 1983b. Grebogi C, Ott E, Pelikan S, Yorke JA. Strange Attractors That Are Not Chaotic. Physica D 13 (12): 261268 1984. Gross, RE. Deep brain stimulation in the treatment of neurological and psychiatric disease. Expert Review of Neurotherapeutics. 4(3), 465478 (2004). Groves DA, Brown VJ. Vagal Nerve Stimulation: a Review of its Applications and Potential Mechanisms that Mediate its Clinical Effects. Review. Neuroscience & Biobehavioral Reviews. Volume 29, Issue 3 May 2005, Pages 493500. Giler I, Ubeyli ED.Adaptive neurofuzzy inference system for classification of EEG signals using wavelet coefficients. J Neurosci Methods. 2005 Oct 30; 148(2):11321. Epub 2005 Jul 28. 234 Gwinn RP, Kondratyev A, Gale K. Timedependent increase in basic fibroblast growth factor protein in limbic regions following electroshock seizures. Neuroscience. 2002; 114(2):403 9. Heck C, Helmers SL, DeGiorgio CM. Vagus nerve stimulation therapy, epilepsy, and device parameters.Neurology 2002;59:S31S37. Hively LM, Protopopescu VA, Munro NB. Enhancements in epilepsy forewarning via phase space dissimilarity. J Clin Neurophysiol. 2005 Dec;22(6):4029. Hodaie, M. Wennberg, RA. Dostrovsky, JO. Lozano, AM. Chronic anterior thalamus stimulation for intractable epilepsy. Epilepsia. 43(6):603608, 2002. Hodgkin, AL. Huxley, AF. A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. (1952) 117, 500544. Hoppe C, Poepel A, Elger CE. Epilepsy: Accuracy of Patient Seizure Counts. ARCH NEUROL/VOL 64 (NO. 11), NOV 2007. Iasemidis LD, Zaveri HP, Sackellares JC, Williams WJ. Phase space analysis of EEG in temporal lobe epilepsy, IEEE EMBS, 10th Annual Int. Conf, pp. 12011203, 1988. lasemidis LD, Sackellares JC, Zaveri HP,Williams WJ. Phase space topography of the electrocorticogram and the Lyapunov exponent in partial seizures, Brain Topogr. vol. 2, pp. 187201, 1990. Iasemidis LD, Sackellares JC. Long time scale temporospatial patterns of entrainment of preictal electrocorticographic data in human temporal lobe epilepsy. Epilepsia 31(5): 621, 1990. Iasemidis LD. On the dynamics of the human brain in temporal lobe epilepsy. PhD dissertation, University of Michigan, Ann Arbor, 1991. lasemidis LD and Sackellares JC, The evolution with time of the spatial distribution of the largest Lyapunov exponent on the human epileptic cortex, In: Measuring chaos in the human brain, Duke D. W. and Pritchard W.S. (Eds.): 4982, World Scientific, Singapore, 1991. lasemidis LD, Sackellares JC and Savit R.S., Quantification of hidden time dependencies in the EEG within the framework of nonlinear dynamics, In: Nonlinear dynamical analysis of the EEG, Jansen B.H. and Brandt M.E. (Eds): 3047, World Scientific, Singapore, 1993. Iasemidis LD and Sackellares JC, The use of dynamical analysis of EEG frequency content in seizure prediction, Electroenceph. Clin. Neurophysiol., 1993. lasemidis LD, Olson LD, Sackellares JC and Savit R., Time dependencies in the occurrences of epileptic seizures: a nonlinear approach, Epilepsy Research 17: 8194, 1994. 235 lasemidis LD and Sackellares JC, Chaos theory and epilepsy, The Neuroscientist 2: 118126, 1996. Iasemidis LD, Gilmore R.L., Roper S.N. and Sackellares JC, Dynamical interactions of the epileptogenic focus with extrafocal sites in temporal lobe epilepsy. Ann Neurol 42(3): 429, 1997. Iasemidis LD, Principe JC, Czapewski J.M., Gilmore R.L., Roper S.N. and Sackellares JC., Spatiotemporal transition to epileptic seizures: a nonlinear dynamical analysis of scalp and intracranial EEG Recordings. In: Spatiotemporal Models in Biological and Artificial Systems, Silva F.L., Principe JC and Almeida L.B. (Eds.): 8188, IOS Press, Amsterdam, 1997. Iasemidis LD, Shiau DS, Sackellares JC P.M. Pardalos, "Transition to epileptic seizures: Optimization," in DIMACS series in Discrete Mathematics and Theoretical Computer Science, D. Du, P. Pardalos, J. Wang, Eds. Providence, RI: American Mathematical Society, pp. 5574,1999. Iasemidis LD, Principe JC, Sackellares JC. "Measurement and Quantification of Spatio Temporal Dynamics of Human Epileptic Seizures", in Nonlinear Biomedical Signal Processing, Editor M. Akay, IEEE Press, 294316, 2000. Iasemidis LD, Shiau DS., P.M. Pardalos and JC Sackellares (2002). Phase entrainment and predictability of epileptic seizures. In: P.M. Pardalos and J. Principe (Eds.), Biocomputing, pp. 5984. Kluwer Academic Publishers, Dordrecht, Netherlands. lasemidis LD, Pardalos PM, Shiau DS, W. Chaovalitwongse, M. Narayanan, S. Kumar, P.R. Carney, JC Sackellares. Prediction of human epileptic seizures based on optimization and phase changes of brain electrical activity. Optimization Methods & Software 18 (1): 81 104 FEB 2003. lasemidis LD. Epileptic seizure prediction and control. IEEE Trans Biomed Eng. 2003 May;50(5):54958. Review. Iasemidis LD, Shiau DS, Chaovalitwongse W, Sackellares JC, Pardalos PM, Principe JC, Carney PR, Prasad A, Veeramani B, Tsakalis K. Adaptive epileptic seizure prediction system. IEEE Trans Biomed Eng. 2003 May;50(5):61627. Iasemidis LD, Shiau DS, Sackellares JC, Pardalos PM, Prasad A. Dynamical resetting of the human brain at epileptic seizures: application of nonlinear dynamics and global optimization techniques. IEEE Trans Biomed Eng. 2004 Mar;51(3):493506. ILOG Inc. CPLEX 9.0 User's Manual, 2004. Intel Corporation. Excerpts from A Conversation with Gordon Moore: Moore's Law (2005). ftp ://download.intel. com/museum/Moores_Law/Video Transcripts/Excepts A Conversation_with_GordonMoore.pdf. Retrieved on January 19, 2008. 236 Jain AK, Murty MN, Flynn PJ. Data Clustering: A Review. ACM Computing Surveys, Vol. 31, No. 3, September 1999. Jansen B, Cheng W. Structural EEG analysis. Int. J. Biomed. Comput., vol. 23, pages 221237, 1988. Jen KK, Hwang YR. Longterm ECG signal feature extraction. J Med Eng Technol. 2007 May Jun;31(3):2029. Jing H, Takigawa M. Nonlinear analysis of EEG after repetitive transcranial magnetic stimulation. J Clin Neurophysiol. 2002 Jan; 19(1):1623. Jung KY, Kim JM, Kim DW. Nonlinear dynamic characteristics of electroencephalography in a highdose pilocarpineinduced status epilepticus model. Epilepsy Res. 2003 May;54(2 3):17988. Kaper M, Meinicke P, Grossekathoefer U, Lingner T, Ritter H. BCI Competition 2003Data Set lib: Support Vector Machines for the P300 Speller Paradigm. IEEE transactions on biomedical engineering, vol. 51, no. 6, June 2004. Kantz H, Schreiber T. Dimension estimates and physiological data. Chaos. 1995 Mar;5(1):143 154. Kantz H, Schreiber T. Nonlinear Time Series Analysis. Cambridge University Press, Cambridge, UK 1997, pp 7075. Kaplan PW, Birbeck G. Lithiuminduced confusional states: nonconvulsive status epilepticus or triphasic encephalopathy? Epilepsia 2006; 47(12): 20712074. Kerem DH, Geva AB. Forecasting epilepsy from the heart rate signal. Med Biol Eng Comput 2005; 43: 2309. Kim HK, Carmena JM, Biggs SJ, et al. The muscle activation method: An approach to impedance control of brainmachine interfaces through a musculoskeletal model of the arm. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING 54 (8): 15201529 AUG 2007. Koo B. EEG changes with vagus nerve stimulation. J Clin Neurophysiol. 2001 Sep;18(5):43441. Korff CM, Nordli DR Jr. Diagnosis and management of nonconvulsive status epilepticus in children. Nat Clin Pract Neurol. 2007 Sep;3(9):50516. Review. Kotas M. Projective filtering of time warped ECG beats. Comput Biol Med. 2008 Jan;38(1): 127 37. KovacsVajna ZM. A fingerprint verification system based on triangular matching and dynamic time warping. IEEE Transactions on Pattern Analysis and Machine Intelligence. Vol 22, Issue 11, Nov 2000, pages 1266 1276. 237 Krystal AD, Greenside HS, Weiner RD, Gassert D. A comparison of EEG signal dynamics in waking, after anesthesia induction and during electroconvulsive therapy seizures. Electroencephalogr Clin Neurophysiol. 1996 Aug;99(2):12940. Krystal AD, Zaidman C, Greenside HS, Weiner RD, Coffey CE. The largest Lyapunov exponent of the EEG during ECT seizures as a measure of ECT seizure adequacy. Electroencephalogr Clin Neurophysiol. 1997 Dec; 103(6):599606. Krystal AD, Weiner RD, Lindahl V, Massie R. The development and retrospective testing of an electroencephalographic seizure qualitybased stimulus dosing paradigm with ECT. The Journal of ECT. 2000 Dec; 16(4):33849. Kumar A, Bleck TP. Intravenous midazolam for the treatment of refractory status epilepticus. Crit Care Med. 1992 Apr;20(4):4838. Lai YC, Harrison MA, Frei MG, Osorio I. Inability of Lyapunov exponents to predict epileptic seizures. Phys Rev Lett. 2003 Aug 8;91(6):068102. Lai YC, Harrison MA, Frei MG, Osorio I. Controlled test for predictive power of Lyapunov exponents: their inability to predict epileptic seizures. Chaos. 2004 Sep;14(3):63042. Le Van Quyen M, Martinerie J, Navarro V, Baulac And M, Varela FJ. Characterizing neurodynamic changes before seizures. J Clin Neurophysiol. 2001 May; 18(3):191208. Review. Leentjens AF, Lousberg R, Verhey FR. Markers for depression in Parkinson's disease. Acta Psychiatr Scand. 2002 Sep;106(3):196201. Lehmann C, Koenig T, Jelic V, Prichep L, John RE, Wahlund LO, Dodge Y, Dierks T. Application and comparison of classification algorithms for recognition of Alzheimer's disease in electrical brain activity (EEG). JNeurosci Methods. 2007 Apr 15;161(2):342 50. Leocani L, Comi G. EEG coherence in pathological conditions.J Clin Neurophysiol. 1999 Nov; 16(6):54855. Review. Liu CC, Shiau DS, W. Art Chaovalitwongse, Pardalos PM, Sackellares JC. Presence of nonlinearity in intracranial EEG recordings: detected by Lyapunov exponents. Proceedings of the conference on Data Mining, Systems Analysis and Optimization in Biomedicine. Gainesville, (FL), 2830 March 2007, AIP Conference Proceedings, No. 953, pp. 197205. Lopes da Silva FH, Blanes W, Kalitzin SN, Parra J, Suffczynski P, Velis DN. Dynamical diseases of brain systems: different routes to epileptic seizures. IEEE Trans Biomed Eng. 2003 May;50(5):5408. Lorenz E. Deterministic nonperiodic flow. Journal of Atmosperic Science, 20:130141, 1963. 238 Lothman, EW. Bertram, EH. Stringer, JL. Functional Anatomy of Hippocampal Seizures. Progress in Neurobiology. Vol. 37, pp. 182, 1991. Lotte F, Congedo M, Lecuyer A, Lamarche F, Arnaldi B. A review of classification algorithms for EEGbased braincomputer interfaces. J Neural Eng. 2007 Jun;4(2):R1R13. Lowenstein DH, Bleck T, Macdonald RL. It's time to revise the definition of status epilepticus. Epilepsia. 1999;40:120122. Mackey MC, Glass L. Oscillation and chaos in physiological control systems. Science, vol. 197, pp. 287 289, 1977. Mackey MC, an der Heiden U. "Dynamic diseases and bifurcations in physiological control systems", Funk. Biol. Med. (1982) 1, 156164. Madeira SC, Oliveira AL, Biclustering Algorithms for Biological Data Analysis: A Survey, IEEE Transactions on Computational Biology and Bioinformatics, 1 (2004), pp. 2425. Mandelbrot BB. The Fractal Geometry of Nature. New York, New York: W.H. Freeman and Company, 1983. Manford, Mark. Practical Guide to Epilepsy. Burlington, MA: Elsevier Science Inc., 2003. McLachlan RS. Suppression of interictal spikes and seizures by stimulation of the vagus nerve. Epilepsia. 1993 SepOct;34(5):91823. Merkwirth C, Parlitz U, Wedekind I, Lauterborn W. TSTOOL and User Manual, Ver. 1.11, DPI Gottingen, www.physik3.gwdg.de/tstool/gpl.txt, 2002. McIntyre, CC. Savasta, M. Walter, BL. Vitek, JL. How does deep brain stimulation work? Present understanding and future questions. Journal of Clinical Neurophysiology. Vol 21, Number 1, February 2004. Milton JG, Longtin A, Beuter A, Mackey MC, Glass L. Complex dynamics and bifurcations in neurology. J Theor Biol. 1989 May 22;138(2):12947. Review. Milton J, Mackey MC. "Periodic haematological diseases: Mystical entities or dynamical disorders?", Journal of the Royal College of Physicians of London (1989), vol. 23, no. 4, 236241. Milton JG, Black D. Dynamic diseases in neurology and psychiatry. Chaos. 1995 Mar;5(1):813. Milton JG, "Epilepsy: multistability in a dynamic disease," in: J. Walleczek, Ed., Selforganized biological dynamics and nonlinear control, New York: Cambridge University Press, pp. 374386, 2000. Misiti, M., Misiti, Y., Oppenheim, G., Poggi, JM. (1996). Wavelet toolbox for use with Matlab. MathWorks, Inc. 239 Morrell, M. Brain stimulation for epilepsy: can scheduled or responsive neurostimulation stop seizures? Current Opinion in Neurology 2006, 19:164168. Mormann F, Andrzejak RG, Elger CE, Lehnertz K. Seizure prediction: the long and winding road. Brain. 2007 Feb;130(Pt 2):31433. Mu Q, Bohning DE, Nahas Z, Walker J, Anderson B, Johnson KA, Denslow S, Lomarev M, Moghadam P, Chae JH, George MS. Acute vagus nerve stimulation using different pulse widths produces varying brain effects. Biol Psychiatry. 2004 Apr 15;55(8):81625. Na SH, Jin SH, Kim SY.The effects of total sleep deprivation on brain functional organization: mutual information analysis of waking human EEG. Int J Psychophysiol. 2006 Nov;62(2):23842. Epub 2006 Jul 11. Nair SP, Miller, Norman W.M., Shenk D., Suharitdamrong W., lasemidis LD, Pardalos P.M., Sackellares JC, Carney P.R., "Dynamical Changes in the Rat Chronic Limbic Epilepsy Model," Epilepsia, vol. 45 (Suppl 7), pp. 211 212, 2004. Nair SP, Shiau DS., lasemidis LD, Pardalos P.M., Sackellares JC, Carney P.R., "Seizure predictability in an experimental model of epilepsy," in Proceedings of Data Mining Conference, University of Florida, Gainesville, FL:, 2005. Nair SP, Sackellares JC, Shiau DS, Norman WM, Dance LK, Pardalos PM, Principe JC, Carney PR. Effects of acute hippocampal stimulation on EEG dynamics. Conf Proc IEEE Eng Med Biol Soc. 2006; 1:43826. Nakagawa M, Durand D. Suppression of spontaneous epileptiform activity with applied currents. Brain Res. 1991 Dec 20;567(2):2417. Nelson GD. A brief history of cardiac pacing. Texax Heart Institute Journal. 1993;20(1):128. Medtronic Inc., Minneapolis, Minnesota 554323576. Nicolelis MAL. Actions from thoughts. NATURE 409 (6818): 403407 JAN 18 2001. Niedermeyer E, Lopes da Silva FH. Electroencephalography. Baltimore: Williams & Wilkins, 1993. Noe' F, Nissinen J, Pitkanen A, Gobbi M, Sperk G, During M, Vezzani A. Gene therapy in epilepsy: the focus on NPY. Peptides. 2007 Feb;28(2):37783. Novak V, Reeves AL, Novak P, Low PA, Sharbrough FW. Timefrequency mapping of RR interval during complex partial seizures of temporal lobe origin. J Auton Nerv Syst 1999; 77: 195202. Ochoa JG, Riche W. Antiepileptic Drugs: An Overview. Available at http://www.emedicine.com/NEURO/topic692.htm, April 5th, 2007. last accessed January 23, 2008. 240 Okumura E, Sanada S, Suzuki M, Takemura A, Matsui O. Improvement of temporal and dynamic subtraction images on abdominal CT using 3D global image matching and nonlinear image warping techniques. Phys Med Biol. 2007 Nov 7;52(21):646174. Olejniczak PW, Fisch BJ, Carey M, Butterbaugh G, Happel L, Tardo C. The effect of vagus nerve stimulation on epileptiform activity recorded from hippocampal depth electrodes. Epilepsia. 2001 Mar;42(3):4239. Osorio I., Harrison M.F., Lai Y.C., Frei M.G. Observations on the application of the correlation dimension and correlation integral to the prediction of seizures. Journal of Clinical Neurophysiology (2001), 18(3), 269274. Osorio I, Frei MG, Manly BF, Sunderam S, Bhavaraju NC, Wilkinson SB. An introduction to contingent (closedloop) brain electrical stimulation for seizure blockage, to ultrashort term clinical trials, and to multidimensional statistical analysis of therapeutic efficacy. J Clin Neurophysiol. 2001 Nov; 18(6):53344. Osorio I, Frei MG, Sunderam S, Giftakis J, Bhavaraju NC, Schaffner SF, Wilkinson SB. Automated seizure abatement in humans using electrical stimulation. Ann Neurol. 2005 Feb;57(2):25868. Oxley, Jolyon. Smith, Jay. The Epilepsy Reference Book. London: Faber and Faber, 1991. Palus M, Albrecht V, Dvorak I. "Information theoretic test for nonlinearity in time series," Phys. Rev. A, vol. 34, pp. 49714972, 1993. Palus M, Komarek V, Prochazka T, Hrncir Z, Sterbova K. Synchronization and information flow in EEGs of epileptic patients. IEEE Engineering in Medicine and Biology Magazine 20 (5): 6571 SEPOCT 2001. Pardalos PM, Chaovalitwongse W, lasemidis LD, Sackellares JC, Shiau DS, Carney PR, Prokopyev OA, Yatsenko VA. Seizure warning algorithm based on optimization and nonlinear dynamics. Math. Program., Ser. B 101: 365385 (2004). Parker JN, Parker PM. The Official Patient's Sourcebook on Seizures and Epilepsy. ICON Group International, Inc., San Diego, CA 92122 USA, 2003. Pijn, JP, Velis DN, van der Heyden M, DeGoede J, van Veelen CW, Lopes da Silva FH. 1997. Nonlinear dynamics of epileptic seizures on the basis of intracranial EEG recordings. Brain Topogr. 94, 249270. Pincus SM. Approximating Markov chains. Proc Natl Acad Sci USA, vol. 89: pp. 44324436, 1992. Pincus SM, Keefe DL. Quantification of hormone pulsatility via an approximate entropy algorithm. American Journal of Physiology, 265:E741E754, 1992. Pincus SM. Approximate entropy (ApEn) as a complexity measure. Chaos. 1995 Mar;5(1): 110 117. Pritchard WS, Duke DW, Krieble KK. Dimensional analysis of resting human EEG. II: Surrogatedata testing indicates nonlinearity but not lowdimensional chaos. Psychophysiology. 1995 Sep;32(5):48691. Purves D. Augustine GJ, Fitzpatrick D, Hall WC, LaMantia AS, McNamara JO, Williams SM. Neuroscience. 3rd Edition. Massachusetts: Sinauer Associates, 2004. Quintana H, Snyder SM, Pumell W, Aponte C, Sita J. Comparison of a standard psychiatric evaluation to rating scales and EEG in the differential diagnosis of attention deficit/hyperactivity disorder. Psychiatry Res. 2007 Aug 30;152(23):21122. Rabiner L, Rosenberg A, Levinson S. (1978). Considerations in dynamic time warping algorithms for discrete word recognition. IEEE Trans. Acoustics Speech, and Signal Proc., Vol. ASSP26, pp. 575582. Ramani, R. Vagus Nerve Stimulation Therapy for Seizures. J Neurosurg Anesthesiol. Volume 20, Number 1, January 2008. Rapp PE, Albano AM, Mees AI. Calculation of correlation dimension from experimental data: Progress and problems," in Dynamic patterns in complex systems, J.A.S. Kelso, A.J. Mandell, M.F. Schlesinger Eds. Singapore: World Scientific, pp. 191205, 1988. Rizzo P, Beelke M, De Carli F, Canovaro P, Nobili L, Robert A, Fornaro P, Tanganelli P, Regesta G, Ferrillo F. Modifications of sleep EEG induced by chronic vagus nerve stimulation in patients affected by refractory epilepsy. Clin Neurophysiol. 2004 Mar; 115(3):65864. Savit, R. Predicting Epileptic Seizures. In: J. G. Milton and P. Jung, Eds., Epilepsy as a Dynamical Disease. Heidelberg, Germany: SpringerVerlag, 2003. SchalkoffR. Pattern recognition statistical, structural, and neural approaches. John Wiley & Sons, New York, 1992. Schanze T, Hesse L, Lau C, Greve N, Haberer W, Kammer S, Doerge T, Rentzos A, Stieglitz T. An optically powered singlechannel stimulation implant as test system for chronic biocompatibility and biostability of miniaturized retinal vision prostheses. IEEE Trans Biomed Eng. 2007 Jun;54(6 Pt 1):98392. Schevon CA, Cappell J, Emerson R, Isler J, Grieve P, Goodman R, McKhann G Jr, Weiner H, Doyle W, Kuzniecky R, Devinsky O, Gilliam F. Cortical abnormalities in epilepsy revealed by local EEG synchrony. Neuroimage. 2007 Mar;35(1):1408. Schreiber T, Schmitz A. Improved surrogate data for nonlinearity tests. PHYSICAL REVIEW LETTERS 77(4), 635638, 1996. 242 Schreiber T, Schmitz A. "Surrogate time series," Physica D, vol. 142, pp. 346382, 2000. Seref O, Kundakcioglu OE, Bewemitz MA. "Support vector machines in neuroscience", Encyclopedia of Healthcare Information Systems, N. Wickramasinghe and E. Geisler (editors), IDEA Group Inc., 2007, accepted for publication. Shamir R, MaronKatz A, Tanay A, et al. EXPANDER An integrative program suite for microarray data analysis. BMC BIOINFORMATICS Volume: 6 Article Number: 232 Published: SEP 21 2005. Shannon CE. A Mathematical Theory of Communication. Bell System Technical Journal, vol. 27, pp. 379423, 623656, July, October, 1948. Shaw JC. Correlation and coherence analysis of the EEG: a selective tutorial review. Int J Psychophysiol. 1984 Mar;1(3):25566. Shen Y, Olbrich E, Achermann P, Meier PF. Dimensional complexity and spectral properties of the human sleep EEG. Electroencephalograms. Clin Neurophysiol. 2003 Feb;114(2):199 209. Shiau DS. Signal Identification and Forecasting in Nonstationary Time Series Data. Ph.D. Dissertation, University of Florida, 2001. Shiau DS, lasemidis LD, Yang MCK, Carney PR, Pardalos PM, Suharitdamrong W, Nair SP and Sackellares JC (2004) Patternmatch regularity statistic A measure quantifying the characteristics of epileptic seizures. Epilepsia 45 (S7): 8586. Shimada I, Nagashima T. A numerical approach to ergodic problem of dissipative dynamical systems. Progress of Theoretical Physics, 61:16051616, 1979. Shneker BF, Fountain NB. Assessment of acute morbidity and mortality in nonconvulsive status epilepticus. Neurology 2003; 61: 10661073. Shorvon S, Perucca E, Fish D, Dodson E. The Treatment of Epilepsy. Second edition. Malden, Mass Blackwell Publishing Ltd., 2004. Silva C, Pimentel IR, Andrade A, Foreid JP, DuclaSoares E. Correlation dimension maps of EEG from epileptic absences. Brain Topogr. 1999 Spring; 11(3):2019. Simon RH, Zimmerman AW, Sanderson P, Tasman A. EEG markers of migraine in children and adults. Headache. 1983 Sep;23(5):2015. Smart OL, Worrell GA, Vachtsevanos GJ, Litt B. Automatic detection of high frequency epileptiform oscillations from intracranial EEG recordings of patients with neocortical epilepsy. Technical, Professional and Student Development Workshop, 2005 IEEE Region 5 and IEEE Denver Section. 78 April 2005, pages: 53 58. 243 Speckmann EJ, Elger CE, Altrup U. Neurophysiologic basis of the EEG. In: The Treatment of Epilepsy: Principles and Practice, 2nd ed. Elaine Wyllie, M.D. Baltimore, Williams and Wilkins, 1997. pp 204217. Srinivasan V, Eswaran C, Sriraam N.Approximate entropybased epileptic EEG detection using artificial neural networks. IEEE Trans Inf Technol Biomed. 2007 May;11(3):28895. Stein AG, Eder HG, Blum DE, Drachev A, Fisher RS. An automated drug delivery system for focal epilepsy. Epilepsy Res. 2000 Apr;39(2):10314. Takens F. Detecting strange attractors in turbulence. In: D.A. Rand and L.S. Young (Eds.), Dynamical Systems and Turbulence, Lecture Notes in Mathematics. SpringerVerlag, Heidelburg (1981). Talathi SS, Hwang DU, Spano ML, Simonotto J, Furman MD, Myers SM, Winters JT, Ditto WL, Carney PR. Nonparametric early seizure detection in an animal model of temporal lobe epilepsy. J Neural Eng. 2008 Mar;5(1):8598. Tanay A, Sharan R, Shamir R, Biclustering Algorithms: A Survey, to appear in the Handbook of Bioinformatics, 2004. Available at http://www.cs.tau.ac.il/rshamir/papers/bicrevbioinfo.ps, last accessed January 20th 2008. Tarca AL, Carey VJ, Chen XW, Romero R, Drdghici S. Machine learning and its applications to biology. PLoS Comput Biol. 2007 Jun;3(6):ell116. Taylor S. Electroconvulsive therapy: a review of history, patient selection, technique, and medication management. South Med J. 2007 May;100(5):4948. Thakor NV, Tong SB. Advances in quantitative electroencephalogram analysis methods. Annual review of biomedical engineering. 6: 453495 2004. Theiler J. Spurious dimension from correlation algorithms applied to limited timeseries data, Phys. Resv. A 34 (1986) 24272433. Theiler J, Eubank S, Longtin A, Galdrikian B, Farmer JD. Testing for nonlinearity in time series: the method of surrogate data, Physica D 58 (1992) 77. Theiler J, Prichard D. Constrainedrealization MonteCarlo method for hypothesis testing. Physica D. 94(4), 221235, 1996. Theodore WH, Fisher RS. Brain stimulation for epilepsy. Lancet Neurol. 2004 Feb;3(2): 1118. Thomasson N, Pezard L, Allilaire JF, Renault B, Martinerie J. Nonlinear EEG Changes Associated with Clinical Improvement in Depressed Patients. Nonlinear Dynamics, Psychology, and Life Sciences, Vol. 4, No. 3, 2000. 244 Tirsch WS, Keidel M, Perz S, Scherb H, Sommer G. Inverse covariation of spectral density and correlation dimension in cyclic EEG dynamics of the human brain. Biol Cybern. 2000 Jan;82(1):114. Tirsch WS, Stude P, Scherb H, Keidel M. Temporal order of nonlinear dynamics in human brain. Brain Res Brain Res Rev. 2004 May;45(2):7995. Uthman B, Bewernitz M, Liu CC, Ghacibeh G. Optimization of epilepsy treatment with vagus nerve stimulation. Proceedings of the conference on Data Mining, Systems Analysis and Optimization in Biomedicine. Gainesville, (FL), 2830 March 2007, AIP Conference Proceedings, No. 953, pp. 308315. Uthman B, Bearden S. Rhythmic diffuse delta frequency activity presenting as an unusual EEG correlate of nonconvulsive status epilepticus: Three case studies. Epilepsy Behav. 2008 Jan;12(1):191199. Vapnik, V, Lerner A. Pattern recognition using generalized portrait method. Automation and Remote Control, 24, 774780, 1963. Varma NK, Kushwaha R, Beydoun A, Williams WJ, Drury I. Mutual information analysis and detection of interictal morphological differences in interictal epileptiform discharges of patients with partial epilepsies. Electroencephalogr Clin Neurophysiol. 1997 Oct;103(4):42633. Velasco AL, Velasco M, Velasco F, Menes D, Gordon F, Rocha L, Briones M, Marquez I. Subacute and Chronic Electrical Stimulation of the Hippocampus on Intractable Temporal Lobe Seizures: Preliminary Report. Archives of Medical Research 31 (2000) 316328. Vezzani A. Gene Therapy in Epilepsy. Epilepsy Curr. 2004 May; 4(3): 8790. Warren RJ, Durand DM. Effects of applied currents on spontaneous epileptiform activity induced by low calcium in the rat hippocampus. Brain Res. 1998 Sep 28;806(2):18695. Weaver D. Epilepsy and Seizures: Everything You Need to Know. Buffalo, NY: Firefly Books Inc., 2001. Weinand ME, Carter LP, ElSaadany WF, Sioutos PJ, Labiner DM, Oommen KJ. Cerebral blood flow and temporal lobe epileptogenicity. J Neurosurg 1997; 86: 22632. Wilner AN. Epilepsy: 199 Answers: A Doctor Responds to His Patients' Questions. New York: Demos, 2003. Winterhalder M, Schelter B, Maiwald T, Brandt A, Schad A, SchulzeBonhage A, Timmer J. Spatiotemporal patientindividual assessment of synchronization changes for epileptic seizure prediction. Clin Neurophysiol. 2006 Nov; 117(11):2399413. Wolf A, Swift J, Swinney H, and Vastano J. Determining Lyapunov exponents from a time series. Physica D, 16:285317, 1985. 245 Wolf A, and Vastano J. Intermediate length scale effects in Lyapunov exponent estimation. In G. MayerKress, editor, Dimensions and entropies in chaotic systems: Quantification of complex behavior, pages 9499. SpringerVerlag, 1986. Yaari Y, Beck H. 'Epileptic neurons' in temporal lobe epilepsy. Brain Pathol 2002; 12: 2349. Zaveri HP, Williams WJ, and Sackellares JC. "Energy based detection of seizures," presented at 15th Annual International Conference on Engineering and Medicine in Biology, 1993. 246 BIOGRAPHICAL SKETCH Michael Andrew Bewernitz was born and raised in the state of Michigan in the United States of America. Michael received his Bachelor of Science degree in chemical engineering with a biochemical engineering option from Michigan State University in 2002. He enrolled the Ph.D. program of the J. Crayton Pruitt Family Department of Biomedical Engineering in 2003 under the guidance of Dr. J. Chris Sackellares in the Brain Dynamics Lab. After three productive years, Michael joined Dr. Panos Pardalos in the Center for Applied Optimization in the summer of 2006. In summer of 2007, Michael earned his Master of Engineering degree from the J. Crayton Pruitt Family Department of Biomedical Engineering. He went on to complete his Doctor of Philosophy in spring of 2008. Michael has written and presented three conference talks, produced four journal publications, one book chapter, participated in the creation of a patent, helped create four IRB medical research protocols on which he served as a subinvestigator, participated in the creation of a bioengineering research fellowship grant, as well as an NIH R21 grant. He has worked as a visiting researcher at the AlleghenySinger Research Institute in Pittsburgh, PA under the guidance of Dr. Kevin Kelly for two months during the summer of 2005. Michael's research interests include data mining biomedical time series datasets and neural state classification using electroencephalographic recordings obtained from patients or animal models of neurological disorders. PAGE 1 DATA MINING AND TIME SERIES ANALYSIS OF BRAIN DYNAMICAL BEHAVIOR WITH APPLICATIONS IN EPILEPSY By MICHAEL ANDREW BEWERNITZ A DISSERTATION PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLORIDA IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY UNIVERSITY OF FLORIDA 2008 1 PAGE 2 2008 Michael A. Bewernitz 2 PAGE 3 To my family, my loving fiance Teddi, and all those whom have helped me along the way of this challenging journey. 3 PAGE 4 ACKNOWLEDGMENTS I would first like to thank Panos Pardalos for his guidance, wisdom, and his persistent drive towards excellence which helped me and numerous students to think big, aim high, and repeatedly achieve great feats throughout the years. Most of all, I thank Dr. Pardalos for the effort he exerted to assist me during a difficult portion of my graduate schooling. I would also like to thank Dr. Basim Uthman for teaming up with me to share his brilliant ideas, time, energy, and financial support. The benefits of his impact on my graduate experience are beyond measure. Im very grateful for opportunity to work with Dr. Georges Ghacibeh and for the large positive impact he has had on my career as a Ph.D. student. I would also like to thank Dr. Mingzhou Ding, Dr. Steven Roper, and Dr. Hans Van Oostrom for serving on my graduate committee and providing valuable feedback. I thank Dr. J. Chris Sackellares for his guidance and support throughout the years, especially when we worked together at the Brain Dynamics Laboratory at the University of Florida. In addition, I commend Dr. DengShan Shiau for his continual assistance in all areas of my graduate career for the last five years. Im also grateful for the guidance of my BDL labmates, Dr. Wanpracha Chaovalitwongse, Linda Dance, ChangChia Liu, Dr. Sandeep Nair, and Wichai Suharitdamrong as well as Dr. Wendy Norman for their assistance with work and just keeping my bearings during this challenging chapter of my life. I would also like to thank Dr. Paul Carney for his guidance throughout the years during meetings, conferences, seminars, or just in passing on campus. He has helped me in numerous ways and I extend sincere thanks. I am also grateful for Dr. Kevin Kelly for providing me the privilege of a fruitful and engaging experience working at his facility. I thoroughly enjoyed the summer of 2005 working in his Pittsburgh lab on our challenging task. I am grateful to have 4 PAGE 5 made the acquaintance of Peter Jukkola, Dr. Elena Kharlamov, Kathy Schmitt, and all the AlleghenySinger Research Institute staff that helped me along the way. Im very grateful for my most recent group of friends in the Center for Applied Optimization at the University of Florida. The broad spectrum of research experience available my CAO colleagues such as Ashwin Arulselvan, Dr. Vladimir Boginski, Nikita Boyko, Dr. Stanislav Busygin, Dr. Altannar Chinchuluun, Alla Kammerdiner, O. Erhun Kundakcioglu, Dr. Antonio Mucherino, Dr. Oleg Prokopyev, Steffen Rebennack, Dr. Onur Seref, Oleg Shylo, and Petros Xanthopoulos helped provide me with rapid answers to many research questions, numerous perspectives to attacking a problem, as well some tasty ethnic food, drink and insider information for world travel! Short of becoming a United Nations ambassador, I doubt I will ever work with such a unique and diverse group of friends ever again. I also appreciate the efforts of Scott Bearden, David Juras, and all the staff at the Malcom Randall VA Medical Center of the North Florida/South Georgia Veterans Health System who have collaborated with our University of Florida research team and provided invaluable support for my Ph.D. studies. I would also like to thank Professor Jens Timmer, Professor Andreas SchulzeBonhage, Dr. Bjrn Schelter, Dr. Michael Jachan, Hinnerk Feldwisch, Armin Brandt, Jakob Nawrath, Raimar Sandner, Johannes Wohlmuth, Thomas Maiwald, Christiane Lehmann, Carolin Gierschner, Dr. Matthias Winterhalder, Dipl. Ing. Richard AschenbrennerScheibe, Dr. Henning Voss of the Freiburg Center for Data Analysis and Modeling, University of Freiburg, Germany, for providing publicly available deidentified EEG signals for research purposes. Their generosity has greatly benefited my studies. In addition, General Clinical Research Center, 5 PAGE 6 Grant # MO1RR00082 has provided the means to conduct a portion of the research conducted in this dissertation. I would like to acknowledge the efforts of AprilLane Derfinyak, Anide PierreLouis, Laura Studstill, Kristi Wagner, Kathryn Whitesides, as well as Tifiny Dyer, Michelle Griffin, Danielle Wise, and Cindy Hansen for helping keep me on schedule with graduate school deadlines and comply with all the university guidelines that were a challenge to keep track of. Outside of my professional contacts, I would like to thank all my friends and my entire family, Howard, Noreen, Julie, and Mark Bewernitz for countless hours of encouragement in good and bad times. They have shared my ups and downs and maintained a steady supply of loving support throughout it all. I thank my loving fiancee, Teddi, for her continued support throughout the various phases of my graduate career. You mean everything to me Teddi. Above all, I thank The Father, The Son, and The Holy Spirit for the grace and blessings to persevere throughout the greatest challenge of my life thus far. 6 PAGE 7 TABLE OF CONTENTS page ACKNOWLEDGMENTS ...............................................................................................................4 LIST OF TABLES .........................................................................................................................10 LIST OF FIGURES .......................................................................................................................12 LIST OF ABBREVIATIONS ........................................................................................................17 ABSTRACT ...................................................................................................................................18 1 INTRODUCTION..................................................................................................................20 Computational Therapeutic Approaches: a New Frontier in Medical Treatment ..................21 Establishment of Neural States in Epilepsy ............................................................................24 Dynamical Disorders in Neurology ........................................................................................25 Objectives and Contributions of this Dissertation ..................................................................27 Organization of Chapters ........................................................................................................28 2 AN OVERVIEW OF EPILEPTIC DISORDERS AND EPILEPSY RESEARCH DIRECTIONS.........................................................................................................................32 Introduction .............................................................................................................................32 Classification of Seizure Types ..............................................................................................34 Partial Seizures ................................................................................................................34 Generalized Seizures .......................................................................................................35 Absence seizures ......................................................................................................35 Status epilepticus ......................................................................................................36 Epilepsy Treatment .................................................................................................................37 The Electroencephalogram as a Diagnostic Tool ............................................................38 Antiepileptic Drugs .........................................................................................................39 Sodium channel blockers .........................................................................................40 GABA agonists, reuptake inhibitors, and transaminase inhibitors ..........................40 Glutamate blockers ...................................................................................................41 Pharmacologicallyresistant epileptic seizures .........................................................41 Epilepsy Surgery .............................................................................................................42 Gene Therapy ..................................................................................................................42 Electrical Stimulation Therapy ........................................................................................42 Deep brain stimulation .............................................................................................44 Cerebellum ...............................................................................................................45 Subcortical structures ...............................................................................................46 Caudate nucleus ........................................................................................................46 Thalamus ..................................................................................................................46 Centromedian nucleus ..............................................................................................47 Anterior thalamic nucleus ........................................................................................47 7 PAGE 8 Subthalamic nucleus .................................................................................................48 Hippocampus ............................................................................................................48 Vagus nerve stimulation ...........................................................................................48 Future Therapeutic Directions .........................................................................................51 Complex nature of epileptic dynamics .....................................................................52 Dynamical diseases and disorders ............................................................................52 Epilepsy as a dynamical disorder of brain systems ..................................................54 Compensating for impaired neural control mechanisms: system control therapy ...54 3 TIME SERIES ANALYSIS AND DATA MINING TECHNIQUES: THEORY AND APPLICATION......................................................................................................................56 Glossary of Terms ...................................................................................................................56 Time Series Analysis ..............................................................................................................57 Methods Applied in the Time Domain ............................................................................58 Autoregressive moving average modeling ...............................................................58 Autoregressive integrated moving average modeling ..............................................59 Cross correlation ......................................................................................................59 Methods Applied in the Frequency Domain ...................................................................61 Coherence .................................................................................................................61 Discrete Fourier transform .......................................................................................62 Wavelet analysis .......................................................................................................64 Information Based Methods ...................................................................................................65 Approximate Entropy ......................................................................................................65 Pattern Match Regularity Statistic ...................................................................................66 Mutual Information .........................................................................................................67 Chaotic System Analysis Techniques .....................................................................................68 Phase Space Mapping ......................................................................................................70 The Method of Delays .....................................................................................................71 Fractal Dimension ...........................................................................................................72 Box counting dimension (D0) ..................................................................................74 Information dimension (D1) .....................................................................................74 Correlation dimension (D2) .....................................................................................75 The Lyapunov Exponent ..........................................................................................75 Computing ShortTerm Maximum Lyapunov Exponents ...............................................77 Mean Angular Frequency in Phase Space .......................................................................85 Data Mining ............................................................................................................................86 Clustering ........................................................................................................................87 Kmeans clustering ...................................................................................................87 Biclustering ..............................................................................................................87 Consistent biclustering .............................................................................................89 Data Classification ...........................................................................................................92 Machine learning ......................................................................................................92 Mahalanobis distance classification .........................................................................93 Support vector machines ..........................................................................................94 8 PAGE 9 4 INVESTIGATION OF EEG BIOMARKER EXISTENCE FOR VAGUS NERVE STIMULATION THERAPY: A DATA MINING APPROACH........................................102 Motivation for VNS Therapy Improvement .........................................................................103 EEG Markers for Treatment of Neurological Diseases and Disorders .........................103 Modeling Brain Disorder Dynamics .............................................................................104 Biclustering Analysis of EEG Dynamics in Patients undergoing VNS Therapy for Epilepsy .............................................................................................................................107 Data Description ............................................................................................................107 STLmax Feature Extraction ..........................................................................................109 Experimental Setup .......................................................................................................110 Results ...........................................................................................................................111 Discussion ......................................................................................................................112 SVM Analysis of EEG Phase Space Patterns in Patients undergoing VNS Therapy for Epilepsy .............................................................................................................................113 Data Description ............................................................................................................114 SVM Application Description .......................................................................................114 Experimental Design .....................................................................................................115 Results ...........................................................................................................................117 Discussion ......................................................................................................................117 Data Mining Analysis of EEG Dynamics Patients undergoing VNS Therapy for Epilepsy .............................................................................................................................120 Data Description ............................................................................................................120 Feature Extraction .........................................................................................................121 SVM Analysis of EEG Dynamics .................................................................................121 Logistic Regression Analysis of EEG Dynamics ..........................................................122 Experimental Setup .......................................................................................................124 Results ...........................................................................................................................124 Discussion ......................................................................................................................125 Conclusions ...........................................................................................................................127 5 ANALYSIS OF INTERSTIMULATION BRAIN DYNAMICS IN VAGUS NERVE STIMULATION THERAPY................................................................................................142 Further Characterizations/Investigations of EEGEffects in VNS Therapy .........................142 Dynamical EEG Measures as Markers for Neurological Diseases and Disorders ........143 Data Description ............................................................................................................145 The Surrogate Analysis Method ....................................................................................146 The Role of Surrogate Data Analysis in EEG studies ...................................................148 Nonlinearity Analysis of Interstimulation EEG ...................................................................149 Choosing a Test Statistic ...............................................................................................150 Experimental Design .....................................................................................................151 Results ...........................................................................................................................152 Discussion ......................................................................................................................153 Temporal Evolution of Interstimulation EEG Dynamics .....................................................156 Data Description ............................................................................................................156 EEG Dynamical Measures ............................................................................................157 9 PAGE 10 Approximate entropy ..............................................................................................157 Correlation sum ......................................................................................................158 Mean angular frequency in phase space .................................................................159 Shortterm maximum Lyapunov exponent ............................................................159 Experimental Design .....................................................................................................160 Results ...........................................................................................................................162 Discussion ......................................................................................................................163 Conclusions ...........................................................................................................................166 6 A NOVEL GENERALIZED ABSENCE SEIZURE DETECTION ALGORITHM...........199 Methods ................................................................................................................................200 Energy Method for SWD Detection ..............................................................................200 Fanselow Method for SWD Detection ..........................................................................201 Westerhuis Method for SWD Detection ........................................................................201 Dynamic Time Warping ................................................................................................202 TeagerKaiser Energy ....................................................................................................203 Empirical Study ....................................................................................................................204 EEG Data Acquisition ...................................................................................................204 Data Sampling and Feature Extraction ..........................................................................205 SVM Training and Testing ............................................................................................206 Detector Performance Evaluation ..................................................................................207 Results ...................................................................................................................................208 Discussion .............................................................................................................................208 7 DISCUSSION AND CONCLUDING REMARKS.............................................................217 Towards RealTime EEG Analysis Tools for the Bedside and Implantation .......................217 Data Mining Approaches to Characterizing EEG Patterns ...................................................218 Analysis of Interstimulation Dynamics ................................................................................222 Remarks on VNS Results .....................................................................................................225 Seizure Detection and Stratification .....................................................................................226 Final Remarks .......................................................................................................................227 LIST OF REFERENCES .............................................................................................................229 BIOGRAPHICAL SKETCH .......................................................................................................247 LIST OF TABLES Table page Table 41. VNS stimulation parameters .......................................................................................133 Table 42. Patient information for epilepsy patients with the VNS implant. ..............................136 Table 43. SVM separation accuracy and seizure information. ...................................................136 10 PAGE 11 Table 44. Mean SVM and LR separation accuracy and patient seizure information. ................141 Table 51. Surrogate analysis results summary for all six patients with the VNS implant. ........176 Table 52. Control patient surrogate analysis results summary. ..................................................177 Table 53. Approximate entropy analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H1 using the ApEnt measure. ...........................................................................................................................187 Table 54. Approximate entropy analysis results for the control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H1 using the ApEnt measure. ................................................................................................188 Table 55. Correlation sum analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H2 using the correlation sum measure. .................................................................................................189 Table 56. Correlation sum analysis results for the control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H2 using the correlation sum measure. .................................................................................................190 Table 57. Mean angular frequency in phase space analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H3 using the measure. ......................................................................................................191 Table 58. Mean angular frequency in phase space analysis results for control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H3 using the measure. ..............................................................................193 Table 59. Shortterm maximum Lyapunov exponent analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H4 using the STLmax measure. .....................................................................194 Table 510. Shortterm maximum Lyapunov exponent analysis results for the control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H4 using the STLmax measure. .......................................................196 Table 61. Classification performance using the first second of each seizure. ............................213 Table 61. Classification performance using the last second of each seizure. .............................213 11 PAGE 12 LIST OF FIGURES Figure page Figure 21. Seizure classification ruling as designated by the Epilepsy Foundation (2008). ........34 Figure 22. VNS pulse sequence. ...................................................................................................49 Figure 23. Closedloop seizure control device using electroencephalogram or electrocorticogram signals as an input to a feature extraction algorithm, which supplies the extracted features to a controller which makes a decision regarding the action of a stimulator. ........................................................................................................55 Figure 31. A 15 second segment depicting the 200 Hz EEG of an absence seizure viewed from channel Fp1F7. .........................................................................................................98 Figure 32. A 15 second segment depicting the spectrogram of an absence seizure viewed from channel Fp1F7. The vertical lines represent the onset and offset of the seizure. ....99 Figure 33. Example angular frequency evolution in phase space. .............................................100 Figure 34. Biclustering result of a toy dataset. The dataset produced three distinct classes. ....100 Figure 41. Rationale for studying EEG patterns which may be associated with the effect of VNS on the brain. ............................................................................................................131 Figure 42. Conceptual EEG dynamics model in threedimensional feature space for testing stimulation parameter configurations in newlyimplanted VNS patients. Adjusting the stimulation parameters results in an altered dynamical state of the brain denoted by the coordinates in threedimensional feature space. The models colored regions relate the EEG dynamical state to its predicted clinical outcome. ...................................132 Figure 43. EEG electrode placement. Electrodes were positioned according to the 1020 electrode placement system which assigns locations proportionally spaced locations (e.g. 10%20%) with respect to the size of the patients head. ........................................133 Figure 44. STLmax class designation for biclustering analysis. ................................................134 Figure 45. Biclustering heatmap of STLmax from A) patient A and B) patient B. ...................135 Figure 46. Mean SVM separation accuracy value across the stimulations for each individual intrastimulation window. ................................................................................................137 Figure 47. VNS output current and the corresponding mean SVM separation accuracy over 24 hours. ...........................................................................................................................137 Figure 48. VNS pulse width and the corresponding mean SVM separation accuracy over 24 hours. ................................................................................................................................138 12 PAGE 13 Figure 49. VNS signal frequency and the corresponding mean SVM separation accuracy over 24 hours. ...................................................................................................................138 Figure 410. SVM Separation accuracy throughout the VNS epoch, averaged across all epochs. Stimulation begins at t=0 seconds. .....................................................................139 Figure 411. Overall mean SVM separation averaged across intraepoch time points and all epochs. .............................................................................................................................139 Figure 412. LR separation quality throughout the VNS epoch, averaged across all epochs. Stimulation begins at t=0 seconds. ..................................................................................140 Figure 413. Overall mean LR AUC averaged across intraepoch time points and all epochs. ..140 Figure 51. Map of EEG electrode location for the VNS patients. The electrodes were positioned according to the 1020 electrode placement system which assigns locations proportionally spaced locations (e.g. 10%20%) with respect to the size of the patients head. ............................................................................................................171 Figure 52. Electrode positions for the control patient from A) an inferior and right view and B) axial slice view of the brain. Red circles indicate focal electrodes (TBa4, TBb6, HR7), blue circles indicate nonfocal electrodes (TLb2, TLb3, TLc2). Images provided for this publication courtesy of the Freiburg Center for Data Analysis and Modeling at the AlbertLudwigs Universitt Freiburg (University of Freiburg), Freiburg, Germany. ..........................................................................................................171 Figure 53. Comparison of pulse width parameter to the fraction of epochs displaying a nonlinear signature in the six patients treated with VNS. The fraction of epochs displaying a nonlinear signature in control patient using the 3minute and 5minute off pseudo stimulation times are represented by the column of six triangles (3 minute off times) and six squares (5 minute off times). ..............................................................172 Figure 54. Patient A surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. .................172 Figure 55. Patient B surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. The red lines indicate seizures. .....................................................................................................173 Figure 56. Patient C surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. .................173 Figure 57. Patient D surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. .................174 13 PAGE 14 Figure 58. Patient E surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. .................174 Figure 59. Patient F surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. .............................................174 Figure 510. The fraction of all interstimulation epochs per channel which rejected the null hypothesis H0 using ApEnt for A) patient A, B) patient B, C) patient C, D) patient D, E) patient E, F) patient F. ............................................................................................175 Figure 511. Control patient (with 5minute artificial stimulation times) surrogate data analysis results over 24 hours for all artificial interstimulation epochs. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. ............................................................................177 Figure 512. Control patient (with 3minute artificial stimulation times) surrogate data analysis results over 24 hours for all artificial interstimulation epochs. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. ............................................................................177 Figure 513. Experimental setup for characterizing the temporal evolution EEG dynamics during interstimulation intervals in patients undergoing VNS therapy for epilepsy. The double head arrows indicate a statistical comparison is made between the EEG feature segments represented by the shaded rectangles. ..................................................178 Figure 514. Patient A temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. ................................................................................................................179 Figure 515. Patient B temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. The red lines indicate seizures. .............................................................180 Figure 516. Patient C temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. ................................................................................................................181 Figure 517. Patient D temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. ................................................................................................................182 14 PAGE 15 Figure 518. Patient E temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. ................................................................................................................183 Figure 519. Patient F temporal evolution of dynamics analysis results for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. ................................................................................................................184 Figure 520. Control patient (with 5minute artificial stimulation times) temporal evolution of dynamics analysis results for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. .............................................185 Figure 521. Control patient (with 3minute artificial stimulation times) temporal evolution of dynamics analysis results for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. .............................................186 Figure 522. Approximate entropy analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H1 using the ApEnt measure. ................................................................................................................188 Figure 523. Correlation sum analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H2 using the correlation sum measure. .................................................................................................190 Figure 524. Mean angular frequency in phase space analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H3 using the measure. ..............................................................................192 Figure 525. Shortterm maximum Lyapunov exponent analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H4 using the STLmax measure. .....................................................................195 Figure 526. ApEnt results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation. ..........................................................................................................................196 Figure 527. Correlation sum results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation. ..........................................................................................................................197 Figure 528. results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation. ........197 15 PAGE 16 Figure 529. STLmax results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation. ..........................................................................................................................198 Figure 61. Approximately 6 seconds of scalpEEG demonstrating the 2.53.5 Hz spikewave discharge that defines an electrographic absence seizure (data provided courtesy of Dr. Gregory Holmes). ...................................................................................210 Figure 62. DTW comparison of two different SWD segments. The top signal is a 300 ms SWD segment. Bottom signal is a 300 ms segment of a different SWD. The DTW distance is about 2.4 x 10. 7 ...............................................................................................211 Figure 63. DTW comparison of a SWD segment with a random interictal segment. Top signal is a 300 ms EEG segment of a SWD. Bottom signal is 300 ms of interictal EEG. The DTW distance is about 5.1 x 10. 7 ...................................................................212 Figure 64. Seizure classification evaluation framework. ...........................................................212 Figure 65. Seizure detection performance for RBF parameter sigma=20 using the first second of each seizure. ....................................................................................................214 Figure 66. Seizure detection performance for RBF parameter sigma=40 using the first second of each seizure. ....................................................................................................214 Figure 67. Seizure detection performance for RBF parameter sigma=80 using the first second of each seizure. ....................................................................................................215 Figure 68. Seizure detection performance for RBF parameter sigma=20 using the last second of each seizure. ....................................................................................................215 Figure 69. Seizure detection performance for RBF parameter sigma=40 using the last second of each seizure. ....................................................................................................216 Figure 610. Seizure detection performance for RBF parameter sigma=80 using the last second of each seizure. ....................................................................................................216 16 PAGE 17 LIST OF ABBREVIATIONS AED Antiepileptic drug ApEnt Approximate entropy DNA Deoxyribonucleic acid DTW Dynamic time warping EEG Electroencephalogram FN False negative FP False positive GCRC General Clinical Research Center IID Independent and identically distributed IRB Institutional Review Board LR Logistic regression PLED Periodic lateralized epileptiform discharge STL max Shortterm maximum Lyapunov exponent SVM Support vector machine SWD Spikeandwave discharge TN True negative TP True positive VNS Vagus nerve stimulation Mean angular frequency in phase space 17 PAGE 18 Abstract of Dissertation Presented to the Graduate School of the University of Florida in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy DATA MINING AND TIME SERIES ANALYSIS OF BRAIN DYNAMICAL BEHAVIOR WITH APPLICATIONS IN EPILEPSY By Michael Andrew Bewernitz May 2008 Chair: Panagote M. Pardalos Major: Biomedical Engineering Epilepsy is a neurological disorder characterized by recurrent seizures. Approximately 30% of patients with epilepsy have seizures that are resistant to antiepileptic drug (AED) therapy. If these patients are unable to undergo epilepsy surgery, they may choose to utilize the Vagus Nerve Stimulator (VNS) implant. The VNS therapy system has been approved by the FDA to electrically stimulate the left vagus nerve for epilepsy treatment. Patients with newly implanted VNS systems undergo an adjustment period of several months involving numerous medical checkups to fine tune the electrical stimulation parameters based on clinical response. This suboptimal adjustment method leaves the patient at risk of seizures and imposes financial burden. Identification of a marker of desired VNS operation would greatly expedite this adjustment process. The utility of noninvasive electroencephalogram (EEG), success of neural state classification research for diagnosis and treatment of neurological disorders, and the potential for realtime application due to advances of computer technology motivate this study. This dissertation outlines data mining approaches involving biclustering, logistic regression, and support vector machines as well as statistical comparisons of a range of relevant EEG dynamical measures for the characterization of electroencephalographic patterns associated with VNS therapy. The preliminary results are consistent with biological processes and clinical 18 PAGE 19 observations. One explanation for the electroencephalographic behavior is that VNS mimics a theorized therapeutic seizure effect where a seizure resets the brain from an unfavorable preictal state to a more favorable interictal state. The preliminary results suggest a connection between the EEG patterns and the stimulation parameters which may require a range of linear and nonlinear measures for adequate characterization. In addition, support vector machines are utilized to create a seizure detection and stratification algorithm in patients with generalized absence epilepsy. The algorithm utilizes dynamic time warping distance and TeagerKaiser energy as the representative EEG features. The algorithm performed slightly better at seizure onset detection than for seizure offset. This is likely due to increased waveform consistency shortly after onset compared to offset. Such an algorithm may benefit clinicians and researchers by providing a means to rapidly annotate EEG signals as well as a means to provide a clinically interesting measure of therapeutic efficacy for drug evaluation studies (e.g. distribution of seizure durations may vary before and after drug therapy, and thus a measure of this distribution may find clinically relevant information which a raw seizure count would miss). A future direction of this project is to test additional EEG feature inputs and assess how the algorithm copes with the challenges presented in online EEG analysis. 19 PAGE 20 CHAPTER 1 INTRODUCTION Recent advances in mathematics provide new tactics for the analysis of complex datasets. These advances provide new options for analyzing and modeling seemingly complex system behavior such as that seen in biological systems. In addition, the rapid growth of computational capabilities in the modern computer provides the possibility for realtime computational analysis of biological datasets. Such scientific milestones have revolutionized the direction of scientific research in many disciplines, among them, the study of epilepsy. In recent decades, a growing body of evidence has surfaced in research reports suggesting the existence of a preictal state has resulted in a great interest in quantitatively characterizing this theorized seizure imminent state. Due to the superior time resolution and large availability of the electroencephalographs, much research has been devoted to characterizing the preictal state in terms of electroencephalogram (EEG) datasets. Advances in the understanding of nonlinear system dynamics have lead to massive breakthroughs for the challenging task of characterizing the dynamics governing the behavior of complex systems. In many instances, these novel system modeling approaches can achieve better results than were previously attainable with standard linear approaches. One major premise for the characterization of neural states is that the dynamics directing brain function are often best examined within a nonlinear deterministic framework (Savit et al., 2003). Such a framework can provide a useful means to analyze systems that that exhibit adaptive behavior and are nonautonomous (both of which are traits of biological systems). For the example of seizure prediction, this method bypasses the explicit underlying neurophysiological processes involved in seizure generation and instead focuses on predicting undesirable neural states (e.g. seizures) by measuring and modeling the temporal progression 20 PAGE 21 of various observable features of brain behavior. Whether predicting seizure or other neural state changes, such features may currently include brain electrical or magnetic field fluctuations, blood flow, neurochemical concentration profiles. Of these measures, electrical activity as measured in EEG data sets is the most commonly used feature for describing neural state in epilepsy. Computational Therapeutic Approaches: a New Frontier in Medical Treatment The computational power and memory storage abilities of modern computational age have revolutionized the way that scientists and engineers approach problems. One of the most exciting achievements of the 20 th century is the invention of the semiconductor transistor, which was followed by a cascade of computational advances throughout the last 50 years. Moores Law is a famous model of the observed growth rate of computational abilities and has remained astonishingly accurate for several decades (Intel Corporation, 2005). The state of modern technology provides modern researchers the ability to not only solve problems that could be not practically be solved a few decades ago, but now we are in a unique position to solve many such problems in realtime applications. While the benefits of such technology are manifesting at an almost alarming pace in every aspect of life, the fields of biology and medicine have capitalized in ways that may have seemed inconceivable only decades ago. Necessity is the mother of invention, and such is the driving force for many of the numerous serendipitous medical discoveries. One prime example is a solution to the many problems plaguing the functionality of hospital bedside cardiac regulation devices. The original device utilized an external bedside machine which regulated the cardiac pacing. Among the many difficulties included impeded patient mobility due to the size and mass of the equipment, alternating current power requirement, as well as skin burns at electrode sites (Nelson, 1993). 21 PAGE 22 The advent of implantable devices forever revolutionized the field of medical treatment when a Swedish group first implemented the previously unheardof idea of utilizing an implantable device for cardiac pacing (Nelson, 1993). The success of cardiac pacemakers opened the eyes of physicians and engineers alike that were seeking new solutions to the challenge of improving the state of medical treatment. The cardiac pacemaker was highly sophisticated solution to the treatment of damaged and diseased hearts and helped pave the way for a revolution in medicine; the use of computational devices (implantable or bedside) to help regulate the physiology of patients afflicted with some chronic condition. This new engineering direction added numerous challenges such a biocompatibility and safety issues, as well as new concepts (e.g. designing implantable devices with the expectation that the treatment device is likely to or guaranteed to fail in lifetime of the patient). In recent years, microelectromechanical devices (MEMs) have been able to strongly capitalize on the advancements of computers. As computers became smaller, faster, and more efficient, savvy engineers were able to capitalize on the new options available to them. For example, the combination of MEM sound sensors, processors, and transcutaneous transmitters provides the possibility of mimicking the role of the cochlea in patients with a specific cause of hearing impairment (Chapin and Moxon, 2001). While the device is far from being as precise or accurate as the original brain tissue, such a device helped pioneer a new research direction for augmenting impaired brain function. Additionally, retinal implants are being heavily researched to compensate for certain types of blindness (Schanze et al., 2007). The device is able to mimic some of the tasks of a 22 PAGE 23 function retinal including photo detection and the directing preprocessing phase output to the optic nerve. Despite the astonishing milestones of progress in these brain machine interfaces (BMI), these two implantation devices are still being heavily researched. Another intensely researched field of BMI aims to integrate the state of the art computational technology combined with the modern marvels of neuroscience in order to overcome certain types of paralysis (Nicolelis et al., 2001; Kim et al., 2007). Such an apparatus provides the ability of the brains muscle movement signals to execute actions in a prosthetic limb. The above BMIs face numerous challenges which must be overcome before such devices can become a mainstay of treatment. For one, adequate input data acquisition is massive challenge in and of itself. All such devices assume that obtaining samples of the brains electrical signals can serve as sufficient inputs (as the specific knowledge of neurotransmitter chemistry and exact neuronal connectivity cannot currently be obtained as successfully as the electrical signals can be recorded). Also, while our understanding of the roles of the secondary and primary motor cortices in the planning and execution of motor movements have sufficed to provide exciting preliminary results for such BMIs, the time and spatial resolution of such recordings required for optimal external limb control remains uncertain. In addition, one massive challenge of itself is to extract useful features from such signals in order to serve as the proper inputs to the underlying model governing the action of such a device. Furthermore, the proper choice of model is a field of heavy research in and of itself. As is expected, the available models of brain function have numerous advantages and disadvantages compared one another that can depend on the particular states of the brain to be modeled, the range of brain states considered, quality of recordings, feature extraction methods and so on. 23 PAGE 24 While the state of the art of neuroscience has made progress relevant to the development of BMIs, there is still much room for improvement in understanding the basic and advanced mechanisms of normal brain function as well as impaired brain function in various neurological disorders. While the impaired neural functions of interest in the previously described BMI applications may in some cases seem rather straight forward, the specific neural impairment processes of some other neurological disorders are at the present moment less explicitly understood. For such disorders, such as epilepsy, the extraction of suitable biomarkers for any type of advanced therapeutic scheme is hampered by the apparent mysterious nature of the disorder. Epilepsy is a disorder that not only has symptoms that are not fully understood (e.g. the specific cause and purpose of an epileptic seizure), but also the occurrence of seizures often does not appear to follow any known behavioral pattern with a sufficient degree of accuracy. There is much room for improvement. Establishment of Neural States in Epilepsy Extensive research has been conducted in the last four decades with the focus of unveiling and modeling the mechanisms that lead up to a seizure. It has been said that only approximately 3% of epilepsy cases present seizures that are initiated by some external stimulus whereas for the vast majority of patients there are no such clear events associated with seizure initiation (Le Van Quyen et al., 2001). However, there is a large body of clinical evidence suggesting that seizures are preceded by a physiologic state change that occurs prior to seizure onset. Documented clinical changes preceding a seizure include increase in heart rate (Delamont et al., 1999; Novak et al., 1999; Kerem and Geva, 2005), cerebral blood flow (Weinand et al., 1997; Baumgartner et al., 1998), the availability of oxygen (Adelson et al., 1999), magnetic resonance imaging of the blood oxygenleveldependent signal (Federico et al., 24 PAGE 25 2005) as well as changes visible in single photon emission computed tomographic patterns (Baumgartner et al., 1998). Thus, one of the most profound discoveries in this field of research is postulation of a physiologic preseizure state (Mormann et al., 2007). This theory is supported by a large volume of documented physiologic changes occurring prior to seizure onset within and outside of the brain. This transition from a normal state into a preseizure or preictal state is one of the major theories regarding seizure initiation that has affected the direction of epilepsy research. On a neuronal level, the preictal state results in an abnormal synchronized bursting involving large populations of neurons in various brain structures. Depending on the type of epilepsy, these discharges can begin locally and possibly spread to various regions of the brain or can begin multiple regions nearly simultaneously. Dynamical Disorders in Neurology The epileptic disorder exhibits traits similar to a class of diseases termed dynamic diseases which demonstrate particular complex behavior patterns that evolve over time. Specifically, these dynamic diseases have been broadly described as a class of diseases which undergo a temporal disruption of underlying physiological control mechanisms leading to period of abnormal dynamical behavior (Mackey and Glass, 1977; Mackey and an der Heiden, 1982; Milton and Mackey, 1989; Belair et al., 1995; Milton and Black, 1995; Milton, 2000; Lopes Da Silva et al., 2003; Colijn and Mackey, 2005). Examples of these phenomena include the oscillation of blood cell populations in hematological diseases (Colijn et al., 2006), tremor in Parkinsons Disease (Beuter and Vasilakos, 1994), as well as several neurological disorders such as epilepsy, migraine, and multiple sclerosis (Milton and Black, 1995). Within the perspective of control mechanisms (e.g. feedback or feed forward control systems), dynamical diseases can be viewed as an undesirable alteration of a standard biological control scheme (Mackey and Glass, 25 PAGE 26 1977; Mackey and an der Heiden, 1982; Milton and Mackey, 1989; Belair et al., 1995; Milton and Black, 1995; Milton, 2000; Lopes Da Silva et al., 2003). Such dynamical disorders often undergo state transitions that bear resemblances to bifurcations in mathematical systems, for example. The overall significance of identifying dynamic diseases is that it may be possible to develop therapeutic approaches based on the manipulation of the identified critical control parameters (Mackey and an der Heiden, 1982; Milton and Black, 1995). Numerous studies present models utilizing linear and nonlinear dynamical EEG time series analysis measures to model the transition into a seizure (Iasemidis and Sackellares, 1991; Iasemidis et al., 1993; Lehnertz and Elger, 1995; Casdagli et al., 1996; Lehnertz, 1999; Le Van Quyen et al., 2001; Osorio et al., 2001; Iasemidis et al., 2003, 2004; Chaovalitwongse et al., 2005). Often the longterm goal is to utilize these measures to serve as inputs for a dynamical disease model used in a closedloop therapeutic control device (Iasemidis et al., 2003; Good et al., 2004, 2005; Fountas and Smith, 2007). Thus, if a seizure represents a period of aberration in a dynamical epileptic disorder which is characterized by nonlinear EEG measures such as STLmax (Iasemidis et al., 2000), then nonlinear dynamical measures (such as STLmax) could conceivably provide a useful framework for characterizing the effect of therapeutic intervention (Good et al., 2004, 2005; Ghacibeh et al., 2005). Aside from such practical applications, quantitative EEG analysis from a nonlinear dynamical framework has also helped provide some novel insight towards defining a physiological role of seizures in epileptic disorders. For example, one theory states that a seizure is the manifestation of the brains mechanism for resetting the brain when it enters an undesirable state. Such a state has been characterized by an unhealthy similarity in the rate of information production among critical brain sites, a process referred to as dynamical 26 PAGE 27 entrainment (Iasemidis et al., 2004). Physiologically, such a resetting effect may follow a proposed therapeutic mechanism similar to that of ECT induced seizures (Fink, 2000; Gwinn et al., 2002; Taylor, 2007). The theorized existence of neural states that are indicative of the current status of the epileptic disorder forms the basis for many modelbased seizure control therapy research projects. A common belief of researchers in this field is that a therapeutic dosage of drug or electrical stimulation can be applied at the proper location of the central nervous system and at the proper time to mitigate and possibly prevent seizure occurrence. In essence, this line of therapy embraces a philosophy that a welltimed, minor therapeutic action in the proper location will abort a seizure by means of fulfilling the therapeutic action for which the seizure was intended. Much like the cardiac pace maker described earlier, a brain pacemaker is becoming more of a realistic possibility (Savit, 2003) for providing a means to dispense localized electrical stimulation or drug dispensing treatment on demand when preictal transition state changes are detected (Stein et al., 2000; Theodore and Fisher, 2004; Good et al., 2004, 2005; Morell, 2006). Objectives and Contributions of this Dissertation A team of leading scientists, health care providers, and leaders of voluntary health organizations came together to discuss what it would take to find a cure for epilepsy in March, 2000. The milestone WhiteHouse initiated conference, "Curing Epilepsy: Focus on the Future," was sponsored by the National Institute of Neurological Disorders and Stroke in collaboration with the American Epilepsy Society, Citizens United for Research in Epilepsy, Epilepsy Foundation, as well as the National Association of Epilepsy Centers. The conference stressed the importance of scientists throughout the nation to investigate methods of studying and treating 27 PAGE 28 seizures. The conference produced a national agenda for epilepsy research which has served as a community guide towards a cure. Since then, the epilepsy research community has progressed substantially in updating the research benchmarks to be aligned with current research developments. As a result, a primary goal of the 2007 conference was to assess the original benchmarks and discuss new research directions. The attendees voted on which areas were most promising, as well as those in need of attention. The Epilepsy Benchmark Stewards gathered in October 2007 to finalize a hierarchy of epilepsy research benchmarks. Of particular interest to this dissertation are the following specific benchmarks: Develop valid screening strategies and biomarkers and surrogate markers (e.g., genetic, pharmacogenomic, electrophysiologic, imaging, biochemical) to identify patients who are likely to respond to, or develop adverse effects from specific therapies. Develop higherthroughput costeffective models for screening pharmacotherapies for specific types of epilepsy. Optimize existing therapies The main goal of this dissertation is to extract useful features from the EEG signal of patients afflicted with epilepsy in order to further the understanding of the disorder and work towards improvements to existing therapies. The first portion of this research addresses the desire to identify EEG markers of optimal VNS therapy for the purpose of expediting the parameter adjustment phase in newlyimplanted patients. The final chapter introduces a novel approach to seizure detection and stratification algorithm which may provide a useful tool for evaluation drug efficacy. Organization of Chapters The research presented in this dissertation is organized into seven chapters. Chapter one provides an overview of the document. The overview consists of a brief introduction to the field 28 PAGE 29 of quantitative EEG analysis in epilepsy as well as the scope of research presented in this dissertation from the context of federallyestablished epilepsy research guidelines. Chapter two describes an extensive overview of various epileptic disorders, symptoms, diagnosis, and a range of relevant clinical and biological information. In addition, an overview of diagnostic tools and current treatment modalities is presented as well the direction of future treatment research. Chapter three overviews the broad range of methods utilized in quantitative EEG analysis. The described methods are broadly classified as time series analysis and data mining methods. Relevant mathematical theory is and biological interpretations in experimental situations are explained. Chapter four begins with a description of epilepsy from a dynamical disorder perspective and outlines some key EEG data mining analysis methods applied within this framework. Based on these observations from scientific literature, the aforementioned dynamical EEG analysis methods are employed to study the effect of vagus nerve electrical stimulation therapy in order to characterize the relationship of the stimulation parameters with the EEG behavior in terms of dynamical measures. The results are discussed in terms of their relationship to relevant clinical research observations and the underlying biological processes. The work described in chapter four is has been published in three journal articles: Biclustering EEG data from epileptic patients treated with vagus nerve stimulation, authored by Stanislav Busygin, Nikita Boyko, Panos Pardalos, Michael Bewernitz, and Georges Ghacibeh (Busygin, 2007). Quantification of the Impact of Vagus Nerve Stimulation Parameters on electroencephalographic Measures with authors Michael Bewernitz, Georges Ghacibeh, Onur Seref, Panos Pardalos, ChangChia Liu, Basim Uthman (Bewernitz, 2007). "A Data Mining Approach to the Investigation of EEG Biomarker Existence for Vagus Nerve Stimulation Therapy Patients", with authors Nikita Boyko, Michael Bewernitz, 29 PAGE 30 Vitaliy Yatsenko, Panos Pardalos, Georges Ghacibeh, Basim Uthman, submitted to Computing and Optimization in Medicine and Life Sciences Vol. 3, (Boyko et al., 2008). Chapter five provides additional quantitative EEG analysis in patients undergoing VNS therapy for epilepsy. This chapter closely examines the interstimulation EEG dynamics using numerous EEG dynamical measures commonly applied in neural state classification studies. Specifically, this chapter assesses the nonlinearity of EEG dynamics and characterizes timedependent dynamical behavior and compares these features to stimulation parameters. The results are discussed in the context relevant clinical research findings as well as relevant physiologic processes. The potential application of such results for use in realtime seizure control applications and rapid parameter tuning apparatus is presented. A paper related to these interstimulation dynamics studies was published under the title Optimization of epilepsy treatment with vagus nerve stimulation with authors Basim Uthman, Michael Bewernitz, ChangChia Liu, and Georges Ghacibeh (Uthman et al., 2007). Chapter six begins with an introduction into generalized absence epilepsy. A novel seizure detection and stratification algorithm is presented as a means to help physicians and researchers rapidly annotate EEG signals as well as provide online diagnostic tools. In particular, such a seizure stratification algorithm may provide a clinically interesting measure of therapeutic efficacy for drug evaluation studies (e.g. the distribution of seizure duration distribution before and after drug therapy may provide clinically relevant information which a raw seizure count would miss). A manuscript related to this work was published under the title Support vector machines in neuroscience with authors Onur Seref, O. Erhun Kundakcioglu, and Michael Bewernitz (Seref et al., 2007). 30 PAGE 31 Chapter seven summarizes the findings of this dissertation. Concluding remarks regarding the overall significance of the findings are discussed. Future research directions in light of these results are presented. 31 PAGE 32 CHAPTER 2 AN OVERVIEW OF EPILEPTIC DISORDERS AND EPILEPSY RESEARCH DIRECTIONS Introduction The term epilepsy is derived from the Greek word epilamvanein which means to be seized, to be attacked, to be taken hold of. This disorder has been well documented throughout historical texts for thousands of years in numerous civilizations. Ancient Greeks referred to people being seized and having an attack as if the person were under the influence of a supernatural force. This idea comes from the ancient notion that disease was a form of punishment from the gods or evil spirits (Engel, 1989). These descriptions likely refer to the abrupt, complex timing of seizure onset and how the symptoms could be described as almost a supernatural seizing of the individual for certain types of seizure. Hippocrates was the first person documented as having suggested that epilepsy was a disorder of the brain around 400 B.C. (Parker and Parker, 2003). Epilepsy is not a disease, though, but rather a symptom of a disorder of the brain. Normally, the tens of billions of brain cells making up the brain communicate with one another via small bursts of electrical activity. An unexpected, erratic electrical discharge of a group of brain cells is referred to as a seizure. A seizure can be brought on by a variety of insults such as toxins, drugs, metabolic disturbances, or trauma, flashing lights, or hyperventilation (Wilner, 2003). Such a provoked seizure is separate from Epilepsy, which is a disorder distinguished by recurrent seizures (Lothman et al., 1991). The epileptic condition can arise from numerous causes. Typically, the common element in all causes of epilepsy are events that result in a disturbance of neuronal functionality such as extreme illness, chemical or physical brain damage, or abnormal brain development resulting from genetic or other triggers (Parker and Parker, 2003). Specific brain features resulting from 32 PAGE 33 such brain alterations that could be responsible for epilepsy include altered neuronal connectivity, excessive levels of excitatory neurotransmitters, deficiencies of inhibitory neurotransmitters, or possibly a combination thereof. It has also been observed that the brains attempts to repair itself after injury can lead to irregular nerve connectivity patterns which eventually lead to epilepsy (Parker and Parker, 2003). Recent estimates of worldwide epilepsy prevalence for a wide range of age groups indicated between 3 and 8 reported cases of epilepsy per 1000 people (Shorvon et al., 2004). The hallmark of epilepsy is recurrent seizures caused by the sudden development of synchronous neuronal firing. Seizure symptoms can include uncontrollable shaking, loss of awareness, visual and aural hallucinations, phantom odors, and other sensory disturbances depending on the location and spread of electrical activity in the brain (Weaver, 2001; Wilner, 2003). Electroencephalogram (EEG) recordings show that these discharges begin either locally in one or more portions of a cerebral hemisphere or simultaneously in both cerebral hemispheres (Binnie et al., 1997; Niedermeyer et al., 1993). These seemingly unpredictable seizures can cause a variety of motor symptoms and have a major effect on the patients quality of life by imposing restricted driving privileges, adverse effects on social and career opportunities, selfesteem, education, and psychiatric issues (Goldstein and Harden, 2001; Manford, 2003; Wilner, 2006). In addition, recurrent seizures may cause progressive neuronal damage, leading to impaired memory and cognition. A 1995 study estimated that epilepsy imposed an economic burden of $12.5 billion in associated health care costs and losses in employment, wages, and productivity in the U.S. (Begley et al., 2000). 33 PAGE 34 Classification of Seizure Types All types of seizures are broadly classified depending on whether the seizure arises in a restricted portion of the brain within one hemisphere or if the onset involves both hemispheres (Shorvon et al., 2004). Seizures that do not fit into these categories are referred to as unclassified. Figure 21 outlines a basic framework for seizure classification as designated by the Epilepsy Foundation (2008). Figure 21. Seizure classification ruling as designated by the Epilepsy Foundation (2008). Partial Seizures Partial seizures are those that occur in a localized region of the brain known as a focus. Partial seizures can be roughly broken down into simple partial, complex partial, and secondary generalized seizures. A simple partial seizure may materialize with rhythmic twitching of a limb, cessation of speed, strange sensations in the body, or hallucinations (Shorvon et al., 2004). The particular symptoms vary from patient to patient and depend on the region of the brain in which the seizure 34 PAGE 35 is occurring. Simple partial seizures begin suddenly, cease quickly, and do not involve an impairment of consciousness. In a complex partial seizure a person will temporarily undergo an impairment of consciousness are often preceded by a premonitory sensory or psychic aura (Shorvon et al., 2004). During the seizure the person appears unresponsive and may make purposeless limb movements called automatisms. Automatisms can include such behavior as eye blinks, twitches, chewing motions of the mouth, and possibly walking in a circular pattern (Parker and Parker, 2003). Patients can often be amnesic about the events occurring in complex partial seizures. Some partial seizures can spread to both hemispheres resulting in tonic (muscle tensing) and clonic (rhythmic muscle twitching) symptoms. This type of spreading of seizure activity after focal onset is referred to as secondary generalization. These seizures were once referred to as grand mal seizures, though this terminology is now discouraged. Conversely, atonic seizures produce a sudden reduction in muscle tone. Generalized Seizures Generalized seizures refer to seizures initiate in both brain hemispheres simultaneously. These seizures are often accompanied with impaired consciousness. Two important types of generalized absence seizures are absence seizures and status epilepticus. Absence seizures Absence seizures are a type of generalized seizure where seizures are initiated by an abrupt rapid onset as well as an abrupt rapid offset. These seizures have an off and on nature where the duration of the seizure is rarely longer than 30 seconds in duration and most often less than 5 seconds in duration (Shorvon et al., 2004). Often the patient will not provide explicit symptoms of having experienced a seizure, but rather may continue the behavior or movement pattern that 35 PAGE 36 was active at seizure onset. The impaired consciousness combined with a general amnesia about the experience means that absence seizures can interfere with schooling and may even be misinterpreted as daydreaming. Status epilepticus Status epilepticus is a serious, potentially fatal condition in which seizures persevere for significantly longer durations than other seizure types. One of the challenges in diagnosing status epilepticus is to provide a definition that is theoretically sound as well as useful in the emergency room as neuronal damage can occur after sufficient time (Costello and Cole, 2007). In addition to the brain, prolonged seizures can damage to numerous body systems including heart, lung, and kidney tissue (Wilner, 2003). A recent review article suggests a hybrid of operational definitions including 5 minutes of persistent, generalized, convulsive seizure activity or two or more distinct seizures between which there is incomplete recovery of consciousness (Lowenstein et al., 1999) where the seizure activity also persists after sequential administration of appropriate doses of appropriate first and second lineAEDs (Costello and Cole, 2007). Nonconulsive status epilepticus (NCSE) refers to the cases of status epilepticus associated with ictal EEG activity yet without convulsive motor activity (Uthman and Bearden, 2008). Patients in the NCSE state may appear to be in a confused stuporous state or a comatoselike state (Costello and Cole, 2007). While status epilepticus can take on many electroencephalographic characteristics, clear cut nonconvulsive status epileptic cases will present the following properties: Frequent or continuous focal electroencephalographic seizures demonstrating changes in amplitude, frequency, or localization Frequency or continuous generalized spike and wave discharges (SWDs) in patients whom do not have a history of epilepsy 36 PAGE 37 Frequent or continuous generalized SWDs which show significant amplitude or frequency differences in relation to previous SWDs (in patients with a history of epileptic encephalopathy) Periodic lateralized epileptiform discharges (PLEDs) in patients which have become comatose after convulsive status epilepticus (Korff and Nordli, 2007). The challenge of treating NCSE cases is that both the electroencephalographic characteristics and the clinical symptoms can appear very similar to those exhibited by metabolic disorders. For example, cases of positive NCSE diagnosis have been reported where patients initially demonstrated extended periods of diffuse rhythmic delta activity before any ictal waveforms were presented (Uthman and Bearden, 2008). Triphasic waves can be present in both NCSE as well as the nonepileptic encephalopathies such as metabolic encephalopathies, though triphasiclike waves must be highly persistent to be considered as possibly arising from NCSE (Kaplan and Birbeck, 2006). Currently, one of the most reliable diagnostic strategies is to administer a dosage of a benzodiazepine class drug and to observe any changes in the EEG signal. Though a small portion of patients (~15%) will be resistant to benzodiazepine therapy, the drug will often result in improved mental status and suppression of ictal waveforms in patients that were undergoing NCSE (Shneker and Fountain, 2003). The absence of clinical improvement after benzodiazepine dosage does not necessary rule out NCSE. Epilepsy Treatment Surprising as it may be the plethora of modern medical imaging technologies that have developed in the recent decades, though useful for supplementing available information about the brain, are no substitute for a medical imaging modality invented over 80 years ago. EEG 37 PAGE 38 recordings are relatively cheap to acquire, relatively safe, are often noninvasive (except in more severe epilepsy cases), and provide exceptional time resolution. The Electroencephalogram as a Diagnostic Tool EEG recordings as well as other related electrophysiological measures are the most commonly used diagnostic tools for the treatment of epilepsy. Though numerous people made significant technological contributions, Richard Caton is established as the first physician to observe the brains continuous spontaneous electrical activity in 1875 (Goldensohn, 1997). Hans Berger is credited as the father of electroencephalography due to his 1932 report containing four photographic EEG segments of a patients postictal recovery (Goldensohn, 1997). The measurement of the brains electrical field potentials via EEG is the cornerstone for epileptic diagnosis and classification of epileptic seizures (Speckmann et al., 1997). Field potentials are detectable in the space surrounding nervous system tissue. Field potentials arise from the changes in membrane potential of neurons and glial cells. An excitatory post synaptic potential (EPSP) occurs when an excitatory afferent fiber is stimulated and the resulting inflow of cations (e.g. sodium) lead to a membrane depolarization. The spread of the membrane depolarization results in an intracellular current as well as an extracellular current. The extracellular current induces the field potential which is perceived by a nearby electrode as a negative charge (due to the influx of cations) and a distant electrode perceives a positive charge (due to the out flux of cations) (Speckmann et al., 1997). A similar yet opposing process occurs for an inhibitory post synaptic potential (IPSP), where the stimulation of an inhibitory afferent fiber induces an outflow of cations perceived by a nearby electrode as a local positive charge. Field potentials generated by epileptic processes exceed the potentials generated by nonepileptic processes because the epileptic activity is highly synchronized (and thus have relatively elevated amplitude due to a summation effect). Furthermore, experiments have 38 PAGE 39 demonstrated a close temporal relationship between the paroxysmal depolarization of a neuron in superficial cortex and EEG sharp waves (an indicator of epileptic activity) during the development of an epileptic focus in a seizure model (Speckmann et al., 1997). Due to the large degree of synchrony in epileptic outbursts the behavior of this neuron can be extrapolated to provide a suitable representation of the epileptic neuronal network. Though sharp waves have an important role in epilepsy diagnosis, there are numerous types of epilepsy with differing characteristic EEG patterns. For example, absence seizures are often associated with 3hz generalized spike and wave patterns yet tonicclonic seizures are often associated with a variety of rhythms of generalized spiking and polyspike bursting (Chabolla and Cascino, 1997). Beyond the handful of examples of epileptiform EEG patterns listed here, there are numerous EEG properties that the trained electroencephalographer takes into consideration before arriving at a diagnosis. Such diagnostic details are beyond the scope of this dissertation, however, an excellent overview can be found in Chabolla and Cascino (1997). Once the proper diagnosis is made, there are numerous methods used to treat epilepsy. The methods are treating a specific cause (if one can be identified), avoiding precipitants of seizures (if any can be identified), antiepileptic drugs (AED), behavior modification, surgery, electrical stimulation, and diet control (Oxley and Smith, 1991). Use of AEDs is the most common form of treatment. Antiepileptic Drugs AEDs can treat seizures in numerous ways. Some AEDs make brain cells less excitable. Others make brain cells less likely to pass messages. Still other AEDs increase the amount of a inhibitory neurotransmitters such as gamma amino butyric acid (GABA) (Oxley and Smith, 1991). One way to classify AEDs is by their main therapeutic mechanism (though there are some drugs that utilize numerous mechanisms and others may even have unknown mechanisms). 39 PAGE 40 From this organizational framework, the main groups include sodium channel blockers, calcium current inhibitors, gammaaminobutyric acid (GABA) enhancers, glutamate blockers, carbonic anhydrase inhibitors, hormones, and drugs with unknown mechanisms of action (Ochoa and Riche, 2007). While an indepth review of antiepileptic drugs is beyond the scope of this dissertation, an executive summary of some of the basic antiepileptic drug categories will be outlined. Sodium channel blockers This class of drug is well characterized. As the name implies, sodium channel blocking drugs inhibit sodium channel operation which prevents the affected neuron from depolarizing and thus inhibits neuronal firing (Ochoa and Riche, 2007). Prominent examples of sodium channel blockers include carbamazepine, lamotrigine and zonisimide. Lamotrigine is a drug commonly used to treat absence seizures. GABA agonists, reuptake inhibitors, and transaminase inhibitors aminobutyric acid (GABA) is an inhibitory neurotransmitter and popular target for antiepileptic drug action. This is because there are numerous ways to enhance the functionality of the GABA system, many of which demonstrate a clinically useful antiepileptic effect. GABAA receptors control the influx of Clions and GABAB receptors are connected with potassium channel function (Ochoa and Riche, 2007). The effect of GABA can be enhanced several ways: direct binding to GABAA receptors, blocking presynaptic GABA uptake, inhibiting the metabolism of GABA by GABA transaminase, increasing the synthesis of GABA (Ochoa and Riche, 2007). Benzodiazepines (BZDs) are an important class of shortacting drugs whose anticonvulsant effect is due to binding with GABAA receptors, where they then 40 PAGE 41 enhance inhibitory neurotransmission (Shorvon et al., 2004). BZDs are commonly used in epilepsy treatment as well as anesthetic applications. They are most often used for treating status epilepticus and clusters of seizures rather than long term treatment. For example, the BZD midazolam has demonstrated effectiveness the treatment of convulsive status epilepticus in patients for whom phenytoin, and/or phenobarbital had failed (Kumar and Bleck, 1992). One difficulty in with this drug class is the sedative effects which are a major factor limiting the use of benzodiazepines in long term seizure therapy. Thus, benzodiazepines tend to be used most often for acute seizure treatment. Glutamate blockers Glutamate is more of the most important excitatory neurotransmitters in the brain (along with aspartate). The glutamate neurotransmission system is highly intricate and the major classification scheme for ionotropic glutamate receptors is to name them after the agonist that activates the binding site (e.g. AMPA, kainite, and NMDA). AMPA and kainite sites control channels that pass sodium and a small amount of calcium. NMDA sites control channels that pass large amounts of calcium in addition to sodium (Ochoa and Riche, 2007). Felbamate and Topiramate are examples of antiepileptic drugs that mitigate glutamate excitatory transmission. Pharmacologicallyresistant epileptic seizures AED therapy can be very effective in preventing seizures. Primary generalized epilepsy and benign partial epilepsy are two classes of epilepsy that respond well to AEDs. Patients with temporal lobe epilepsy are not so fortunate, though. These unfortunate people can usually expect to take AEDs their entire life. The odds of gaining complete control over temporal lobe epilepsy seizures are not as good as primary generalized or benign partial epilepsy (Oxley and Smith, 1991). Approximately 30% of patients with epilepsy have seizures that are resistant to AED therapy, and must resort to alternative therapies (Theodore and Fisher, 2004). 41 PAGE 42 Epilepsy Surgery Surgical treatment may be considered in extreme cases where the patient does not achieve adequate benefit from AED therapy (Engel et al., 1993). The mean duration of inpatient hospital stay for presurgical EEG monitoring ranges from 4.7 to 5.8 days and costs over $200 million each year (Begley et al., 2000). In order to be a candidate for surgery, the first criterion is that the patient must have seizures arising from a single seizure focus in the brain. In addition, the excision procedure cannot be performed on brain regions that are essential for normal functioning of the patient (Roper, et al., 1993; Velasco et al., 2000; Durand and Bikson, 2001). Even if as many as 50% of these patients were to benefit from surgical resection (an optimistic estimate), many patients still require new therapeutic approaches (Theodore et al., 2004). Gene Therapy Gene therapy is an innovative approach to providing antiepileptic therapy to patients with pharmacologically resistant seizures. From the perspective of treating epilepsy by correcting an imbalance in excitatory and inhibitory neuronal transmission, a vector can be used to insert neuropeptide genes in certain brains which lead to intracranial creation of therapeutic peptides. For example, the neuropeptide Y gene inserted into rat hippocampus with adenoassociated viral vectors resulted in reduced generalization, delayed seizure initiation, and provided neuroprotection in a rat seizure model (Noe et al., 2007). Additionally, the lentivirus may be used as a vector, or to graft genetically engineered cells which produce therapeutic substances (Vezzani, 2004). Though these as well as other results are very promising, gene therapy for epilepsy treatment is still at the preclinical research stage. Electrical Stimulation Therapy Brain stimulation is becoming one of the main alternative therapeutic approaches for patients whom are suffering for pharmacologically intractable epilepsy and are not surgical 42 PAGE 43 candidates. While the force can have a strong influence on the weakminded (Kenobi, 1977), conventional electrical stimulation therapy remains a more widelyused form of brain stimulation. Numerous forms of electrical stimulation therapy have been utilized for the treatment of epilepsy. One such method of brain stimulation is membrane polarization by uniform direct current (DC) electric fields. This form of stimulation comes from the basic principle that electrical current can generate an electric field when then results in generation of electric current. Specifically, electric fields generated by the nervous system can directly modulate the activity of neurons and often can recruit neighboring cells. DC electric fields have a unique property compared to other stimulation paradigm in that they can cause either excitation or inhibition of neuronal activity depending on the orientation of the field with respect to dendrite. (Durand and Bikson, 2001). While DC field stimulation utilizes a relatively low current amplitude (only a few microamperes), there are several drawbacks to this method: 1) irreversible chemical reactions can result the dc field which often result in tissue and/or electrode damage; 2) the efficacy of stimulation is highly sensitive on DC field orientation; 3) either excitation or inhibition can be induced depending cell location and orientation (thus, improper DC field orientation can induce the opposite of the intended effect); 4) the termination of the DC pulse induces an excitation which results in a rebound of spontaneous activity; and 5) DC fields application must typically be applied for the entire duration of an ictal event for desired efficacy and thus may require long pulses (Durand and Bikson, 2001). Low frequency stimulation paradigms (e.g. stimulation frequencies less than 10 Hz) provide robustness over DC electric field stimulation. Unlike DC field stimulation, low frequency stimulation is not orientation dependent and thus its effects are less variable. In 43 PAGE 44 addition, lowfrequency and single pulse stimulation have longlasting effects which remain long after the duration of the pulse. This after effect helps minimize the electrochemical damage as well as the amount of energy required for stimulus. Periodic low frequency stimulation applied via transcranial magnetic stimulation (TMS) is a noninvasive method to induce electric fields in the brain. A study investigating the susceptibility of amygdala for kindling in rats demonstrated a 55% higher threshold for the induction of epileptic after discharges two weeks after a single TMS train (120A/s, 20 Hz for 3 s) (Ebert, 1999). The mechanism underlying this type of antiepileptic effect for lowfrequency stimulation is unknown, but suspected to be longterm depression (LTD). LTD is a persistent decrease in synaptic strength caused by low frequency (e.g. 1 Hz) stimulation (Purves et al., 2004). Lowfrequency stimulation paradigms for establishing LTD could decrease neuronal firing rate which may in an antiepileptic effect (Durand and Bikson, 2001). Deep brain stimulation Deep brain stimulation (DBS) attracted great attention in 1996 for its use in the treatment of tremor related to Parkinsons disease and essential tremor (Gross, 1994). DBS offers several advantages over PNS (e.g. vagus nerve) stimulation. Specifically, electrodes implanted in the brain can directly stimulate the targeted structure with far greater accuracy than PNS stimulation. Also, the coarse action of PNS stimulation risks activation of afferent (such as pain or sensory) and efferent fibers (such as those modulating cardiovascular and abdominal visceral functions) (Durand and Bikson, 2001). Naturally, a major DBS disadvantage is that the implantation of intracranial electrodes has a greater extent of invasiveness and associated risk than PNS stimulation. There are presently four general hypotheses explaining the therapeutic mechanism of DBS: 1) stimulationinduced alterations in the activation of voltagegated currents block neural output 44 PAGE 45 near the stimulating electrode; 2) indirect inhibition of neuronal output by means of activation of axon terminals that make synaptic connections with neurons near the stimulating electrode; 3) synaptic transmission failure of the efferent output of stimulated neurons as a result of transmitter depletion; 4) stimulationinduced disruption of pathologic network activity (McIntyre et. al, 2004). Additional research utilizing microdialysis, neural recordings, modeling, and functional imaging will likely need to be conducted in order to fully characterize the effects of DBS (McIntyre et. al, 2004). Since DBS therapy relies on accurate positioning of electrodes, surgical implantation is assisted with several guiding tools. DBS electrodes are implanted into the brain using stereotaxic methods, MRI targeting, recording of extracellular unit activity, and electroencephalographic monitoring. Some typical stimulation parameters are 110 volts, 90 s pulses in trains of 100165 Hz, running either continuously or in intervals of 1 minute on and 5 minutes off (Theodore and Fisher, 2004). Clinically useful and tolerable stimulation parameters can vary from patient to patient as well as across different sections of the brain. Thus, a common strategy of DBS is to exploit the natural behavior of various brain structures in a manner to most effectively produce an antiseizure effect. Cerebellum Cerebellar stimulation can be performed to capitalize on the inhibitory outflow which is present in nearly all patients. Anterior stimulation decreased hippocampal formation discharges. However, cerebellar stimulation has had variable effects in animal models, which may have been related to variable stimulation parameters (Theodore and Fisher, 2004). An interesting phenomenon discovered in controlled DBS studies is the placebo effect. For example, in a controlled study of cerebellar DBS involving 14 control patients, 2 of the 14 patients showed improvements in seizure frequency (Hodaie et al., 2002). This placebo effect, defined as a 45 PAGE 46 reduction (or abolition) of symptoms with insertion of DBS alone, might be due to an initial lesioning resulting from the implantation procedure. Subcortical structures Interest in subcortical stimulation comes from its widespread, nonspecific, anterior and intralaminar nuclear connections to the mesial frontal, temporal, and limbic structures. In addition, it demonstrates progressive recruitment of substantia nigra, subthalamic nucleus, and midline thalamic nuclei in animal models of epilepsy. Stimulation of the subthalamic nucleus, anterior, thalamus, and substantia nigra have been shown to inhibit limbic seizures in animal models of epilepsy (Theodore and Fisher, 2004). In addition, stimulation of the basal ganglia structure may modify propagation of seizures (Deransart et al., 1998). Some of the most important subcortical structures will now be discussed. Caudate nucleus The effect of caudate nucleus stimulation has demonstrated antiepileptic effects in an aluminumhydroxide seizure focus model, though the efficacy is highly dependent on stimulation frequency (Theodore and Fisher, 2004). An inhibitory seizure protection effect was demonstrated for stimulation at 10100 Hz, whereas 100 Hz stimulation increased seizure frequency. The antiseizure effects of the caudatenucleus are hypothesized to be due to activation of the substantia nigra under the presumption that lowfrequency stimulation is excitatory and high frequency stimulation is inhibitory (Theodore and Fisher, 2004). Since these results are from uncontrolled studies, it is uncertain if micro ablation resulting from electrode implantation is contributing to the antiseizure effect. Thalamus The thalamus is seen as a strategic stimulation site on the basis that it is the pacemaker of the cortex, with widespread connections between the two structures. There is electrophysical 46 PAGE 47 and anatomical evidence suggesting that midline thalamic nuclei may participate in modulation and spread of limbic seizures. Experimentally, thalamic stimulation has been shown to terminate seizures in a primate epilepsy model. Studies of human thalamic stimulation have been published with favorable results (Theodore and Fisher, 2004). Centromedian nucleus The centromedian nucleus (CN) has been classified as part of the nonspecific thalamus. The CNs major difference from the thalamus in terms of stimulation for epileptic seizures is that the CNs output is more strongly related with the caudate nucleus than with the cortex (Theodore and Fisher, 2004). In a placebocontrolled doubleblind study involving 7 patients, CN stimulation resulted in a 30% decrease with respect to baseline when the stimulator was on versus an 8% decrease when the stimulator was off (Fisher et al., 1992). CN stimulation appeared safe and well tolerated by the patients. Anterior thalamic nucleus The anterior nucleus of the thalamus (ATN) may help influence the propensity of seizures due on its connectivity and functional relations with the cortex and limbic structures. High frequency stimulation of the ATN leads to EEG desynchronization, which is believed to render the cortex less susceptible to seizures (Hodaie et al., 2002). Specifically, 100 Hz had an antiseizure effect whereas stimulation at 1050 Hz lowered the seizure threshold. A controlled study of 5 patients resulted in a mean seizure reduction of 54%. An interesting observation was that the results did not differ from the stimulation on and stimulation off periods (Theodore and Fisher, 2004). This is thought to be due to a microthalamotomy placeboeffect. This phenomenon of a reduction or abolition of symptoms due to insertion of DBS electrodes alone has been seen in over 53% of DBS electrode implantations for tremor, and can last up to a year in some cases (Hodaie et al., 2002). 47 PAGE 48 Subthalamic nucleus The subthalamic nucleus (STN) was chosen based on encouraging responses in patients with movement disorders as well as highfrequency stimulation in animal epilepsy models. In a study utilizing STN high frequency stimulation in 5 patients, 3 patients showed reduction in seizure frequency of 6780%, one patient had approximately 50% seizure reduction, and the fifth showed no improvement. In this study, the recording of epileptiform activity in the STN suggests that it is part of a corticosubcortical network involved in the epileptogenic process (Chabardes et al., 2002). Hippocampus Human studies of hippocampal stimulation have demonstrated that highfrequency stimulation, rather than low frequency, can be inhibitory. This is contradictory to several preclinical investigations of hippocampal stimulation. One theory for this phenomenon is that the antiseizure effect is due to the activation or inhibition of downstream structures (as opposed to the hippocampus itself). Nevertheless, 7 patients that participated in a hippocampal stimulation study involving 23 weeks of 130 Hz electrical stimulation for 23 hours per day responded very well. Stimulation halted clinical seizures and decreased the number of interictal EEG spikes at the focus after 56 days. However, no observable antiepileptic effects (or no effects at all) were found in three patients when stimulation was either interrupted or given elsewhere just outside of the hippocampus (Theodore and Fisher, 2004). Vagus nerve stimulation VNS therapy has been the subject of many studies before and after its approval for treatment of intractable seizures in 1997 (Uthman et al., 1993; BenMenachem et al., 1994; Theodore et al., 1997; Schachter et al., 2002; Cyberonics, 2006; Ardesch et al., 2007; Ramani, 2008). VNS is licensed in several countries as an adjunctive epilepsy therapy with a rare 48 PAGE 49 occurrence of serious side effects. Studies suggest that VNS treatment results in a much lower incidence of adverse cognitive, neurological, and systemic effects than AED treatments (George, 2001). Over 40,000 epilepsy patients have VNS therapy implants (Cyberonics, 2008). VNS is a useful therapy for patients with medically refractory and localizationrelated epilepsy characterized by complex partial and secondary generalized seizures (Theodore and Fisher, 2004). The apparatus consists of an electric stimulator which is implanted subcutaneously in the left side of the chest and connected to the left cervical vagus nerve using subcutaneous electrical wires. The device is programmed to provide neurostimulation at a set duration, frequency, intensity, and pulse width for the treatment of epilepsy. Figure 22 provides an example of the VNS pulse sequence. Figure 22. VNS pulse sequence. The vagus nerve was chosen as the site for stimulation because of its diffuse and widespread projections to the thalamus, amygdala, and forebrain through the nucleus tractus solitarius and to other cortical areas via the medullary reticular formation. Though VNS therapy has demonstrated seizure treatment efficacy, the therapeutic mechanism is still uncertain (BenMenachem et al., 1994; Fisher et al., 1999; Groves, 2005; Ramani, 2008). However, a physiologic framework for the VNS therapy mechanism has been 1 0 mA Output Current Pulse Width Ramp up (2 sec) 1/frequency Ramp down (2 sec) On time 49 PAGE 50 described (Upton et al., 1991; Ramani, 2008). The vagus nerve is the 10th cranial nerve and is comprised of approximately 80% afferent fibers, which carry sensory information to the brain. The vagus nerve is highly involved in the regulations of numerous autonomic systems such as the heart, the intestines, and provides and integral role in respiration. Studies suggest that the metabolic activation of thalamic, brainstem, and limbic regions may be integral in the mediation of VNS effects (Fisher et al., 1999). It has been shown that depletion of norepinephrine in the locus coeruleus attenuates the AEDlike effect of VNS (Krahl et al., 1998). Recent studies also suggest that the VNS may exert its effect through the locus coeruleus (Groves, 2005; Ramani, 2008). Experiments in which cat vagus afferent neurons were stimulated were able to produce either cortical synchronization or desynchronization, depending on the fibers conduction velocity (Upton, 1991). Recent studies have determined that vagus A and B fiber activation can lead to EEG synchronization whereas vagus C fiber activation results in EEG desynchronization (Groves, 2005). Electrical stimulation of the vagus nerve resulted in a reduction of interictal epileptiform spike frequency during and up to three minutes after stimulation in a rat seizure model (McLachlan, 1993). Overall, in lieu of these and other reported VNS effects there is no consensus as to how these empirical effects relate to epilepsy. Though studies have examined how vagus A, B, and C fiber stimulation affects synchronization, the overall VNSinduced effects of these fibers and other relevant brain structures on EEG, reports suggest that these effects not explicitly visible in the time domain (Fisher et al., 1999) or in frequency domain (Salinsky et al., 1993). Numerous studies report little success in quantifying immediate EEG effects corresponding with VNS (Hammond et al., 1992; Salinsky et al., 1993; Koo, 2001; Rizzo et al., 2004; Marrosu et al., 2005). The only reported scalpEEG effects of VNS are reported to 50 PAGE 51 occur numerous months after VNS implantation. Studies involving longterm EEG monitoring have shown that longterm VNS produces a delay in interspiking activity and a reduction in the occurrence of epileptic interictal spikes (Koo, 2001; Olejniczak et al., 2001). Marrosu et al. reported no noticeable changes after one month but an increase in gamma activity and desynchronization one year after VNS implantation compared to baseline recordings (2005). Studies have demonstrated VNS effects on interictal epileptiform discharges (SantiagoRodriguez and AlonsoVanegas, 2006) and that the absence of bilateral interictal epileptiform discharges may be an electroencephalographic predictor of seizure freedom (Janszky et al., 2005). In addition, longterm VNS effects have been reported on the spectral content of sleep EEG after 1018 months of VNS compared to a baseline at 3 months prior to implantation (Rizzo et al., 2004). Future Therapeutic Directions One major epilepsy research direction is to enhance therapeutic effectiveness of electrical stimulation or drug therapy though the application of implantable controlled therapy systems. For patients which are currently undergoing therapy from the available electrical stimulation implants (such as the vagus nerve stimulator), research in this direction may help to enhance efficacy, mitigate side effects, reduce therapeutic tolerance, and prolong battery life. Along these lines, such a framework could be adapted to an implantable drug delivery system that would dispense drug at right and the right place (e.g. in proximity of a seizure focus or in a location to rapidly circulate medication such as the ventricles). One framework from which this strategy can be visualized is from a system control perspective. Thus, the basic theory behind this strategy is that the transition from a normal interictal state into a preictal state can be conceptualized as a deviation of a control parameter from its set point. Numerous researchers have invested in this idea using EEG signals as 51 PAGE 52 controlled measure (Osorio et al., 2001; Iasemidis, 2003; Iasemidis et al., 2003; Osorio et al., 2005). While the basic example of deviation from a set point does not do justice to the enormous complexity of the brains electrical activity, recent advances in mathematical theory of complex nonlinear dynamical systems provide an interesting perspective from which to examine and interpret EEG signals. Complex nature of epileptic dynamics One of the most challenging aspects of epilepsy treatment is that despite the major milestones in biological research, there is still an inadequate knowledge of the underlying biological processes governing the epileptic condition that describes how, where, when, and for what purpose a seizure will occur. One perspective is that the epileptic brain is exposed to at least two states, a normal (interictal) state and a seizure imminent (preictal state). A natural approach for studying any aspect of brain behavior is to create mathematical model of some brain function using measurable quantities, such as electrical signals. Such models allow predictions to be made about the behavior of sections of the brain. Due to the massive complexity of the interacting neurons in the brain, direct models are most often achieved for small groups of neurons and small brain structures (Hodgkin and Huxley, 1952; Breakspear, 2001; Chauvet and Berger, 2002). The enormous complexity of electrical brain signals often means exact modeling approaches are insufficient. However, despite the observed dynamical complexity of the epileptic brain there certain behavioral characteristics it possess which can provide analytical guidance. Dynamical diseases and disorders One important diagnostic aspect of many diseases and disorders is the physiologic behavior in the temporal dimension. In the 1980s many studies addressed the temporal behavior 52 PAGE 53 of biological systems with and without a disease state. Experts within this field often focused their attention on the time scales involved in the clinical aspects of the disorder. This includes characterization of the disease or disorder onset (acute or subacute) as well the succeeding clinical course (selflimiting, relapsingremitting, cyclic, or chronic progressive) (Belair et al., 1995). The term Dynamical Disease or Dynamical Disorder refers to the general class of diseases and disorders that are characterized by sudden changes in physiological dynamics that lead to state of morbidity characterized by abnormal dynamics (Belair et al., 1995). Such dynamical disorders arise as a result of abnormalities in underlying physiological control mechanisms. There are many instances of disease and disorder models where the apparent shift of control parameters to region results in pathological behavior of an observable which bears a resemblance to experimental data. Mackey and Glass demonstrated adaptive respiratory disease behavior that displayed a wide range of behaviors such as limit cycle oscillations with aperiodic chaotic solutions (Mackey and Glass, 1977). This particular example exhibited a bifurcation in the systems dynamics that was associated with disease onset. The unstable dynamical realm achieved by altering a normal hematopoiesis model bears qualitative similarities to actual hematopoietic data from a leukemia patient (Mackey and Glass, 1977). Thus, there are biological examples to support the claim that mathematical models of physiologic systems may be able to predict the existence of dynamical regimes corresponding to the status of a dynamical disease. Whether the dynamical behavior is periodic, irregular, or apparently random, the significance of dynamical disease identification is that it may be possible to develop therapeutic strategies based on manipulation of critical control parameters (Milton and Black, 1995). Taking into account the temporal rhythm of the disorder as well as an understanding that certain 53 PAGE 54 dynamical rhythms may respond better to some treatments rather than others can help provide a foundation for a suitable therapy (Belair et al., 1995). Epilepsy as a dynamical disorder of brain systems Neurological disorders can take on a wide range of complex and abnormal rhythmic behavior over time (Milton et al., 1989). Milton and Black reported observations of recurring sets of symptoms and oscillatory behavior in 32 periodic diseases of the nervous system including, ankle clonus in corticospinal tract disease, movement disorders such as essential tremor and Parkinsons disease, as well as paroxysmal oscillations in neuronal discharges in epileptic seizures (Milton and Black, 1995). The cluster of symptoms occurring with a distinct temporal pattern could represent the clinical manifestation of dynamical state changes in these patients. In the context of neural tissue, one view of the abnormal dynamical behavior in neurological patients may arise because of altered control parameters (e.g. nerve conduction time, number of receptors, etc.) and/or alterations in neuronal network structure (Milton et al., 1989). Compensating for impaired neural control mechanisms: system control therapy Currently, the biological mechanisms driving transitions into and out of dynamical rhythms (e.g. oscillatory behavior) in neurological disorders are in general poorly understood. A study examining a tremor simulation by inducing delay and amplification in a visual motor task suggests there tremor could be an alteration of numerous interacting control loops or possibly a timedelay statedependent control system (Milton et al., 1989). One major difficultly whether dealing with tremor or other neurological disorders is to uncover the complex interactions of various interconnected control loops and determine how each contributes to the observed dynamical behavior. Understanding the origins of the dynamical behaviors seen in neurological 54 PAGE 55 disorders can provide a foundation for designing any type of patientspecific therapeutic control system. An example of such a device is shown in figure 23. ECoG / EEG Stimulator Feature extraction algorithm Closed loop Controller Figure 23. Closedloop seizure control device using electroencephalogram or electrocorticogram signals as an input to a feature extraction algorithm, which supplies the extracted features to a controller which makes a decision regarding the action of a stimulator. One of the major themes of quantitative EEG analysis in epilepsy as well as other neurological disorders is the identification of signal features that are sensitive to neural state changes. Chapter 3 provides an overview of the rich spectrum of feature extraction strategies employed for quantification of brain dynamics in neurological disorders such as epilepsy. 55 PAGE 56 CHAPTER 3 TIME SERIES ANALYSIS AND DATA MINING TECHNIQUES: THEORY AND APPLICATION The wealth of epilepsy research conducted via quantitative analysis of EEG signals comprises a rich history. Numerous mathematical models have been applied for the purpose of modeling the progression of disease and inferring the biological significance of the underlying the observed EEG signal patterns. The EEG is a time series of voltage measurements acquired between a scalp or intracranial location of interest and a reference electrode point (e.g. an electrode placed on the ear). Naturally, time series analysis techniques were among the first methods applied for quantifying brain dynamics and constitute a significant portion of quantitative EEG research. In addition, data mining tools are becoming increasingly popular for the extraction and classification of patterns in biological datasets such as EEG signals. The following literature review provides a general overview of the tools used in quantitative EEG research. Glossary of Terms Attractor. An attractor is defined as a set of points mapped into a phase space representation which is a target region which adjacent states within a neighborhood (see: basin of attraction) will converge towards as the system evolves towards infinity. An attractor is established to be the smallest region for which the entire volume cannot be further split into two or more attractors having corresponding basins of attraction (as a system may have multiple attractors each with a basin of attraction). Basin of Attraction. A set of points in phase space such that initial conditions existing in this set evolve over time into a corresponding attractor. 56 PAGE 57 Bifurcation. A bifurcation is defined as a sudden appearance of a qualitative change in dynamics resulting from an alteration in a parameter of a nonlinear system. Bifurcations can occur in both continuous systems as well as discrete systems. Degrees of Freedom. The dimensions of a phase space mapping. Limit Cycle. In a phase space, a limitcycle is a closed trajectory which possesses the characteristic that at least one other trajectory will traverse into it as time approaches infinity. Phase Space. Phase space is the group of potential states for a dynamical system. Phase space is typically identified with a topological manifold. Each point in the phase space represent an instantaneous and unique state of the system. Strange Attractor. Strange attractors have a noninteger dimension. The descriptive term strange refers to the geometrical structure of the attractor, whereas the term chaotic refers to the dynamics on the attractor (Grebogi, 1984). Trajectory. The trajectory of a dynamical system is the orbit connecting points in chronological order in the phase space that is traversed by a solution of an initial value problem. If the state variables are within a realvalued continuum, then the orbit of a continuous time system is a curve. Discreet system trajectories consist of a sequence of points. Time Series Analysis Time series analysis is the field of study that aims to extract useful information from time series datasets. A time series is a series of measurements that are acquired at successive times often with a constant time interval. Many aspects of our universe can be represented and studied as time series datasets. This field of study has been extensively applied to financial decision making as well as numerous scientific disciplines. One major goal of time series analysis is to extract useful information about the system that generated the time series dataset. An additional 57 PAGE 58 aim of time series analysis is to model the system dynamics in order to make predictions about future behavior. Methods Applied in the Time Domain Numerous linear EEG processing techniques have been implemented in the history of quantitative analysis. This section reviews some of the most utilized measures for the analysis of discrete time series data within the time domain. Autoregressive moving average modeling The autoregressive moving average model (ARMA) is standard time series analysis tool used to model univariate datasets. This method is also known as the BoxJenkins model as the iterative BoxJenkins procedure it often used to estimate model coefficients (Box and Jenkins, 1976). The model is comprised of two parts, an autoregressive component and a moving average component. For a univariate time series dataset X t autoregressive component at time t is defined as: tpiititXCX1 (31) where C is a constant, pi ... are the parameters of the model of order p and t is the error term. The moving average component is defined as: tqititX11 (32) where pi ... are the parameters of the model of order q, and 1t and t are the previous and current error terms, respectively. Combining the autoregressive term with the moving average term produces the ARMA model of order p (autoregressive terms), and q (moving average terms): 58 PAGE 59 tqitipiititXX111 (33) Such methods have been utilized in modeling functional brain network organization using spectral analysis of local field potentials (Bressler et al., 2007). Autoregressive integrated moving average modeling The autoregressive integrated moving average (ARIMA) process is a wellknown method for making predictions in nonstationary time series datasets (Box and Jenkins, 1976). As the name implies, this measure is a generalization of the ARMA process. The ARIMA approach to working with nonstationary time series works by utilizing the d th difference to convert the nonstationary time series to a stationary ARMA process. Naturally, the ARIMA method assumes that a time series can be reduced to a stationary time series through the process of differencing. The statistical properties of the stationary time series remain constant in time, and residuals (errors between the original time series and the ARIMA model) are assumed to be the result of noise. Let be an ARIMA process of order p,d,q where the d ty th difference of is a stationary ARMA process of order p,q. The model ARIMA model is then expressed as: ty ttdzByBB1 (34) where and are polynomials of degree p and q (respectively) having roots outside the unit circle, B is the backward shift operator, and z t is white noise. Cross correlation Crosscorrelation analysis is one of the oldest and most standard time series analysis techniques (Bendat and Piersol, 1986). This method measures the linear coupling between two signals. 59 PAGE 60 Let X be some represent an identically distributed stationary stochastic process where is the value of tX X at time t. Crosscorrelation function representing the coupling between two time series functions and tX tY is defined with a time lag, as follows: dttytxCxy (35) Crosscorrelation is often applied to data from a physical system which typically takes on a discrete form. Let and represent two simultaneously acquired stationary time series of length M, zero mean, and unit standard deviation. The discrete unbiased estimate of the cross correlation function is then defined as a function of time lag 10,...,Mxx 10,...,Myy 1,...,0,...,1MM as follows: 0,0,11xyNiiixyCyxNC (36) The normalized crosscorrelation function outputs values within the range of negative one (maximum antisynchronization) to one (complete synchronization). The maximum of equation 3.5 is understood to be an estimation of the delay between two signals (assuming this signals have a linear relationship to one another). The crosscorrelation of a function to itself is called autocorrelation. As the crosscorrelation value approaches zero, the signals of interest are increasingly linearly independent. Often a significance threshold is applied to prevent the possible occurrence of a nonzero crosscorrelation value for two linearly independent systems (Box and Jenkins, 1976). 60 PAGE 61 Methods Applied in the Frequency Domain Frequency representation is a standard format for visualizing signal characteristics. This perspective provides a clear visualization of a signals periodic behavior which may not be evident in the time domain. Thus, frequency domain analysis can help uncover important properties of the system of interest. Coherence Coherence is a measure of coupling between two signals as a function of frequency. The signal coherence can take on values between zero and one that provide a relative indicator of how well the signal X corresponds to signal Y at each frequency. The Fourier transform is performed on each signal to convert the signal into the frequency domain (calculate the power spectral density). The cross power spectral density is calculated by multiplying one signal by the complex conjugate of the other signal. The coherence measure is a function of the power spectral density of the individual signals and the cross power spectral density. This measure is typically expressed in terms of its square magnitude and is derived by normalizing the cross power density by the product of power spectral density for the two signals, fPfPfPfCyyxxxyxy22 (37) where and represent the power spectral densities for signals X and Y respectively and is the cross power spectral density (Fuller, 1976). A coherence of zero indicates no coupling between the two signals at the particular frequency whereas a coherence of one implies linear relationship with constant phase shifts between each frequency component. Coherence has been implemented in electrophysiology experiments for several years and more information can be found in literature (Shaw, 1984; Leocani, 1999). xxP yyP xyP 61 PAGE 62 Discrete Fourier transform The Fourier transform has been implemented in extensively in numerous fields such as mathematics, physics and natural sciences. The Fourier transform is an especially attractive algorithm due to the development of the streamlined Fast Fourier Transform (FFT) (Cooley and Tukey, 1965). In recent years, additional developments have been implemented in the FFTW subroutine library developed by a team of MIT researchers (Frigo and Jonhnson, 2005). This free software package provides a means to optimize the FFT algorithm using various heuristic approaches for each unique problem and platform combination. This subroutine library has been utilized by many researchers and is even implemented in the Matlab function library. Fourier analysis decomposes a signal into linear component parts. The analysis involves to concepts: Linear combination of different waveforms. A time series of any shape can be sufficiently represented by the summation of ample simple sine waves of different frequencies, phases, and amplitudes. Given a signal Fourier analysis models the signal as a linear combination of sine and cosine waves for frequency where: tx f dfefXtxfti2 (38) and dtetxfXfti2 (39) Equation (38) is the continuous Fourier transform which is comprised of the complex coefficients representing the contributions of each frequency, to the overall representation of the original time series Equation (37) is often referred to as the inverse Fourier transform. f tx 62 PAGE 63 For a discrete signal, (310) 10,...,Nxxx where is sampled at the time nx jttn0 the discrete Fourier transform (DFT) is represented as: 102NnNknienxkX (311) for the discrete frequencies Nkfk (312) where the inverse Fourier transform is expressed as: 1021NkNkniekXNnx (313) While Fourier analysis is useful for capturing periodic waveforms in nontransient signals, this measure is not suited for extracting transient features. This is because time information is no longer available in the frequency domain as the DFT coefficients are representative of the entire signal duration. The Fourier transform has been extensively applied to the analysis of EEG waveforms in epileptic patients. Diagnostically, it can help determine the presence of specific brain wave rhythms which may be indicative of certain types of epileptic behavior. Often the time series of interest is broken down into nonoverlapping segments in which the Fourier transform is calculated to give a rough estimate of the frequency behavior over time. An example of an a single channel of EEG acquired during an absence seizure and its corresponding windowed Fourier transform is shown in figures 31 and 32, respectively. 63 PAGE 64 In figure 32, the absence seizure onset is characterized by a sudden energy increase in the 030 Hz frequency band with the strongest effect around 3 Hz (which is the typical rhythm of spike wave discharges in absence seizures). Wavelet analysis Wavelet analysis is a signal processing tool which models a times series signal in terms of shifted and scaled mother wavelet. Wavelet analysis is similar in some aspects to Fourier analysis, which models a signal using sinusoids. Instead of sinusoids, wavelet analysis models a signal using an applicationspecific waveform called a wavelet which has an effectively limited duration and a mean value of zero (Misiti et al., 1996). Wavelet analysis is very useful for performing localized analysis in a subregion of a larger signal. In addition, wavelet analysis is capable of revealing aspects of data that traditional signal analysis techniques may miss such as trends, breakdown points, discontinuities in higher derivatives, and selfsimilarity (Misiti et al., 1996). For a particular mother wavelet function t the subspace at time t for a scale, a, and a position, b is represented by abtatba1, (314) If represents the time series signal, then the continuous wavelet transformation at scale, a, and position b is defined as: tx dtabtatxCba1, (315) where denotes the complex conjugate of the wavelet and 0,, aRba For low values of the scaling factor a, the wavelet becomes compressed and becomes sensitive to rapidlychanging details and high frequency waveforms. For high values of a, the wavelet becomes stretched and 64 PAGE 65 is more sensitive to coarse slowlychanging features and low frequency waveforms. The parameter b localizes the wavelet function in time. Wavelet analysis has demonstrated utility for the analysis of nonstationary signals such as EEG (Geva et al., 1998, Gler and Ubeyli, 2005; Glassman et al., 2005). Information Based Methods Information theory is based on the 1948 publication by Claude Shannon which was the first paper to quantify the concepts involved in communication. Information quantified in units of bits and concepts such as entropy and mutual information were used to describe the transfer of information (Shannon, 1948). Information theory concepts have been extended to time series analysis in biological series such as the EEG. Under the proper statistical conditions, these measures provide useful information about the behavior of the brain. Approximate Entropy Approximate entropy (ApEnt) is a statistical measure used to quantify system regularity/complexity from a time series dataset. This measure has been extensively utilized in physiological time series data (Pincus, 1995). The ApEnt measure has been utilized to study the EEG signals acquired from Alzheimers disease patients (Absolo et al., 2005), as a measure of anesthetic depth (Bruhn et al., 2000, 2001, 2003), epileptic seizures detection (Absolo et al., 2007; Srinivasan, 2007), and studies characterizing EEG nonlinearity patterns (Thomasson et al., 2000; Burioka et al., 2003,2005; Ferenets et al., 2006). The ApEnt measure has demonstrated the ability to quantify system complexity using as few as 1000 data points based on theoretical analyses of stochastic and deterministic chaotic processes (Pincus, et al., 1991; Pincus and Keef, 1992) as well as clinical and clinical applications (Pincus 1995; Bruhn et al., 2000). In this dissertation, ApEnt is used as a measure for quantifying the VNS effect on EEG recordings. 65 PAGE 66 Let Ube a signal of length. For positive integer and a positive real number extract create vectors N m fr 1 m N 1,...,1, miuiuiuixm For all i, 11 mNi the quantity is computed as follows: number of j such that miC 1,dsuch that j ofnumber mNrjxixrCfmmfmi (316) where d is the maximum absolute difference between the respective scalar components of the two vectors defined as : ixm jxm 11max,,...,1kjxkixjxixdmmmkmm (317) Using these results, the value of can be calculated as: m 11log11mNimifmCmNr (318) ApEnt is calculated as: fmfmfrrNrmApEn1,, (319) In this manner, the value of the positive real number corresponds distance between the neighboring point that is often designated as some fraction of the signals standard deviation. For this reason, the positive real number can be thought of as a filtering level for the process. The parameter mis the dimension at which the signal is embedded for calculation. fr fr Pattern Match Regularity Statistic Pattern match regularity statistic (PMRS) is a method used to extract the nonlinear characteristics (complexity) of a time series over time. This measure has been for the quantifying the complexity of an input EEG signal and further detecting EEG state changes such as seizure onset (Shiau, 2001; Shiau et al., 2004). This measure estimates the likelihood of 66 PAGE 67 pattern similarity for a given time series. PMRS has the attractive feature that it can be interpreted in both stochastic and chaotic models. The steps to calculate PMRS include reconstruction of the state space, searching for the pattern matched state vectors, and the estimation of pattern match probabilities. Specially, given an EEG signal let },,,{21nuuuU u be the sample standard deviation for U. For an integer m (embedding dimension), phase space vectors U are reconstructed as 11},,,,{11 mniuuuxmiiii (320) then for a given positive x fr i and x j are considered pattern match to each other if: 11)()(,,1111 mkforuusignuusignandruuruukjkjkikimjmiji (321) where corresponds distance between the neighboring point that is often designated as some fraction of the signals standard deviation. PMRS can then be calculated as: fr mniipmnPMRS1)ln(1 (322) where })()({Pr11matchedpatternarexandxuusignuusignobpjimjmjmimii (323) Mutual Information Information theory measures such as mutual information have shown utility for estimating high order statistical dependencies between signals. In contrast to linear coupling measures (e.g. crosscorrelation), mutual information is sensitive to nonlinear dependencies. 67 PAGE 68 For continuous variables X and Y with probability density function of and respectively, and is the joint density function, mutual information can be calculated as follows: xf yf yxf, dxdyyfxfyxfyxfYXIXY,log,, (324) Mutual information between two discrete random variables having marginal probabilities = prob(X=x) and = prob(Y=y) and joint probability xpX ypY ),(yYxXprobxpX is defined as: ypxpyxpyxpYXIYxyx,log,,, (325) A common approach to calculating mutual information is to first partition X and Y into bins (e.g. a histogram). An estimation of YXIYXIbin,, is obtained by replacing the probability functions, and xf yf yxf, with an approximations based on the histogram. Thus, if and are the number of points from X within the xth bin and number of points from Y within the yth bin, respectively, and is the number of points in the intersection of the two bins, then and xb yb xyb Nbxpxx/ NbypyY/ Nbyxpxy/, Mutual information has been successfully used to quantify statistical couplings in biological applications such as sleep studies (Na et al., 2006) Alzheimers disease (Absolo et al., 2007) and epileptic seizures (Varma et al., 1997; Palus et al., 2001; Netoff et al., 2002). Chaotic System Analysis Techniques One approach for quantifying the behavior of a complex system such as the brain is to create a mathematical model of the system behavior using measurable quantities. Electrical signal measurements are often used to model the brain modeling the brains behavior. Such 68 PAGE 69 models allow predictions to be made about the behavior of sections of the brain. Due to the massive complexity of the interacting neurons in the brain, direct models have only been achieved for small groups of neurons and small brain structures (Breakspear et al., 2001; Chauvet and Berger, 2002; Hodgkin and Huxley, 1952). The enormous complexity of electrical brain signals often means exact modeling approaches are insufficient. Edward Lorenz is often credited as the discoverer of chaos for the fruits of his efforts to devise a longterm weather prediction scheme (Lorenz, 1963). Though Lorenzs model did not turn out to aid in forecasting weather, his results directed his attention to research which helped give rise to research in the area of chaos theory. Chaotic systems have the interesting property of displaying apparent random behavior but are actually governed by deterministic laws. Specifically, chaotic systems demonstrate a large degree of sensitivity to initial conditions to the point at which minor fluctuations in initial parameters give rise to extremely altered outcomes (to the extent that prediction of such events may even be hampered by sensitivity to computer precision rounding). Since chaotic systems have characteristic similar to noise as well as a broad range of frequency components, linear measures may fail to provide meaningful results. When exact knowledge of the system governing dynamics is unknown, such as in the brain, an alternative method is a macroscopic modeling approach based on empirical measures of the system as a whole (Iasemidis et al., 1996). After such information is extracted, it may be possible to derive useful empirical models of the global behavior of the system as a whole. A wellknown method to study complex system behavior is to observe the system from a phase space representation (Hively et al., 2005; Iasemidis et al., 1996). Phase space mapping is a process of applying some transformation on a dataset, often into a higher dimensional space, 69 PAGE 70 from which system behavior characteristics can be quantified. Some classic transformations applied in EEG analysis include time delay mapping, (Breakspear, 2001; Hively et al., 2005; Iasemidis et al., 1996; Da Silva et al., 2003; Marino et al., 2003) derivative mapping (Aksenova et al., 1999, 2003; Letellier et al., 1998; Sceller et al., 1999; Tetko et al., 1999). Phase space mapping provides a means to help distinguish random, noisy signals from signals generated from a system governed by deterministic chaos. Phase Space Mapping Generate of a timedelay phase space portrait of the system is one of the most established methods for visualizing the dynamical behavior of a multivariable system such as the brain (Iasemidis et al., 1996; Hively et al., 2005). Timedelay phase space maps are a particularly useful phase space mapping variant and are often used for the study of nonlinear deterministic systems. The phase space portrait is created by assigning each timedependent variable of the observed from the system as a vector element in a multidimensional phase space. Each vector mapped into the phase space represents a unique and instantaneous state of the system. By plotting the phase space vectors in chronological order a representation of the temporal evolution of a discrete system can be visualized. In principle, the analysis of an individual measured variable can provide dynamical information about other system variables which are related to the measured variable (Iasemidis et al., 2003). A relevant example of this concept is that EEG recorded from one electrode can be related to the activities located at distant electrode sites. Thus, important features of a dynamical system can often be quantified through analysis of a single variables behavior over time in terms of geometrical attractor properties. From the reconstructed phase space, measurements can be made to extract useful system information from a single variable (Iasemidis et al., 1996; Pardalos et al., 2003; Chaovalitwongse 70 PAGE 71 et al., 2006). Such information can often be used in data classification algorithms for determining neural state (Tetko et al., 1999, Hively et al., 2005). The method of quantifying phase space properties has been extensively applied to EEG signals analysis for the purpose of studying neurological disorders (Chaovalitwongse et al., 2006; Hively et. all, 2000, 2005; Iasemidis et al., 1996, 2004, 2005; Pardalos et al., 2003, 2004). The Method of Delays Timedelay embedding is performed as follows: 12...2mtxmtxtxtxtxxnnnnnn (326) where is the time delay and m is the embedding dimension (Takens, 1981). For a discrete system, every instantaneous state of the system is represented by the vector in m dimensional phase space. nx Numerous studies have addressed the problem of determining proper parameters for the embedding dimension m and The first zero of the autocorrelation function (Rapp et al., 1988) or the first minimum of the mean automutual information (Fraser et al., 1986) are two of the most common approaches to obtain the time delay, Takens recommended a minimum embedding dimension m = (2D+1) to ensure complete unfolding of the attractor, where D is the fractal dimension (Takens, 1981). 71 PAGE 72 Fractal Dimension The term "fractal" was coined by Benoit Mandelbrot in 1975 to describe selfsimilarity characterized as a jagged geometric shape which can be split into parts which are approximately reducedsize copies of a whole (Mandelbrot et al., 1983). The fractal dimension is a statistical measure of the extent to which a fractal appears to fill space. A noninteger fractal dimension is said to originate from fractal geometry. Strange attractors often have a complex structure with fractallike properties. Thus, the fractal dimension is a logical measure to use for quantifying strange attractor dimension. Determining the dimension of an attractor is an important step in the characterization of a systems properties. A proper dimensionality estimate can enhance the accuracy at which the location of a point on an attractor can be specified. Furthermore, the dimension value provides a lower bound on the number of variables required to model the system dynamics. A standard technique for estimating attractor dimension is from the framework of measuring the changes in the number of points occupying a sphere of radius r as it approaches zero (Grassberger and Procaccia, 1983a; 1983b). Geometrically, the relevance of this observation is that volume occupied by a sphere of radius r in dimension d behaves as d r For most attractors the dimension d would be the dimension of the attractor, regardless of the origin of the sphere. For a chaotic attractor, however, the dimension will vary depending on which point is selected for the estimation. If the particular systems dynamics do not result in dimensional variation, then the mean of the surrounding points can be used. Obtaining the dimension in this method can be obtained by determining the number of point y(k) within a sphere positioned at the phase space location x as follows: 72 PAGE 73 NkxkyrNrxn11, (327) where represents the Heaviside Step Function where: 0,10,0nnn (328) Equation (326) returns a counts of all the points on the orbit y(k) located within a radius r from point x and normalizes this quantity by N, the number of points in the dataset. The point density, (x), on an attractor does not need to be uniform to utilize this method (for a strange attractor). If equation (327) is raised to the power of q1, the function C(q,r) is established in terms of q and r and the mean of n(x, r) q1 over the attractor weighted with the natural density (x) as: 11,1111,,qMkMknnqxkynyrMMrxnxxdrqC (329) This quantity is referred to as the correlation function or correlation integral. This function estimates the probability that two points on the attractor lie within a distance r of each other. M and K are large in value (but not infinite). Though this function is invariant on the attractor, it is conventional to only look at the variation of rqC, when r is small. At that scale, it is assumed that: qDqrrqC1, (330) which defines the fractal dimension The quantity is estimated in the case of small r as: qD qD rqrqCDrqlog1,loglim0 (331) 73 PAGE 74 Using this method, needs to be calculated over a small range of r in order to achieve a nearlinear range for selection of the slope of rqC, rqC,log over rlog Box counting dimension (D0) Box counting dimension (D0) is the title given to the measure when q=0. D0 can be estimated as the amount of spheres of radius r or the number of boxes required to envelop all points in the dataset. If N(r) represent the amount of Ddimensional spheres needed to cover the attractor for relatively small values of r, then the box counting dimension can be estimated as: rrNrqrNDrrlogloglimlog1loglim000 (332) Equation (331) is often represented as: qqDD00lim (333) Information dimension (D1) Information dimension (D1) is the name of the measure when q=1. D1 is a generalization of the box counting dimension that takes into account the relative probability of cubes used to cover the dataset. Let I represent the information function: rPrPIiNiilog1 (334) and represent the probability that an element i is populated, normalized such that: rPi 11NiirP (335) Information dimension is thus defined as: NiiirrPrPD11loglog (336) 74 PAGE 75 Correlation dimension (D2) Correlation dimension (D2) is title of the measure when q=2 (Grassberger and Procaccia, 1983a, 1983b; Kantz and Schreiber 1997). Under this condition, Dq takes on special form which tends towards reliable computation. Correlation dimension is estimated as the slope of the loglog plot generated by: rrCDrlog,2loglim02 (337) The correlation dimension can be challenging to quantify in time series data as it can result in highly nonlinear slopes for small r. Correlation dimension has been extensively utilized for neural state classification studies using EEG (Tirsch et al., 2000; 2004) and has been utilized extensively in analysis of physiological data (Kantz and Schreiber, 1995) such as seizure prediction applications (Elger et al., 1998; Martinerie et al., 1998). As correlation sum can demonstrate a high sensitivity to EEG amplitude when using a fixed radius (Osorio, 2001), many authors have implemented a relative radius (with respect to the dataset diameter in vector space) to strengthen their findings (Casdagli et al., 1996, 1997, Merkwirth et al., 2002). The Lyapunov Exponent The Lyapunov exponent is an important measure for the quantification of dynamical systems. This measure quantifies the degree of system chaoticity by quantifying the rate of divergence or convergence between two points initially in close proximity (Iasemidis et al., 1999). Lyapunov exponents provide a generalization of linear stability analysis due to steadystate solution perturbation to timedependent solution perturbations. The measure also provides a meaningful characterization of asymptotic behavior in nonlinear dynamical systems. Lyapunov exponents are a collection of invariant geometric measures that characterize describe a systems dynamics. Specifically, they provide a measure of predictability for the 75 PAGE 76 particular system. Lyapunov exponents provide a global measure of the rate of convergence or divergence or of two trajectories initially in close proximity to one another for a dynamical system. Positive Lyapunov exponents measure represent the mean exponential divergence rate of two trajectories, whereas negative Lyapunov exponents measure represent the mean exponential convergence of two trajectories. As Lyapunov exponents becomes more positive, trajectories move apart more rapidly. Similarly, as Lyapunov exponents become more negative, the trajectories move together more rapidly. A system with positive exponents has positive entropy as trajectories that are initially in close proximity to one another separate over time. If a discrete nonlinear system is dissipative then the sum of all the Lyapunov exponents is zero. A system with both a positive and negative Lyapunov exponents is said to be chaotic. Thus, Lyapunov exponents provide a measure of linear stability (or instability) of the attractor or an asymptotically long orbit for a dynamical system. For a chaotic system with initial conditions a and b which are initially in close proximity, the distance between these two trajectories at successive time points will exponentially increase over time. If this is written as for a time duration of n iterations, then ne is the Lyapunov exponent. For a system to be chaotic, at least one Lyapunov exponent needs to be positive. Thus, at each point in the series the derivative of the timeadvanced equation is evaluated. The Lyapunov exponent is expressed as the mean value of the log of the derivative. If the Lyapunov exponent is negative, the iteration is stable. It is important to note that by summing the logs of the derivatives the result corresponds to multiplying the derivatives. Thus, if the product of the derivatives has magnitude less than 1, points will attract together as they go through the iteration. Though an ndimensional system will produce n Lyapunov exponents, the maximum exponent is usually most important. The maximum Lyapunov exponent represents the time 76 PAGE 77 constant, in the expression for the change in distance between the two initial orbits, If is negative, then the orbits converge over time, and thus the dynamical system is insensitive to the choice of initial conditions. However, if is positive, then the distance between the initial orbits increases exponentially over time and the system displays sensitivity to initial conditions. ne Calculation of the spectrum of Lyapunov exponents can be derived analytically for systems in which process dynamical equations are known aprioi (Shimada et al., 1979). Numerous algorithms have been developed which compute this measure on experimental datasets. One of the most wellknown algorithms was developed by Wolf et al. (1985), though other algorithms have been established (Eckman et al., 1986; Ellner et al., 1991). Short comings of the Wolf algorithm have been identified as sensitivities to the number of observations as well as measurement noise. Numerous researchers have proposed updated versions of Wolfs algorithm with increased robustness to the number of observations (Ellner et al., 1991; Iasemidis et al., 1991; Iasemidis and Sackellares, 1992; Abarbanel, 1996). The following section will provide an executive overview of the Lyapunov exponent estimation. Additional details can be found in (Iasemidis et al., 1991, 2000; Wolf et al., 1985). Computing ShortTerm Maximum Lyapunov Exponents A phase space mapping is performed by embedding a signal x(t) of duration T using the method of delays (326). The phase space representation provides the proper perspective for measuring the degree of chaoticity of the attractor. An attractor is chaotic if on average the two trajectories with similar initial conditions (two points in close proximity in phase space) diverge at an exponential rate (expansion process). If these trajectories are members of a finite attractor, they will fold back into the attractor as time progresses (folding process). A result of these two processes may be the generation of a stable and topologically layered attractor. If the expansion 77 PAGE 78 process outweighs the folding process in some of the attractors eigendirections, the attractor is said to be chaotic. If the phase space is Ddimensional then theoretically up to D Lyapunov exponents can be estimated. However, as expected, only (D +1) of them will be real (Abarbanel, 1996). If L represents the short term largest Lyapunov exponent estimate STLmax, then: aNijijiaXtXtNL1,,20log1 (338) where jijitXtXX0, (339) ttXttXtXjiji (340) for the following conditions: 1. is the point of the fiducial trajectory itX ittX' having ,, T denotes the transverse, and itt TDtxtxtX1,...,000 jtX is a properly chosen vector adjacent to in the phase space. itX 2. jijitXtXX0, is the displacement vector i.e., a perturbation of the fiducial order at and it it ttXttXtXjiji is the evolution of this perturbation after time t 3. and titti10 tjttj 10 where Ni,1 and Nj,1 for ij 4. is the evolution time for t jiX, (the time provided for jiX, to evolve in phase space). If the evolution time is given in seconds, then the Lyapunov exponent is measured in bits/sec. t 5. 0 is the initial time point of the fiducial trajectory and coincides with the time point of the first data in the data segment of analysis. In the estimation of L, for a complete scan of the attractor, should move within t 0t t ,0 6. is the number of local s that will be estimated within a duration T data segment. Therefore, if is the sampling period of the time domain data, then aN maxL st 11DtNtNTas The method proposed by Iasemidis et al. (Iasemidis et al., 1999) was used to estimate the short term maximum Lyapunov exponent (STLmax). This method is a modification of Wolfs algorithm (Wolf et al., 1985). The measure is denoted as short term to distinguish it from the variants used to study autonomous dynamical systems. Modification of Wolf's algorithm is 78 PAGE 79 necessary to enhance STLmax estimate robustness to transients in small data segments such as interictal spikes. The main modification is in the replacement vector searching procedure along the fiducial trajectory. One of the most crucial parameters affecting STLmaxs ability to distinguish interictal from preictal states is the adaptive estimation in time and phase space of the magnitude bounds of the candidate displacement vector (Iasemidis 1999), though evolution time t, and the angular separation V i,j between the evolved displacement vector X i1,j (t) and the candidate displacement vector X i1,j (0) are important components as well (Frank et al., 2005). The modifications proposed by Iasemidis and Sackellares (1991) can be summarized as follows: 1. To help ensure that L is a reliable estimate of STLmax, the candidate vector X(t j ) should be chosen such that the previously evolved displacement vector X i1,j1 (t) is nearly parallel to the candidate displacement vector X i,j (0), that is, max1,1,,,0VtXXVjijiji (341) where Vmax should be relatively a small value and denotes the absolute value of the angular separation between two vectors and in phase space. 2. Also, X i,j (0) should also be relatively small in magnitude. This constraint helps avoid computer overflow in the future evolution within very chaotic regions and also reduces the probability of starting up with points on separatrices (Wolf et al., 1986). Mathematically, this corresponds to, max,0jijitXtXX (342) where takes on a small value. Thus, the parameters involved in the estimation of L are: (i) The embedding dimension p and the time lag for the reconstruction of the phase space (ii) The evolution time t (iii) The constraint parameters for selecting X(t max j ; V max and max ) (iv) The duration of the data segment T It is worth nothing that since only vector differences are involved in the estimation of L, any direct current (DC) present in analyzed data segment does not influence the value of L. In addition, only vector difference ratios participate in the estimation of L. Thus, L is not influenced by data scaling (provided the parameters involved in the estimation procedure, i. e. are max 79 PAGE 80 expressed in values relative to the scale of each analyzed data segment). Both of the above points are consistent with the fact that L is related to the entropy rate of the data (Palus et al., 1993). Selecting D and The selection of the embedding dimension D is such that the dimension of the epileptic attractor in phase space is clearly defined. For an epileptic attractor, v 3 (Iasemidis et al., 1988, 1990; Iasemidis, 1991). Thus, according to Takens theorem a value of D (2 3 + 1) = 7 can be viewed as adequate for the embedding of the epileptic attractor in the phase space. This value of D may not provide a large enough phase space to embed all interictal brain states, but has demonstrated success in detecting the transition of the brain toward the ictal stage (Iasemidis and Sackellares, 1991). The parameter should be small enough to characterize the shortest signal changes (i.e., highest frequency component) in the data. However, should be large enough to result in the maximum feasible independence between the vectors components in the phase space (with the method of delays). These two conditions are typically addressed by selecting to be the first minimum of the mutual information or as the first zero of the time domain autocorrelation function of the data (Abarbanel, 1996). Since the time span (D1) of each vector in the phase space theoretically represents the duration of a system state, (D1) has been recommended to be (at the greatest) equal to the period of the maximum (or dominant) frequency component in the data (Abarbanel, 1996). As an example, a sine wave (or a limit cycle) has v = 1, then D = 2 1 + 1 = 3 is required the phase space embedding and (D1) = 2 should equal the sine waves period. In such a case, the value of would then correspond to the Nyquist frequency of the sine wave. In addition, for the epileptic attractor the highest frequency considered is 70 Hz (as EEG data are often lowpass filtered at 70Hz) which would require a maximum of about 7 ms according to the above rationale for D = 3. However, since a typical epileptic attractor (i.e., 80 PAGE 81 during the ictal period) in temporal lobe epilepsy has described to have a maximum dominant frequency of about 12 Hz (Iasemidis and Sackellares, 1991), according to the above rationale, an adequate value for phase space reconstruction of the epileptic attractor is (7 1) 84 ms, and thus, should be about 14 ms (for additional details see Iasemidis and Sackellares, 1991). Selecting t. If the evolution time t is too large, the folding process within the attractor distorts L. If t is too small, Xi,j(0) may not follow the direction of the maximum rate of information change. One option is to obtain t as a fraction of timedelay mapping of the maximum frequency component of interest in the data, f 0 Specifically, the t is usually chosen to correspond to 0.5*f 0 (Iasemidis and Sackellares, 1991). Therefore, according to the previous discussions about the selection of D and t ((D 1) )/2, which results in t 42 ms which is within a range that can distinguish the ictal state from the preictal state (Iasemidis and Sackellares (1991). Selecting max In Wolf's algorithm (1986), max is selected as 0max,,maxjijiX (343) where j = 1,,N and i = 1,,N a Thus, max represents the global maximum distance between any two phase space vectors in a segment of data. This value suffices as long as the data is stationary and distributed relatively uniformly in phase space. Rarely is this the case with real data, especially with the brains electrical activity which is strongly nonstationary and nonuniform (Barlow et. al, 1985; Feber et. al, 1987; Jansen and Cheng, 1988). Such statistical fluctuations combined with noise may adversely influence the predictive power of STLmax (Lai et al., 2003, 2004). Thus it is essential to perform a searching procedure modification in order to locate the proper X(t j ). The first step is obtain an adaptive estimation of max for each point X(t i ) as 81 PAGE 82 0max,max,jijiX (344) where j = 1,,N. Estimating max in this manner can help compensate for the nonuniformity of phase space ( max is now a spatially local quantity of the phase space at a point X(t i ) ). Another technique for managing nonstationary data is to estimate max with a temporal constraint on top of the spatial constraint. From this perspective, max is ijXjiIDISTttIDISTiji;0max,max,21 (345) for which 1IDIST (346) 12DIDIST (347) where and upper and lower bounds for 1IDIST 2IDIST jitt which help enforce temporal constraints when searching for a maximum spatial distance. In other words, these parameters establish a neighborhood in time around each point in the fiducial trajectory for the estimation of the parameter i,max which establishes a spatial search neighborhood around this point in the phase space. Thus, the search for i,max is always made temporally about the state X(t i ) and its changes within a period of the time span (D 1) of a state. According to the previous formulae, the values for the parameters involved in the adaptive estimation of i,max for the neural state classification studies are: = = 14 msec and = (D 1) 84 msec. 1IDIST 2IDIST Selecting V max Starting with an initial V max,initial = 0.1 rad, if a replacement vector X(t j ) is not found with 0 jiV, < V max,initial and 0,jiX < 0.1* max the bound is relaxed for 0,jiX At this point the process is repeated with bounds up to 0.5* max If it is not successful, we relax the bounds for jiV, by doubling V max and then repeat the process with bounds for V max up to 1 82 PAGE 83 rad. It should be noted that values of V max larger than 0.8 rad did not occur in the reported results (Iasemidis and Sackellares, 1991). If V max does grow this large, the replacement procedure halts, a local L(t i ) is not estimated at time t i the entire procedure beings again at the next point in the fiducial trajectory. Selecting X(t j ). It is important that the replacement vector X(t j ) should be spatially close to X(ti) in phase space (with respect to angle deviation and magnitude), yet with sufficient temporal distance from X(t i ) to allow selecting X(t j ) from a nearby (but not the same) trajectory. Otherwise, by replacing one state with one that shares too many common components would lead to a false underestimation of L. The arguments described above are represented by the following expressions: radVVinitialjiji1.00,,, (348) max,,max,0ijiicXb (349) 13DIDISTttji (350) The parameter c at a value of 0.1 and increases with a step of 0.1 up to 0.5 in order to locate a replacement vector X(t j ) satisfying (348) through (350). The parameter b (which must be less than parameter c) is used to account for possible noise contamination of the data. Thus, b is the distance below which the estimation of L is considered to be inaccurate. A value of b = 0.05 provided is recommended (Wolf et al., 1985; Iasemidis and Sackellares, 1991). To clarify, the temporal bound IDIST2 should not be confused with the temporal bound IDIST3. The variable IDIST2 places an upper temporal bound for locating an appropriate i,max at each point X(t i ), whereas IDIST3 is a lower temporal bound for locating an appropriate X(t j ) within a i,max spatial distance from X(t i ). 83 PAGE 84 Selecting T. For data obtained from a stationary system state, the time duration T of the analyzed data segment may be large for estimating of L. For nonstationary data, there are two competing requirements: T is desired to be as small as possible to provide local dynamic information yet the algorithm requires a minimum length of the data segment to stabilize the STLmax estimate. Previous studies have deemed that for 200 Hz, a window of 2048 points (corresponding to 10.24 seconds) is a sufficient length for the algorithm to converge and yet is able to distinguish the two extreme cases (preictal and ictal) (Iasemidis, 1991; Iasemidis and Sackellares, 1991; Iasemidis et al., 2000). These studies also point to the IDIST2 parameter as being the most critical parameter in the above algorithm. The STLmax seizure prediction algorithm identifies progressively increasing similarity in the information production rate (termed dynamical entrainment) between critical electrode sites prior to seizures. In other words, long before the onset of an epileptic seizure, critical brain sites begin to display similar dynamics. The progressive STLmax convergence prior to a seizure is thought to reflect dynamical dependence because 1) the critical sites share direct or indirect anatomical connections that are conducive to physiologic interaction, and 2) occurrence of the progressive STLmax entrainment prior to a seizure (Iasemidis et al., 2004). This concept is indirectly supported by the therapeutic effect of neurostimulation therapies such as ECTinduced seizures and the potential longterm anticonvulsant effect (for a recent review of ECT therapy see Taylor, 2007). A potential physiologic basis for brain resetting could be a release of neuromodulators after seizures (Gwinn et al., 2002). In addition, Iasemidis et al. (2004) suggest that the lack of an observed timereverse of the resetting phenomenon is consistent with hysteresis, a characteristic observed in epilepsy as well as other dynamical disorders (Lopes Da Silva et al., 2003). 84 PAGE 85 Mean Angular Frequency in Phase Space One modification of the Lyapunov exponent was proposed by Iasemidis to measure a quantity related to the STLmax measure (Iasemidis et al., 2002, 2003). The mean angular frequency in phase space ( ) measure quantifies the angular frequency of the phase space evolution of two nearest neighbor points relative to a reference point. Conceptually, this measure quantifies the rate of change in stability of a dynamical system. The measure is related to the Lyapunov exponent, which measures the local stability of a system. Consider the vectors and as two states in phase space separated by the time delay. The difference in phase between these two states in phase space is itX ttXi t i (Iasemidis et al., 2002). The mean () of the local phase changes in state space is denoted as: i NiiN11 (351) where is the total number of phase differences calculated from the evolution of to in state space, according to: N itX ttXi ttXtXttXtXiiiiiarccos (352) The mean angular frequency in phase space can then be defined as: t1 (353) If the units of are seconds, t has units of radians per second (an alternative is to divide by 2 resulting in units of sec 1 or Hz for expression of rate of system state change). Figure 33 illustrates the concept of the phase change measure as it is applied to data with the same phase 85 PAGE 86 space mapping with STLmax where dtkt is the evolution time allowed for the vector to evolve to where dt is the sampling period of the original time series. itX ttXi Data Mining Data mining refers to the application of algorithms to extracting patterns from and modeling large databases (Flexer et al., 2000) and provides reasonable tools for extracting useful patterns in datasets from complex systems. Data mining techniques have demonstrated successful detection of scalp EEG patterns which may be difficult for the human eye to visualize (Acir et al., 2005; Chaovalitwongse et al., 2006; Thulasidas et al., 2006). Often such algorithms or the patterns they reveal can be utilized in real time applications, providing a basis for realtime EEG analysis tools (Chaovalitwongse et al., 2005; Iasemidis et al., 2005; Sackellares et al., 2006; Thulasidas et al., 2006). Typical data mining tasks are described by the following categories: Dimensionality reduction: the process of mapping of a highdimensional data set into a lowerdimensional space in order to facilitate data exploration Reduction of noise: correction or removal of measurement artifacts and significantly atypical samples from the data set. Clustering: creation of a partition of a given set of samples into classes according to similarities that are relevant to the particular analysis One of the more important instances of dimensionality reduction is called feature selection. This process results in the generation of a lowerdimensional space by eliminating a subset of dimensions from the original space. Feature selection is an important process for reducing computation time as well potentially improving accuracy. Reduction of noise is an important procedure which is universally applied in applications spanning numerous disciplines. Finally, clustering refers to a broad class of data mining applications which are highly relevant to the work done in this dissertation. 86 PAGE 87 Clustering Clustering problems can be subdivided into unsupervised or supervised clustering. Unsupervised learning methods divide data into natural groupings. Supervised clustering methods are also referred to as classification, which is described later in this chapter. The following represents a nonexhaustive listing of some basic clustering techniques. Kmeans clustering The kmeans algorithm is one of the most basic and commonly applied cluster algorithms. The method clusters a set of N data points into K partitions based on the similarity between the pattern and the cluster centers, where K< N (Jain et al., 1999). A random initial partition is selected after which the patterns are repeatedly reassigned some convergence (e.g. squared error threshold) is achieved. The kmeans algorithm is especially attractive due to its O(n) complexity as well as its ease of implementation (Jain et al., 1999). One deficit of this method is a high sensitivity to initial conditions, which can result in convergence at local minima. Biclustering Biclustering is a data mining technique which provides the ability to not only cluster data samples, but also the data features. The procedure is performed in a manner that each class of data features created within the biclustering is related to a class of data samples by a particular property that distinguishes it from samples in other classes and is said to be the cause of its creation. In other words, the biclusters are subsets of samples which exhibit similar characteristics across a subset of features, or vice versa. The biclustering methodology has been used extensively in numerous biomedical research applications such as DNA microarray analysis and drug design as well as others (Madeira and Oliveira, 2004; Shamir et al., 2005; Busygin et al., 2006). The output of biclustering algorithms 87 PAGE 88 is especially useful for feature extraction, a crucial procedure in many biomedical studies. Analogous to the ability of biclustering to reveal up regulation and down regulation of genes in dna microarray datasets, biclustering is a data mining tool wellsuited for revealing spatial and temporal subsets of EEG features that are indicative of neural states (Busygin, 2007). A dataset containing m features and n samples is arranged as a rectangular matrix nmijaA where a ij represents the ith feature of the jth sample. Consider the assignment of the samples into classes as follows lkrlkSSnSSSrknSSSSlkrkr,,...,1,,,,...,1...,,...,1,,...,1,,...,,2121 This method intends to assign samples such that samples from the same class share specific common properties. Similarly, a feature i may be assigned to one of the features classes lkrlkFFmFFFrkmFFFFlkrkr ,,...,1,,,,...,1...,,...,1,,...,1,,...,,2121 in such a manner that the features of class F k are responsible for the creation of the class of samples S k Such a simultaneous classification of samples and features is termed biclustering. Definition 1: A biclustering of a dataset is a group of sample / feature pair subsets such that the group rrFSFSFSB,,...,,,,2211 rSSS,...,,21 forms a partition of the set of samples, and the collection forms a partition of the set of features. A pair rFFF,...,,21 kkFS, will be called a bicluster. Various criteria may be used for relating sample clusters to feature clusters. Most commonly, it is required that the subset corresponding to a bicluster is either includes a certain 88 PAGE 89 amount of values above the mean of the dataset, or has a lower variance than that of the dataset. In general, it is acceptable for biclustering to rely on any type of common pattern among the elements of the bicluster. Consistent biclustering: The following biclustering framework utilizes feature selection based on 01 fractional programming (Busygin, 2005). Let each sample j be arbitrarily assigned to one of the classes. A 01 matrix rSSS,...,,21 rnjksS is introduced such that = 1 if and = 0 otherwise. The sample class centroids are represented by the matrix : jks kSj jks rmikcC 1SSASCT (354) whose kth column represents the centroid of class kS Consider a row i of the matrix C. Each element in the row is the mean expression of the ith feature in one of the sample classes. Each feature is then assigned to the class where it is among the largest number of features with a similar value as is shown in figure 34. Let the ith feature be classified as a member of the class with the maximal value : k kic ikkikcckkrkFi:,,...,1 (355) Using the acquired feature classification rFFF,...,,21 let a classification of samples be constructed using the same principle of maximal average expression and test whether this arrives at the same classification as when using features. This is performed by constructing a 01 matrix such that if and rmikfF 1ikf kFi 0 ikf otherwise. The feature class centroids can be represented by a matrix rnjkdD : 1FFFADTT (356) 89 PAGE 90 whose kth column represents the centroid of the class The requirement for sample classification is kF jkkjkddkkrkSj:,,...,1 (357) The feature selection and supervised biclustering framework proposed in (Busygin, 2005) is grounded in the following definition. Definition 2: A biclustering B will be called consistent if both relations (355) and (357) hold, where the matrices C and D are defined as in (354) and (356). Unlike other biclustering schemes, this definition of consistent biclustering is justified by the fact that consistent biclustering implies class separability with convex cones (Busygin, 2005). Theorem 1: Let B be a consistent biclustering. Accordingly, there exist convex cones such that every sample from belongs to the cone and no other sample belongs to it, nrPPP,...,,21 kS kP rk,...,1 Similarly, there exist convex cones such that every feature from belongs to the cone and no other feature belongs to it, nrQQQ,...,,21 kF kQ rk,...,1 It follows from the theorem of conic separability that convex hulls of the classes are separated and thus do not intersect. The term biclusteringadmitting is used to describe a dataset for which some consistent biclustering exists. In addition, the data set will be called conditionally biclusteringadmitting with respect to a given (partial) classification of certain 90 PAGE 91 samples and / or features if a consistent biclustering exists which preserves the given (partial) classification. Given a training set nmijaA where the samples are assigned to classes the corresponding classification of features can be constructed according to expression (355). If the obtained biclustering is not consistent, features are then excluded from the dataset so that the biclustering with respect to the cropped feature set is consistent. rSSS,...,,21 Let a vector of 01 variables miixx,...,1 be introduced where the ith feature is selected if and is not selected otherwise. When only the selected features are applied, the condition of biclustering consistency in expression (357) becomes 1ix kkrkkSjxfxfaxfxfakmiiikmiiikijmiikimiikiij,,...,1,,,1111 (358) The expressions in (358) are utilized as constraints of a feature set optimization problem. Though the objective function may take on various functions of x depending on the desirable properties of the features, a general choice is to aim for the maximal number of features. This formulation helps minimize the amount of lost information provided during training. In this scenario, the objective function is expressed as miiX1max (359) Expressions (358) and (359) comprise a specific type of fractional 01 programming problem which can be solved using the approach laid out in (Busygin et al., 2005). 91 PAGE 92 Data Classification Classification can be described as the process of categorizing an unknown dataset. First, a socalled training set of samples wherein sample classes are known a priori is provided to the algorithm. The preclassified training data is used to train the algorithm to recognize the specified patterns. Training is typically an iterative process where the parameters affecting classification are systematically adjusted until the classification error bound is decreased below a specified threshold. This specific process is referred to as machine learning. Machine learning Machine learning refers to a collective group of methods which are utilized to enable computers to learn. There have been very successful implementations such as finding genes in a DNA sequence, filtering email, financial analysis, detecting or recognizing objects in machine vision, language processing, and medical diagnosis (Cristianini and ShaweTaylor, 2000). Many of these applications rely on pattern recognition which is essentially concerned with object classification based on characteristics. An objects characteristics or features can be described as the qualitative and quantitative measures which can distinguish it from other objects. The amount of similarity between two objects can be quantified as a function of the differences in the objects set of features. Object similarity can be used as a basis for grouping objects into classes. Please note, while the content of a persons character may be a useful feature of a person, the color of a persons skin is not a good feature for classification. Classes may be represented in various ways such as approximation functions or functions that define borders between classes. Arranging objects into classes based on their location relative to these functions is referred to as classification. Machine learning from the classification perspective can be organized into two main categories. Supervised learning refers to the process where a system learns from an example data 92 PAGE 93 set in the form of input/output pairs. In such an example dataset, the input is typically a vector of representing an objects features and the output is the objects class label. A set of objects each with a corresponding feature vector and class label is more formally referred to as a training set. The training set is used to derive a classification function. Once trained, a classification function is capable of predicting an objects label. The term supervised stems from the nature of the training scheme where the training sets object labels are determined by an outside source and provided as an input. Therefore, this training method requires supervisory guidance to train the classifier. Unsupervised learning is the other machine learning category where objects are not labeled with any class information a priori. Thus, unsupervised learning forms object classes based on inherent feature similarities determined during training. Supervised learning systems applications have found extensive use in biological applications (see Tarca et al., 2007 for a review). Briefly, some biological and medicinal applications include detection of cancer prone tissues, mapping tissue gene expression profiles to disease groups, and protein folding based on the DNA sequence. In addition, a broad range of machine learning algorithms have provided a means for successful neural state classification and neurological disorder diagnosis using EEG signal features (Flexer, 2000; Lotte et al., 2007; Seref et al., 2007). There are several wellknown machine learning algorithms, including decision trees, neural networks, and support vector machines. These base algorithms can be used in combination with other algorithms for improved accuracy often at the cost of hindered performance. One of the most widely used measures in classification problems is the Mahalanobis distance metric. Mahalanobis distance classification Mahalanobis distance is a statistical distance measure which factors in correlations between variables. The mahalanobis distance is a useful method of quantifying similarity of an 93 PAGE 94 unknown sample set to a known sample set. The square of the mahalanobis distance measure has been applied to the classification of neural states using EEG signal patterns (Scher et al., 2003; Le Van Quyen et al., 2005; Piccini et al., 2005). The squared mahalanobis distance, D 2 ref,t between a 25dimensional EEG data point vector X(t) where TtchtchtchtchXXXXtX,,...,,,,25,3,2,1 (360) and the centroid of the reference class ref where Tchchchchref25321,...,,, (361) is equal to: refrefTreftreftXCtXD1,2 (362). The C ref term is the covariance matrix for the reference class. The mahalanobis distance measure D 2 comparison,t refers to distance between the same EEG data point, X(t), and the centroid of the comparison class, comparison The EEG data point X(t) is assigned to the class with the closest centroid (e.g. the class from which the point is at the minimum Mahalanobis distance) to X(t) (Le Van Quyen et al., 2005). If the EEG data point is equidistant between the two classes, the point is considered misclassified. The accuracy of the minimum Mahalanobis distance classifier is equal to the number of correctly classified points divided by the total number of points. Support vector machines Support Vector Machines (SVMs) are a class of data classification algorithms first introduced by Vapnik and Lerner (1963) which are used to model and classify large volumes of multivariate data. The SVM algorithm determines the optimal separating hyper surface between two multidimensional datasets (Burgess et al., 1998). SVMs have been demonstrated success in numerous biomedical applications such as magnetic resonance imaging (MRI), functional MRI 94 PAGE 95 (fMRI), positron emission tomography (PET), and Singlephoton emission computed tomography (SPECT) (Seref et al., 2007) in addition to applications where neural states were classified from EEG data (Acir et al., 2005; Chaovalitwongse et al., 2006; Lehmann et al., 2007; Thulasidas et al., 2006). The SVM formulation for linearly separable data quantifies the distance from the hyper surface for each data point in the positive class and each data point in the negative class. In this context, the term margin will refer to the distance between the separating hyper surface and the nearest point for a class. The margin of the function output is referred to as the functional margin. The geometric margin is the functional margin of a normalized weight vector. Hence the geometric margin can be optimized by fixing the functional margin to be equal to one and then minimizing the norm of the weight vector (Cristianini and ShaweTaylor, 2000). If w is the weight vector for a functional margin of distance equal to one from a positive (reference) class point, x+ and a distance equal to one from a negative (comparison) class point, x, then the geometric margin can be determined as follows. For a functional margin equal to one: 1,bxw (363) 1,bxw (364). To calculate the geometric margin, w must be normalized. The geometric margin, is then the functional margin of the resulting classifier 22221,,21,,21wxwxwwxwwxww (365). 95 PAGE 96 Thus, the interclass margin is maximized by 2,minwbw (366) subject to 1,bxwyi ni,,1 (367) where the constraints are that all points are properly classified for positive and negative classes, as stated in (367). For nonseparable data, the objective function (368) combines the term for maximizing interclass margin with a term for minimizing misclassification error (Cristianini and ShaweTaylor, 2000). niibwCw1,22,,min (368) ni,,1 iiibxwy1 (369) ni,,1 0i (370) ni,,1 The cost term, C, in (368) is the weight assigned to the error. Expressions (369) and (370) represent the constraints that each misclassified point is assigned a linear penalty (slack variable) and that all slack variables are nonnegative, respectively. An example of such a soft margin classifier is shown in figure 35. The SVM formulation in equations (368), (369), and (370) utilizes a linear hyper surface for discrimination. A common practice for improving separation accuracy is to perform a transformation to remap the data from input space into feature space using a kernel function. The inner product is then performed on the transformed feature space data (see equation (371)). jijixxxxK,, (371) The concept of a kernel function is identical to that of phase space mapping. The purpose is to view the data in a transformed space to unmask patterns which may have been hidden in 96 PAGE 97 input space. The radial basis function (RBF) is a standard choice as a kernel function in neuroscience applications (Acir and Gzelis, 2005; Bewernitz et. al., 2006; Lehmann et. al., 2007; Thulasidas et. al., 2006; Seref et al., 2006). The RBF function is expressed as 2exp,jijixxxxK (372) The SVM is trained using a set of data features with a known classification. The SVMs performance is measured in terms of the accuracy at which it is able to classify a test data set. 97 PAGE 98 Figure 31. A 15 second segment depicting the 200 Hz EEG of an absence seizure viewed from channel Fp1F7. 98 PAGE 99 Figure 32. A 15 second segment depicting the spectrogram of an absence seizure viewed from channel Fp1F7. The vertical lines represent the onset and offset of the seizure. 99 PAGE 100 t 1 Figure 33. Example angular frequency evolution in phase space. Figure 34. Biclustering result of a toy dataset. The dataset produced three distinct classes. 2 1 t 2 t 0 )0(0x )1(0x )0(kx)1(kxtdtk 100 PAGE 101 Figure 35. Linear hyperplane classifier applied to nonseparable data. 101 PAGE 102 CHAPTER 4 INVESTIGATION OF EEG BIOMARKER EXISTENCE FOR VAGUS NERVE STIMULATION THERAPY: A DATA MINING APPROACH Patients with newly implanted vagus nerve stimulation (VNS) systems in VNS therapy undergo a calibration period of several months. With little knowledge of the mechanism of action (see chapter 2) or a rapid measure of efficacy, the current process of tuning VNS stimulation parameters in newly implanted patients is essentially based on the physicians experience and trialanderror. This process consists of setting initial stimulation parameters then iteratively adjusting stimulation parameters based on patient reports of clinical efficacy (seizure frequency) and tolerability since the previous visit to the doctor. It is known that high settings for stimulation parameters (such as output current, frequency, and pulse width) are shown to result in greater seizure reduction than low settings (BenMenachem et. al, 1994), but there is no available means for determining the proper set of stimulation parameters for a particular patient without numerous visits to the neurologist. This period involves numerous medical checkups to fine tune the electrical stimulation parameters based on clinical response. This suboptimal adjustment method leaves the patient at risk of seizures and imposes financial burden. The purpose of this study is to address this problem using data mining analysis. This chapter is organized as follows. First, the rationale for this study is introduced in terms of clinical relevance. Next, the experimental strategy is outlined and justified with examples from the literature. Afterwards, the four experiments comprising this chapter are presented in the following format: introduction, data description, experimental setup, results, and discussion. Finally, an overall conclusion is presented which comments on all the findings as a whole. 102 PAGE 103 Motivation for VNS Therapy Improvement It is desirable to establish a method to rapidly predict the efficacy of the various combinations of VNS parameters newlyimplanted patients in order to mitigate doctors visits and perhaps expedite the process of optimizing therapeutic efficacy. A first step towards this goal is to investigate the existence of a physiologic metric that is sensitive to the EEG stimulation parameters and then the patient's clinical response to VNS therapy. Such an effect could be present in the EEG signal. EEG Markers for Treatment of Neurological Diseases and Disorders The utility of electroencephalogram (EEG) markers in treatment of neurological disorders motivates the examination of this treatment modality in terms of EEG effect (see chapters 2 and 3 for additional details). Electroencephalographic markers have demonstrated robust utility for the diagnosis, treatment, and evaluation of treatment for epilepsy (Iasemidis et al.,1996; Pardalos et. al, 2003, 2004; Chaovalitwongse et al., 2005, 2006; Ding et al., 2007; Schevon et al., 2007) as well as other neurological disorders (Krystal et al., 1996, 1997, 2000; Asyali et al., 2007; Ding et al., 2007; Quintana et al., 2007). Specifically, there is has been an interest in the application of such analysis to the EEG signals of VNS patients to provide a better understanding of the therapy (Uthman et al., 2007). Recent studies have produced interesting findings of longterm VNS effects on epileptic interictal spikes (Koo, 2001), epileptiform sharp waves in the hippocampus (Olejniczak et al., 2001), interictal epileptiform discharges (Janszky et al., 2005; SantiagoRodriguez and AlonsoVanegas, 2006), gamma activity and desynchronization (Marrosu et al., 2005), and spectral content of sleep (Rizzo et al., 2004). The effects on interictal epileptiform discharges such as the studies by Koo and Olejniczak et al. suggest the presence of brain dynamical changes and further motivate the desire to examine VNSinduced EEG changes from the perspective of nonlinear dynamics since the 103 PAGE 104 existence dynamical changes are implied by changes in spiking patterns. In addition, no studies could be located which aimed to relate the EEG effects of VNS to the stimulation parameters. Aside from longterm epileptiform effect (Koo, 2001) or effects observed in hippocampal depth electrodes (Olejniczak et al., 2001), the lack of readilyavailable shortterm scalp electroencephalographic VNS effects reported in the literature (Hammond, 1992; Salinsky et al., 1993; Fisher et al., 1999; Koo, 2001; Rizzo et al., 2004; Marrosu et al., 2005), the benign noninvasiveness of scalpEEG, state of the art techniques of modern knowledge discovery in database techniques (Flexer, 2000), and the potential for realtime application due to modern computer technology make EEG data mining analysis a desirable approach to studying VNS effect. These reasons motivate the current study which aims to identify electroencephalographic markers which are sensitive to VNS stimulation parameter configuration. If such electroencephalographic markers are identified, and if the electrographic markers are found to correlate with clinical efficacy then these findings could be applied to determine optimal VNS stimulation parameters on a patientbypatient basis. Modeling Brain Disorder Dynamics One approach for studying the brains behavior is to generate a mathematical model of some subset the brains activity using observable quantities, such as EEG recordings. Such models provide a means to make predictions about the behavior of one or more sections of the brain in response to various inputs. Due to the high degree of complex neuronal interaction in the brain, direct models have only been achieved for small neuronal networks small brain structures (Breakspear, 2001; Chauvet and Berger, 2002). The enormous complexity of electrical brain signals often means exact modeling approaches are insufficient. The challenge of direct modeling is compounded by the fact that no consistent immediate or shortterm VNSinduced effects have been identified in the raw EEG or its timefrequency profile (Salinsky et al., 1993; 104 PAGE 105 Fisher, et al., 1999; Koo, 2001; Rizzo et al., 2004; Marrosu et al., 2005). However, suppression of epileptiform sharp waves in the hippocampus has been observed (Olejniczak et al., 2001). This provides motivation for searching for dynamical scalpEEG effects of VNS. However, in a complex system such as the brain, it is often difficult if not impossible to obtain exact knowledge of system governing the observed dynamical behavior. In such a case, an alternative method to exact modeling is to develop a macroscopic modeling approach based on observable measures of the system in its entirety, such as EEG signals (Iasemidis et al., 1996). Upon extraction of such information, it may be possible to generate useful empirical models of the systems global behavior. One such modeling scheme treats epilepsy as a dynamic disorder which is a class of disorders characterized by a sudden qualitative change in dynamics in response to an endogenous factor or a clinical maneuver (Milton, 2000). From this perspective, epileptic symptoms occur as a result of modifications to underlying physiologic control system parameters (Mackey and Glass, 1977; Mackey and an der Heiden, 1982; Milton and Mackey, 1989; Belair et al., 1995; Milton and Black, 1995; Milton, 2000; Lopes Da Silva et al., 2003). Such changes may manifest, for example, as a qualitative change in dynamics corresponding to bifurcations in mathematical systems. The importance of identifying a dynamic disorder is that a treatment possibility can focus on manipulating underlying control parameters back into a range of healthy dynamics (Milton, 2000). An example of this is the epileptic seizure control strategy of Iasemidis et al. where the control focuses on maintaining a healthy range of STLmax tindex values (associated with seizure transition) by therapeutic intervention (Iasemidis et al., 2003; Good et al., 2004, 2005). An analogous scenario may apply to VNS calibration in newlyimplanted patients where the VNS parameters are adjusted in order to elucidate a brain 105 PAGE 106 dynamical response or state that has been previously established as indicative of desired and even optimal seizure protection. Thus, the achieved neural state as described by dynamical EEG responses associated with different stimulation parameters over time may serve as marker for VNS treatment and facilitate rapid determination of optimal VNS parameters. See figure 42 for a threedimensional conceptual example of such a model. The example in 42 utilizes three measures only for the sake of example. In actuality, a real model may utilize dozens or even hundreds of such EEG features. Determining which EEG measures should be used in such model is a challenging task indeed. A common approach for revealing complex relationships among the features and samples from large a multidimensional dataset (such as an EEG recording) is to employ data mining methods. Data mining refers to the application of algorithms in order to extract patterns from complex databases (Flexer, 2000) and provides a means for identifying EEG features which may be sensitive to neural stimulation as well as neural stimulation parameters in the VNS implant. Previous work employing data mining techniques has demonstrated successful pattern detection from scalp EEG signals which is often difficult for the human eye to visualize (Iasemidis et al., 1996; Pardalos et al., 2003; Iasemidis et al., 2004; Acir et al., 2005; Iasemidis et al., 2005; Chaovalitwongse et al., 2006; Sackellares et al., 2006; Thulasidas et al., 2006). Thus, such an algorithm may be useful in the case of VNS therapy where shortterm stimulation scalp EEG effects are not explicitly visible in the time or frequency domain (Hammond et al., 1992; Salinsky et al., 1993; Koo, 2001; Rizzo et al., 2004; Marrosu et al., 2005). Often such algorithms can be run in real time, providing a basis for an online EEG analysis tool (Sackellares et al., 1997; Chaovalitwongse et al., 2005; Iasemidis et al., 2005; Thulasidas et al., 2006). 106 PAGE 107 The overall goal of this work is to investigate the existence of EEG feature patterns which may be related to clinical and biological aspects of a patient's VNS therapy. The underlying hypothesis of this work (stated as null) is electroencephalographic effects in patients undergoing VNS therapy for epilepsy do not vary with differing VNS parameters. Expressing VNSrelated effects in terms of scalpEEG recordings is desirable considering its wide availability at medical facilities and utility in epilepsy diagnosis. Such EEG measures may one day find use as markers to help determine optimal VNS parameters more rapidly in newlyimplanted patients. Biclustering Analysis of EEG Dynamics in Patients undergoing VNS Therapy for Epilepsy Biclustering is a useful method for determining the existence of supervised binary classifications in multivariate datasets. The outputs of biclustering are particularly valuable for feature extraction purposes which are a significant concern in many biomedical studies. One of the most common applications is establishing connections between syndromes (e.g., signs and symptoms in cancer) and their corresponding gene expression patterns (Cheng et al. 2000; Kluger et al., 2003; Yoon et al., 2005). The biclustering algorithms ability to distinguish two predefined states makes it a potentially useful tool for characterizing EEG dynamical alterations associated with VNS activation using EEG features (such as STLmax ) as an input. Data Description The scalpEEG recordings utilized in this study were obtained from patients with functioning VNS implants for the treatment of epilepsy. The recordings were performed at the General Clinical Research Center (GCRC) in Shands Hospital at The University of Florida. EEG was acquired under GCRC protocol # 614, Institutional Review Board (IRB) protocol #6172004, "Neurophysiologic Measures of Vagus Nerve Stimulation". EEG data were obtained at 512 Hz sampling rate using 16bit precision with a 0.16 Hz high pass filter and 105 107 PAGE 108 Hz low pass filter hardwired into the amplifier. The dataset contained 25 scalpEEG channels arranged in the standard international 1020 system (see Fig. 43). EEG channels included in the study were: Fp1, Fp2, F3, F4, C3, C4, P3, P4, O1, O2, F7, F8, T3, T4, T5, T6, A1, A2, Fz, Cz, Pz, Leye, Reye, Lmn, and Rmn ("mn" refers to an electrode placed on the mandibular notch positioned between the jaw bone and the skull, which provides information about the temporal lobe). The CPz electrode, which is positioned between Cz and Pz, is used as the reference for the 25 EEG channels and electrocardiogram (ECG). The ECG electrode was placed near the VNS pulse generator for two reasons. While this position provides a sufficient ECG signal, it is also close enough to the pulse generator to introduce a unique artifact in the ECG channel which corresponds to the pulse generator activation. This explicit VNS signature provides a means to determine stimulation times. Once stimulation times were obtained, the ECG channel was excluded the further study. This study included two patients. The VNS paradigm is configured to deliver stimulation for 30 seconds and halt stimulation for 5 minutes, a cycle which repeated regularly throughout the entire recording for both Patient A and Patient B. Patient A's VNS parameters were 1.75 mA output current, 30 Hz signal frequency, 500 sec pulse width, 30 second signal duration, and a 5 minute VNS deactivation duration. Patient B's VNS stimulation parameters were 1.5 mA output current, 20 Hz signal frequency, 250 sec pulse width, 30 second signal duration and 5 minutes VNS deactivation duration. The VNS implants allow manual activation of the device should the patient require an immediate stimulation (e.g. if the patient senses an imminent seizure). Patient A's manual stimulation parameters were 2 mA output current, 30 Hz signal frequency, 500 sec pulse width, and a 60 second stimulation duration. Patient A did not experience any seizures 108 PAGE 109 during the recording session, and did not initiate manual stimulations. Patient B's manual stimulation parameters were 1.75 mA output current, 20 Hz signal frequency, 500 sec pulse width, and a 60 second signal duration. Patient B underwent 14 seizures during the recording session and manually activated the stimulator between 20 to 40 seconds after onset of each seizure (a total of 14 manual activations). Additional information on the patients clinical status can be found in tables 41 and 42. Each patient underwent continuous scalpEEG recordings approximately 24 hours in duration. For Patient A, a total of 255 VNS were analyzed in this study. For Patient B, a total of 237 VNS cycles were used in the analysis. Some of Patient Bs VNS cycles were excluded from the study due to their disruption by a manuallyactivated stimulation and/or occurrence during a seizure. Finally, the last VNS cycle was excluded from analysis for both patients because it was not a complete cycle (it began closer than a full cycle length to the end of the recording). STLmax Feature Extraction Modeling brain activity using chaos measures has been shown to be useful for providing dynamical information about the neural state of the epileptic brain. Studies involving human patients (Iasemidis and Sackellares, 1990; Iasemidis and Shiau et al., 1999; Iasemidis et al., 2001; Iasemidis and Pardalos et al. 2003; Iasemidis and Shiau et al., 2003) and animal models of epilepsy (Nair et al., 2004, 2005, 2006; Talathi et al., 2008) suggest that occurrence of spontaneous seizures correlates with the evolution of the brain to a state of greater spatiotemporal order. This phenomenon manifests as a progressive increase in intrachannel similarity as measured by Lyapunov exponents calculated from multichannel EEG recordings. The reported sensitivity of STLmax to neural state changes in epilepsy make the measure a reasonable choice for attempting to characterize the VNS effects. Additional information can be found on the STLmax measure in chapter 3. 109 PAGE 110 Briefly, as was described in chapter 3, the window duration for calculating STLmax needs to be short to provide temporally local information about the brains dynamics yet contain enough points for the algorithm to converge. A window length of 2048 points (corresponding to 4 seconds) was selected as it was sufficient for providing a stabilized STLmax estimate in previous neural state classification studies in epilepsy (Iasemidis and Sackellares, 1999). In addition, it is desirable to utilize the shortest window length possible for STLmax estimation in order to provide locally dynamic information. As such, while maintaining a window length of the recommended number of data points for algorithm convergence, the 512 Hz sampling frequency provides improved time resolution over previous studies (which utilized a 200 Hz frequency). Additional parameters for STLmax estimation were selected based on the successful neural state classification studies that utilized them (Iasemidis and Sackallares, 1999): reconstructed dimension D = 7, phase space reconstruction delay = 14 msec (7 samples), evolution time T = 41 msec (21 samples). Experimental Setup The STLmax time series for 25 EEG channels were analyzed using a consistent biclustering framework to determine separability of EEG fragments corresponding to stimulation times versus VNS deactivation. Since stimulation duration was set to 30 second and a four second time window was used to estimate each STLmax value, each stimulation provided seven data points. In order to help compensate for EEG pattern changes over the recording session which may not be related to VNS, each point in the stimulation class was averaged with the corresponding samples across all other stimulation cycles. This procedure reduces the amount of features to seven STLmax values for each channel to represent the stimulation class. The nonstimulation class was comprised of ten STLmax points starting 250 seconds after each stimulation to represent the portion of the nonstimulation temporally furthest from the end 110 PAGE 111 of stimulation. This class size was utilized capture as much information about the nonstimulation periods as possible while keep class sizes reasonably close to one another (<50% size difference in classes). Each STLmax point in the nonstimulation class was averaged across all VNS epochs (where an epoch consists of one stimulation and one nonstimulation period). Thus, the nonstimulation class consists of ten averaged STLmax samples from nonstimulation time intervals (see figure 44). Thus, with 25 EEG channels, there total dimensionality of the biclustering input is 25 x 17. This particular input size this problem could be solved without any relaxation using CPLEX (ILOG Inc., 2004). Crossvalidation by the leaveoneout method was performed for each sample. Results Patient As data were conditionally biclusteringadmitting into a binary supervised classification for the designated nonstimulation and stimulation classes with inclusion of all features (see figure 45). All but one feature (channel P3) were classified into the nonstimulation class. The heatmap indicates that STLmax indicates during the stimulation with respect to nonstimulation for all but the P3 channel. The leaveoneout crossvalidation method resulted in consistent classification of all 17 samples for Patient A. Only five features in patient B were able to fulfill the supervised biclusteringadmitting sample class designation with respect to given stimulation and nonstimulation classes. Channels F7 and T6 were designated as belonging to the nonstimulation class, while channels T3, Leye and Reye were classified into the stimulation class. Thus, there is less similarity among the channels during stimulation and nonstimulation, and a less clear distinction between stimulation and nonstimulation in Patient B than Patient A. 111 PAGE 112 Patient As stimulation parameters (1.75 mA, 30 Hz, and 500 s pulse width) were all greater than Patient Bs (1.5 mA, 20 Hz, and 250 s pulse width) except for the 30 second on time and 5 minute off time, which were the same for both patients. Discussion The successful application of biclustering with Lyapunov exponents demonstrates the potential to distinguish during VNS stimulation from VNS deactivation epochs using the dynamical scalpEEG measure STLmax. There is a greater spatialtemporal similarity in EEG dynamics during stimulation in patient A than during nonstimulation. However, this phenomenon was not nearly as welldefined in patient B. It should be noted that Patient A had no seizures during the recording, whereas Patient B underwent seizures which were accompanied by a manuallyinitiated VNS stimulation. Though epochs containing seizures or manual stimulations were excluded from the analysis, it is possible that the seizures may have affected the results. Studies have demonstrated EEG dynamical transitions (in terms of the STLmax measure) preceding seizures minutes to hours (Iasemidis et al., 1988; Iasemidis, 1991; Iasemidis et al., 1994, 1996, 1997). It may be that EEG dynamical changes leading up to a seizure and/or persisting after the seizure lead to such a small amount of features selected in Patient B. Despite the seizures and manual stimulations, the signals arising from the frontal lobe (f7, leye, and reye) and temporal lobe (t3 and t6) of the brain were sufficiently altered between stimulation and nonstimulation to allow a biclustering of the during the stimulation class (from t3, leye and reye channels) and nonstimulation class (from f7 and t6 channels) for Patient B. This could mean that the EEG effects of VNS are most pronounced in the frontal and temporal lobes. Patient B has a right frontal lobe focus. 112 PAGE 113 The biological significance of these results may be related to study which discovered that VNSinduced acute suppression of epileptiform activity in a hippocampal depth electrode (Olejniczak et al., 2001). While the study by Olejniczak et al. utilized depth electrodes, its possible that scalp EEG recordings may display some manifestation of such an EEG effect observed at a hippocampal depth electrode. From this perspective, perhaps the STLmax behavioral differences between patients A and B are associated with enhanced suppression of epileptiform activity in patient A compared to patient B. Patient As stimulation parameters were all higher than patient Bs parameters, with the exception of stimulation duration and off time, which were 30 seconds and 5 minutes for both patients, respectively. In general, high stimulation parameters are associated with a greater clinical response than low settings (BenMenachem et al., 1994). Thus, any enhancement to epileptiform activity suppression in patient A over patient B is likely attributed to patient As higher stimulation parameter settings. This work was published in the paper Biclustering EEG data from epileptic patients treated with vagus nerve stimulation, authored by Stanislav Busygin, Nikita Boyko, Panos Pardalos, Michael Bewernitz, and Georges Ghacibeh (Busygin, 2007). SVM Analysis of EEG Phase Space Patterns in Patients undergoing VNS Therapy for Epilepsy In light of the numerous successful neural state classification applications, often in real time (Chaovalitwongse et al., 2006; Thulasidas et al., 2006) it is possible that SVMs may be able to provide a computationally inexpensive yet robust similarity measure for quantifying stimulationinduced EEG effects. As was stated chapter 3, experimental evidence supports the idea of a therapeutic resetting effect of epileptic seizures in terms of preictal convergence and postictal divergence of the STLmax measure among critical EEG electrodes (Iasemidis et al., 2004). Furthermore, recent experimental evidence suggests that therapeutic interventions such 113 PAGE 114 as neurostimulation and AEDs can mimics the electroencephalographic resetting effect of a seizure (Good et al., 2004, 2005; Ghacibeh et al., 2005). Thus, a reasonable approach for examining VNS therapy is from the framework that it mimics the effect of a seizure by comparing stimulation artificial seizures to nonstimulation (postictal or interictal). Thus, the EEG phase space of an EEG segment during VNS stimulation was compared to successive windows spanning the full stimulation / nonstimulation epoch with the intent of comparing the degree of separability to the stimulation parameters and the clinical status of the patient. The application of support vector machines for obtaining an estimate of EEG similarity during stimulation compared to subsequent EEG segments may provide a rapid means to investigate and quantify electroencephalographic effects of VNS. The goal of this study is to extract EEG patterns which could be used as an electroencephalographic marker of optimal VNS stimulation parameters. Data Description Approximately 24 hours of scalpEEG was recorded and analyzed from six epileptic patients being treated undergoing AEDs and VNS therapy and the control patient. The recording electrode placement scheme is described in figure 42. The VNS Patient information is summarized in tables 41 and 42. SVM Application Description SVM training and testing were performed using LIBSVM software package designed for Matlab (Chang et al., 2001). The RBF kernel transform (equation 372) is a useful feature space mapping technique successfully utilized in numerous neurophysiological studies (Acir et al., 2005; Lehmann et al., 2007; Thulasidas et al., 2006).The RBF kernel with =39 was utilized for the feature space transformation and a cost parameter of C=1000 were employed based on studies utilizing RBF SVMs to classify neural states using scalp EEG data (Kaper et al., 2004; 114 PAGE 115 Acir et al., 2005; Lotte et al. 2007). Thus, In contrast to the traditional SVM application where a typical goal is to obtain maximal separation basis by adapting all parameters, this study fixes the and C parameters in order to mitigate subjectivity when comparing stimulation epochs to the nonstimulation epochs. An SVM classification accuracy of 50% implies minimal separation between the reference class and comparison class whereas 100% separation implies maximal separation between the reference and comparison class. These two extremes are interpreted as maximal and minimal similarity, respectively. Experimental Design The progression of EEG pattern evolution was quantified as the amount of separation achieved with support vector machines between two EEG segments both mapped into feature space using the radial basis function kernel. This exploratory study aims to examine how the EEG feature space patterns evolve throughout VNS stimulation and to identify potential relationships to stimulation parameters. In addition, the results will be compared to the clinical status of the patient. The ECG electrode was positioned on the skin over the VNS pulse generator so that VNS stimulation waveform is introduced into the ECG channel (see figure 43). The VNS stimulation times were then obtained by examining the ECG channel, which was excluded from further analysis. The following experimental procedure was applied to each stimulation epoch (an epoch defined as a VNS "on" cycle and one "off' cycle) in the continuous EEG recording for each patient (with the exclusion of the final stimulation epoch which began less than one full cycle before the EEG acquisition was deactivated). An EEG segment occurring from 10 seconds to 20 seconds after the start of the VNS stimulation is selected as the positive class (from here on this class will be referred to as the reference class). The duration of each class was set at 10 seconds because this time frame is suggested to be long enough to be able to quantify brain 115 PAGE 116 dynamics yet short enough to be sufficiently stationary (Casdagli et al., 1995, 1996, 1997). The reference class segment was selected to start at one full window length after the start of stimulation because that allows the stimulator to have finished the rampup phase and be at the steadystate stimulation phase. The first successive EEG window (the segment ranging from 20 seconds to 30 seconds) was selected as the first negative class (from here on this class will be referred to as the "comparison class"). The first preprocessing step was to down sample both classes by calculating the mean value of a movingaverage nonoverlapping window, a step which decreases SVM classification time often without a significant effect of results (Thulasidas et al., 2006). The smoothing window was set at 10 points in duration based on prior experience. Next, each data point is converted to a zscore by normalizing to zero mean and unit standard deviation. This procedure prevents channels with greater mean amplitudes from dominating the classification decision (Acir et al., 2005). The trained SVM was tested with a vfold cross validation scheme, as described in (Hsu et al., 2003). This process applied a resampling technique in which the two classes are first randomly shuffled then divided into v equallysized subsets. The SVM is trained using v1 segments and is tested using the remaining subset V. This process is repeated until all v subsets have been tested. The accuracy is the percentage of properly classified points from each of the v trials. Based on prior experience, v=2 folds were utilized for SVM training and testing in this study. Once the training accuracy is obtained for the particular reference class and comparison class combination, the comparison class advances one full window length and the process repeats. The process of calculating SVM accuracy then advancing the comparison class is repeated for all comparison segments which occur within one window length from the next stimulation (into the next VNS epoch). This process is performed for each VNS epoch in the 116 PAGE 117 approximately 24 hour continuous EEG recording for each patient (with the exception for the final stimulation epoch during which the EEG recording ended). Results The results for the six patients are shown in figures 46 through 49 and table 43. The vertical line at 30 seconds in figure 46 represents the time when the VNS stimulator deactivates. Patients D and F have fewer comparison segments due to their off time of 3 minutes (thus the time between stimuli is less than the rest of the patients, which have a 5 minute off time). Patients E and F are seizure free. Discussion The results suggest a correlation may exist between pulse width and SVM separation accuracy (figure 48) as well as between stimulation frequency and SVM separation accuracy (figure 49). Furthermore, less similarity (greater SVM separation accuracy) is observed between the reference class (10 second EEG segment during stimulation) and all subsequent comparison classes (all nonoverlapping 10 second EEG segments prior to the next stimulation) for higher values of pulse width and stimulation frequency than is observed with lower values of pulse width and stimulation frequency. The biological significance of these results may be related to studies demonstrating differences in cerebral blood flow related to stimulation parameters. Specifically, a study demonstrated that the 250 s VNS pulse width caused reduced blood flow in significantly more brain regions (e.g. hippocampus and superior temporal lobe) than a 500 s pulse width (Mu et al., 2004). It is possible that pulsewidthinduced blood flow changes in these brain regions may have altered neuronal activity and thus be responsible for covariation of EEG feature space dispersion with pulse width. Another study reported that a 20 Hz stimulation frequency produced significant blood flow increase over 5 Hz in numerous brain regions such as the orbitofrontal 117 PAGE 118 cortex, hypothalamus, and thalamus in VNS patients (Lomarev et al., 2002). These regions may brain regions may be responsible for observed covariation of EEG feature space dispersion with stimulation frequency. It may seem counterintuitive that output current (figure 47) did not appear to demonstrate a trend with the SVM separation measure as a study demonstrated that higher stimulation settings (such as output current, frequency, and pulse width) can result in greater seizure reduction than lower (BenMenachem et al., 1994). However, the output current increase in (BenMenachem, et al., 1994) was also accompanied by increases in frequency and pulse width parameters. Thus the outcomes of that study can not be attributed to changes in a single parameter. Fortunately, the other two parameters (frequency and pulse width) mentioned in (BenMenachem et al., 1994) may correlate with EEG pattern changes, though more patients are needed to verify such a claim. It is possible that VNS mimics the seizure effect of "resetting" the brain from an unfavorable preictal state to a more favorable interictal state (Sackellares et al., 1997; Iasemidis et al., 2004) in which case the decrease in EEG similarity (signified by higher SVM separation accuracy) between the reference class and all subsequent comparison classes in an epoch may be an multidimensional analog to the brain dynamical resetting effect. The original effect was described as statistical convergence and divergence of STLmax values among critical electrode pairs (Iasemidis et al., 2004). Thus, one explanation for the observed feature space similarity phenomenon is these measures are electroencephalographic evidence that VNS is in some manner resetting the brain more effectively (as denoted by the lower similarity measures after stimulation) in the patients with fewer seizures per month. Perhaps therapies such VNS provide 118 PAGE 119 ongoing gradual therapeutic action which suppresses the need for a large scale brain dynamical transition such as a seizure. It is worth stating that the time of each patient's last seizure prior to the EEG recording session for this study is not documented. The timing of the last seizure could prove to be important for patients who are not seizurefree (A, C and D). This is because there is a period of heightened seizure resistance during the period immediately following a generalized tonicclonic seizure. If patients A, C, and D had undergone a generalized tonic clonic seizure shortly before the EEG data were recorded for this study, then they may still have been under the influence of the reduced seizure susceptibility phenomenon. This may explain why they did not experience any seizures during this study. If Patient B had not experienced a generalized tonic clonic seizure recently, then reduced seizure susceptibility phenomenon may have been partially responsible for the large number of seizures reported this patient underwent during the study. These results should be viewed in the context that all six VNS patients are considered responders to the therapy defined as having at least 50% seizure reduction after one year of VNS therapy (Morell et al., 2006). Drug medication differences could also have an effect on the results. For example, patient D (whom demonstrated the lowest average similarity) is the only patient using either carbamazepine or zonisamide. On the other hand, Patient B (whom demonstrated the highest average similarity) is the only patient taking phenobarbital. Perhaps these differences in antiepileptic medications could have altered the observed electroencephalographic effects. As all patients have undergone VNS therapy for >1 year it may be regions of their nervous system such as the vagus nerve and/or brain may have adapted to VNS to such an extent that they do not demonstrate a significant acute EEG response to individual stimulations. However, it 119 PAGE 120 is premature to arrive at such a conclusion. The SVM training parameters utilized, though successful in similar studies, are not optimized for this particular application. In addition to nonoptimized SVM parameters, it is likely that improvements can be made in terms of feature selection for exposing VNS EEG effects. This study is published in an article titled Quantification of the Impact of Vagus Nerve Stimulation Parameters on electroencephalographic Measures with authors Michael Bewernitz, Georges Ghacibeh, Onur Seref, Panos Pardalos, ChangChia Liu, Basim Uthman (Bewernitz, 2007). Data Mining Analysis of EEG Dynamics Patients undergoing VNS Therapy for Epilepsy The fact that the resetting effect is described in terms of the STLmax feature motivates the use of the STLmax measure for investigating EEG patterns potentially associated with VNS and VNS stimulation parameters. Inspired by the notion that therapeutic interventions may replicate the therapeutic seizure resetting effect of a seizure without adverse symptoms, the following study computes and compares STLmax values before VNS to values during VNS and utilizes SVMs as well as logistic regression to provide measures of STLmax pattern evolution. The evolution of STLmax values among the EEG channels is one method to track global EEG dynamics over time. Data Description This study involved six patients undergoing VNS therapy for intractable epilepsy. The continuous scalpEEG recordings are ~24 hour in duration and were obtained at the Shands Hospital GCRC protocol # 614, IRB protocol #6172004, Neurophysiologic Measures of Vagus Nerve Stimulation at the University of Florida, Gainesville. Clinical information for all six patients used in this study is summarized in tables 41 and 42. The electrode placement scheme is illustrated in figure 42.The stimulation times were obtained from the ECG channel, which 120 PAGE 121 was recorded in close proximity to the VNS pulse generator. The ECG channel was excluded from the EEG analysis. Feature Extraction The behavior of STLmax values calculated from EEG signals for seizure prediction has been extensively researched (see chapter 3). The embedded dimension of the reconstructed space D=7, lag step =7 (14 msec), evolution time T=21 (41 msec), and a window size N=2048 (4 sec) have provided useful neural state classification estimates (Iasemidis and Sackellares, 1991; Casdagli1996; Casdagli1997; Iasemidis et al., 1999). The interested reader may find the detailed explanation and justification of the algorithm and parameters in (Iasemidis, 1991), (Iasemidis and Sackellares, 1999) and (Wolf et al., 1985). STLmax was calculated for all 25 channels for the full EEG recording duration (~ 24 hours) for all six patients. SVM Analysis of EEG Dynamics The LIBSVM software package for the Matlab environment was used for SVM training and testing (Chang et al., 2001). An RBF kernel with =39 and a cost parameter of C=1000 were utilized based on studies utilizing RBF SVM to classifying neural states from scalp EEG data (Kaper et al., 2004; Acir et al., 2005; Lotte et al., 2007). The SVM parameters C and sigma are held constant in an effort to provide objectivity to this measure which can be used to study EEG signal evolution over time in feature space for all the patients. This study fixes the and C parameters in order to mitigate subjectivity when comparing stimulation epochs to the nonstimulation epochs. An SVM separation accuracy of 50% is interpreted as maximum measureable dynamical feature space similarity between reference class and comparison class features. An SVM 121 PAGE 122 separation accuracy of 100% is interpreted as the minimum dynamical feature space similarity between the reference class and comparison class features. Results are validated using a vfold cross validation scheme, as described in (Hsu et al., 2003) using 10 folds. This process applied a resampling technique in which the two classes are first randomly shuffled then divided into v equallysized subsets. The SVM is trained using v1 segments and is tested using the remaining subset V. This process is repeated until all v subsets have been tested. The accuracy is the percentage of properly classified points from each of the v trials. Logistic Regression Analysis of EEG Dynamics Logistic regression (LR) has seen number applications for the diagnosis of neurological diseases and disorders. Examples include Parkinson's Disease diagnosis using various clinical diagnostic measures (Leentjens et. al, 2002), diagnosis of Alzheimer's Disease (Lehmann et al., 2007), cognitive decline (Prichep et al., 2006), and Schizophrenia using electrophysiological features (Price et al., 2006), and epilepsy using EEG features (Alkan et al., 2005; Subasi et al., 2005). Thus, LR analysis is a suitable candidate for further characterizing the brain dynamics in patients undergoing VNS. LR is a statistical modeling technique utilized for probabilistic binary classification. As described in Subasi et al., 2005, the probability, P t,ref of a binary outcome event (EEG point at time t belonging to the reference class) is related to EEG value of channel ch at time t, x ch,t in the form: 251,0,2525,110,,,...1lnchtichitchtchreftreftreftxxxPPPLOGIT (41) 122 PAGE 123 251,0,1111,chtichtreftxXPLOGITtrefteeXP (42) In equation (41), 0 is the intercept of the model and 1, 2, 25 represent the coefficients for EEG channels one through 25. Once the logistic regression model is trained, the probability P t,ref of an EEG data point X t belonging to the reference class can be calculated in equation (42). The performance of the logistic regression model is measured using the area under the curve (AUC) approach (Komaraek, et al., 2005). The AUC is equal to the area under the receiver operating characteristics (ROC) curve. The AUC metric is simply the ratio of the area of an ROC curve to the area under a perfect ROC curve. Let NR be the number of points in the reference class, and NC be the number of points in the comparison class. NR = NC for this study, but do not have to be equal. The ROC curve is generated by first calculating P t,ref for each EEG data point X t in both the reference class and the comparison class. Then, the P t,ref values are sorted in decreasing order. The ROC curve creation begins at the lower left hand corner of a blank curve plot. Each point with P t,ref 0.5 (most likely that the EEG point is from the reference class) results in the creation of an upward line segment of length one unit. Each point with P t,ref < 0.5 (most likely that the EEG point is from the comparison class) in the creation of a line segment of length one unit to the right. The AUC metric is the ratio of the area under the generated ROC curve divided by the area under a perfect ROC curve (which climbs from (0,0) to (0, NR), then moves laterally from (0, NR) to (NC, NR) and is equal to one in this case). 123 PAGE 124 An AUC=0.5 (or ROC=0.5) is equivalent negligible dynamical feature space similarity between the reference class and comparison class. AUC=1.0 (or ROC=0) refers to the maximum measurable dynamical feature space similarity between the reference class and comparison class. Experimental Setup The following procedure was applied to each stimulation epoch (an epoch defined as a VNS on cycle and one off cycle) for each patient using SVMs and then repeated for LR. The EEG segment occurring 8 seconds (two window lengths) prior to stimulation start is selected as the reference class. The reference class was represented as an mn array of STLmax values where n is the number of channels and m is one less than the total number of stimulations occurring during the EEG recording. Setting m as one less than the total number of detected stimulations ensures that only complete VNS epochs are included in the analysis (as the last stimulation intersected with the end of the recording for all six patients). For each patient, the reference class utilized STLmax estimates from all n=25 channels from the time period of 8 seconds (two full window lengths) prior to stimulation start, for all m stimulations. The comparison class was initially established as an mn array of STLmax values occurring at the start of the stimulation for all m stimulations included for each patient. The SVM and LR classifiers are trained and tested for separation of the reference and comparison class combination. Once the accuracies are obtained, the reference class is advanced 4 seconds (one full window length) and the process is repeated throughout the epoch with the last comparison class occurring 200 seconds after stimulation start. The end point corresponds to the end of the 3 minute interstimulation cycle, which is the final endpoint which Results Figures 410, 411, 412, and 413 as well as table 44 demonstrate a similar performance between the LR and SVM results. Using both methods, the same two patients which produced 124 PAGE 125 the greatest STLmax feature separation between nonstimulation and stimulation epochs (patients A and D) also possessed the greatest stimulation frequency, 30 Hz, whereas the patient with the lowest separation (patient B) also possessed the lowest stimulation frequency, 20 Hz. In addition, patient D produced the second greatest separation while possessing highest stimulation frequency of 30 Hz. On the other hand, Patient F also had the greatest stimulation frequency of 30 Hz yet only achieved an intermediate separation value compared to the other patients (though patient F is seizurefree whereas patients A, B, and D are not). The final noteworthy observation the width was the lowest (250 microseconds) and Patient B who demonstrated the least separation. There was no apparent trend regarding the degree of separation using either LR or SVM and output current. One interesting connection with the clinical status was that the patients whom experienced the greatest amount of separation (patients A and D) were also taking more types of AED medications (patients A and D each were on four medications, patient B was on three medications, all other patients were only taking two medications). Another interesting connection to the clinical status is that the patient with the largest number of monthly seizures (patient B) also demonstrated the least amount of STLmax feature separation between nonstimulation and stimulation. Discussion The LR and SVM classification results suggest that EEG dynamical pattern changes (in terms of the STLmax measure) between stimulation and nonstimulation may be related to the stimulation frequency parameter. Lomarev et al. reported that a 20 Hz stimulation frequency produced significant blood flow increase over 5 Hz in numerous brain regions such as the orbitofrontal cortex, hypothalamus, and thalamus in VNS patients (2002). These regions may 125 PAGE 126 brain regions may be responsible for observed covariation of STLmax dispersion with stimulation frequency. At a first glance it seems counterintuitive that the output current did not appear to demonstrate a similar LR or SVM classification accuracy trend as pulse width and stimulation frequency, as a study demonstrated that higher stimulation parameter settings (such as frequency, output current, and pulse width) are associated with greater seizure reduction than lower settings (BenMenachem et al., 1994). However, the output current increase mentioned in (BenMenachem et al., 1994) was accompanied by increases in frequency and pulse width and thus the observed therapeutic effect in that study can not be attributed to changes in an individual parameter. Furthermore, the values of the other two parameters mentioned in the study by BenMenachem et al. (frequency and pulse width) did show indications of a connection with EEG dynamical changes, which is encouraging. Patient Bs large amount of seizures accompanying the lowest LR and SVM separation is an interesting observation. It is difficult to draw preliminary conclusions about clinical connections to the brain dynamical behavior as Patient B's stimulator was set at the lowest pulse width and the lowest stimulation frequency of all six patients. However, a potential connection between this patient's clinical behavior and the observed EEG patterns can be viewed from an interesting perspective first described in seizure prediction research studies. Considering the electroencephalographic and clinical effects observed during seizures, it is possible that the VNS therapeutic effect is enacted by artificially replicating the theorized therapeutic seizure mechanism first suggested by Iasemidis et al. (2004). By adopting this perspective, patient B's seizures could be seen as the result of the VNS failing to replicate the resetting function of a real seizure. Thus, the brain is then permitted to 126 PAGE 127 seize in order to reset itself. This observation is congruent with the notion that patient B has the lowest STLmax feature separation for both LR and SVM between the VNS on (which could be considered a VNS artificial seizure) and VNS off class (which from an artificial seizure perspective could be viewed as a postictal period for the artificial seizure). It is worth mentioning that all six patients are considered as responders to VNS therapy by a definition of experiencing at least a 50% seizure frequency reduction following one year of VNS therapy (Morell et al., 2006). The observation that patients A and D were taking the most types of AEDs and demonstrated the highest STLmax feature separation between nonstimulation and stimulation is reasonable. Again, from the view of a seizures resetting mechanism described in the previous paragraph, the two additional AEDs could possibly be enhancing effectiveness of the VNS resetting phenomenon as characterized by increased STLmax separation between VNS on and VNS off. This study was submitted to Computing and Optimization in Medicine and Life Sciences Vol. 3, under the title "A Data Mining Approach to the Investigation of EEG Biomarker Existence for Vagus Nerve Stimulation Therapy Patients", with authors Nikita Boyko, Michael Bewernitz, Vitaliy Yatsenko, Panos Pardalos, Georges Ghacibeh, Basim Uthman (Boyko et al., 2008). Conclusions The interesting results of these studies may be indicative of EEG dynamical effects of VNS and suggest the LR, SVM and biclustering may serve as useful data classification tools for use in an online realtime seizure control application. Biologically, these results may be related to the trait pointed in a study by Olejniczak et al. which discovered a shortterm suppression of epileptiform sharp waves following VNS from a hippocampal depthelectrode (2001). While the 127 PAGE 128 scalp electrodes used to collect the EEG data for this chapter cannot achieve the fidelity of hippocampal depth electrodes, it is possible that the scalp EEG data mining analysis results may reflect the same therapeutic effect as observed in the hippocampus by Olejniczak et al. (2001). The biological significance of the potential covariation of the EEG patterns with the pulse width and stimulation frequency parameters may be related to studies which demonstrated cerebral blood flow patterns corresponding to the pulse width (Mu et al., 2004) and stimulation frequency (Lomarev et al., 2002) parameters in VNS patients. Additional patients are needed to validate such claims against possible type 1 error. However, additional patients would also provide the opportunity to potentially uncover any VNSinduced EEG dynamical changes which may have been missed in this small sample (thus reducing the chance of type 2 error). A difficulty for this type of clinical research is recruiting patients with similar clinical situations (e.g. similar stimulation parameter configurations) in order to strengthen any observed connections between EEG behavior and stimulation parameters. For example, if numerous patients with similar stimulation parameters could be recruited, the patients may be taking different medications in different doses, etc. While it may be tempting to consider altering drug paradigms to mitigate intersubject variability, practical and ethical concerns must be kept in mind at all times when attempting to alter patient treatment regimes for research purposes. In addition, the impact of epileptic seizures on these EEG features and classification techniques is important for generating a robust stimulationresponse model. Thus, as the clinical circumstances such seizure occurrence can affect observed EEG dynamical patterns, it is worth mentioning that each patient's last seizure time prior to this studys EEG recording session is unknown. The time at which the last seizure occurred may be important factor for the patients 128 PAGE 129 which are not seizure free (patients A, B, C, and D) as there exists a period of reduced seizure susceptibility for a period of time following a generalized tonicclonic seizure. Thus, patients A, C, and D could have experienced generalized tonic clonic seizures prior to the study recording session and thus been influenced by this period of reduced seizure susceptibility. Such an scenario could have contributed to the lack of seizures occurring during the recording session and also influenced seizure dynamics. In addition, if patient B had not experience a generalized tonicclonic seizure prior to the study recording session then this patient's large number of seizures may have been partially induced due to the lack of said seizure protection phenomena following a seizure. Despite exclusion of stimulation epochs containing seizure activity from analysis, patient Bs seizures during the recording session still may have altered the observed EEG patterns. The rationale for such as claim is the observation of dynamical EEG shifts (in terms of the STLmax measure) identified from minutes to hours prior to epileptic seizures (Iasemidis et al., 1988; Iasemidis, 1991; Iasemidis et al., 1994, 1996, 1997). Thus, conclusions about patient B must be carefully considered as the seizures themselves could affect the observed EEG classification results. There is also a possibility of error in the monthly seizure rate as described by the patients. A 2007 study by Hoppe et al. demonstrated documentation inaccuracies in patient seizure counts (Hoppe et al., 2007). Thus, caution must be exercised in any epilepsy study which incorporates seizure information that was documented by patients. Thus, in an ideal study, additional consideration should focus on recruiting a group of patients with similar epilepsy cases (e.g. similar focus locations). By studying multiple patient groups each with similar variants of epilepsy, experimental findings are strengthened and the findings may help tailor resulting VNS therapy devices. 129 PAGE 130 In order further the understanding of EEG effects accompanying VNS it is important to track EEG feature patterns in patients before, immediately after, and for at least six months after implantation. A longitudinal study starting before VNS implantation and ending 612 months after implantation would provide insight into the evolution of EEG dynamical patterns before and after VNS parameter adjustment. In addition, such an analysis would help determine the presence of EEG characteristics present prior to VNS implantation for each individual patient. Thus, such a study design would add strength to postimplantation EEG patterns which are not observed prior to VNS implantation. In the case that preVNS data is not available for a particular patient of interest, patients whom are receiving VNS for depression treatment may serve as useful control subjects. Such patients could help determine how brain dynamics in VNS patients are influenced by epilepsy and seizures. The potential knowledge gained from these suggested studies could lead us one step closer to the creation of an EEG marker for optimal VNS parameters. In addition, as the relationship of EEG patterns stimulation parameters and clinical outcome in VNS patients is not clearly defined, then it is possible that the EEG measure parameters or perhaps the measures used in data classifiers are suboptimal. Thus, additional EEG features should be utilized for possible improvements in EEG dynamical comparisons. Complexity measures entropy measures have demonstrated success as data mining features for extracting brain dynamical information and classifying neural states (Chaovalitwongse et al., 2006). 130 PAGE 131 Figure 41. Rationale for studying EEG patterns which may be associated with the effect of VNS on the brain. Ultimate goal Experimental objective Clinical Literature Review / Future Ex p eriments Stimulation parameters Clinical effect EEG measures 131 PAGE 132 Sz free 15 sz/month 510 sz/month >10 sz/month OC = 1.25 mA PW = 250 SF = 25 Hz On = 30 sec Off = 5 min OC = 0.75 mA PW = 250 SF = 20 Hz On = 30 sec Off = 5 min OC = 1.0 mA PW = 250 SF = 20 Hz On = 30 sec Off = 5 min OC = 1.25 mA PW = 250 SF = 20 Hz On = 30 sec Off = 5 min OC = 1.25 mA PW = 500 SF = 20 Hz On = 30 sec Off = 5 min OC = 1.25 mA PW = 750 SF = 20 Hz On = 30 sec Off = 5 min OC = 1.25 mA PW = 250 SF = 30 Hz On = 30 sec Off = 5 min Figure 42. Conceptual EEG dynamics model in threedimensional feature space for testing stimulation parameter configurations in newlyimplanted VNS patients. Adjusting the stimulation parameters results in an altered dynamical state of the brain denoted by the coordinates in threedimensional feature space. The models colored regions relate the EEG dynamical state to its predicted clinical outcome. 132 PAGE 133 Table 41. VNS stimulation parameters Patient A B C D E F Output Current (mA) 1.75 1.5 2.5 2 1.25 0.75 Stimulation Frequency (Hz) 30 20 25 30 20 30 Pulse Width (s) 500 250 500 500 500 750 On Time (seconds) 30 30 30 30 30 30 Off Time (minutes) 5 5 5 3 5 3 Magnet Output Current (mA) 2 1.75 2.75 2 1.5 0.75 Magnet On Time (seconds) 60 60 60 30 60 60 Magnet Pulse width (s) 500 500 500 500 500 750 Figure 43. EEG electrode placement. Electrodes were positioned according to the 1020 electrode placement system which assigns locations proportionally spaced locations (e.g. 10%20%) with respect to the size of the patients head. 133 PAGE 134 Figure 44. STLmax class designation for biclustering analysis. 134 PAGE 135 A B Figure 45. Biclustering heatmap of STLmax from A) patient A and B) patient B. 135 PAGE 136 Table 42. Patient information for epilepsy patients with the VNS implant. Patient A B C D E F Age 38 53 54 29 54 54 Right frontal Right temporal Focus Left frontal Right frontal Right temporal Left frontal unknown Left temporal Mean seizures per month 3 30 2 3 0 0 # of seizures during recording 0 14 0 0 0 0 Seizure Type C. Partial with infrequent secondary gen. C. Partial with infrequent secondary gen. C. Partial with infrequent secondary gen. C. Partial with infrequent secondary gen. C. Partial with infrequent secondary gen. C. Partial with infrequent secondary gen. Duration of VNS therapy (years) > 1 year > 1 year > 1 year > 1 year > 1 year > 1 year Gab Lev Gab Carb Chlor Preg Lam Phen Top Lam Gab Lev Lev Top Lev Medications* Preg *Gab = Gabapentin, Lam = Lamotrigine, Lev = Levetiracetam, Preg = Pregabalin, Phen = Phenobarbital, Top = Topiramate, Carb = Carbamazepine, Chlor = Chlorazepate Table 43. SVM separation accuracy and seizure information. Patient Mean SVM separation Average monthly seizure rate Seizures during recording A .9284 3 0 B .7788 30 14 C .8359 2 0 D .9807 3 0 E .9454 0 0 F .8982 0 0 *Average monthly seizure rate of zero indicates seizure freedom. 136 PAGE 137 Figure 46. Mean SVM separation accuracy value across the stimulations for each individual intrastimulation window. Figure 47. VNS output current and the corresponding mean SVM separation accuracy over 24 hours. 137 PAGE 138 Figure 48. VNS pulse width and the corresponding mean SVM separation accuracy over 24 hours. Figure 49. VNS signal frequency and the corresponding mean SVM separation accuracy over 24 hours. 138 PAGE 139 Figure 410. SVM Separation accuracy throughout the VNS epoch, averaged across all epochs. Stimulation begins at t=0 seconds. Figure 411. Overall mean SVM separation averaged across intraepoch time points and all epochs. 139 PAGE 140 Figure 412. LR separation quality throughout the VNS epoch, averaged across all epochs. Stimulation begins at t=0 seconds. Figure 413. Overall mean LR AUC averaged across intraepoch time points and all epochs. 140 PAGE 141 Table 44. Mean SVM and LR separation accuracy and patient seizure information. Patient Overall mean SVM separation Overall mean LR separation Seizures per month Seizures during recording A 0.8082 0.9701 3 0 B 0.4746 0.5104 30 14 C 0.6171 0.7571 2 0 D 0.7536 0.9658 3 0 E 0.7210 0.8878 0 0 F 0.6885 0.8319 0 0 141 PAGE 142 CHAPTER 5 ANALYSIS OF INTERSTIMULATION BRAIN DYNAMICS IN VAGUS NERVE STIMULATION THERAPY The Identification of a marker of desired VNS operation would greatly expedite the VNS parameter adjustment process in newlyimplanted patients. This study faces two significant challenges: 1) the underlying therapeutic mechanism of VNS is still poorly understood, and 2) despite some interesting results reported in innovative research studies, the electroencephalographic effects of vagus nerve stimulation are not clearly defined. From the perspective of dynamical disorder (see chapter 2), there is reason to believe any such potential stimulationinduced EEG effects are likely to be elucidated from dynamical EEG analysis (Uthman et al., 2007). Further Characterizations/Investigations of EEGEffects in VNS Therapy Preliminary data mining results described in chapter four present interesting EEG dynamical phenomena with biological interpretations that are consistent with the theory about the physiological resetting role of a seizure. Of additional interest is the behavior of the brain between VNS stimulations. Viewing interstimulation brain behavior provides a means to determine how the brain recovers after VNS therapy (or artificial seizures). In addition, this analysis duration also provides information about the brain while is not being actively influenced by a therapeutic action (e.g. VNS or the therapeutic effect of a seizure). Thus, as nonictal EEG can help provide information about the seizure imminent state, so to may the interstimulation EEG intervals provide information additional information about the brains response to VNS which may not be available while the VNS is active. This chapter focuses on characterizing the temporal dynamical behavior of the EEG signals during the periods when the VNS is inactive. 142 PAGE 143 Building on the successes of the data mining approaches in chapter four, this chapter aims to further characterize EEG patterns which may be related to VNS. The brains behavior will be characterized during all periods of respite from VNS. Dynamical EEG Measures as Markers for Neurological Diseases and Disorders The success of EEG markers for the treatment of neurological disorders is the primary motivation for this study. Such signature observations of pathological activity have greatly boosted diagnosis, treatment, and therapeutic evaluation of a range of neurological disorders (Krystal et al., 1996, 1997, 2000; Asyali et al., 2007; Ding et al., 2007; Quintana et al., 2007) including epilepsy (Iasemidis et al., 1996; Pardalos et. al, 2003, 2004; Chaovalitwongse et al., 2005, 2006; Ding et al., 2007; Schevon et al., 2007). Additional details can be found in chapters 2 and 3. Despite reported interest in the application of such a technique to the EEG signals for improving VNS epilepsy therapy (Uthman et al., 2007), studies have been published which do not support the presence of VNSinduced EEG effects (Hammond et al., 1992; Salinsky et al., 1993; Koo, 2001; Rizzo et al., 2004; Marrosu et al., 2005). Though longterm VNSinduced EEG changes on epileptic interictal spikes (Koo, 2001) epileptiform sharp waves in the hippocampus (Olejniczak et al., 2001), interictal epileptiform discharges (Janszky et al., 2005; SantiagoRodriguez and AlonsoVanegas, 2006), gamma activity and desynchronization (Marrosu et al., 2005), and spectral content of sleep (Rizzo et al., 2004) have been reported, the time frame for observing such an effect renders it less useful the current task of expediting VNS parameter calibration in newlyimplanted patients. Physiological behavior such as alterations in the interitical spiking rate is congruent with the characteristics dynamical diseases and disorders. The class of disorders termed dynamic disorders demonstrates complex behavior patterns which evolve over time. Specifically, these 143 PAGE 144 disorders have been broadly described as undergoing a temporal disruption in the underlying physiological control mechanisms which results in a period of abnormal dynamical behavior (Mackey and Glass, 1977; Mackey and an der Heiden, 1982; Milton and Mackey, 1989; Belair et al., 1995; Milton and Black, 1995; Milton, 2000; Lopes Da Silva et al., 2003; Colijn and Mackey, 2005). Thus, studying epilepsy therapy from the vantage point of a dynamical disorder is a rational approach. Koos observation of the VNS effect on interictal spiking rate (2001) demonstrates that relatively shortterm EEG effects (such as interictal spikes) are the manifestation of longterm modulatory VNS effects (e.g. after several months). Thus, this observation raises the possibility of less obvious shortterm manifestations of VNS modulatory effects existing in the EEG. Such EEG effects may be detectable using EEG measures that have demonstrated successful neural state characterization such as preictal transitions in seizure prediction studies (Casdagli et al., 1996; Chaovalitwongse et al., 2005; Iasemidis and Sackellares, 1991; Iasemidis et al., 1993; Iasemidis et al., 2003, 2004; Le Van Quyen et al., 2001; Lehnertz, 1999; Lehnertz and Elger, 1995; Osorio et al., 2001). The purpose of identifying dynamic disorders is that successful treatment may result from manipulation of some physiologic control parameter into a range associated with healthy dynamics of the observed variables (Milton, 2000). One example of this is a seizure control strategy where thehealthy range of STLmax tindex values (associated with seizure transition) in maintained by therapeutic intervention (Iasemidis et al., 2003; Good et al., 2004, 2005). An analogous scenario may apply to VNS parameter adjustment in newlyimplanted patients where the VNS parameters may be adjusted in order to elucidate a brain dynamical response or state that has been previously established as indicative of desired or even optimal seizure protection. 144 PAGE 145 Thus, the achieved neural state as described by dynamical EEG responses associated with different stimulation parameters over time may serve as marker for VNS treatment and facilitate rapid determination of optimal VNS parameters. An example of this concept is illustrated for a brain dynamics model involving three dynamical measures in chapter 4, figure 42. Realistically, mapping the clinical outcome to subregions of a multidimensional feature space will likely be very complex and require numerous additional features for adequate characterization. While determining the proper features to best represent the brain behavior and its relationship to stimulation parameters in VNS is a daunting task, this study aims to provide an indepth evaluation of a number of EEG measures which have demonstrated sensitivity to neural state changes in other studies. For these reasons, the current study aims to identify electroencephalographic markers which are sensitive to the stimulation parameter configuration in patients with the VNS implant. If such electroencephalographic markers are identified, and if the electrographic markers are found to correlate with clinical efficacy then these findings could be applied to determine optimal VNS stimulation parameters on a patientbypatient basis. Data Description This study utilized EEG data from six patients undergoing VNS therapy for epilepsy. Extensive patient information can be found in chapter four. The recordings were acquired under GCRC protocol # 614 / IRB protocol #6172004, "Neurophysiologic Measures of Vagus Nerve Stimulation" GCRC in Shands Hospital at The University of Florida. EEG data was acquired from channels Fp1, Fp2, F3, F4, C3, C4, P3, P4, O1, O2, F7, F8, T3, T4, T5, T6, A1, A2, Fz, Cz, Pz, Leye, Reye, Lmn, and Rmn using CPz (located between Cz and Pz) as a reference. The data were acquired at 512 Hz sampling rate using 16bit precision from an amplifier with 0.16 Hz high pass filter and 105 Hz low pass hardwired filters. The mandibular notch channel near the 145 PAGE 146 location where the jaw and skull contact one another provides information about the nearby temporal lobe. See figure 51 for electrode locations. The ECG electrode was placed near the pulse generator to introduce the VNS waveform in the ECG channel when the stimulator is active. Thus, the VNS signature waveform was introduced into the ECG (see figure 44) to provide an effective means to identify stimulation times by modifying a channel that is not used in the quantitative analysis. A summary of patient clinical information can be found in tables 41 and 42. Ideally, the baseline recording from each involved patient should be compared to their own EEG after implantation in order to strengthen claims that observed EEG patterns are the result of VNS and thus were not present prior to implantation. However, baseline EEG data was not available for this set of patients. As no baseline data was available for the VNS study, an interictal EEG recording from a temporal lobe epilepsy patient of ~24 hours in duration provided courtesy of the Freiburg Center for Data Analysis and Modeling at the AlbertLudwigs Universitt Freiburg (University of Freiburg), Freiburg, Germany (Winterhalder et al., 2006) was utilized as a control dataset. The interictal EEG data came from patient p012 and was acquired at 512 Hz. The data were acquired from three focal channels (TBa4, TBb6, HR7) and three nonfocal channels (TLb2, TLb3, TLc2). The patient has a right hippocampal seizure focus which gives rise to simple partial, complex partial, and generalized tonicclonic seizures. The control dataset was utilized with artificial stimulation times based on both a 5 minute interstimulation interval and a 3 minute interstimulation interval. The Surrogate Analysis Method The surrogate data analysis method is a statistical approach for identifying nonlinearity in a time series. The best expression of the surrogate data method is from a statistical hypothesis 146 PAGE 147 testing framework (Theiler et al., 1992). This formulation requires a null hypothesis to test against and some test statistic. The null hypothesis is a possible description of system output which is tested to determine how well it models the observed data. The test statistic is a quantity calculated from the sample data to determine whether or not to reject the null hypothesis. Surrogate data analysis typically defines the null hypothesis such that the time series data are described by a specific process belonging to a broader class of processes (Schreiber and Schmitz, 2000). A common null hypothesis asserts that the time series data are generated by a general Gaussian linear stochastic process (Theiler et al, 1992). However, different realizations that fit within this broad category can result in surrogates with different power spectra and distributions. This scenario and may cause the test statistic may mistake such variations for deviations from the null hypothesis and falsely reject the null hypothesis (Schreiber and Schmitz, 2002). The can be approach using pivotal statistics or using constrained realizations (Theiler and Prichard, 1996). Pivotal statistics are measure created such that do not depend on mean or standard deviation under the null hypothesis. The constrained realization method enforces a requirement that all surrogates display the same power spectrum and distribution of values as the original data (Theiler and Prichard, 1996; Schreiber and Schmitz, 2000). Under the constrained realization approach the randomization method covers the pivotal requirement and thus opens up the possibility to use numerous nonpivotal test statistics for testing the null hypothesis. While the surrogate method is useful for suggesting the presence of nonlinear signal components, this technique cannot be used to characterize the specific type of observed nonlinear behavior. For example, while it is valid to utilize a Lyapunov exponent to test the null hypothesis, surrogate analysis cannot indicate that an observed nonlinear signal is the result of lowdimensional chaos (Pritchard et al., 1995; Palus, 1997; Schreiber and Schmitz, 2000). 147 PAGE 148 Surrogate data sets were generated using the algorithm proposed by Schreiber and Schmitz to produce same power spectrum and amplitude distribution as the original dataset (1996). The algorithm runs as follows. Let represent an EEG signal of length n. Store sorted list of the raw EEG values, ns sortns, and the absolute value of the amplitudes of the discrete Fourier transform (equation 311) of which is denoted as ns kS First the original data are randomly shuffled ns 0ns Each iteration consists of two actions. At iteration step i, the signal from the previous iteration 1ins is brought to the desired power spectrum by computing the Fourier transform and replacing the amplitudes 1ikS with those of the original signal kS and performing the inverse Fourier transform. The original complex Fourier phase values of the signal from the previous iteration 1ins remain unchanged when reconstructing the signal ins having the desired power spectrum. While this step enforces the correct power spectrum, it usually disrupts the signal amplitude distribution. Thus, the second step in an iteration is to rank order the resulting time series ins and replace the ranked indices with the ranked amplitudes from the original signal sortns, Performing the rank ordering will thus alter the power spectrum calculate in step i+1, thus requiring the entire procedure to repeat. After each iteration, the deviation from the original power spectrum is checked and the process repeats until a given accuracy is achieved. The Role of Surrogate Data Analysis in EEG studies Nonlinear measures such as complexity, chaoticity, and informationbased measures can be useful in the analysis of the output of complex systems such as the brain (Lehnertz and Elger, 1995; Pincus, 1995; Lehnertz, 1999; Le Van Quyen et al., 2001; Osorio et al., 2001; Iasemidis et al., 2003, 2004). However, analysis of less complex systems may not require the application of 148 PAGE 149 nonlinear methods as they may provide the same (or perhaps less) information about the system at hand while often resulting in increased computational cost. Thus, an original application of surrogate analysis was to provide partial justification for the use of nonlinear analysis methods in EEG studies. Surrogate data analysis has provided support for the presence of nonlinear components of EEG signal in various types of epilepsy (Casdagli et al., 1995; 1996, 1997; Lopes Da Silva et al., 1999; Jung et al., 2003; Liu et al., 2007). Additionally, observations have been made regarding the different neural states in epilepsy such as interictal, preictal, ictal, and postictal the corresponding occurrence of significant nonlinearity (Pijn et al., 1997; Jung et al., 2003) as well as a measure of the amount of nonlinearity (e.g. the magnitude of the pvalue when comparing original to surrogate data) ( Liu et al., 2007). In addition, surrogate data analysis has demonstrated changes in nonlinear signal component expression following various brain stimuli such as transcranial magnetic stimulation (Jing and Takigawa, 2002), drug treatment (Ferenets et al., 2006) compared to baseline EEG. As any similar studies regarding VNS was could not be located, such an analysis may provide a means for quantifying EEG effects related to VNS parameters and perhaps clinical outcome. In addition the following analysis may provide an improved understanding of the brains EEG response to VNS and potentially provide insight into how it delivers its therapy. Nonlinearity Analysis of Interstimulation EEG The following study is motivated by a desire to characterize the interstimulation EEG dynamics in VNS patients and identify potential covariation with stimulation parameters using surrogate EEG analysis. The underlying hypothesis (stated as null) which motivates this study is EEG dynamics during the interstimulation period are unrelated to the stimulation parameters in VNS patients. The interstimulation period is targeted in order to track the brains post 149 PAGE 150 stimulation response which may contain useful EEG dynamical information relating to the stimulation parameter configuration. Under this experimental setup, it is logical to compare to the results to a control patient which utilizes artificial stimulation times. Resulting EEG dynamical differences between the VNS patient interstimulation epochs and the control patient artificial interstimulation epochs could provide convincing support for the existence of VNSinduced EEG effects which may be related to the VNS parameters. Choosing a Test Statistic By utilizing the constrained realization approach to surrogate data analysis, the options for a test statistic become more plentiful as the requirement for a pivotal test statistic is now relinquished (Theiler and Prichard, 1996). Based on the successful application of entropy measures in EEG nonlinearity test studies (Thomasson et al., 2000; Burioka et al., 2003,2005; Ferenets et al., 2006), as well as the general success in classifying neural states from EEG (Bruhn, 2000; Bruhn, 2001; Bruhn, 2003; Absolo, 2005; Ferenets et al., 2006), the approximate entropy (ApEnt) measure will serve as the test statistic. The ApEnt measure was calculated within nonoverlapping windows of size 2048 points (4 seconds). A window of this size falls within a reasonable range utilized for computing ApEnt in terms of clinical and theoretical relevance (Pincus, 1995). The noise threshold r=0.2*std was selected as a result of studies which successfully correlated the ApEnt EEG measure to clinical drug anesthesiology levels (Bruhn, 2000; Bruhn, 2001; Bruhn, 2003; Ferenets et al., 2006), as well as a study which used ApEnt to characterize background EEG in patients with Alzheimers Disease (Absolo, 2005). The phase space mapping process utilized an embedding dimension of 7 is used based on previous EEG complexity studies quantifying neural state transitions in patients with mesial temporal lobe epilepsy (Iasemidis et al. 1988; Iasemidis et al., 1990; 150 PAGE 151 Iasemidis et al., 1999). The time delay embedding process utilized a delay =7 corresponding to14 ms (Iasemidis et al., 1990; Zaveri et al., 1993; Iasemidis et al., 1996). Experimental Design The amount of surrogates were selected based on a model proposed by Schreiber and Schmitz which considers a residual probability of a false rejection by random chance with a corresponding significance level of 1001 % (2000) The proposal suggests creating an amount of surrogates M=2*K/ 1 such that the probability that the data will reject the null hypothesis by chance is for a twotailed test (Schreiber and Schmitz, 2000). Due to the intensive computational complexity of this procedure, this preliminary analysis utilizes K=1 and =0.1 for the purposes of selecting the amount of surrogate data copies. Thus, this study uses 19 surrogates. EEG surrogates were calculated in nonoverlapping windows of length 2048 points (4 seconds). This window size is considered to be within a reasonable range for surrogate data generation (Schreiber and Schmitz, 1996). This is also used as the window length utilized in the calculation of the ApEnt measure used as the test statistic. The mean value of each ApEnt point across all 19 surrogates is computed to the surrogate datasets to a single time series which is then compared to the original signal (Casdagli et al., 1996; 1997; Liu et al., 2007). For patients with a 5 minute interstimulation time a window of 73 points represented the interstimulation period. For patients with a 5 minute interstimulation time a window of 73 points represented the interstimulation period. For patients with a 3minute interstimulation time, a 43 point window represented the interstimulation time. Statistical testing was performed using a twotailed pairedt test. For 95% certainty and 72 degrees of freedom and 42 degrees of freedom the critical tvalues are t= 1.993 and t=2.018, respectively. 151 PAGE 152 This preliminary study assesses the dynamical structure of EEG signals during VNS interstimulation periods. The dynamical structure is evaluated by testing each interstimulation epoch against a null hypothesis of a Gaussian linear process using surrogate datasets for all epochs for all six patients. The hypothesis, stated as null is: H0: EEG dynamics during an interstimulation epoch are described by a Gaussian linear stochastic process. Results For each patient and for each channel, the hypothesis was tested using approximate entropy of the EEG of VNS deactivation epoch (see figure 53 through 512 and tables 51 through 53). Patients A and B showed a notable increase in the amount of interstimulation epochs demonstrating a nonlinear signature occurring across most channels occurring between 11 pm until 7 am. The control patient showed a decrease in a nonlinear fingerprint occurrence in nonfocal channels during the same time of day. The fraction of epochs across the entire recording and all channels which displayed a nonlinear signature (could reject H0 at the given significance) displayed a potential negative correlation with the pulse width parameter for all six patients. In addition, patient F showed nonlinear signatures in fewer epochs than any other patient (35.1% of all epochs could reject H0 at the given significance), followed by patient E (39.0%). Both of these patients are seizure free. Patient Bs EEG showed the most nonlinear fingerprints having 52.3% of the epochs rejecting H0 at the given significance level. While patient F showed the most nonlinearity, patient F had the greatest stimulation frequency (30 Hz) and the greatest pulse width (750 s). Patient B had the lowest stimulation frequency (20 Hz) and the shortest pulse width (250 s). The fraction of epochs which displayed nonlinear signatures for the 152 PAGE 153 control patient with 5minute and 3minute interstimulation times were 42.5% and 37.2%, respectively. In general, the lower the monthly seizure rate, the less nonlinear signatures were observed. According figure 53, patient F (seizurefree) produced a smaller fraction of nonlinear interstimulation epochs than the 3minute control whereas patient D (~3 seizures per month) produced a larger fraction of nonlinear epochs than the 3minute control. A similar trend was observed in the patients with the 5minute interstimulation time. Patients C and E (seizure free and ~ seizures per month, respectively) generated a smaller fraction of nonlinear epochs than the 5minute control whereas patients A and B (~3 seizures per month and ~30 seizures per month, respectively) displayed a larger fraction of nonlinear epochs than the 5minute control. Patients A, B, D, and F showed noticeably higher expressions of nonlinearity in channels located near foci than nonfocal channels. The control patient demonstrated a high density of nonlinear behavior in nonfocal channels during waking hours which is diminished around 11 pm 7 am, except for the TLc2 channel which shows a greater fraction of epochs demonstrating nonlinear signatures than other channels. Discussion In regards to the connection of EEG patterns stimulation parameters, the most obvious observation was the potential relationship between the fraction of epochs which displayed nonlinearity and the pulse width parameter. In addition, Patient F produced the smallest fraction of epochs presenting a nonlinear signature (35.1% of epochs could reject H0 at the given significance level) and patient had the highest stimulation frequency (30 Hz) and the highest pulse width (750 s) of all six VNS patients. Patient Bs EEG presented the greatest fraction of epochs presenting a nonlinear fingerprint (52.3% of epochs could reject H0) whereas the patient 153 PAGE 154 had the lowest stimulation frequency (20 Hz) and the lowest pulse width (250 s) of all six VNS patients. The underlying biology driving this EEG behavior could be related to a study which demonstrated an acute suppression of epileptiform activity in the hippocampus during VNS (Olejniczak et al., 2001). Perhaps enhanced suppression of epileptiform activity is responsible for the diminished nonlinearity in patients with fewer seizures. Also, a study has demonstrated that the 250 s pulse width parameter results in blood flow mitigation to significantly more brain regions (e.g. hippocampus, sup. temp. lobe) than a 500 s pulse width in VNS patients (Mu et al., 2004). Perhaps pulse width related bloodflow reductions reported by Mu et al. are responsible for any such changes in epileptiform activity suppression which may have been detected by the surrogate data analysis. In addition, patients E and F demonstrated the lowest fraction of epochs presenting a nonlinear signature (39% and 35.1%) and also happen to be the only two patients which are seizurefree. This may be aligned with the clinical observation that the absence of bilateral interictal epileptiform discharges was the only EEG predictor of seizure freedom (Janszky et al., 2005). Future studies should include characterizing the profile of interictal epileptiform discharges for relationship to linear and nonlinear measures. In patients A and B there was a notable increase in the amount of interstimulation epochs demonstrating a nonlinear signature occurring across most channels at times around 11 pm until 7 am. The increase in the occurrence of nonlinear signature may have been partially resulted from the patient being drowsy or asleep. A surrogate analysis study by Shen et al. demonstrated a considerable number of EEG segments displaying a nonlinear signature during stage 2 sleep and may be the result of Kcomplexes (Shen et al., 2003). 154 PAGE 155 The control patient demonstrated a high density of nonlinear behavior in nonfocal channels during waking hours which is diminished around 11 pm 7 am, except for the TLc2 channel which shows a greater fraction of epochs demonstrating nonlinear signatures than other channels. Patients A, B, D, and F showed a greater fraction of epochs presenting nonlinear signatures in channels located near foci than nonfocal channels. This observation is aligned with the literature where focal electrodes demonstrated higher nonlinearity than nonfocal electrodes (Casdagli et al., 1995, 1996, 1997). While the control patient provides information from a patient with a similar epileptic condition and recorded at the same frequency as the VNS patients, the depth electrode recordings from the control patient provide limits to what can be suggested to conclusions about VNSinduced scalpEEG patterns. The ideal control would be use baseline from each patient using an identical electrode setup. The fraction of epochs rejected the null hypothesis is a necessary condition for nonlinear dynamical, however, these results are not sufficient to suggest a particular type of nonlinearity (e.g. surrogate analysis cannot prove the existence of lowdimensional chaos). Changing parameters (e.g. the dimensionality or noise threshold) for ApEnt may improve sensitivity to potential VNSinduced EEG effects and thus provide the possibility to relate said effects to stimulation parameters and ultimately to the clinical outcome. The results, combined with studies documenting the ability of various nonlinear measures to quantify neural states motivates the usage of nonlinear as well as linear measures to examine EEG dynamical behavior which could be associated with VNS stimulation. 155 PAGE 156 Temporal Evolution of Interstimulation EEG Dynamics The results of the previous experiment characterized the presence of nonlinear EEG signal components throughout each of the interstimulation epochs for each of the six patients undergoing VNS therapy for epilepsy. However, as surrogate analysis does not provide characterization of nonlinear signal components, it is possible that the properties of the detected nonlinear components may distinguish the control patient from the VNS patient. Thus, additional characterization signal dynamics would enhance the findings from the surrogate analysis. This experimental perspective aims to analyze the observed nonlinear signal components and further characterize how brain dynamical patterns behave during the period between stimulations. This study is motivated by an underlying hypothesis (stated as null) H0: Interstimulation EEG dynamics are time invariant in patients undergoing VNS therapy for epilepsy. While VNS is believed to induce its therapeutic effect via longterm modulation (Koo, 2001), this longterm effect may manifest as changes in shortterm temporal dynamical behavior compared to baseline which would be consistent with the traits of a dynamical disorder such as epilepsy (Mackey and Glass, 1977; Mackey and an der Heiden, 1982; Milton and Mackey, 1989; Belair et al., 1995; Milton and Black, 1995; Milton, 2000; Lopes Da Silva et al., 2003). Thus, it is possible that the brain dynamics during the interstimulation epochs in VNS patients will be distinguishable from a control patient, which would provide support for the use of EEG dynamical analysis for the study of VNS effects. Furthermore, EEG dynamical behavior during the interstimulation period may be related to stimulation parameters. Data Description Six patients undergoing VNS therapy for intractable epilepsy were analyzed in this study. The continuous scalpEEG recordings are approximately 24 hours in duration and were obtained 156 PAGE 157 at the Shands Hospital GCRC protocol # 614, IRB protocol #6172004, Neurophysiologic Measures of Vagus Nerve Stimulation at the University of Florida, Gainesville. Available clinical information for the six patients is summarized in tables 41 and 42. The electrode positions are described in figure 51. VNS activation times were obtained from the ECG channel, which was recorded from an electrode placed in close proximity to the VNS pulse generator. The ECG channel was otherwise excluded from this study. EEG Dynamical Measures Quantitative EEG analysis is a broad field incorporating numerous methods for quantifying various properties of EEG signals (see chapter 3). In order to improve the characterization of the dynamical evolution, this study utilized multiple EEG measures. Each of the EEG analysis techniques first applies a phase space transformation after which the relevant information is extracted. The phase space mapping procedure of Takens (1981) was applied using an embedding dimension of 7 is used based on previous studies in which the epileptic attractor was characterized from EEG recordings of patients with mesial temporal lobe epilepsy (Iasemidis et al. 1988; Iasemidis et al., 1990; Iasemidis et al., 1999). For an embedding dimension of 7, a time delay of =7 samples corresponding to14 ms is applied. This time delay value has demonstrated success in characterizing the rhythm of a typical seizure in temporal lobe epilepsy (Iasemidis et al., 1990; Zaveri et al., 1993; Iasemidis et al., 1996;). Approximate entropy This ApEnt measure (see equations 316 to 319) has been utilized to study EEG patterns in Alzheimers disease patients (Absolo, 2005), as a surrogate marker for anesthesia depth (Bruhn 2000, Bruhn 2001, Bruhn 2003), detecting epileptic seizures (Absolo 2007; Srinivasan, 2007), and as a test statistic for characterizing EEG nonlinearity (Thomasson et al., 2000; 157 PAGE 158 Burioka et al., 2003,2005; Ferenets et al., 2006). Thus, it may be useful for characterizing brain dynamics during interstimulation intervals. The noise threshold was set at 20% of the signals standard deviation r=0.2*std was applied based on studies which successfully correlated ApEnt with drug anesthesia levels (Bruhn, 2000; Bruhn, 2001; Bruhn, 2003; Ferenets et al., 2006) and a study characterizing background EEG in patients with Alzheimers Disease (Absolo, 2005). The 2048 point (4 second) window selected for this study is within a range that has been described as being clinically and theoretically appropriate (Pincus, 1995). Correlation sum For a collection of points in some vector space, the correlation sum is the fraction of all possible vector pairs which are closer than a given distance r for a particular norm distance norm (see equation 32). The correlation sum is estimated after mapping the EEG into phase space. The correlation sum is often used to estimate the correlation dimension (equation 327) which has been extensively utilized in physiological data (Kantz and Schreiber, 1995) such as neural state classification studies using EEG (Tirsch et al., 2000, 2004), as well as seizure prediction (Elger et al., 1998; Martinerie et al., 1998). However, since use of an absolute radius can result in a heavy EEG amplitude sensitivity (Osorio et al., 2001), this study utilizes a relative radius measure (with respect to the diameter of the dataset in phase space) for brain dynamics characterization (Casdagli et al., 1996, 1997, Merkwirth et al., 2002). Correlation sum was estimated using the TSTOOL package (Merkwirth, 2002) for Matlab. Theiler recommends application of an exclusionary window to a range of points surrounding each reference point in order to avoid embedding vectors on the same trajectory (Theiler et al., 1986). Based on the results of similar studies, a 250 ms (128point) exclusion 158 PAGE 159 window around reference points and a search radius r=0.2 (10% of attractor diameter) were implemented (Casdagli et al., 1996, 1997). Mean angular frequency in phase space A modification to the Lyapunov exponent measures, the mean angular frequency in phase space measure ( ) quantifies the angular frequency of the phase space evolution of two nearest neighbor points relative to a reference point (Iasemidis et al., 2001, 2002, 2003). Conceptually, this measures the average rate of change of a system state. The measure is related to the Lyapunov exponent, which measures the local stability of a system. A study quantifying neural states in epilepsy found that preictal, ictal, and postictal states corresponded with medium, high, and lower values of respectively (Iasemidis et al., 2002, 2003). In addition, the dynamic entrainment / disentrainment and seizure resetting phenomena observed before and after epileptic seizures using the STLmax measure has also been described with (Iasemidis et al., 2003). Thus, the sensitivity of to changes in neural state makes it a candidate for quantifying any EEG dynamics changes which may be associated with VNS. The window length selected for this study, 2048 points, is the same window length as was used in Iasemidis et al. (2001, 2002, 2003). Shortterm maximum Lyapunov exponent The STLmax measure has been shown to be useful for providing dynamical information about the neural state of the epileptic brain. Studies performed on EEG from human patients (Iasemidis and Sackellares, 1990; Iasemidis and Shiau et al., 1999; Iasemidis et al., 2001; Iasemidis and Pardalos et al. 2003; Iasemidis and Shiau et al., 2003) and animal models of epilepsy (Nair et al., 2004, 2005, 2006; Talathi et al., 2008) imply that the evolution of the brain to a state of greater spatiotemporal order correlates with spontaneous seizures. This 159 PAGE 160 phenomenon is presented as a temporally progressive increase in the similarity among socalled critical channels measured by STLmax calculated from multichannel EEG recordings. Thus, sensitivity of STLmax to neural state changes in epilepsy indicated by the above studies makes the measure a reasonable candidate for identification and characterization of potential VNSinduced EEG effects. The window duration for calculating STLmax needs to be short to provide temporally local information about the brains dynamics yet contain enough points for the algorithm to converge (additional information about this can be found in chapter 3). The 2048 point (4 second) window size chosen for this study is suggested to provide a sufficiently stable STLmax estimate in previous neural state classification studies in epilepsy (Iasemidis and Sackellares, 1999). Also, use of the shortest window length possible for STLmax estimation can help provide a stationary segment for estimating local dynamical information. As such, while maintaining a window length of the recommended number of data points for algorithmic convergence, the 512 Hz sampling frequency provides improved time resolution over previous studies (which utilized a 200 Hz frequency). The evolution time parameter was set to T = 41 msec (21 samples) based on successful neural state classification studies that utilized them (Iasemidis and Sackallares, 1999). Experimental Design This preliminary investigation into the temporal evolution of the EEG between stimulations will start searching for coarse dynamics transitions between the first and second halves of each epoch where the VNS is deactivated. The rationale for this class designation is to assess the existence of any shortterm transitions, to characterize the temporal evolution where it exists, compare with a similar experimental setup in a control patient and determine any correlation to clinical parameters. The underlying hypothesis (stated as null) which motivates 160 PAGE 161 this study is EEG dynamics during the interstimulation period are unrelated to the stimulation parameters in VNS patients. Figure 513 shows an illustration indicating how the measures were grouped to examine the temporal evolution of these dynamical measures during VNSOFF. As shown in figure 513, EEG measures corresponding to the first half of an epoch are compared to EEG measures corresponding to the second half of an epoch for each channel, for all channels (except ECG). Using 4 second windows to calculate the various EEG measures, the The preliminary hypotheses (stated as null) are formulated for the purpose of characterizing the EEG behavior associated with stimulation in the VNS patients: H1: The EEG dynamics as quantified by approximate entropy are time invariant while VNS is deactivated. H2: The EEG dynamics as quantified by correlation sum are time invariant while VNS is deactivated. H3: The EEG dynamics as quantified by mean angular frequency in phase space are time invariant while VNS is deactivated. H4: The EEG dynamics as quantified by shortterm maximum Lyapunov exponent are time invariant while VNS is deactivated. These hypotheses aim to answer the question of how the dynamical brain behavior as described by these four nonlinear EEG measures evolves over time between stimulations. Such an analysis may identify EEG patterns which are sensitive to particular stimulation parameter configurations as well as the candidate measures for detecting such patterns. The control patient underwent two similar tests; one which utilized stimulation times with a 3 minute off duration, and a second test which utilized stimulation times with a 5 minute off duration. The hypotheses were tested with a twotailed unpooled twosample ttest with =0.05 using the Matlab Statistics Toolbox. The tests were performed assuming unequal variances and utilized Satterthwaite's approximation for the effective degrees of freedom. For a measure window size of 2048 points (4 seconds), the first and second halves of the interstimulation epoch 161 PAGE 162 each contain 36 values of each measure for patients A,B,C,E (whom have a 5 minute interstimulation duration) and 21 values of each measure for patients D and F (whom have a 3 minute interstimulation duration). The same statistical testing method was used to test the control patient. The control patient was tested with artificial stimulation times using 3minute and 5minute interstimulation duration. Results As figures 522 and 524 show, for all patients the ApEnt and measures resulted in a larger fraction of epochs rejecting H1 and H3 (respectively) than the control patient for the majority of the 25 EEG channels. When using the correlation sum measure, the majority of electrodes had a greater fraction of epochs reject H2 for patient A than the control patient. However, the correlation sum did not show any such trend for any other patients. For all four measures, patient C rejected the four hypotheses in 23 times more interstimulation epochs than the control patient. For all four measures, patient F produced the fewest amount of interstimulation epochs that rejected the null hypothesis than any other patient. Numerous observations can be made regarding focal and nonfocal electrode behavior according to tables 53, 55, 57, 59. In terms of the ApEnt measure, the focuses of patients A,B,C, and F produced significant dynamical complexity fluctuations during more interstimulation epochs than their corresponding nonfocal areas, and greater than the control focus. This phenomenon could be related to studies where electrodes in the vicinity of an epileptogenic focus displayed more prominent nonlinear behavior (Casdagli et al., 1995, 1996, 1997). The correlation sum measure suggested that the focus and nonfocus of patient A demonstrated significant time varying dynamics in more interstimulation epochs than the control. For all six patients, the showed significant temporal dynamics variation in more epochs than 162 PAGE 163 the corresponding control patient. With regards to the spatial comparison of focal and nonfocal electrodes, the STLmax measure did not show any obvious trends. The main finding in regards to the dynamical behavior throughout the day (see figures 514 through 521) is the overall trend of diminished dynamical variance between approximately 11 pm and 7 am for all four measures in patients A (~epoch 130) and C (~epoch 140). Patient Bs seizures were accompanied by significant temporal fluctuation in the dynamical measure before and after seizures. As stimulation epochs which overlapped with seizures were excluded from the study, these dynamical alterations occurred within about 10 minutes of the seizure. Discussion This study aimed to characterize the interstimulation EEG periods using a range of dynamical EEG measures which have demonstrated sensitivity to neural state changes such as those observed in epilepsy. Patient C had highest output current (2.5 mA) as well as the greatest amount of epochs (45.6%, 36.8%, 36.1%, and 21.8%) showing time varying dynamics of all the patients as measured by the ApEnt correlation sum, and STLmax measures, respectively (see figures 526 through 529). Patient A showed similar ApEnt and behavior (35.7% and 31.0% of interstimulation epochs demonstrated significant temporal variance for both measures, whereas control values were 21.8%, 10.5%, respectively) compared to patient C and had the second highest output current (1.75 mA). Patient F showed an opposite trend having the lowest output current (0.75 mA) where ApEnt, and STLmax produced the smallest fraction epochs rejecting H1, H3, and H4 (23.8%, 20.2% and 14.3% whereas control values produced 16.9%, 7.9%, and 19.4%, respectively). The ApEnt measure quantifies the regularity in a time series (Pincus, 1995; Absolo et al., 2007), the measure provides an estimate of the stability of the 163 PAGE 164 reconstructed attractor in phase space (Iasemidis et al., 2002, 2003), and STLmax provides a measure of chaoticity of a signal (Iasemidis et al., 1991). Thus, the similar behavior of these three measures implies the EEG could be undergoing fewer changes in the regularity, stability and observed chaoticity in patient F than patients A and C. Overall, the ApEnt and measures demonstrated the greatest deviation from the control patient, the broadest range of the fraction of epochs showing time varying dynamics, and a potential covariation with output current. For these reasons, the ApEnt and measures may potentially find use as EEG biomarkers for VNS. Biologically, these results may be related to the findings of studies which identified a current threshold for suppression of chemically induced seizure models. For example, seizures induced in a low Ca2+ model could be suppressed with currents greater than 1A (Warren and Durand, 1998). In addition, seizures induced in a high K+ model could be suppressed with currents greater than 4A (Nakagawa and Durand, 1991). Yet patient F has been seizure free for at least one year at the time of recording, while patients A and C have mean seizure rates of 3 and 2 seizures per month (respectively). In general, higher values of VNS parameters are associated with improved seizure protection (BenMenachem et al., 1994). So while at first it may seem counterintuitive that the patient with the lowest output current (patient F) is seizure free, keep in mind that the aforementioned study is referring to collective impact of output current, pulse width, and stimulation frequency. So even though patient Fs output current (0.75 mA) is less than patient As (1.75 mA) and patient Cs (2.5 mA), patient F has higher pulse width (750 s) than patients A and C (both 500 s). In addition, patients A and F have the greatest stimulation frequency of all the patients in the study (30 Hz) whereas patient C has a 25 Hz stimulation frequency. 164 PAGE 165 In addition, patient F has a shorter interstimulation interval (3 minutes) compared to patients A and C (both 5 minutes). It is tempting to attribute patient Fs seizure freedom to this patient having a greater amount of stimulation cycles over time, however patient E is also seizure free and has a 5 minute interval. It is interesting that all four measures behaved in a similar manner for patient F whom had the lowest output current and was seizure free. Perhaps when the output current raises above a particular threshold value the neuronal activity is affected in such a manner that it becomes more erratic and thus results in more rapid dynamical transitions. The minimum current threshold for suppression of epileptiform activity in seizure observed by Nakagawa and Durand (1991) as well as Warren and Durand (1998) may be responsible for this. This could explain why patients A, B, C, D and E whom had greater output currents than patient F produced results less consistent with the other dynamical measures than for patient F. Regarding the relationship to the time of day to EEG dynamical effects, the most obvious trend was the period corresponding to 11 pm and about 7 am (see figures 514 and 516). The reduced dynamical temporal variance for all four measures in A (~epoch 130) and C (~140) during this period compared to other times of day is likely related to the fact that the patients are drowsy or asleep. A recent study by Rizzo et al. (2004) demonstrated that an overall increase in EEG total power both in sleep and wakefulness after longterm VNS treatment compared to pretreatment EEG, so it is plausible that the dynamical measures during sleep were influenced by the VNS. However, EEG sleep studies have demonstrated a decrease in the mean and standard deviation of the ApEnt measure (Acharya et al., 2005; He et al., 2005) during sleep compared to wakefulness, which is aligned with the observation of diminished variation of the ApEnt measure during times when the patient is presumed to be asleep. In addition, a study by Acharya et al. 165 PAGE 166 showed an increase in mean and a decrease in standard deviation for most sleep stages (2005). Thus, the observation of STLmax behavior during sleep is aligned with the literature. Therefore, while VNS has been shown to affect the sleep EEG signal (Rizzo et al., 2004), the behavior of the nonlinear measures during a period when the patient is drowsy or asleep is consistent with sleep patterns in people without VNS implants. Conclusions The results from the surrogate EEG analysis show a potential between the fraction of epochs which displayed nonlinearity and the pulse width parameter. In addition, Patient F produced the smallest fraction of epochs presenting a nonlinear signature (35.1% of epochs could reject H0 at the given significance level) and patient had the highest stimulation frequency (30 Hz) as well as highest pulse width (750 s) of all six VNS patients. Patient Bs EEG presented the greatest fraction of epochs presenting a nonlinear fingerprint (52.3% of epochs could reject H0) whereas the patients stimulator was programmed with the lowest stimulation frequency (20 Hz) and the lowest pulse width (250 s) of all six VNS patients. In addition, patient B demonstrated the greatest amount of monthly seizures. It is possible that neuronal modulation may be sensitive to the duration of the individual pulses in a manner which may manifest as increased linearity of neuronal output. For example, Mu et al. (2004) demonstrated that 250 s showed blood flow reduction to significantly more brain regions than 500 s. However, such an observation requires additional patients for verification. Also, patients E and F demonstrated the lowest fraction of epochs presenting a nonlinear signature (39% and 35.1%) and are also the only two patients which are seizurefree. This observation may be aligned with the clinical observation that the absence of bilateral interictal epileptiform discharges was the only EEG predictor of seizure freedom (Janszky et al., 2005). While interictal epileptiform discharge detection was not included in this study, future studies should include the spatiotemporal 166 PAGE 167 distribution of interictal epileptiform discharges in the characterization process. Comparison with linear and nonlinear EEG measures may provide additional information relevant to the connection between stimulation parameters and EEG patterns. The results from the temporal analysis of interstimulation dynamics demonstrate a potential manifestation of the VNS longterm modulation effect in terms of the interstimulation dynamics behavior. In particular, the ApEnt and measures displayed a potential covariation the output current parameter, demonstrated the greatest deviation from the control patient, the broadest range of the fraction of epochs showing time varying dynamics. For these reasons, the ApEnt,and measures could serve as EEG biomarkers for VNS. In light of this result, its possible that when the current reaches a threshold level the neuronal activity intensifies such that the summed output (the EEG) behaves more erratically (in terms of more rapidly fluctuating dynamical measures such as ApEnt and ,). This phenomena could be related to the observation of minimum stimulation current thresholds were needed to suppress epileptiform activity in low Ca 2+ (Warren and Durand, 1998) and high K + (Nakagawa and Durand, 1991) seizure models. Overall, the two interstimulation analysis experiments (analysis of nonlinearity and analysis of temporal variation) showed potential connections EEG covariation with the pulse width, output current, and signal frequency parameters. Such effects may be useful as an EEG biomarker of optimal VNS settings. Additional studies should be performed on a larger sample of patients in order to validate these claims. In addition, baseline EEG recordings obtained prior to VNS implantation are crucial for determining which EEG effects in the VNS patient could be associated with VNS and which effects appeared to be present in the EEG prior to VNS implantation. 167 PAGE 168 The EEG measures were likely suboptimal as they were selected based on similar studies. Though it is difficult to select the proper parameters in measures used in an expeditionary study such as this one, a good place to start may be to calibrate the measures such that they are able to capture and unfold an epileptic attractor in phase space. From this perspective, future VNS studies which utilize phase space embedding transformations should utilize a patients own seizures to determine the dimension and delay for embedding signals. In addition, study of the VNS in this setup is limited by the fact that the stimulator is programmed for chronic regular stimulation. Thus, though these studies aim to characterize the shortterm EEG effects after stimulation, the shortterm affect is produced by the cumulative effect of a large number of stimulations. Thus, an interesting study to help truly elucidate the effects of an individual stimulation or a group of stimulations would be to record prestimulation baseline for a group of patients, perform a single VNS stimulation, and perform an additional EEG recording while keeping output current at zero milliamps to examine any poststimulation effects. Such an analysis may be one of the best ways to provide the most objective insight into the EEG effects of VNS without concern of any longterm modulatory effects. In addition, tracking the progression of such measures over time (e.g. 3 months, 6 months, 12 months after implantation) and comparing with the patients own baseline EEG recording are a desirable approach to examining EEG dynamics in patients with VNS. The seizures that patient B underwent during the recording session could likely have had a far reaching impact on the observed dynamics patterns, as EEG dynamical transitions have been documented as occurring several minutes to several hours prior to seizures (Iasemidis et al., 2004). One potential improvement to this study is to record multiple days of recordings in order to compare a sufficient amount of interictal data, which has been defined as being at least 168 PAGE 169 8 hours away from a seizure (Pardalos et al., 2003; Hively et al., 2005; Chaovalitwongse et al., 2006). This would eliminate preseizure dynamical transitions as an additional variable to influence results. If this were not possible, one other possibility would be to examine only the EEG data that occurs at least 8 hours away from any detected seizure in a patient. One challenging aspect this approach is that the amount of EEG that would be allowed in the study would be diminished significantly (e.g. twothirds of a single day would be excluded due to a single seizure), and with only a handful of seizures at the wrong time would render this approach infeasible. Though sleep staging was not included in this research protocol obtaining the precise sleep times with manual and/or computer automated sleep staging for each patient should be included in future work. This would help to further examine the observation that the four EEG measures underwent less variation over time during the periods between about 11 pm and about 8 am. The preliminary study of temporal evolution of dynamics used a two tailed test to determine the means are different or not. A future study should look at the direction of the two way test to determine if regularity, stability, or chaoticity are increasing or decreasing throughout the duration of the interstimulation interval. Such information may provide additional insight into the dynamical behavior and the stimulation parameters (e.g. a trend of decreasing or increasing the dynamical measures may be related to the stimulation parameters, the clinical status of the patient, or even the time of day). Ultimately this study may lead to a method of surgical VNS testing, e.g. surgically exposing the left vagus nerve so a diagnostic vagus nerve stimulation device could be temporarily attached to the patient, stimulations could be applied in the operating room and the 169 PAGE 170 EEG signal can be analyzed. If this setup were to prove successful, it may provide a method to prescreen patients for responsiveness to VNS therapy prior to undergoing the implantation process. An article related to these studies was published under the title Optimization of epilepsy treatment with vagus nerve stimulation with authors Basim Uthman, Michael Bewernitz, ChangChia Liu, and Georges Ghacibeh (Uthman et al., 2007). 170 PAGE 171 Figure 51. Map of EEG electrode location for the VNS patients. The electrodes were positioned according to the 1020 electrode placement system which assigns locations proportionally spaced locations (e.g. 10%20%) with respect to the size of the patients head. A B Figure 52. Electrode positions for the control patient from A) an inferior and right view and B) axial slice view of the brain. Red circles indicate focal electrodes (TBa4, TBb6, HR7), blue circles indicate nonfocal electrodes (TLb2, TLb3, TLc2). Images provided for this publication courtesy of the Freiburg Center for Data Analysis and Modeling at the AlbertLudwigs Universitt Freiburg (University of Freiburg), Freiburg, Germany. 171 PAGE 172 01002003004005006007008000.30.350.40.450.50.55Fraction of interstimulation epochs displaying a nonlinear signature (rejecting H0 at 95% significance)Pulse width (s) Patients 5 min off Patients 3 min off Control 5 min off Control 3 min off F E A D, C B Figure 53. Comparison of pulse width parameter to the fraction of epochs displaying a nonlinear signature in the six patients treated with VNS. The fraction of epochs displaying a nonlinear signature in control patient using the 3minute and 5minute off pseudo stimulation times are represented by the column of six triangles (3 minute off times) and six squares (5 minute off times). Figure 54. Patient A surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. 172 PAGE 173 Figure 55. Patient B surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. The red lines indicate seizures. Figure 56. Patient C surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. 173 PAGE 174 Figure 57. Patient D surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. Figure 58. Patient E surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. Figure 59. Patient F surrogate data analysis results over 24 hours during the interstimulation epoch. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. 174 PAGE 175 fp1CPzfp2CPzf3CPzf4CPzc3CPzc4CPzp3CPzp4CPzo1CPzo2CPzf7CPzf8CPzt3CPzt4CPzt5CPzt6CPza1CPza2CPzfzCPzczCPzpzCPzleyeCPzreyeCPzlmnCPzrmnCPz A B C D E F Figure 510. The fraction of all interstimulation epochs per channel which rejected the null hypothesis H0 using ApEnt for A) patient A, B) patient B, C) patient C, D) patient D, E) patient E, F) patient F. 175 PAGE 176 Table 51. Surrogate analysis results summary for all six patients with the VNS implant. % of epochs where the ApEnt measure rejected H0 channel A B C D E F fp1CPz 58.27% 42.37% 42.15% 29.31% 38.89% 36.27% fp2CPz 61.42% 38.56% 40.61% 32.76% 36.90% 31.62% f3CPz 56.30% 62.71% 57.85% 64.53% 30.95% 31.13% f4CPz 44.49% 60.17% 49.04% 42.12% 36.11% 35.05% c3CPz 27.56% 31.36% 52.11% 30.05% 37.70% 34.80% c4CPz 29.92% 77.54% 50.57% 38.18% 49.21% 27.45% p3CPz 38.98% 24.58% 48.66% 31.53% 32.94% 19.61% p4CPz 28.35% 50.00% 41.76% 39.66% 34.92% 22.55% o1CPz 27.17% 39.41% 47.89% 42.86% 36.11% 33.33% o2CPz 28.74% 36.02% 51.34% 55.17% 44.05% 33.82% f7CPz 57.09% 85.17% 35.25% 36.45% 27.38% 39.95% f8CPz 66.14% 78.39% 35.25% 33.50% 37.70% 41.67% t3CPz 46.46% 48.31% 32.95% 39.16% 39.29% 55.64% t4CPz 42.13% 78.81% 44.83% 43.10% 42.06% 54.66% t5CPz 24.02% 48.73% 36.78% 38.42% 31.35% 48.77% t6CPz 24.80% 46.19% 45.98% 50.25% 33.33% 35.05% a1CPz 53.54% 56.78% 37.16% 34.24% 42.86% 32.60% a2CPz 44.49% 47.88% 51.34% 35.22% 40.87% 32.60% fzCPz 71.65% 30.08% 36.78% 44.33% 40.48% 27.94% czCPz 60.63% 51.69% 27.59% 34.98% 47.62% 26.72% pzCPz 61.81% 47.88% 21.46% 41.63% 56.35% 22.30% leyeCPz 51.97% 43.64% 33.33% 41.38% 42.06% 47.79% reyeCPz 53.54% 61.44% 30.65% 61.08% 44.84% 34.31% lmnCPz 56.30% 59.75% 25.29% 30.79% 30.16% 42.16% rmnCPz 43.70% 61.02% 23.37% 27.83% 39.68% 30.15% # epochs 254 236 261 406 252 408 denotes focal EEG channel 176 PAGE 177 Figure 511. Control patient (with 5minute artificial stimulation times) surrogate data analysis results over 24 hours for all artificial interstimulation epochs. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. Figure 512. Control patient (with 3minute artificial stimulation times) surrogate data analysis results over 24 hours for all artificial interstimulation epochs. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. Table 52. Control patient surrogate analysis results summary. % of epochs where the ApEnt measure rejected H0 channel Control 5 minute 'off' time Control 3 minute 'off' time TBA4 22.65% 19.41% TBB6 29.27% 22.85% HR7 27.18% 26.54% TLB2 43.21% 40.05% TLB3 51.57% 44.72% TLC2 81.53% 70.02% # epochs 261 406 denotes focal EEG channel 177 PAGE 178 1 Figure 513. Experimental setup for characterizing the temporal evolution EEG dynamics during interstimulation intervals in patients undergoing VNS therapy for epilepsy. The double head arrows indicate a statistical comparison is made between the EEG feature segments represented by the shaded rectangles. VNS on/off Epoch 2 Epoch n EEG feature for channel 1 EEG feature for channel 2 EEG feature for channel 26 First half of an interstimulation p erio d Second half of an interstimulation period For the purposes of this study, a full stimulation epoch consists of 30 seconds of stimulation and either a 3 or 5 minute off p eriod. 178 PAGE 179 A B C D Figure 514. Patient A temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. 179 PAGE 180 A B C D Figure 515. Patient B temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. The red lines indicate seizures. 180 PAGE 181 A B C D Figure 516. Patient C temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. 181 PAGE 182 A B C D Figure 517. Patient D temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. 182 PAGE 183 A B C D Figure 518. Patient E temporal evolution of dynamics analysis results over 24 hours for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. 183 PAGE 184 A B C D Figure 519. Patient F temporal evolution of dynamics analysis results for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. 184 PAGE 185 A B C D Figure 520. Control patient (with 5minute artificial stimulation times) temporal evolution of dynamics analysis results for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. 185 PAGE 186 A B C D Figure 521. Control patient (with 3minute artificial stimulation times) temporal evolution of dynamics analysis results for A) ApEnt, B) correlation sum, C) and D) STLmax. Yellow indicates that particular interstimulation epoch (abscissa) for the channel of interest (ordinate) rejected the null hypothesis. 186 PAGE 187 Table 53. Approximate entropy analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H1 using the ApEnt measure. % of epochs rejecting H1 channel Patient A Patient B Patient C Patient D Patient E Patient F fp1CPz 40.94% 31.78% 47.13% 18.23% 34.92% 24.75% fp2CPz 40.94% 43.64% 43.30% 20.20% 32.94% 24.26% f3CPz 44.09% 49.58% 52.11% 21.67% 31.75% 25.00% f4CPz 40.55% 41.53% 49.43% 24.14% 30.95% 29.90% c3CPz 42.13% 38.14% 42.53% 20.44% 28.57% 23.53% c4CPz 29.53% 33.47% 50.57% 24.14% 29.37% 26.72% p3CPz 27.17% 35.59% 47.89% 22.41% 24.60% 19.36% p4CPz 26.38% 25.42% 50.57% 22.41% 26.59% 20.59% o1CPz 38.98% 41.53% 47.51% 24.14% 24.21% 22.55% o2CPz 38.58% 37.29% 49.81% 22.91% 30.16% 22.79% f7CPz 36.22% 54.24% 50.96% 27.34% 38.49% 24.51% f8CPz 38.98% 54.24% 47.89% 25.37% 37.70% 28.43% t3CPz 42.91% 50.85% 43.30% 29.80% 34.92% 30.39% t4CPz 33.46% 43.22% 40.23% 23.65% 37.70% 30.88% t5CPz 33.86% 52.54% 39.08% 20.94% 32.14% 30.15% t6CPz 37.80% 41.10% 41.38% 25.86% 35.32% 28.43% a1CPz 40.55% 50.42% 34.10% 31.53% 35.71% 24.75% a2CPz 35.43% 50.00% 41.00% 28.08% 36.11% 23.28% fzCPz 37.40% 34.32% 46.74% 19.21% 28.97% 21.08% czCPz 29.92% 23.31% 48.28% 17.49% 25.40% 18.87% pzCPz 20.47% 26.69% 36.78% 21.67% 18.65% 17.65% leyeCPz 37.40% 29.24% 50.19% 24.38% 34.92% 17.40% reyeCPz 32.68% 37.71% 50.96% 24.88% 35.71% 18.87% lmnCPz 37.80% 46.61% 44.83% 24.38% 40.48% 19.85% rmnCPz 29.92% 47.88% 44.06% 21.43% 36.90% 21.81% # epochs 254 236 261 406 252 408 denotes focal EEG channel 187 PAGE 188 fp1CPzfp2CPzf3CPzf4CPzc3CPzc4CPzp3CPzp4CPzo1CPzo2CPzf7CPzf8CPzt3CPzt4CPzt5CPzt6CPza1CPza2CPzfzCPzczCPzpzCPzleyeCPzreyeCPzlmnCPzrmnCPz A B C D E F Figure 522. Approximate entropy analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H1 using the ApEnt measure. Table 54. Approximate entropy analysis results for the control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H1 using the ApEnt measure. % of epochs rejecting H1 channel Control 5 minute 'off' time Control 3 minute 'off' time TBA4 22.65% 18.18% TBB6 25.44% 17.94% HR7 23.34% 15.23% TLB2 20.91% 17.69% TLB3 23.69% 19.66% TLC2 14.63% 13.02% TBA4 261 406 denotes focal EEG channel 188 PAGE 189 Table 55. Correlation sum analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H2 using the correlation sum measure. % of epochs rejecting H2 channel Patient A Patient B Patient C Patient D Patient E Patient F fp1CPz 25.98% 18.64% 34.10% 12.07% 20.24% 10.54% fp2CPz 26.38% 16.10% 29.12% 12.81% 19.84% 8.82% f3CPz 19.29% 12.71% 24.90% 9.85% 18.65% 11.52% f4CPz 18.11% 10.17% 26.05% 12.81% 18.25% 11.52% c3CPz 19.29% 13.98% 21.84% 10.59% 17.86% 10.54% c4CPz 15.75% 15.25% 19.92% 12.07% 18.25% 9.31% p3CPz 13.39% 11.86% 14.94% 11.58% 15.48% 9.80% p4CPz 12.99% 8.47% 13.79% 12.32% 15.87% 9.31% o1CPz 15.35% 8.90% 13.03% 11.82% 13.49% 10.29% o2CPz 17.32% 8.47% 13.79% 14.29% 11.90% 13.73% f7CPz 16.93% 9.75% 31.80% 11.82% 21.43% 10.54% f8CPz 16.14% 9.32% 29.50% 12.32% 18.65% 10.29% t3CPz 22.44% 10.59% 22.22% 11.08% 18.65% 12.25% t4CPz 16.54% 6.78% 21.07% 13.30% 21.83% 11.52% t5CPz 15.35% 10.17% 13.41% 9.85% 12.30% 9.31% t6CPz 11.81% 9.32% 17.24% 12.07% 21.83% 8.33% a1CPz 11.81% 13.56% 23.37% 11.08% 21.03% 10.29% a2CPz 16.54% 13.56% 22.22% 15.27% 18.25% 11.03% fzCPz 22.05% 12.71% 25.67% 11.33% 17.46% 12.01% czCPz 17.32% 8.05% 11.11% 9.61% 18.65% 12.25% pzCPz 14.57% 7.63% 9.96% 11.33% 15.08% 6.13% leyeCPz 14.96% 13.56% 27.97% 10.10% 17.06% 10.05% reyeCPz 16.54% 12.71% 32.57% 13.55% 17.06% 8.33% lmnCPz 13.78% 7.20% 21.84% 9.36% 17.46% 11.03% rmnCPz 12.60% 8.47% 24.90% 11.58% 16.27% 9.56% # epochs 254 236 261 406 252 408 denotes focal EEG channel 189 PAGE 190 fp1CPzfp2CPzf3CPzf4CPzc3CPzc4CPzp3CPzp4CPzo1CPzo2CPzf7CPzf8CPzt3CPzt4CPzt5CPzt6CPza1CPza2CPzfzCPzczCPzpzCPzleyeCPzreyeCPzlmnCPzrmnCPz A B C D E F Figure 523. Correlation sum analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H2 using the correlation sum measure. Table 56. Correlation sum analysis results for the control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H2 using the correlation sum measure. % of epochs rejecting H2 channel Control 5 minute 'off' time Control 3 minute 'off' time TBA4 11.50% 8.60% TBB6 10.80% 8.85% HR7 8.71% 8.11% TLB2 9.76% 7.13% TLB3 8.71% 8.35% TLC2 5.57% 7.37% # epochs 261 406 denotes focal EEG channel 190 PAGE 191 Table 57. Mean angular frequency in phase space analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H3 using the measure. % of epochs rejecting H3 channel Patient A Patient B Patient C Patient D Patient E Patient F fp1CPz 38.19% 30.51% 37.93% 23.89% 39.68% 20.10% fp2CPz 35.83% 22.46% 38.70% 22.66% 32.94% 24.02% f3CPz 29.53% 26.27% 41.00% 24.88% 34.92% 19.36% f4CPz 27.95% 27.12% 41.76% 23.65% 33.73% 21.32% c3CPz 30.31% 26.27% 38.70% 22.17% 36.51% 18.38% c4CPz 34.25% 35.17% 31.80% 26.11% 41.67% 19.61% p3CPz 31.89% 27.54% 35.25% 27.83% 33.33% 17.89% p4CPz 26.38% 22.88% 32.95% 22.91% 33.73% 18.14% o1CPz 29.53% 23.73% 39.46% 25.62% 28.97% 19.12% o2CPz 29.92% 20.34% 34.87% 26.85% 33.33% 21.81% f7CPz 34.25% 25.00% 43.68% 24.38% 33.73% 19.12% f8CPz 31.10% 23.73% 39.46% 27.34% 35.32% 20.10% t3CPz 39.37% 24.58% 41.00% 23.40% 38.10% 19.85% t4CPz 29.92% 22.46% 31.42% 27.59% 34.13% 21.08% t5CPz 28.74% 25.00% 31.42% 26.35% 26.59% 21.08% t6CPz 25.59% 21.61% 31.42% 22.41% 37.30% 20.098% a1CPz 24.80% 19.92% 31.03% 26.60% 31.35% 18.87% a2CPz 27.56% 22.03% 31.80% 30.30% 32.54% 18.38% fzCPz 27.95% 36.02% 39.46% 23.40% 34.52% 20.83% czCPz 29.53% 23.73% 40.61% 20.94% 30.16% 21.57% pzCPz 31.10% 24.58% 34.48% 25.37% 29.37% 19.61% leyeCPz 37.80% 29.66% 42.53% 26.60% 34.92% 20.83% reyeCPz 32.68% 28.81% 37.93% 26.85% 31.35% 21.57% lmnCPz 32.68% 23.31% 34.10% 19.70% 34.92% 18.38% rmnCPz 29.13% 22.88% 37.93% 25.12% 30.16% 23.77% # epochs 254 236 261 406 252 408 denotes focal EEG channel 191 PAGE 192 fp1CPzfp2CPzf3CPzf4CPzc3CPzc4CPzp3CPzp4CPzo1CPzo2CPzf7CPzf8CPzt3CPzt4CPzt5CPzt6CPza1CPza2CPzfzCPzczCPzpzCPzleyeCPzreyeCPzlmnCPzrmnCPz A B C D E F Figure 524. Mean angular frequency in phase space analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H3 using the measure. 192 PAGE 193 Table 58. Mean angular frequency in phase space analysis results for control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H3 using the measure. % of epochs rejecting H3 channel Control 5 minute 'off' time Control 3 minute 'off' time TBA4 12.20% 7.13% TBB6 13.59% 8.60% HR7 9.41% 8.85% TLB2 8.01% 7.13% TLB3 8.36% 6.88% TLC2 11.50% 9.09% # epochs 261 406 denotes focal EEG channel 193 PAGE 194 Table 59. Shortterm maximum Lyapunov exponent analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H4 using the STLmax measure. % of epochs rejecting H4 channel Patient A Patient B Patient C Patient D Patient E Patient F fp1CPz 29.13% 30.08% 40.23% 18.23% 31.35% 17.65% fp2CPz 28.35% 32.20% 33.72% 16.50% 29.37% 17.89% f3CPz 29.13% 27.54% 35.25% 17.49% 28.97% 15.93% f4CPz 24.41% 15.25% 37.55% 15.52% 22.22% 19.12% c3CPz 24.80% 15.25% 44.06% 14.78% 26.98% 18.63% c4CPz 21.26% 14.41% 39.85% 16.75% 23.81% 12.50% p3CPz 19.69% 16.10% 35.63% 16.26% 19.84% 10.54% p4CPz 17.72% 15.25% 37.55% 16.01% 19.84% 11.27% o1CPz 23.23% 19.07% 35.25% 15.52% 21.43% 13.48% o2CPz 20.47% 16.95% 31.80% 17.00% 25.40% 11.76% f7CPz 24.41% 22.88% 42.53% 17.73% 28.17% 13.97% f8CPz 26.77% 30.51% 37.16% 17.00% 19.84% 15.69% t3CPz 40.94% 27.12% 43.68% 24.88% 26.98% 14.95% t4CPz 29.53% 15.25% 40.61% 20.94% 27.78% 21.57% t5CPz 25.20% 19.92% 32.95% 17.49% 23.41% 20.34% t6CPz 17.32% 15.68% 38.70% 16.26% 22.62% 15.93% a1CPz 24.41% 31.78% 32.95% 24.88% 30.16% 13.24% a2CPz 30.71% 28.81% 38.31% 21.18% 17.06% 12.25% fzCPz 24.41% 19.07% 25.29% 18.97% 26.19% 10.54% czCPz 15.75% 15.25% 26.44% 11.82% 21.83% 10.78% pzCPz 21.65% 15.25% 25.67% 14.04% 25.79% 11.52% leyeCPz 26.38% 23.73% 44.83% 14.29% 25.40% 15.20% reyeCPz 23.23% 19.07% 38.31% 18.97% 19.05% 12.50% lmnCPz 16.93% 17.80% 34.87% 12.81% 19.84% 12.01% rmnCPz 20.08% 20.76% 30.27% 14.04% 15.87% 9.56% # epochs 254 236 261 406 252 408 denotes focal EEG channel 194 PAGE 195 fp1CPzfp2CPzf3CPzf4CPzc3CPzc4CPzp3CPzp4CPzo1CPzo2CPzf7CPzf8CPzt3CPzt4CPzt5CPzt6CPza1CPza2CPzfzCPzczCPzpzCPzleyeCPzreyeCPzlmnCPzrmnCPz A B C D E F Figure 525. Shortterm maximum Lyapunov exponent analysis results for VNS patients. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H4 using the STLmax measure. 195 PAGE 196 Table 510. Shortterm maximum Lyapunov exponent analysis results for the control patient. Results are expressed as the fraction of epochs in each channel which rejected hypothesis H4 using the STLmax measure. % of epochs rejecting H4 channel Control 5 minute 'off' time Control 3 minute 'off' time TBA4 26.13% 20.88% TBB6 32.06% 26.78% HR7 27.87% 22.11% TLB2 21.60% 14.25% TLB3 19.86% 16.95% TLC2 15.68% 15.72% # epochs 261 406 denotes focal EEG channel 0.511.522.5300.10.20.30.40.5Fraction of epochs showing significant temporal variationOutput current (mA) Patients 5 min off Patients 3 min off Control 5 min off Control 3 min off C D A B F E Figure 526. ApEnt results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation. 196 PAGE 197 00.511.522.5300.050.10.150.20.25Fraction of epochs showing significant temporal variationOutput Current (mA) Patients 5 min off Patients 3 min off Control 5 min off Control 3 min off C D A B E F Figure 527. Correlation sum results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation. 0.511.522.5300.10.20.30.40.5Fraction of epochs showing significant temporal variationOutput current (mA) Patients 5 min off Patients 3 min off Control 5 min off Control 3 min off C D A F B E Figure 528. results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation. 197 PAGE 198 0.511.522.530.10.20.30.40.5Fraction of epochs showing significant temporal variationOutput current (mA) Patients 5 min off Patients 3 min off Control 5 min off Control 3 min off C D A E B F Figure 529. STLmax results and the corresponding output current setting. Results are expressed as the fraction of interstimulation epochs showing significant temporal variation. 198 PAGE 199 CHAPTER 6 A NOVEL GENERALIZED ABSENCE SEIZURE DETECTION ALGORITHM Absence epilepsy makes up about 8% of child epilepsy cases with peak occurrence between 67 years of age (Berkovic, 1996). Absence seizures are clinically characterized by brief, transient loss of awareness, responsiveness, and memory. These paraxoysmal discharges have a sudden onset, are often less than 5 seconds in duration, cease abruptly without postictal effects and can occur multiple times per day. Absence seizures are generalized with regular and symmetrical 2.53.5 Hz SWDs (Panayiotopoulos et al., 1994). Figure 61 shows an example of an electrographic absence seizure. The antiepileptic drugs valproic acid and ethosuximide are the most commonlyused drugs for treating absence epilepsy. For additional information on absence epilepsy, see chapter 2. Seizure detection is an important procedure for the treatment of epilepsy. In particular, there are areas wherein seizure detection can benefit epilepsy treatment; rapid seizure annotation and online realtime EEG analysis. Seizure detection algorithms can greatly improve the rate at which physicians analyze EEG recordings by providing a tool to help point out EEG waveforms which are likely to be epileptiform discharges. Such an algorithm can improve the efficiency of health care for epilepsy treatment. The other popular application of seizure detection algorithms is for online realtime analysis. Such analysis is useful in the research field for enhancing the understanding of how EEG activity correlates to the clinical status of the patient or for cognitive testing in animal models of epilepsy. For some epilepsy variants, such as mesial temporal lobe epilepsy, seizure detection may provide a basis for an implantable seizure control device (e.g. utilizing a drug pump and/or neural stimulation apparatus). For generalized absence epilepsy, it is possible that 199 PAGE 200 someday an online realtime absence seizure detection algorithm may be integrated with scalpEEG recordings as part of medical checkups in patients with generalized absence epilepsy. In addition to seizure detection, such an algorithm can be extended to perform seizure stratification and provide a histogram of seizure count versus seizure duration. The ability to automatically stratify seizures may provide additional useful information for evaluating therapeutic effect (e.g. compare the seizure stratification histogram profile before and after therapeutic intervention). For these reasons, the purpose of this study is examine a novel method for expediting detection and stratification of SWDs such as those found in generalized absence epilepsy. Methods Previous automated SWD detection algorithms typically relied on thresholding methods and performed well in animal seizure models (Westerhuis et al. 1996; Fanselow et al., 2000; Van Hese et al., 2003). Energy Method for SWD Detection One method calculates the signal energy (Van Hese et al., 2003) and establishes a threshold energy level which designates spike and wave activity or nonspike and wave activity. In each window, the signal energy is calculated as 1021LnSknxkE (61) where a detection is signified if the calculated energy exceeds a chosen threshold value for four consecutive windows. 200 PAGE 201 Fanselow Method for SWD Detection The Fanselow method (Fanselow et al., 2000) establishes a voltage threshold which allows classification of SWDs. The method is based on the maximum absolute value of the EEG amplitude within a window SknxkALn1max1,...,0 (62) A threshold is set for each subject. If three consecutive windows are above the threshold, a SWD detection is made. Westerhuis Method for SWD Detection The Westerhuis method (Westerhuis et al., 1996) estimates the first derivative of the EEG signal which is referred to as the steepness of signal. The maximum value of this steepness in consecutive, nonoverlapping windows is evaluated as SkndkDLn1max1,...,0 (63) where nxnxnd1 (64) A positive detection is made if D exceeds a certain threshold value in four consecutive windows. The threshold is automatically determined on the basis of the EEG during wakefulness. This method showed strong performance in Genetic Absence Epilepsy Rats from Strasbourg (GAERS). This study aims to address improvements in the following areas; minimize detection lag (which is critical for online utilization of such a seizure detection device), decreasing window size (to help increase detection time resolution), increasing robustness to noise, and simplified detection calibration. For these reasons, supervised machine learning algorithms were utilized 201 PAGE 202 with the intention of providing a robust seizure detector. The two features selected for this algorithm are TeagerKaiser energy and dynamic time warping distance. Dynamic Time Warping Dynamic time warping (DTW) is one of the most wellstudied temporal pattern similarity measures (Rabiner et al., 1978). This method utilizes a dynamic programming approach to align a test time series to a template time series and provides an alignment distortion measure to ascertain pattern similarity. For two time series X and Y of equal length nYX pattern similarity is established by aligning time series X with time series Y using the minimum computed alignment distortion. The distortion path is obtained by warping time for each signal such that the minimum alignment distance between the two signals is achieved. This study applies the DTW measure to two EEG signals of equal length though the signals do not need to be the same length. YXDalign, DTW has been used extensively in biological applications such as ECG analysis (Jen and Hwang, 2007; Kotas, 2008), EEG spiking pattern recognition (Chi et al., 2007), analysis of eventrelated potentials (Casarotto et al., 2005), fingerprint recognition (KovacsVajna, 2000), and medical imaging reconstruction (Okumura et al., 2007). The DTW measure has demonstrated utility as a kernel function for support vector machine based seizure prediction algorithms in temporal lobe epilepsy (Chaovalitwongse and Pardalos, 2008). The minimum DTW distance can be obtained using the following dynamic programming technique. First, an n x n alignment array is generated where each element of the array represents a distance metric for all combinations of points between the two signals. In this array the (i,j)th element is the distance between points x i and y j Euclidean distance 2,jijiyxyxd is 202 PAGE 203 typically used as the distance measure. A warp path KwwW,...,1 is then constructed where K is the length of the warp path for which YXKYX,max Element k of the warping path represents Element k of the warp path represents a matching point of the two time series, where corresponds to index i of time series X and index j of time series Y. A warping path must begin at the first sample of both time series, jiwK, ji, 1,11 w and must finish at the last sample of both time series, nnwK, An additional constraint requires the warping path indices i and j to increase monotonically. That is, jiwk, and '',jiwk where and The optimal warp path possesses the minimum warping cost defined as 1'iii 1'jjj KkjkikalignwwdKYXD1,,,1min, (65) This problem can be approached from a dynamic programming perspective where the path is advanced by one unit on the i axis, one unit on the j axis, or both. Thus, this approach only requires evaluation of cumulative distance found in adjacent elements, 1,1,11,min,,jiDjiDjiDxxdjiDji (66) TeagerKaiser Energy In 1990, Kaiser first derived Teagers nonlinear energy algorithm in discrete time domain to calculate the energy of a sound (Kaiser, 1990). The TeagerKaiser energy (TKE) operator has demonstrated sensitive to both amplitude and frequency changes in time series signals. This measure has demonstrated utility feature for the detection of seizures and high frequency 203 PAGE 204 epileptiform activity (Zaveri et. al., 1993; Smart et. al., 2005; Gardner et. al., 2006). This study utilizes the mean value of the TKE operator across a window, (67) 122111NkkXkXkXNXTKE where N is the length of the window of interest. Empirical Study In order to investigate the possibility of seizure detection and stratification, two experiments are presented, each classifying a different subset of the seizure: Separate the beginning of each seizure from randomlyselected nonseizure segments Separate the end of each seizure from randomlyselected nonseizure segments. Separating the beginning of the seizure from nonseizure segments (experiment one) tests the seizure detection abilities of the detector whereas distinguishing the end of a seizure from nonseizure segments (experiment two) is a critical task in seizure stratification. These two experiments provide an initial framework for testing the SVM classifiers ability to stratify generalized SWDs. This empirical study is motivated by an underlying hypothesis that SVMs are capable of distinguishing neural states (seizure and nonseizure) in a newlydiagnosed patient with typical absence seizures. The signal features consist of the DTW distances between a template SWD signal the test window to be classified, both of which are 0.3 seconds in duration. This section describes the EEG data acquisition, data sampling and feature extraction, SVM training and testing, and results. EEG Data Acquisition Approximately 24 hours of scalp EEG data were acquired from a SleepMed DigiTrace ambulatory EEG recording device. The data were acquired at 200 Hz with an input range of 0.6 204 PAGE 205 mV with builtin filter of 0.570 Hz. A bipolar, longitudinal, chain electrode recording montage was employed to provide 16 EEG channels (Fp1F3, F3C3, C3P3, P3O1, Fp2F4, F4C4, C4P4, P4O2, Fp1F7, F7T3, T3T5, T5O1, Fp2F8, F8T4, T4T6, T6O2) as well as two auxiliary channels which were not utilized. This EEG study utilized the F3C3 and F4C4 channels because provide highquality representations of the SWDs yet are located reasonably far away from facial muscles. The patient underwent 93 seizures during the ~24 hour continuous EEG recording. Seizure times were verified by a boardcertified clinical electroencephalographer. Data Sampling and Feature Extraction Each data sample consists of extracted features from an EEG window one second in duration. Within the onesecond data sample window, a subwindow of 0.3 seconds in duration is advanced with 50% overlap from the start of the data sample window to the end of the data sample window (providing 5 subwindows and thus 5 features per data sample window per EEG channel). Thus for channels F3C3 and F4C4 there are ten features representing each data sample window. For each subwindow within the data sample, the DTW similarity feature is obtained via comparison with an archetypical SWD template. Figures 62 and 63 illustrate the DTW distance metric in this application. The study uses 93 SWD templates (one selected from each seizure) which are centered on the spike and 0.3 seconds in duration. SWD templates are reassigned randomly such that no seizure uses its own template for feature extraction. The seizure class consists of data sample windows from all 93 seizures. The nonseizure class consists of a total of 93 nonseizure data sample windows randomly selected from ~24 hour continuous EEG recording with the following constraints: 205 PAGE 206 Must be at least 60 seconds away from any seizure onset or offset Must be at least 0.1 seconds away from another nonseizure sample The training dataset consists of the 93 seizure and 93 nonseizure data sample windows. SVM Training and Testing The softmargin SVM classifier with a RBF kernel is applied to this problem based on success in other neural state classification problems (Kaper et. al., 2004; Acir and Gzelis, 2005; Bewernitz et. al., 2006; Lehmann et. al., 2007; Seref et al., 2006). A range of SVM parameters which demonstrated satisfactory results in similar EEG classification studies were applied to this study. Thus, each SVM cycle was performed for all nine combinations of cost=10,100,1000 (Kaper et al., 2004; Acir and Gzelis, 2005) and the RBF parameter sigma=20,40,60 (Kaper et. al., 2004; Lehmann et al., 2007). SVM training is performed using a 10fold cross validation scheme. This scheme employs a resampling technique in which the seizure and nonseizure classes are first randomly shuffled. Next, 10 % (~9 samples) of the shuffled seizure class and 10% (~9 samples) of the shuffled nonseizure class are extracted (individually for each class) and combined to form the test set. In general, SVM training is optimal for training datasets with equal numbers of data points from each class. Otherwise, the classifier can be biased towards the class which had more training points. The remaining 90% of each class is used to train the SVM classifier which is then tested on the extracted testing dataset. Upon testing the SVM, the test dataset is replaced in the shuffled training data and the succeeding 10% block of each shuffled class is extracted to form the next test set. This validation scheme repeats until the last 10% block of each shuffled class is extracted and tested. This study repeats the sampling, feature extraction, resampling, training and testing cycle 1000 times. 206 PAGE 207 Detector Performance Evaluation The detection sensitivity and specificity are used to evaluate the performance of the SVM seizure detector. This involves categorizing the classification results into one of four possible outcomes: True positives (TPs) refer to the correct classification of seizure segment True negatives (TNs) refer to the correct classification of a nonseizure segment False positives (FPs) refer to the incorrect classification of a nonseizure segment as a seizure False negatives (FNs) refer to the incorrect classification of seizure segment as a nonseizure The four possible detection outcomes may be illustrated in the context of figure 64. A classification result is considered a TP if a seizure EEG sample is classified as a seizure sample. A classification result is considered a TN if a nonseizure EEG sample is classified as a nonseizure sample. A classification result is considered a FP if a nonseizure EEG sample is classified as a seizure sample. Finally, a classification result is considered a FN if a seizure EEG sample is classified as a nonseizure sample. The sensitivity and specificity measures often used for evaluating detector performance can be derived from these four outcome quantities. Sensitivity is the fraction of positive samples that are classified as positive: FNTPTPySensitivit (68) where positive refers to the seizure class. Specificity refers to the fraction of negative samples that are classified as negative: FPTNTNySpecificit (69) 207 PAGE 208 where negative refers to the nonseizure class. Results The mean value of sensitivity and specificity are reported for 100 SVM detection trials, where each trial underwent 10fold cross validation for one of the nine combinations of SVM parameters. The results for experiment one, seizure detection of the first second of each seizure are shown in table 61. Results from experiment two, seizure stratification experiment performing detection on the last second of each seizure are summarized in table 62. Discussion As is shown in table 61 and figures 65, 66, 67, the SVM classifiers overall best performance is experiment ones application where the SVM is function as a seizureonset detector (classifying the first second of each seizure). This result makes sense in comparison with experiment two where the last second of the seizure is classified as a first step towards a seizure stratification application (figures 68, 69, 610). The beginnings of the seizures appear more visually similar to one another than the ends of the seizures. Even still, the performance of the classifier in the experiment two setup demonstrated high sensitivity and specificity for numerous parameter combinations. The observation that classification is less affected by SVM parameters in experiment one compared to experiment two is a reasonable phenomena. Due to stronger electroencephalographic similarity among various seizures at onset compared to offset, then the beginning of the seizures may be more regular in feature space than the seizure offset. Thus, the alterations in SVM parameters do not seem to have as large of an effect on the results of experiment one as with experiment two. In particular, the classifier varied more with changes in cost for experiment two than experiment one, which could be due to a loss of generality resulting from over fitting the more variant seizure offset period. 208 PAGE 209 These results show promise for the SVM application to seizure detection and stratification. Such a tool may provide benefit to clinicians and researchers by providing a means to rapidly annotate as well as provide a clinically interesting measure of drug effect on a histogram of seizure durations. Thus, this line of work may lead to a greater understanding of the therapeutic effects of AEDs. Future studies will provide a more comprehensive evaluation of features. While the DTW measure performed well, other similarity measures (such as similarity index) may be worth implementing. In addition, adding more EEG channels may improve classification performance though channel addition imposes a computational burden increase. These results should be validated in additional patients. Finally, an important future step is to implement this algorithm in a pseudoonline fashion to assess the robustness to noise. While SVMs provide exceptional generalization abilities, a sliding window classifier will provide an interesting assessment of how the classifier copes with the challenges of realtime EEG acquisition. An expansive review article regarding support vector machines in neuroscience applications was accepted for publication under the title support vector machines in neuroscience with authors Onur Seref, O. Erhun Kundakcioglu, and Michael Bewernitz (Seref et al., 2007). 209 PAGE 210 Figure 61. Approximately 6 seconds of scalpEEG demonstrating the 2.53.5 Hz spikewave discharge that defines an electrographic absence seizure (data provided courtesy of Dr. Gregory Holmes). 210 PAGE 211 Figure 62. DTW comparison of two different SWD segments. The top signal is a 300 ms SWD segment. Bottom signal is a 300 ms segment of a different SWD. The DTW distance is about 2.4 x 10 7 211 PAGE 212 Figure 63. DTW comparison of a SWD segment with a random interictal segment. Top signal is a 300 ms EEG segment of a SWD. Bottom signal is 300 ms of interictal EEG. The DTW distance is about 5.1 x 10 7 Reality Seizure Nonseizure Seizure True Positive False Positive Nonseizure False Negative True Negative Prediction Figure 64. Seizure classification evaluation framework. 212 PAGE 213 Table 61. Classification performance using the first second of each seizure. Sigma Cost Sensitivity Specificity Mean 20 10 97.11% 96.94% 97.02% 20 100 96.45% 96.46% 96.45% 20 1000 96.37% 96.43% 96.40% 40 10 97.18% 97.04% 97.11% 40 100 96.56% 96.49% 96.53% 40 1000 96.19% 96.37% 96.28% 80 10 97.10% 97.04% 97.07% 80 100 96.82% 96.62% 96.72% 80 1000 96.04% 96.31% 96.18% Table 61. Classification performance using the last second of each seizure. Sigma Cost Sensitivity Specificity Mean 20 10 94.85% 93.46% 94.16% 20 100 91.98% 93.10% 92.54% 20 1000 90.25% 92.07% 91.16% 40 10 95.04% 93.34% 94.19% 40 100 93.03% 93.27% 93.15% 40 1000 89.91% 92.13% 91.02% 80 10 94.93% 93.29% 94.11% 80 100 93.86% 93.29% 93.58% 80 1000 90.74% 92.63% 91.69% 213 PAGE 214 Sz NSzSz NSzSigma = 20Cost = 100Sz NSzSigma = 20Cost = 10Sigma = 20Cost = 10000.00%10.00%20.00%30.00%40.00%50.00%60.00%70.00%80.00%90.00%100.00%Percent of classification type Sz Detection NSz Detection Figure 65. Seizure detection performance for RBF parameter sigma=20 using the first second of each seizure. Sigma = 40Cost = 1000Sigma = 40Cost = 10Sz NSzSigma = 40Cost = 100Sz NSzSz NSz0.00%10.00%20.00%30.00%40.00%50.00%60.00%70.00%80.00%90.00%100.00%Percent of classification type Sz Detection NSz Detection Figure 66. Seizure detection performance for RBF parameter sigma=40 using the first second of each seizure. 214 PAGE 215 Sz NSzSz NSzSigma = 80Cost = 100Sz NSzSigma = 80Cost = 10Sigma = 80Cost = 10000.00%10.00%20.00%30.00%40.00%50.00%60.00%70.00%80.00%90.00%100.00%Percent of classification type Sz Detection NSz Detection Figure 67. Seizure detection performance for RBF parameter sigma=80 using the first second of each seizure. Sz NSzSz NSzSigma = 20Cost = 100Sz NSzSigma = 20Cost = 10Sigma = 20Cost = 10000.00%10.00%20.00%30.00%40.00%50.00%60.00%70.00%80.00%90.00%100.00%Percent of classification type Sz Detection NSz Detection Figure 68. Seizure detection performance for RBF parameter sigma=20 using the last second of each seizure. 215 PAGE 216 Sz NSzSz NSzSigma = 40Cost = 100Sz NSzSigma = 40Cost = 10Sigma = 40Cost = 10000.00%10.00%20.00%30.00%40.00%50.00%60.00%70.00%80.00%90.00%100.00%Percent of classification type Sz Detection NSz Detection Figure 69. Seizure detection performance for RBF parameter sigma=40 using the last second of each seizure. Sigma = 40Cost = 1000Sigma = 40Cost = 10Sz NSzSigma = 40Cost = 100Sz NSzSz NSz0.00%10.00%20.00%30.00%40.00%50.00%60.00%70.00%80.00%90.00%100.00%Percent of classification type Sz Detection NSz Detection Figure 610. Seizure detection performance for RBF parameter sigma=80 using the last second of each seizure. 216 PAGE 217 CHAPTER 7 DISCUSSION AND CONCLUDING REMARKS Epilepsy is a disorder of the brain which is characterized by intermittent synchronized discharges of large populations of neurons. This disorder can greatly impact a patients life in numerous ways including financial, social, professional, and psychiatric effects. While AED therapy may help keep seizures at bay in some patients others are not so fortunate. In the last few decades, savvy researchers have taken advantage of the rapid progression of computer technology, biomaterials, signal analysis advances and medical knowledge advancement to extract relevant EEG features in order to enhance epilepsy treatment. Computational neuroscience is an exciting frontier which is providing numerous options for addressing neurological disorders which may have been inconceivable decades ago. The ability to map the brains states in terms of the status of a dynamic neurologic disorder will likely be a highly soughtafter research goal for years to come. This dissertation has helped provide preliminary data mining and dynamical EEG analyses to help uncover patterns which may be related to stimulation parameters and ultimately improve our understanding of the mechanisms that produce the VNS therapeutic effect. In addition, a study outlining a novel generalized spike wave detection algorithm was outlined here as well. These projects aim towards creation of bedside and/or implantable realtime seizure control devices. Towards RealTime EEG Analysis Tools for the Bedside and Implantation The exciting progress made in the characterization of sophisticated disease and disorders modeling schemes is part of the driving force this research. The characteristics of the class of disorders known as dynamic disorders provide an interesting framework to approach the problem of improving existing and creating new therapeutic approaches. This perspective treats such disorders as deviations from a range of healthy dynamics in the underlying physiologic control 217 PAGE 218 systems. Such a perspective implies therapeutic approaches which involve a fusion of medicine, biology, and engineering. Numerous researchers are investigating the possibility of applying a systems control approach to the epileptic brain in order to reduce the burden of epileptic seizures. Some of the studies presented in this dissertation are geared towards such an approach and aim to improve the VNS therapy modality. Patients with newlyimplanted VNS systems undergo a period often lasting several months of suboptimal therapy. During this period, patients may need to undergo numerous visits to the doctors office in order to finetune the stimulation parameters for clinical efficacy and tolerance. Such a process results in increased medical treatment costs and all the while the patients may be at a higher risk to seizures due to suboptimal stimulation parameters. One of the goals of the work presented it to examine the possibility of an EEG marker of optimal VNS therapeutic efficacy to help expedite the process of tuning parameters in newlyimplanted patients. The main focus of the research on the VNS data is to characterize EEG characteristics in numerous VNS patients in order to assess any relationships to stimulation parameters. If such a relationship can be established and if the effects could then be geared towards a final outcome, then such EEG characteristics may find use in a bedside device for rapid VNS calibration or even in an implantable control system for optimal VNS therapy. The studies presented in chapter four represent data mining approaches to characterizing such EEG effects. Data Mining Approaches to Characterizing EEG Patterns Data mining tools have demonstrated an extensive capacity to discover patterns in biological datasets including EEG signals. Data mining is the process of applying algorithms to extract patterns in large datasets. While the human eye is often the best pattern detector of all, data mining algorithms can work on exceedingly large datasets and examine complex multidimensional datasets. One of the most attractive features of data mining tools are their 218 PAGE 219 ability to perform clustering data subsets according to inherent similarities or in a supervised manner. For the purpose of characterizing EEG patterns in patients undergoing VNS therapy for epilepsy, data mining methods provide a useful tool for elucidating preliminary patterns which incorporate an expansive representation of features from all channels. The biclustering experiment provided a characterization of the EEG patterns which may be related to VNS therapy. The observations were based on patterns of the STLmax measure, which assumes a chaotic framework and provides a measure of the sensitivity of the signal to initial conditions. Though the brains behavior may not always be consistent with a lowdimensional chaos model, the chaoticity measure has provided an ability to classify neural states in epilepsy (e.g. interictal or far from a seizure, preictal or seizure imminent, ictal or during a seizure, and postictal or the period of altered consciousness following a seizure). Thus, the measure was selected as a candidate for detecting EEG patterns which may be related to VNS therapy. The study demonstrated separability between the VNS on and off states for which all of patient As electrodes contributed to and only a few frontal and temporal electrodes in patient B contributed to. The biological relevance of these results may be related to study which discovered that VNSinduced acute suppression of epileptiform activity in a hippocampal depth electrode (Olejniczak et al., 2001). Though the study by Olejniczak et al. utilized depth electrodes, it is possible that scalp EEG recordings may display some manifestation of such an EEG effect observed at a hippocampal depth electrode. From this perspective, perhaps the STLmax behavioral differences between patients A and B are associated with enhanced suppression of epileptiform activity in patient A compared to patient B. An interesting future application of biclustering would be to examine the EEG effects during nonstimulation in an unsupervised manner. Such an experiment would provide a highly objective method to determine spatio219 PAGE 220 temporal patterns of EEG features. Based on the results of chapter 5, future experiments should include both linear and nonlinear features to help ensure proper characterization of the wide range of EEG dynamical behavior patterns observed during these studies. This work was published in the paper Biclustering EEG data from epileptic patients treated with vagus nerve stimulation, authored by Stanislav Busygin, Nikita Boyko, Panos Pardalos, Michael Bewernitz, and Georges Ghacibeh (Busygin, 2007). The next experiment examined the patterns of the raw EEG behavior in feature space using support vector machines. The accuracy at which the SVMs could separate the raw EEG between two adjacent EEG segments, a reference segment during stimulation and successive nonoverlapping windows was interpreted as a robust measure of EEG similarity (or dissimilarity) and compared with stimulation parameters. The study determined observed a potential covariation between the EEG and the pulse width and stimulation frequency parameters. A study by Mu et al. showed that a 250 s VNS pulse width caused reduced blood flow in significantly more brain regions (e.g. hippocampus, sup. temp. lobe) than 500 s (2004). Perhaps these regions may be responsible for covariation of EEG feature space dispersion with pulse width parameter. Furthermore, a recent study demonstrated that a 20 Hz stimulation frequency produced significant cerebral blood flow increases (e.g. in the orbitofrontal cortex, hypothalamus, and thalamus) compared to 5 Hz in VNS patients (Lomarev et al., 2002). It is possible that the altered blood flow in these regions may be responsible for the observed covariation of EEG feature space dispersion with stimulation frequency. In addition, patients where seizure free and patients which experienced a small number of seizures per month resulted in greater separation accuracy between the reference class and all subsequent comparison classes in a VNS epoch. The patient with the most seizures per month 220 PAGE 221 resulted in the poorest separation between the reference class and all adjacent classes. This phenomenon could be the multichannel analog of the dynamic resetting effect between two EEG channels postulated by Iasemidis et al. which states that a seizure resets the brain from an unfavorable state to a more favorable state (Sackellares and Iasemidis, 1997; Iasemidis et al., 2004). Thus, the results were interpreted as electroencephalographic evidence that the VNS mimics the therapeutic resetting effect of a seizure. Future studies involving SVM would apply the algorithm in an unsupervised manner to help provide unbiased information about patterns in the data. Also, modification of the support vector machine algorithm, such as adaptive feature scaling (Grandvalet et. al., 2003) can help provide insight into the relevance of each input feature for SVM classification. This study is published in an article titled Quantification of the Impact of Vagus Nerve Stimulation Parameters on electroencephalographic Measures with authors Michael Bewernitz, Georges Ghacibeh, Onur Seref, Panos Pardalos, ChangChia Liu, Basim Uthman (Bewernitz, 2007). The final study utilized SVMs and LR to analyze the timevarying feature space separation of the STLmax dynamical measure in patients undergoing VNS therapy. With an eye towards the VNS replicating the resetting effect of a seizure, this study aimed to characterize potential relationships between the EEG and stimulation parameters using an experimental setup similar to Iasemidis et al. (2004). Thus, a reference class was selected at 8 seconds prior to the stimulation onset and was comprised of the STLmax value of all channels for all stimulations combined. Similarly, each succeeding nonoverlapping window for all channels for all epochs was compared with the reference class. The study demonstrated that the observed pattern changes may be related to the stimulation frequency parameter. Lomarev et al. demonstrated that a 20 Hz stimulation frequency produced significant cerebral blood flow increases (e.g. in the 221 PAGE 222 orbitofrontal cortex, hypothalamus, and thalamus) compared with the 5 Hz stimulation frequency in VNS patients (Lomarev et al., 2002). The brain regions which showed a pulsewidth dependent blood flow in the study by Lomarev et al. may be the source of the observed covariation of EEG feature space dispersion with stimulation frequency. Also, it was speculated that the poor STLmax separation between VNS on (which may be considered as a VNS artificial seizure) and VNS off in patient B combined with patient Bs high seizure frequency (compared with the other patients) is aligned with the dynamic seizure resetting effect described by Iasemidis et al. (2004). In addition, this experiment demonstrated the concept previously observed by Bewernitz et al. (2007) except while using the STLmax measure. Thus, the connection between the observed effect and the observations of Iasemidis et al (2004) are stronger. This study was submitted to Computing and Optimization in Medicine and Life Sciences Vol. 3, under the title "A Data Mining Approach to the Investigation of EEG Biomarker Existence for Vagus Nerve Stimulation Therapy Patients", with authors Nikita Boyko, Michael Bewernitz, Vitaliy Yatsenko, Panos Pardalos, Georges Ghacibeh, Basim Uthman (Boyko et al., 2008). In regards to the biological impact, these results may be related to the phenomenon discovered in a study by Olejniczak et al. where a shortterm suppression of epileptiform sharp waves was observed following VNS from a hippocampal depthelectrode (2001). While the scalp electrodes used to collect the data in these analyses cannot achieve the recording quality of hippocampal depth electrodes, it is possible that the scalp EEG data mining analysis results may reflect the same therapeutic effect as observed in the hippocampus by Olejniczak et al. (2001). Analysis of Interstimulation Dynamics The studies described in chapter 5 focus analysis on the EEG dynamics occurring during interstimulation epochs. While the comparisons of stimulation to nonstimulation epochs 222 PAGE 223 provided interesting results with clinical significance, the advantage of this experimental setup is that the possibility of direct neural modulation is eliminated. Thus, the results are more likely to be due to an aftereffect of stimulation rather than due to immediate neuronal modulation. The first experiment performed an extensive nonlinearity characterization using surrogate EEG analysis. Each epoch was compared to 19 surrogate datasets using the ApEnt measure. The most obvious connection of the EEG with the stimulation parameters was a covariation with the pulse width. In addition, the two seizurefree patients (E and F) produced the lowest fraction of epochs which displayed a nonlinear fingerprint (e.g. rejected the null hypothesis at the given significance level). These results may be related to a study by Olejniczak et al. which reported an acute VNSinduced suppression of epileptiform activity in the hippocampus (2001). Though the effect was observed from a hippocampal depth electrode in the study by Olejniczak et al., it is possible that some manifestation of the effect is present in the scalpEEG signal analyzed in the present study. The VNSenhanced suppression of epileptiform activity reported in the literature may be responsible for the diminished nonlinearity in patients with fewer seizures. The cause of any epileptiform activity suppression may be related to a pulsewidth dependency of blood flow to various brain regions (e.g. hippocampus and superior temporal lobe) reported by Mu et al., 2001. The observation that the seizurefree patients expressed the least amount of nonlinearity may be congruent with the findings of Janszky et al. where the absence of bilateral interictal epileptiform discharges was the only EEG predictor of seizure freedom (2005). Thus, future studies should include epileptiform discharges in order to help further characterize the EEG effect associated with VNS. Shen et al. demonstrated that Kcomplex expression patterns can affect nonlinearity in surrogate analysis of sleep EEG (2003). The observed nonlinearity increases in patients A and B 223 PAGE 224 during late night (~11pm until ~7am) may be the result of altered kcomplex expression during sleep (though other patients did not show this trend). The VNS is known to cause an increase in the overall EEG power during sleep (Rizzo et al., 2004). The nature of surrogate data analysis is to provide a yes/no answer to the question of nonlinearity, but does not provide information on what type of nonlinearity is observed. All in all, these results suggest that nonlinear measures may someday demonstrate sensitivity to the outcome of VNS effect. In addition, this study motivates the usage of linear and nonlinear measures in conjunction with one another as well as specific waveforms such as epileptiform discharges in order to characterize the complex signal patterns present in EEG. The second study in chapter five aimed to characterize any time dependence of the EEG dynamics during the interstimulation epochs. This preliminary study was executed by performing a statistical comparison of the first half of each interstimulation epoch to the second half. The study utilized four measures which have demonstrated success in classifying neural state changes in epilepsy; ApEnt, correlation sum, and STLmax. The study showed that the patient with the greatest amount of interstimulation epochs demonstrating significant time variation (for Apent, correlation sum, and ) also had the highest output current (2.5 mA for patient C). Patient A showed a similar trend and had the second highest output current (1.75 mA). Patient F showed an opposing trend with 0.75 mA output current and the smallest fraction of interstimulation epochs showing time variation. The ApEnt and measures demonstrated a noticeably larger deviation from the control in all six patients than the other two measures, as well as sensitivity to the output current. These two observations suggest that the ApEnt and measures may be good candidates for EEG biomarkers in VNS patients. Biologically, these results may be related two studies which demonstrated an electrical current threshold for 224 PAGE 225 epileptiform activity suppression when stimulating the hippocampus in a low Ca2+ seizure model (Warren and Durand, 1998) and a high K+ seizure model (Nakagawa and Durand, 1991). A paper related to these interstimulation dynamics studies was published under the title Optimization of epilepsy treatment with vagus nerve stimulation with authors Basim Uthman, Michael Bewernitz, ChangChia Liu, and Georges Ghacibeh (Uthman et al., 2007). Remarks on VNS Results The variation in observed sensitivity in these measures to the various VNS parameters suggest that different EEG measures are better suited for providing different information about the EEG signal than other measures. Intuitively, it seems logical that a complex system such as the epileptic brain may require several EEG measures for adequate characterization for therapeutic intervention purposes. This observation is underscored in light of the intermittent expression of nonlinear signatures in various interstimulation epochs. Future studies should address the characterization task using a blend of linear and nonlinear measures. In addition, future studies require additional patients to validate the interpretation of these results. Baseline EEG recordings would provide additional support for the existence of EEGinduced VNS effects by providing an opportunity to demonstrate the absence of such patterns prior to implantation. After acquisition of the necessary baseline data, an interesting study would be to examine the changes induced by the first stimulation. Thus, after the first stimulation, a subsequent VNS deactivation and EEG acquisition may be applied. This would provide a highly objective experimental setup possible for identifying shortterm VNS effects. Subsequent followup recording sessions may provide additional characterization of the summed modulatory effect of chronic VNS. The time of the last seizure should be obtained from the patient for all such studies. The reason for this is that the patient undergoes a brief period of increased seizure protection after 225 PAGE 226 some seizures (e.g. generalized tonicclonic seizures). Thus, if the patient is under the influence of this particular neural state, then that would provide a reduced chance of seizure which is not consistent with the patients standard behavior. This information would be helpful for interpreting results. In addition, caution must be exercised when interpreting the results of patients whom undergo seizures. As dynamical transitions can occur several minutes to several hours prior to a seizure, many researchers operationally define the interictal period as being a minimum of 8 hours away from a seizure (Pardalos et al., 2003; Hively et al., 2005; Chaovalitwongse et al., 2006). Thus, the occurrence of a handful of seizures may produce an unknown amount of influence on EEG dynamics. For this reason, future studies may withhold analysis of EEG signals occurring within 8 hours of a seizure. Seizure Detection and Stratification The final project of this dissertation applied SVM classification in a preliminary experiment geared towards a seizure detection and stratification system in patients with generalized absence epilepsy. The seizure detection system utilized DTW distance with a reference vector centered on a spike as the extracted feature. As spike and wave discharges in absence epilepsy are generalized and often have a highly characteristic pattern. The first experiment in this study performed SVM training and testing for the detection of the first second of the seizure versus randomly selected nonseizure EEG which was located at least one minute away from a seizure and at least 0.1 second away from another nonseizure segment. Though both experiments present high sensitivity and specificity, the SVM classifier performed better at classifying the first second of the seizure than final second o the seizure. This is likely due to stronger electroencephalographic similarity among the different seizures at onset compared to offset. Alteration of the RBF kernel bandwidth did not appear to appear the results much. Variation of the cost parameter produced a greater effect on accuracy in experiment two than 226 PAGE 227 experiment one. This is likely due to a loss of generality resulting from rigid over fit models which may occur when the cost is sufficiently high. Such an algorithm may benefit clinicians and researchers by providing a means to rapidly annotate EEG signals as well as a means to provide a clinically interesting measure of therapeutic efficacy (e.g. distribution of seizure durations may vary before and after drug therapy, and thus a measure of this distribution may find clinically relevant information which a raw seizure count would miss). A future direction of this project is to implement the classifier in a realtime situation to test how the algorithm deals with the challenges presented in realtime EEG analysis. This study was submitted to a 2008 volume of the Optimization and Its Applications book series under the title A Novel Algorithm for the Detection and Stratification of Generalized Absence Seizures with authors Michael Bewernitz, Onur Seref, Basim Uthman, and Panos M. Pardalos. In relation to this work, a review article regarding support vector machines in neuroscience applications was accepted for publication under the title support vector machines in neuroscience with authors Onur Seref, O. Erhun Kundakcioglu, and Michael Bewernitz (Seref et al., 2007). Final Remarks The collection of studies presented address preliminary challenges involved with development of online realtime EEG analysis systems for bedside and/or implantable therapy or diagnosis enhancement tools. The choice of EEG source and extracted features for such a tool is one of the greatest challenges presented to researchers in this field. Brain activity can be measured on numerous scales from individual neurons up to macroscopic field potentials representing large regions of the cerebral cortex. In addition, ensuring highfidelity recordings is an additional challenge requiring careful consideration for preprocessing tasks such as artifact 227 PAGE 228 rejection and filtering. In addition to the complex nature of EEG analysis, the EEG data source itself is limited in what it can tell a person about the brain. As technology improves and electronic components become smaller, faster, and more efficient, future implantable therapeutic control prostheses may also implement chemical sensors for quantifying neurotransmitter concentrations, for example. Inclusion of additional information related to brain function could greatly enhance the characterization of brains behavior and potentially augment the performance of implantable therapeutic control devices. 228 PAGE 229 LIST OF REFERENCES Abarbanel H, Brown R, Kennel M. Variation of Lyapunov exponents in chaotic systems: Their importance and their evaluation using observed data. Journal of Nonlinear Science, vol. 2, pp. 343365, 1992. Abarbanel H. Analysis of observed chaotic data. New York: SpringerVerlag, 1996. Absolo D, Hornero R, Espino P, Poza J, Snchez CI, de la Rosa R. Analysis of regularity in the EEG background activity of Alzheimer's disease patients with Approximate Entropy. Clin Neurophysiol. 2005 Aug;116(8):182634. Absolo D, James CJ, Hornero R. Nonlinear Analysis of Intracranial Electroencephalogram Recordings with Approximate Entropy and LempelZiv Complexity for Epileptic Seizure Detection. Conf Proc IEEE Eng Med Biol Soc. 2007;1:19536. Acharya U R, Faust O, Kannathal N, Chua T, Laxminarayan S. Nonlinear analysis of EEG signals at various sleep stages. Comput Methods Programs Biomed. 2005 Oct;80(1):3745. Acir N, Gzelis C. Automatic recognition of sleep spindles in EEG via radial basis support vector machine based on a modified feature selection algorithm. Neural computing and applications (2005) vol. 14: pp. 56. Adelson PD, Nemoto E, Scheuer M, Painter M, Morgan J, Yonas H. Noninvasive continuous monitoring of cerebral oxygenation periictally using near infrared spectroscopy: a preliminary report. Epilepsia 1999; 40: 1484. Ardesch JJ, Buschman HP, WagenerSchimmel LJ, van der Aa HE, Hageman G. Vagus nerve stimulation for medically refractory epilepsy: a longterm followup study. Seizure. 2007 Oct;16(7):57985. Asyali MH, Berry RB, Khoo MC, Altinok A. Determining a continuous marker for sleep depth. Comput Biol Med. 2007 Nov; 37(11):16009. Barlow J. Methods of analysis of nonstationary EEG with emphasis on segmentation techniques. J. Clin. Neurophysiol., vol. 2, pages 267304, 1985. Baumgartner C, Serles W,Leutmezer F, Pataraia E, Aull S,Czech T, et al. Preictal SPECT in temporal lobe epilepsy: regional cerebral blood flow is increased prior to electroencephalographyseizure onset. J Nucl Med 1998; 39: 978. Begley CE, Famulari M, Annegers JF, Lairson DR, Reynolds TF, Coan S, Dubinsky S, Newmark ME, Leibson C, So EL, Rocca WA. The Cost of Epilepsy in the United States: An Estimate from PopulationBased Clinical and Survey Data. Epilepsia. 2000 Mar; 41(3):34251. Belair J, Glass L, An Der Heiden U, Milton J. Dynamical disease: Identification, temporal aspects and treatment strategies of human illness. Chaos. 1995 Mar;5(1):17. 229 PAGE 230 Bendat JS, Piersol AG. Random Data: Analysis and Measurement Procedures, 2nd ed. New York: John Wiley, 1986. Berndt D, Clifford J. Finding patterns in time series: A dynamic programming approach. In Advances in knowledge discovery and data mining, U. Fayyad, G. PiatetskyShapiro, P. Smyth, and R. Uthursamy, editors, pages 229248. AAAI Press, 1996. Beuter A, Vasilakos K. Tremor: Is Parkinsons Disease a Dynamical Disease? Chaos 5, 1417 (1995). Bewernitz M, Ghacibeh G, Seref O, Pardalos PM, Liu CC, Uthman B. Quantification of the impact of vagus nerve stimulation parameters on electroencephalographic measures. Proceedings of the conference on Data Mining, Systems Analysis and Optimization in Biomedicine. Gainesville, (FL), 2830 March 2007, AIP Conference Proceedings, No. 953, pp. 206219. Binnie CD, Mizrahi EM. The epilepsy monitoring unit. in Epilepsy: A comprehensive textbook, Eds. J. Engel Jr. and T. A. Pedley, Philadelphia: LippincottRaven, 1997. Box GE, Jenkins GM. Time series analysis: Forecasting and control, San Francisco: HoldenDay, 1976. Boyko N, Bewernitz M, Yatsenko V, Pardalos PM, Ghacibeh G, Uthman B. A Data Mining Approach to the Investigation of EEG Biomarker Existence for Vagus Nerve Stimulation Therapy Patients. Submitted to: Computing and Optimization in Medicine and Life Sciences Vol. 3, editor: Eva K. Lee, (2008). Breakspear M. Perception of odors by a nonlinear model of the olfactory bulb. Int J Neural Syst. 2001 Apr;11(2):10124. Bressler SL, Richter CG, Chen Y, Ding M. Cortical functional network organization from autoregressive modeling of local field potential oscillations. Stat Med. 2007 Sep 20;26(21):387585. Bruhn J, Rpcke H, Hoeft A. Approximate entropy as an electroencephalographic measure of anesthetic drug effect during desflurane anesthesia. Anesthesiology. 2000 Mar;92(3):71526. Bruhn J, Bouillon TW, Shafer SL. Onset of propofolinduced burst suppression may be correctly detected as deepening of anaesthesia by approximate entropy but not by bispectral index. Br J Anaesth. 2001 Sep;87(3):5057. Bruhn J, Bouillon TW, Radulescu L, Hoeft A, Bertaccini E, Shafer SL. Correlation of approximate entropy, bispectral index, and spectral edge frequency 95 (SEF95) with clinical signs of "anesthetic depth" during coadministration of propofol and remifentanil. Anesthesiology. 2003 Mar;98(3):6217. 230 PAGE 231 Burioka N, Cornlissen G, Halberg F, Kaplan DT, Suyama H, Sako T, Shimizu E. Approximate entropy of human respiratory movement during eyeclosed waking and different sleep stages. Chest. 2003 Jan;123(1):806. Burioka N, Cornlissen G, Maegaki Y, Halberg F, Kaplan DT, Miyata M, Fukuoka Y, Endo M, Suyama H, Tomita Y, Shimizu E. Approximate entropy of the electroencephalogram in healthy awake subjects and absence epilepsy patients. Clin EEG Neurosci. 2005 Jul;36(3):18893. Busygin S, Prokopyev OA, Pardalos PM, Feature Selection for Consistent Biclustering via Fractional 01 Programming, Journal of Combinatorial Optimization, Vol. 10/1 (2005), pp. 721. Busygin S, Prokopyev OA, Pardalos PM, Biclustering in Data Mining, to appear in Computer and Operations Research, 2006. Busygin S, Boyko N, Pardalos PM, Bewernitz MA, Ghacibeh G. Biclustering EEG data from epileptic patients treated with vagus nerve stimulation. Proceedings of the conference on Data Mining, Systems Analysis and Optimization in Biomedicine. Gainesville, (FL), 2830 March 2007, AIP Conference Proceedings, No. 953, pp. 220231. Casdagli MC, Iasemidis LD, Savit RS, Gilmore RL, Roper SN, Sackellares JC. Nonlinear analysis of mesial temporal lobe seizures using a surrogate data technique. Epilepsia, vol. 36, Suppl. 4, pp. 142, 1995. Casdagli MC, Iasemidis LD, Sackellares JC, Roper SN, Gilmore RL, Savit RS. Characterizing nonlinearity in invasive EEG recordings from temporal lobe epilepsy. Physica D, vol. 99, pp. 381399, 1996. Casdagli MC, Iasemidis LD, Savit RS, Roper SN, Gilmore RL, Sackellares JC. 1997. Nonlinearity in invasive EEG recordings from patients with temporal lobe epilepsy. Electroencephalogr. Clin. Neurophysiol. 102, 98. Casarotto S, Bianchi AM, Cerutti S, Chiarenza GA. Dynamic time warping in the analysis of eventrelated potentials. IEEE Eng Med Biol Mag. 2005 JanFeb;24(1):6877. Chabardes S, Kahane P, Minotti L, Koudsie A, Hirsch E, Benabid AL. Deep brain stimulation in epilepsy with particular reference to the subthalamic nucleus. Epileptic Disorders. 2002 Dec;4 Suppl 3:S8393. Chabolla DR, Cascino GD. Interpretation of Extracranial EEG. In: The Treatment of Epilepsy: Principles and Practice, 2 nd ed. Elaine Wyllie, M.D. Baltimore, Williams and Wilkins, 1997. pp 264279. Chaovalitwongse, WA. Iasemidis, LD. Pardalos, PM. Carney, PR. Shiau, DS. Sackellares, JC. Performance of a seizure warning algorithm based on the dynamics of intracranial EEG. Epilepsy Res. 2005 May;64(3):93113. 231 PAGE 232 Chaovalitwongse, WA. Prokopyev, OA. Pardalos, PM. Electroencephalogram (EEG) time series classification: Applications in epilepsy. Ann Oper Res (2006) 148: 227. Chaovalitwongse WA, Pardalos PM. ON THE TIME SERIES SUPPORT VECTOR MACHINE USING DYNAMIC TIME WARPING KERNEL FOR BRAIN ACTIVITY CLASSIFICATION. Cybernetics and Systems Analysis, Vol. 44, No. 1, 2008. Chapin JK, Moxon KA. Neural Prostheses For Restoration of Sensory and Motor Function. Pg. 333. SNUGGLE. Chauvet, GA. Berger, TW. Hierarchical Model of the Population Dynamics of Hippocampal Dentate Granule Cells. Hippocampus 12:698 (2002). Chi Z, Wu W, Haga Z, Hatsopoulos NG, Margoliash D. Templatebased spike pattern identification with linear convolution and dynamic time warping. J Neurophysiol. 2007 Feb;97(2):122135. Colijn C, Fowler AC, Mackey MC. "High frequency spikes in long period blood cell oscillations", J. Math. Biol. (2006), 53(4), 499. Cooley WJ, Tukey JW. An algorithm for the machine calculation of complex Fourier series. Mathematics of Computation, vol. 19 (90), pp. 297301, 1965. Costello DJ, Cole AJ. Treatment of Acute Seizures and Status Epilepticus. Journal of Intensive Care Medicine 22(6); 2007. Cristianini N, ShaweTaylor J. An introduction to Support Vector Machines and other kernelbased learning methods. Copyright Cambridge University Press, 2000. Cyberonics, Inc. VNS Therapy  Vagus Nerve Stimulation. http://www.vnstherapy.com/epilepsy/patient/About_Magnet.asp Last accessed March 19th, 2008. Delamont R, Julu P, Jamal G. Changes in a measure of cardiac vagal activity before and after epileptic seizures. Epilepsy Res 1999; 35: 87. Deransart, C. Vercueil, L. Marescaux, C. Depaulis, A. The role of the basal ganglia in the control of generalized absence seizures. Epilepsy Research. 32 pp 213223, 1998. Ding, Lei. Wilke, C. Xu, B. Xu, X. Van Drongelen, W. Kohrman, M. He, B. EEG Source Imaging: Correlating Source Locations and Extents with Electrocorticography and Surgical Resections in Epilepsy Patients. (J Clin Neurophysiol 2007;24: 130). Durand, D. Bikson, M. Suppression and control of epileptiform activity by electrical stimulation: a review. Proceedings of the IEEE, vol. 89, no. 7, July 2001. Ebert, U. Ziemann. Altered seizure susceptibility after highfrequency transcranial magnetic stimulation in rats. Neuroscience Letters. Vol. 273, pp. 155158, 1999. 232 PAGE 233 Eckman JP, Kamphorst SO, Ruelle D, Ciliberto S. Lyapunov exponents from time series. Physical Review A, 34:49714979, 1986. Ellner S, Gallent A, McCaffrey D, Nychka D. Convergence rates and date requirements for jacobianbased estimates of lyapunov exponents from data. Phys. Lett. A., 153:357363, 1991. Engel, J. Jr., Seizures and Epilepsy. Philadelphia, PA: F. A. Davis Co., 1989. Epilepsy Foundation. Seizures and Syndromes. http://www.epilepsyfoundation.org/about/types/types/index.cfm Last accessed, March 9th, 2008. Feber F. Treatment of some nonstationarities in the EEG. Neuropsychobiology, vol. 17, pages 100104, 1987. Federico P, Abbott DF, Briellmann RS, Harvey AS, Jackson GD. Functional MRI of the preictal state. Brain 2005; 128: 1811. Ferenets R, Lipping T, Anier A, Jntti V, Melto S, Hovilehto S. Comparison of entropy and complexity measures for the assessment of depth of sedation. IEEE Trans Biomed Eng. 2006 Jun;53(6):106777. Fink M. ECT has proved effective in treating depression. Nature. 2000 Feb 24;403(6772):826. Fisher RS, Uematsu S, Krauss GL, Cysyk BJ, McPherson R, Lesser RP, Gordon B, Schwerdt P, Rise M. Placebocontrolled pilot study of centromedian thalamic stimulation in treatment of intractable seizures. Epilepsia. 1992 SepOct;33(5):84151. Flexer, Arthur. Data mining and electroencephalography. Statistical Methods in Medical Research 2000; 9: 395. Fountas KN, Smith JR. A novel closedloop stimulation system in the control of focal, medically refractory epilepsy. Acta Neurochir Suppl. 2007;97(Pt 2):35762. Frank W., Lookman T., Nerenberg M., Essex C., Lemieux J., Blume W., Chaotic time series analyses of epileptic seizures, Physica D, vol. 46, pp. 427438, 1990. Frigo M, Johnson SG. The Design and Implementation of FFTW3. Proceedings of the IEEE 93 (2), 216 (2005). Fraser AM, Swinney HL. Independent coordinates for strange attractors from mutual information. Phys Rev A, vol. 33, pp. 1134, 1986. Fuller WA. Introduction to Statistical Time Series. New York: Wiley, 1976. Gardner AB, Krieger AM, Vachtsevanos G, Litt B. OneClass Novelty Detection for Seizure Analysis from Intracranial EEG. Journal of Machine Learning Research 7 (2006) 1025 1044. 233 PAGE 234 Geva AB, Kerem DH. Forecasting generalized epileptic seizures from the EEG signal by wavelet analysis and dynamic unsupervised fuzzy clustering. IEEE Trans Biomed Eng. 1998 Oct;45(10):120516. Georges A. Ghacibhen, DengShan Shiau, Linda Dance, Stephan Eisenschenk, J. Chris Sackellares. Influence of Antiepileptic Medications on EEG Dynamics. Epilepsia, Vol. 26 Suppl 8, 2005. Glassman EL. A waveletlike filter based on neuron action potentials for analysis of human scalp electroencephalographs. IEEE Trans Biomed Eng. 2005 Nov;52(11):185162. Goldensohn ES. Historical Perspectives and Future Directions. In: The Treatment of Epilepsy: Principles and Practice, 2 nd ed. Elaine Wyllie, M.D. Baltimore, Williams and Wilkins, 1997. pp 191203. Goldstein MA, Harden CL. Epilepsy and Anxiety. Epilepsy Behav. 2000 Aug;1(4):228234. Goldstein MA, Harden CL. Continuing Exploration of the Neuropsychiatry of Seizures: a Review of Anxiety and Epilepsy. Epilepsy & Behavior., vol. 2 pp. 311317, 2001. Good LB, Sabesan S, Iasemidis LD, Tsakalis K, Treiman DM. Brain dynamical disentrainment by antiepileptic drugs in rat and human status epilepticus. Conf Proc IEEE Eng Med Biol Soc. 2004;1:1769. Good LB, Sabesan S, Iasemidis LD, Treiman DM. Realtime control of epileptic seizures. The 3rd European Medical and Biological Engineering Conference Proc. 2005 11(1). Grassberger P, Procaccia I. Measuring the Strangeness of Strange Attractors. Physica D 9(12), pages 189208 (1983a). Grassberger P, Procaccia I. Characterization of Strange Attractors. Physical Review Letters 50(5), pages: 346349. 1983b. Grebogi C, Ott E, Pelikan S, Yorke JA. Strange Attractors That Are Not Chaotic. Physica D 13 (12): 261268 1984. Gross, RE. Deep brain stimulation in the treatment of neurological and psychiatric disease. Expert Review of Neurotherapeutics. 4(3), 465478 (2004). Groves DA, Brown VJ. Vagal Nerve Stimulation: a Review of its Applications and Potential Mechanisms that Mediate its Clinical Effects. Review. Neuroscience & Biobehavioral Reviews. Volume 29, Issue 3 May 2005, Pages 493500. Gler I, Ubeyli ED.Adaptive neurofuzzy inference system for classification of EEG signals using wavelet coefficients. J Neurosci Methods. 2005 Oct 30;148(2):11321. Epub 2005 Jul 28. 234 PAGE 235 Gwinn RP, Kondratyev A, Gale K. Timedependent increase in basic fibroblast growth factor protein in limbic regions following electroshock seizures. Neuroscience. 2002;114(2):4039. Heck C, Helmers SL, DeGiorgio CM. Vagus nerve stimulation therapy, epilepsy, and device parameters.Neurology 2002;59:S31S37. Hively LM, Protopopescu VA, Munro NB. Enhancements in epilepsy forewarning via phasespace dissimilarity. J Clin Neurophysiol. 2005 Dec;22(6):4029. Hodaie, M. Wennberg, RA. Dostrovsky, JO. Lozano, AM. Chronic anterior thalamus stimulation for intractable epilepsy. Epilepsia. 43(6):603608, 2002. Hodgkin, AL. Huxley, AF. A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. (I952) I I7, 500544. Hoppe C, Poepel A, Elger CE. Epilepsy: Accuracy of Patient Seizure Counts. ARCH NEUROL/VOL 64 (NO. 11), NOV 2007. Iasemidis LD, Zaveri HP, Sackellares JC, Williams WJ. Phase space analysis of EEG in temporal lobe epilepsy, IEEE EMBS, 10th Annual Int. Conf., pp. 12011203, 1988. Iasemidis LD, Sackellares JC, Zaveri HP,Williams WJ. Phase space topography of the electrocorticogram and the Lyapunov exponent in partial seizures, Brain Topogr. vol. 2, pp. 187201, 1990. Iasemidis LD, Sackellares JC. Long time scale temporospatial patterns of entrainment of preictal electrocorticographic data in human temporal lobe epilepsy. Epilepsia 31(5): 621, 1990. Iasemidis LD. On the dynamics of the human brain in temporal lobe epilepsy. PhD dissertation, University of Michigan, Ann Arbor, 1991. Iasemidis LD and Sackellares JC, The evolution with time of the spatial distribution of the largest Lyapunov exponent on the human epileptic cortex, In: Measuring chaos in the human brain, Duke D. W. and Pritchard W.S. (Eds.): 4982, World Scientific, Singapore, 1991. Iasemidis LD, Sackellares JC and Savit R.S., Quantification of hidden time dependencies in the EEG within the framework of nonlinear dynamics, In: Nonlinear dynamical analysis of the EEG, Jansen B.H. and Brandt M.E. (Eds): 3047, World Scientific, Singapore, 1993. Iasemidis LD and Sackellares JC, The use of dynamical analysis of EEG frequency content in seizure prediction, Electroenceph. Clin. Neurophysiol., 1993. Iasemidis LD, Olson LD, Sackellares JC and Savit R., Time dependencies in the occurrences of epileptic seizures: a nonlinear approach, Epilepsy Research 17: 8194, 1994. 235 PAGE 236 Iasemidis LD and Sackellares JC, Chaos theory and epilepsy, The Neuroscientist 2: 118126, 1996. Iasemidis LD, Gilmore R.L., Roper S.N. and Sackellares JC, Dynamical interactions of the epileptogenic focus with extrafocal sites in temporal lobe epilepsy. Ann Neurol 42(3): 429, 1997. Iasemidis LD, Principe JC, Czapewski J.M., Gilmore R.L., Roper S.N. and Sackellares JC., Spatiotemporal transition to epileptic seizures: a nonlinear dynamical analysis of scalp and intracranial EEG Recordings. In: Spatiotemporal Models in Biological and Artificial Systems, Silva F.L., Principe JC and Almeida L.B. (Eds.): 8188, IOS Press, Amsterdam, 1997. Iasemidis LD, Shiau DS, Sackellares JC P.M. Pardalos, Transition to epileptic seizures: Optimization, in DIMACS series in Discrete Mathematics and Theoretical Computer Science, D. Du, P. Pardalos, J. Wang, Eds. Providence, RI: American Mathematical Society, pp. 5574,1999. Iasemidis LD, Principe JC, Sackellares JC. Measurement and Quantification of SpatioTemporal Dynamics of Human Epileptic Seizures, in Nonlinear Biomedical Signal Processing, Editor M. Akay, IEEE Press, 294316, 2000. Iasemidis LD, Shiau DS., P.M. Pardalos and JC Sackellares (2002). Phase entrainment and predictability of epileptic seizures. In: P.M. Pardalos and J. Principe (Eds.), Biocomputing, pp. 59. Kluwer Academic Publishers, Dordrecht, Netherlands. Iasemidis LD, Pardalos PM, Shiau DS, W. Chaovalitwongse, M. Narayanan, S. Kumar, P.R. Carney, JC Sackellares. Prediction of human epileptic seizures based on optimization and phase changes of brain electrical activity. Optimization Methods & Software 18 (1): 81104 FEB 2003. Iasemidis LD. Epileptic seizure prediction and control. IEEE Trans Biomed Eng. 2003 May;50(5):54958. Review. Iasemidis LD, Shiau DS, Chaovalitwongse W, Sackellares JC, Pardalos PM, Principe JC, Carney PR, Prasad A, Veeramani B, Tsakalis K. Adaptive epileptic seizure prediction system. IEEE Trans Biomed Eng. 2003 May;50(5):61627. Iasemidis LD, Shiau DS, Sackellares JC, Pardalos PM, Prasad A. Dynamical resetting of the human brain at epileptic seizures: application of nonlinear dynamics and global optimization techniques. IEEE Trans Biomed Eng. 2004 Mar;51(3):493506. ILOG Inc. CPLEX 9.0 User's Manual, 2004. Intel Corporation. Excerpts from A Conversation with Gordon Moore: Moores Law (2005). ftp://download.intel.com/museum/Moores_Law/VideoTranscripts/Excepts_A_Conversation_with_Gordon_Moore.pdf Retrieved on January 19, 2008. 236 PAGE 237 Jain AK, Murty MN, Flynn PJ. Data Clustering: A Review. ACM Computing Surveys, Vol. 31, No. 3, September 1999. Jansen B, Cheng W. Structural EEG analysis. Int. J. Biomed. Comput., vol. 23, pages 221237, 1988. Jen KK, Hwang YR. Longterm ECG signal feature extraction. J Med Eng Technol. 2007 MayJun;31(3):2029. Jing H, Takigawa M. Nonlinear analysis of EEG after repetitive transcranial magnetic stimulation. J Clin Neurophysiol. 2002 Jan;19(1):1623. Jung KY, Kim JM, Kim DW. Nonlinear dynamic characteristics of electroencephalography in a highdose pilocarpineinduced status epilepticus model. Epilepsy Res. 2003 May;54(23):17988. Kaper M, Meinicke P, Grossekathoefer U, Lingner T, Ritter H. BCI Competition 2003Data Set IIb: Support Vector Machines for the P300 Speller Paradigm. IEEE transactions on biomedical engineering, vol. 51, no. 6, June 2004. Kantz H, Schreiber T. Dimension estimates and physiological data. Chaos. 1995 Mar;5(1):143154. Kantz H, Schreiber T. Nonlinear Time Series Analysis. Cambridge University Press, Cambridge, UK 1997, pp 7075. Kaplan PW, Birbeck G. Lithiuminduced confusional states: nonconvulsive status epilepticus or triphasic encephalopathy? Epilepsia 2006; 47(12): 20712074. Kerem DH, Geva AB. Forecasting epilepsy from the heart rate signal. Med Biol Eng Comput 2005; 43: 230. Kim HK, Carmena JM, Biggs SJ, et al. The muscle activation method: An approach to impedance control of brainmachine interfaces through a musculoskeletal model of the arm. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING 54 (8): 15201529 AUG 2007. Koo B. EEG changes with vagus nerve stimulation. J Clin Neurophysiol. 2001 Sep;18(5):43441. Korff CM, Nordli DR Jr. Diagnosis and management of nonconvulsive status epilepticus in children. Nat Clin Pract Neurol. 2007 Sep;3(9):50516. Review. Kotas M. Projective filtering of time warped ECG beats. Comput Biol Med. 2008 Jan;38(1):12737. KovacsVajna ZM. A fingerprint verification system based on triangular matching and dynamic time warping. IEEE Transactions on Pattern Analysis and Machine Intelligence. Vol 22, Issue 11, Nov 2000, pages 12661276. 237 PAGE 238 Krystal AD, Greenside HS, Weiner RD, Gassert D. A comparison of EEG signal dynamics in waking, after anesthesia induction and during electroconvulsive therapy seizures. Electroencephalogr Clin Neurophysiol. 1996 Aug;99(2):12940. Krystal AD, Zaidman C, Greenside HS, Weiner RD, Coffey CE. The largest Lyapunov exponent of the EEG during ECT seizures as a measure of ECT seizure adequacy. Electroencephalogr Clin Neurophysiol. 1997 Dec;103(6):599606. Krystal AD, Weiner RD, Lindahl V, Massie R. The development and retrospective testing of an electroencephalographic seizure qualitybased stimulus dosing paradigm with ECT. The Journal of ECT. 2000 Dec;16(4):33849. Kumar A, Bleck TP. Intravenous midazolam for the treatment of refractory status epilepticus. Crit Care Med. 1992 Apr;20(4):4838. Lai YC, Harrison MA, Frei MG, Osorio I. Inability of Lyapunov exponents to predict epileptic seizures. Phys Rev Lett. 2003 Aug 8;91(6):068102. Lai YC, Harrison MA, Frei MG, Osorio I. Controlled test for predictive power of Lyapunov exponents: their inability to predict epileptic seizures. Chaos. 2004 Sep;14(3):63042. Le Van Quyen M, Martinerie J, Navarro V, Baulac And M, Varela FJ. Characterizing neurodynamic changes before seizures. J Clin Neurophysiol. 2001 May;18(3):191208. Review. Leentjens AF, Lousberg R, Verhey FR. Markers for depression in Parkinson's disease. Acta Psychiatr Scand. 2002 Sep;106(3):196201. Lehmann C, Koenig T, Jelic V, Prichep L, John RE, Wahlund LO, Dodge Y, Dierks T. Application and comparison of classification algorithms for recognition of Alzheimer's disease in electrical brain activity (EEG). J Neurosci Methods. 2007 Apr 15;161(2):34250. Leocani L, Comi G. EEG coherence in pathological conditions.J Clin Neurophysiol. 1999 Nov;16(6):54855. Review. Liu CC, Shiau DS, W. Art Chaovalitwongse, Pardalos PM, Sackellares JC. Presence of nonlinearity in intracranial EEG recordings: detected by Lyapunov exponents. Proceedings of the conference on Data Mining, Systems Analysis and Optimization in Biomedicine. Gainesville, (FL), 2830 March 2007, AIP Conference Proceedings, No. 953, pp. 197205. Lopes da Silva FH, Blanes W, Kalitzin SN, Parra J, Suffczynski P, Velis DN. Dynamical diseases of brain systems: different routes to epileptic seizures. IEEE Trans Biomed Eng. 2003 May;50(5):5408. Lorenz E. Deterministic nonperiodic flow. Journal of Atmosperic Science, 20:130141, 1963. 238 PAGE 239 Lothman, EW. Bertram, EH. Stringer, JL. Functional Anatomy of Hippocampal Seizures. Progress in Neurobiology. Vol. 37, pp. 182, 1991. Lotte F, Congedo M, Lcuyer A, Lamarche F, Arnaldi B. A review of classification algorithms for EEGbased braincomputer interfaces. J Neural Eng. 2007 Jun;4(2):R1R13. Lowenstein DH, Bleck T, Macdonald RL. Its time to revise the definition of status epilepticus. Epilepsia. 1999;40:120122. Mackey MC, Glass L. Oscillation and chaos in physiological control systems. Science, vol. 197, pp. 287289, 1977. Mackey MC, an der Heiden U. "Dynamic diseases and bifurcations in physiological control systems", Funk. Biol. Med. (1982) 1, 156164. Madeira SC, Oliveira AL, Biclustering Algorithms for Biological Data Analysis: A Survey, IEEE Transactions on Computational Biology and Bioinformatics, 1 (2004), pp. 2425. Mandelbrot BB. The Fractal Geometry of Nature. New York, New York: W.H. Freeman and Company, 1983. Manford, Mark. Practical Guide to Epilepsy. Burlington, MA: Elsevier Science Inc., 2003. McLachlan RS. Suppression of interictal spikes and seizures by stimulation of the vagus nerve. Epilepsia. 1993 SepOct;34(5):91823. Merkwirth C, Parlitz U, Wedekind I, Lauterborn W. TSTOOL and User Manual, Ver. 1.11, DPI Gttingen, www.physik3.gwdg.de/tstool/gpl.txt 2002. McIntyre, CC. Savasta, M. Walter, BL. Vitek, JL. How does deep brain stimulation work? Present understanding and future questions. Journal of Clinical Neurophysiology. Vol 21, Number 1, February 2004. Milton JG, Longtin A, Beuter A, Mackey MC, Glass L. Complex dynamics and bifurcations in neurology. J Theor Biol. 1989 May 22;138(2):12947. Review. Milton J, Mackey MC. "Periodic haematological diseases: Mystical entities or dynamical disorders?", Journal of the Royal College of Physicians of London (1989), vol. 23, no. 4, 236241. Milton JG, Black D. Dynamic diseases in neurology and psychiatry. Chaos. 1995 Mar;5(1):813. Milton JG, Epilepsy: multistability in a dynamic disease, in: J. Walleczek, Ed., Selforganized biological dynamics and nonlinear control, New York: Cambridge University Press, pp. 374386, 2000. Misiti, M., Misiti, Y., Oppenheim, G., Poggi, JM. (1996). Wavelet toolbox for use with Matlab. MathWorks, Inc. 239 PAGE 240 Morrell, M. Brain stimulation for epilepsy: can scheduled or responsive neurostimulation stop seizures? Current Opinion in Neurology 2006, 19:164. Mormann F, Andrzejak RG, Elger CE, Lehnertz K. Seizure prediction: the long and winding road. Brain. 2007 Feb;130(Pt 2):31433. Mu Q, Bohning DE, Nahas Z, Walker J, Anderson B, Johnson KA, Denslow S, Lomarev M, Moghadam P, Chae JH, George MS. Acute vagus nerve stimulation using different pulse widths produces varying brain effects. Biol Psychiatry. 2004 Apr 15;55(8):81625. Na SH, Jin SH, Kim SY.The effects of total sleep deprivation on brain functional organization: mutual information analysis of waking human EEG. Int J Psychophysiol. 2006 Nov;62(2):23842. Epub 2006 Jul 11. Nair SP, Mller, Norman W.M., Shenk D., Suharitdamrong W., Iasemidis LD, Pardalos P.M., Sackellares JC, Carney P.R., Dynamical Changes in the Rat Chronic Limbic Epilepsy Model, Epilepsia, vol. 45 (Suppl 7), pp. 211212, 2004. Nair SP, Shiau DS., Iasemidis LD, Pardalos P.M., Sackellares JC, Carney P.R., Seizure predictability in an experimental model of epilepsy, in Proceedings of Data Mining Conference, University of Florida, Gainesville, FL:, 2005. Nair SP, Sackellares JC, Shiau DS, Norman WM, Dance LK, Pardalos PM, Principe JC, Carney PR. Effects of acute hippocampal stimulation on EEG dynamics. Conf Proc IEEE Eng Med Biol Soc. 2006;1:43826. Nakagawa M, Durand D. Suppression of spontaneous epileptiform activity with applied currents. Brain Res. 1991 Dec 20;567(2):2417. Nelson GD. A brief history of cardiac pacing. Texax Heart Institute Journal. 1993;20(1):128. Medtronic Inc., Minneapolis, Minnesota 554323576. Nicolelis MAL. Actions from thoughts. NATURE 409 (6818): 403407 JAN 18 2001. Niedermeyer E, Lopes da Silva FH. Electroencephalography. Baltimore: Williams & Wilkins, 1993. Noe' F, Nissinen J, Pitknen A, Gobbi M, Sperk G, During M, Vezzani A. Gene therapy in epilepsy: the focus on NPY. Peptides. 2007 Feb;28(2):37783. Novak V, Reeves AL, Novak P, Low PA, Sharbrough FW. Timefrequency mapping of RR interval during complex partial seizures of temporal lobe origin. J Auton Nerv Syst 1999; 77: 195. Ochoa JG, Riche W. Antiepileptic Drugs: An Overview. Available at http://www.emedicine.com/NEURO/topic692.htm April 5th, 2007. last accessed January 23, 2008. 240 PAGE 241 Okumura E, Sanada S, Suzuki M, Takemura A, Matsui O. Improvement of temporal and dynamic subtraction images on abdominal CT using 3D global image matching and nonlinear image warping techniques. Phys Med Biol. 2007 Nov 7;52(21):646174. Olejniczak PW, Fisch BJ, Carey M, Butterbaugh G, Happel L, Tardo C. The effect of vagus nerve stimulation on epileptiform activity recorded from hippocampal depth electrodes. Epilepsia. 2001 Mar;42(3):4239. Osorio I., Harrison M.F., Lai Y.C., Frei M.G. Observations on the application of the correlation dimension and correlation integral to the prediction of seizures. Journal of Clinical Neurophysiology (2001), 18(3), 269. Osorio I, Frei MG, Manly BF, Sunderam S, Bhavaraju NC, Wilkinson SB. An introduction to contingent (closedloop) brain electrical stimulation for seizure blockage, to ultrashortterm clinical trials, and to multidimensional statistical analysis of therapeutic efficacy. J Clin Neurophysiol. 2001 Nov; 18(6):53344. Osorio I, Frei MG, Sunderam S, Giftakis J, Bhavaraju NC, Schaffner SF, Wilkinson SB. Automated seizure abatement in humans using electrical stimulation. Ann Neurol. 2005 Feb;57(2):25868. Oxley, Jolyon. Smith, Jay. The Epilepsy Reference Book. London: Faber and Faber, 1991. Palus M, Albrecht V, Dvorak I. Information theoretic test for nonlinearity in time series, Phys. Rev. A, vol. 34, pp. 49714972, 1993. Palus M, Komarek V, Prochazka T, Hrncir Z, Sterbova K. Synchronization and information flow in EEGs of epileptic patients. IEEE Engineering in Medicine and Biology Magazine 20 (5): 6571 SEPOCT 2001. Pardalos PM, Chaovalitwongse W, Iasemidis LD, Sackellares JC, Shiau DS, Carney PR, Prokopyev OA, Yatsenko VA. Seizure warning algorithm based on optimization and nonlinear dynamics. Math. Program., Ser. B 101: 365 (2004). Parker JN, Parker PM. The Official Patients Sourcebook on Seizures and Epilepsy. ICON Group International, Inc., San Diego, CA 92122 USA, 2003. Pijn, JP, Velis DN, van der Heyden M, DeGoede J, van Veelen CW, Lopes da Silva FH. 1997. Nonlinear dynamics of epileptic seizures on the basis of intracranial EEG recordings. Brain Topogr. 94, 249. Pincus SM. Approximating Markov chains. Proc Natl Acad Sci USA, vol. 89: pp. 4432, 1992. Pincus SM, Keefe DL. Quantification of hormone pulsatility via an approximate entropy algorithm. American Journal of Physiology, 265:E741E754, 1992. 241 PAGE 242 Pincus SM. Approximate entropy (ApEn) as a complexity measure. Chaos. 1995 Mar;5(1):110117. Pritchard WS, Duke DW, Krieble KK. Dimensional analysis of resting human EEG. II: Surrogatedata testing indicates nonlinearity but not lowdimensional chaos. Psychophysiology. 1995 Sep;32(5):48691. Purves D. Augustine GJ, Fitzpatrick D, Hall WC, LaMantia AS, McNamara JO, Williams SM. Neuroscience. 3rd Edition. Massachusetts: Sinauer Associates, 2004. Quintana H, Snyder SM, Purnell W, Aponte C, Sita J. Comparison of a standard psychiatric evaluation to rating scales and EEG in the differential diagnosis of attentiondeficit/hyperactivity disorder. Psychiatry Res. 2007 Aug 30;152(23):21122. Rabiner L, Rosenberg A, Levinson S. (1978). Considerations in dynamic time warping algorithms for discrete word recognition. IEEE Trans. Acoustics Speech, and Signal Proc., Vol. ASSP26, pp. 575582. Ramani, R. Vagus Nerve Stimulation Therapy for Seizures. J Neurosurg Anesthesiol. Volume 20, Number 1, January 2008. Rapp PE, Albano AM, Mees AI. Calculation of correlation dimension from experimental data: Progress and problems, in Dynamic patterns in complex systems, J.A.S. Kelso, A.J. Mandell, M.F. Schlesinger Eds. Singapore: World Scientific, pp. 191205, 1988. Rizzo P, Beelke M, De Carli F, Canovaro P, Nobili L, Robert A, Fornaro P, Tanganelli P, Regesta G, Ferrillo F. Modifications of sleep EEG induced by chronic vagus nerve stimulation in patients affected by refractory epilepsy. Clin Neurophysiol. 2004 Mar;115(3):65864. Savit, R. Predicting Epileptic Seizures. In: J. G. Milton and P. Jung, Eds., Epilepsy as a Dynamical Disease. Heidelberg, Germany: SpringerVerlag, 2003. Schalkoff R. Pattern recognition statistical, structural, and neural approaches. John Wiley & Sons, New York, 1992. Schanze T, Hesse L, Lau C, Greve N, Haberer W, Kammer S, Doerge T, Rentzos A, Stieglitz T. An optically powered singlechannel stimulation implant as test system for chronic biocompatibility and biostability of miniaturized retinal vision prostheses. IEEE Trans Biomed Eng. 2007 Jun;54(6 Pt 1):98392. Schevon CA, Cappell J, Emerson R, Isler J, Grieve P, Goodman R, McKhann G Jr, Weiner H, Doyle W, Kuzniecky R, Devinsky O, Gilliam F. Cortical abnormalities in epilepsy revealed by local EEG synchrony. Neuroimage. 2007 Mar;35(1):1408. Schreiber T, Schmitz A. Improved surrogate data for nonlinearity tests. PHYSICAL REVIEW LETTERS 77(4) 635638, 1996. 242 PAGE 243 Schreiber T, Schmitz A. Surrogate time series, Physica D, vol. 142, pp. 346382, 2000. Seref O, Kundakcioglu OE, Bewernitz MA. Support vector machines in neuroscience, Encyclopedia of Healthcare Information Systems, N. Wickramasinghe and E. Geisler (editors), IDEA Group Inc., 2007, accepted for publication. Shamir R, MaronKatz A, Tanay A, et al. EXPANDER An integrative program suite for microarray data analysis. BMC BIOINFORMATICS Volume: 6 Article Number: 232 Published: SEP 21 2005. Shannon CE. A Mathematical Theory of Communication. Bell System Technical Journal, vol. 27, pp. 379423, 623656, July, October, 1948. Shaw JC. Correlation and coherence analysis of the EEG: a selective tutorial review. Int J Psychophysiol. 1984 Mar;1(3):25566. Shen Y, Olbrich E, Achermann P, Meier PF. Dimensional complexity and spectral properties of the human sleep EEG. Electroencephalograms. Clin Neurophysiol. 2003 Feb;114(2):199209. Shiau DS. Signal Identification and Forecasting in Nonstationary Time Series Data. Ph.D. Dissertation, University of Florida, 2001. Shiau DS, Iasemidis LD, Yang MCK, Carney PR, Pardalos PM, Suharitdamrong W, Nair SP and Sackellares JC (2004) Patternmatch regularity statistic A measure quantifying the characteristics of epileptic seizures. Epilepsia 45 (S7): 8586. Shimada I, Nagashima T. A numerical approach to ergodic problem of dissipative dynamical systems. Progress of Theoretical Physics, 61:16051616, 1979. Shneker BF, Fountain NB. Assessment of acute morbidity and mortality in nonconvulsive status epilepticus. Neurology 2003; 61: 10661073. Shorvon S, Perucca E, Fish D, Dodson E. The Treatment of Epilepsy. Second edition. Malden, Mass Blackwell Publishing Ltd., 2004. Silva C, Pimentel IR, Andrade A, Foreid JP, DuclaSoares E. Correlation dimension maps of EEG from epileptic absences. Brain Topogr. 1999 Spring;11(3):2019. Simon RH, Zimmerman AW, Sanderson P, Tasman A. EEG markers of migraine in children and adults. Headache. 1983 Sep;23(5):2015. Smart OL, Worrell GA, Vachtsevanos GJ, Litt B. Automatic detection of high frequency epileptiform oscillations from intracranial EEG recordings of patients with neocortical epilepsy. Technical, Professional and Student Development Workshop, 2005 IEEE Region 5 and IEEE Denver Section. 78 April 2005, pages: 5358. 243 PAGE 244 Speckmann EJ, Elger CE, Altrup U. Neurophysiologic basis of the EEG. In: The Treatment of Epilepsy: Principles and Practice, 2 nd ed. Elaine Wyllie, M.D. Baltimore, Williams and Wilkins, 1997. pp 204217. Srinivasan V, Eswaran C, Sriraam N.Approximate entropybased epileptic EEG detection using artificial neural networks. IEEE Trans Inf Technol Biomed. 2007 May;11(3):28895. Stein AG, Eder HG, Blum DE, Drachev A, Fisher RS. An automated drug delivery system for focal epilepsy. Epilepsy Res. 2000 Apr;39(2):10314. Takens F. Detecting strange attractors in turbulence. In: D.A. Rand and L.S. Young (Eds.), Dynamical Systems and Turbulence, Lecture Notes in Mathematics. SpringerVerlag, Heidelburg (1981). Talathi SS, Hwang DU, Spano ML, Simonotto J, Furman MD, Myers SM, Winters JT, Ditto WL, Carney PR. Nonparametric early seizure detection in an animal model of temporal lobe epilepsy. J Neural Eng. 2008 Mar;5(1):8598. Tanay A, Sharan R, Shamir R, Biclustering Algorithms: A Survey, to appear in the Handbook of Bioinformatics, 2004. Available at http://www.cs.tau.ac.il/~rshamir/papers/bicrev_bioinfo.ps last accessed January 20 th 2008. Tarca AL, Carey VJ, Chen XW, Romero R, Drghici S. Machine learning and its applications to biology. PLoS Comput Biol. 2007 Jun;3(6):e116. Taylor S. Electroconvulsive therapy: a review of history, patient selection, technique, and medication management. South Med J. 2007 May;100(5):4948. Thakor NV, Tong SB. Advances in quantitative electroencephalogram analysis methods. Annual review of biomedical engineering. 6: 453495 2004. Theiler J. Spurious dimension from correlation algorithms applied to limited timeseries data, Phys. Resv. A 34 (1986) 24272433. Theiler J, Eubank S, Longtin A, Galdrikian B, Farmer JD. Testing for nonlinearity in time series: the method of surrogate data, Physica D 58 (1992) 77. Theiler J, Prichard D. Constrainedrealization MonteCarlo method for hypothesis testing. Physica D. 94(4), 221235, 1996. Theodore WH, Fisher RS. Brain stimulation for epilepsy. Lancet Neurol. 2004 Feb;3(2):1118. Thomasson N, Pezard L, Allilaire JF, Renault B, Martinerie J. Nonlinear EEG Changes Associated with Clinical Improvement in Depressed Patients. Nonlinear Dynamics, Psychology, and Life Sciences, Vol. 4, No. 3, 2000. 244 PAGE 245 Tirsch WS, Keidel M, Perz S, Scherb H, Sommer G. Inverse covariation of spectral density and correlation dimension in cyclic EEG dynamics of the human brain. Biol Cybern. 2000 Jan;82(1):114. Tirsch WS, Stude P, Scherb H, Keidel M. Temporal order of nonlinear dynamics in human brain. Brain Res Brain Res Rev. 2004 May;45(2):7995. Uthman B, Bewernitz M, Liu CC, Ghacibeh G. Optimization of epilepsy treatment with vagus nerve stimulation. Proceedings of the conference on Data Mining, Systems Analysis and Optimization in Biomedicine. Gainesville, (FL), 2830 March 2007, AIP Conference Proceedings, No. 953, pp. 308315. Uthman B, Bearden S. Rhythmic diffuse delta frequency activity presenting as an unusual EEG correlate of nonconvulsive status epilepticus: Three case studies. Epilepsy Behav. 2008 Jan;12(1):191199. Vapnik, V, Lerner A. Pattern recognition using generalized portrait method. Automation and Remote Control, 24, 774, 1963. Varma NK, Kushwaha R, Beydoun A, Williams WJ, Drury I. Mutual information analysis and detection of interictal morphological differences in interictal epileptiform discharges of patients with partial epilepsies. Electroencephalogr Clin Neurophysiol. 1997 Oct;103(4):42633. Velasco AL, Velasco M, Velasco F, Menes D, Gordon F, Rocha L, Briones M, Marquez I. Subacute and Chronic Electrical Stimulation of the Hippocampus on Intractable Temporal Lobe Seizures: Preliminary Report. Archives of Medical Research 31 (2000) 316328. Vezzani A. Gene Therapy in Epilepsy. Epilepsy Curr. 2004 May; 4(3): 87. Warren RJ, Durand DM. Effects of applied currents on spontaneous epileptiform activity induced by low calcium in the rat hippocampus. Brain Res. 1998 Sep 28;806(2):18695. Weaver D. Epilepsy and Seizures: Everything You Need to Know. Buffalo, NY: Firefly Books Inc., 2001. Weinand ME, Carter LP, ElSaadany WF, Sioutos PJ, Labiner DM, Oommen KJ. Cerebral blood flow and temporal lobe epileptogenicity. J Neurosurg 1997; 86: 226. Wilner AN. Epilepsy: 199 Answers: A Doctor Responds to His Patients Questions. New York: Demos, 2003. Winterhalder M, Schelter B, Maiwald T, Brandt A, Schad A, SchulzeBonhage A, Timmer J. Spatiotemporal patientindividual assessment of synchronization changes for epileptic seizure prediction. Clin Neurophysiol. 2006 Nov;117(11):2399413. Wolf A, Swift J, Swinney H, and Vastano J. Determining Lyapunov exponents from a time series. Physica D, 16:285317, 1985. 245 PAGE 246 Wolf A, and Vastano J. Intermediate length scale effects in Lyapunov exponent estimation. In G. MayerKress, editor, Dimensions and entropies in chaotic systems: Quantification of complex behavior, pages 9499. SpringerVerlag, 1986. Yaari Y, Beck H. Epileptic neurons in temporal lobe epilepsy. Brain Pathol 2002; 12: 234. Zaveri HP, Williams WJ, and Sackellares JC. "Energy based detection of seizures," presented at 15th Annual International Conference on Engineering and Medicine in Biology, 1993. 246 PAGE 247 BIOGRAPHICAL SKETCH Michael Andrew Bewernitz was born and raised in the state of Michigan in the United States of America. Michael received his Bachelor of Science degree in chemical engineering with a biochemical engineering option from Michigan State University in 2002. He enrolled the Ph.D. program of the J. Crayton Pruitt Family Department of Biomedical Engineering in 2003 under the guidance of Dr. J. Chris Sackellares in the Brain Dynamics Lab. After three productive years, Michael joined Dr. Panos Pardalos in the Center for Applied Optimization in the summer of 2006. In summer of 2007, Michael earned his Master of Engineering degree from the J. Crayton Pruitt Family Department of Biomedical Engineering. He went on to complete his Doctor of Philosophy in spring of 2008. Michael has written and presented three conference talks, produced four journal publications, one book chapter, participated in the creation of a patent, helped create four IRB medical research protocols on which he served as a subinvestigator, participated in the creation of a bioengineering research fellowship grant, as well as an NIH R21 grant. He has worked as a visiting researcher at the AlleghenySinger Research Institute in Pittsburgh, PA under the guidance of Dr. Kevin Kelly for two months during the summer of 2005. Michaels research interests include data mining biomedical timeseries datasets and neural state classification using electroencephalographic recordings obtained from patients or animal models of neurological disorders. xml version 1.0 encoding UTF8 REPORT xmlns http:www.fcla.edudlsmddaitss xmlns:xsi http:www.w3.org2001XMLSchemainstance xsi:schemaLocation http:www.fcla.edudlsmddaitssdaitssReport.xsd INGEST IEID E20101106_AAAAFA INGEST_TIME 20101106T18:58:43Z PACKAGE UFE0022059_00001 AGREEMENT_INFO ACCOUNT UF PROJECT UFDC FILES FILE SIZE 39097 DFID F20101106_AABFBP ORIGIN DEPOSITOR PATH bewernitz_m_Page_232.QC.jpg GLOBAL false PRESERVATION BIT MESSAGE_DIGEST ALGORITHM MD5 bf0c7af7df2d18e0b1b3ac00e11b4a02 SHA1 c2506b6d128ab2751941a7e0face85e99c9cf76a 49468 F20101106_AABEEW bewernitz_m_Page_152.pro 0ad8f3d81bb65c3a7e3bf2500093fd30 f5c662c5f6f2f3ac5b17a72872d74375fa29dbf4 1053954 F20101106_AABCQC bewernitz_m_Page_004.tif cbe421c360b5e36c6ffaf6dd0e1aed55 a29bfebf65939f647d8db9ba9c50681c9fd5e98a 35591 F20101106_AABFBQ bewernitz_m_Page_233.QC.jpg 9b12714ef0357e10f1fc60a844b121bd a91219ccca0e7a3fc6e34538aaf2d2d3002eff2e 51161 F20101106_AABEEX bewernitz_m_Page_153.pro 978877d882ddb7d8242876954baa0f7f 9e76bccb23d74242b0de8f48f5d07bccb8816e32 8752 F20101106_AABEXA bewernitz_m_Page_151thm.jpg b5a3ead70c52f2238def1a59ae6d5035 b66db801b8803229ec36c35fbe441c62707f3ba6 36130 F20101106_AABCQD bewernitz_m_Page_045.QC.jpg 1093579526601c531633020ac538a738 a603a06f8a44cd11b9082bbfe7f7a727a088ab94 9332 F20101106_AABFBR bewernitz_m_Page_233thm.jpg 4c73c0419c432b9d1b8ef1704ce39756 17618c56c3025e3a442d9c5b38164340358c8f68 51409 F20101106_AABEEY bewernitz_m_Page_154.pro 4c3c9e178ccc47cbd919095b3a4565d4 c491c0915a655f4f436a4a17240d4ced148ef2a7 32831 F20101106_AABEXB bewernitz_m_Page_152.QC.jpg c870d5d09eeb614a844cc7bd71799ff9 3131546e06f0dcea7993eceaea82705b0940f4b5 8618 F20101106_AABCQE bewernitz_m_Page_043thm.jpg c93a46494df7bb40a44ac6744c01919c 82f08518f32a40c1752f75c54fb95bdf0b5e0d06 35943 F20101106_AABFBS bewernitz_m_Page_234.QC.jpg 77d7f222c475688b7457bfc5452af082 4b9dab4a1a87f559f4d1fcd455f9139415ce7fb8 47079 F20101106_AABEEZ bewernitz_m_Page_155.pro 0d5a62255fece253dba43045175a2eae b2b8d8f1e3230fef31cff6587c937d2c1fd21ade 8259 F20101106_AABEXC bewernitz_m_Page_152thm.jpg d7919e7b6d640bc5c9baad11d6168038 c4f14bbe55db10b835077cb7eed87c921cbc20b5 136233 F20101106_AABCQF bewernitz_m_Page_236.jpg 49ca9e6af4f943f0d6f77199501be3a7 18c1091b9adafc8a61c3070313197ba5b18afea1 8887 F20101106_AABFBT bewernitz_m_Page_234thm.jpg fc589a1bfe03b89332e63bb032571bf0 b358f09376e339e2d791dc37a58f4bd28192d36d 33344 F20101106_AABEXD bewernitz_m_Page_153.QC.jpg 6b088315e849197f6aba0c4dfb7990ae ce303d122a0b693a5a523847a6c3fe2055baecff F20101106_AABCQG bewernitz_m_Page_039.tif 39ee4efe0a2da21ea9deb2bc3fdd5f6d b184181327acb5fa0f2d63040ee9d66db2fd55c1 37104 F20101106_AABFBU bewernitz_m_Page_235.QC.jpg a73fea9516a41ee6390e1a3056811698 0465999f7742c2cb8ae2f7876646798568c3a66a 8555 F20101106_AABEXE bewernitz_m_Page_153thm.jpg ddf4af3dea294708eb66307ccab5cd38 a4faac6ac469ea57e7b3623ac88d3899276cf272 36568 F20101106_AABCQH bewernitz_m_Page_063.pro de69be81b03fe56f5974983ce41bc2a9 e92d6720f21d4b56917063f574ab0ed8c869ba00 10549 F20101106_AABDNA bewernitz_m_Page_003.jp2 f6937b1d4473fd2873071b0a93bb1cae 043054c64d300b27515783877ded16d138dfdad6 38721 F20101106_AABFBV bewernitz_m_Page_236.QC.jpg 2ba167f45228ddf26ec800f785a4ad19 3d7293a65ba2c4c1904e8fe48df75958d8bbf67f 33508 F20101106_AABEXF bewernitz_m_Page_154.QC.jpg ef1f0281dd984b34c60852d793ec06c4 00aceeace072f708e5d317330235c7ee30421728 25101 F20101106_AABCQI bewernitz_m_Page_058.QC.jpg 324cf1ce3175dc05d844209df95fac4e 9b3323fec495d4aa41cbdd06a8df2b2ceba02b58 112680 F20101106_AABDNB bewernitz_m_Page_004.jp2 08cadfcb433b2e83abedc7b99d7dc2de ba4195cff5fd660350051b57c83fe1d9ae122710 9527 F20101106_AABFBW bewernitz_m_Page_236thm.jpg 0204546106d851e367e624012d47d761 a9f447aac946df9a6ea1b2622f04e747310732fa 32238 F20101106_AABEXG bewernitz_m_Page_155.QC.jpg f5876e3998e050d5a76e9f243110a831 643bfc285df5d7e7f3c1cdc86fe796c7be769705 F20101106_AABCQJ bewernitz_m_Page_223.tif 7bce74193367871855f400c175d3a4fd 13d0ca1e6358ae26f62eaedfcd412971b83d21ad 108658 F20101106_AABDNC bewernitz_m_Page_005.jp2 67671de6f73cfcebfd13d64845048b77 80ac7a0f117ba243c792d475d100619aebbbe29a 34852 F20101106_AABFBX bewernitz_m_Page_237.QC.jpg 4638c61a2fca4db120378e3b204b56c3 e4e4830e0d6309aaee66862e7c3f8e948edf85ef 7816 F20101106_AABEXH bewernitz_m_Page_155thm.jpg b328f08810b235262b822953c0c0045a ef04eb766b12feaaf848f0bd1951d5611faa440b 49577 F20101106_AABCQK bewernitz_m_Page_035.pro 3e76f7281cb2fca822dfb14a787b56c2 93a8795cfb00238d1a2f5c5cc24361ff88456034 1051959 F20101106_AABDND bewernitz_m_Page_007.jp2 d9b7ca968efe852a11a0fd0702d13f37 08b402b8f53b6bc9d684ffce6b1c7ad46de8bbaf 9181 F20101106_AABFBY bewernitz_m_Page_237thm.jpg 1bba8cb790645c43427fadc5966c1407 a247081f0566f39e8a906ec5d51153411ce78f8b 36010 F20101106_AABEXI bewernitz_m_Page_156.QC.jpg a82aad508f7248cf89b57e743e91b53a 29eec51c7ae6953737ef20951351aa600e768101 25271604 F20101106_AABCQL bewernitz_m_Page_097.tif 2526e71270db8fd46bec70e63f4357d7 4cfbb49e5ff8df0cc1b457b9209006b5193b87ae 1051986 F20101106_AABDNE bewernitz_m_Page_008.jp2 6440a365fbe05b7fd0dd421fcdb047bf 52882bba03cdfa8fe23cb605ebadee6e3b579169 37534 F20101106_AABFBZ bewernitz_m_Page_238.QC.jpg 661fe0836cae69de2a7a09e7bc92ff17 7ae09bf3ad534abe95d86b841341aa7266772904 34462 F20101106_AABEXJ bewernitz_m_Page_157.QC.jpg 1595a3757acdfd5eb9295f916de30858 f27a5417b288bf59ed0e8df96f725848d0c27e10 52701 F20101106_AABCQM bewernitz_m_Page_126.pro 09f7b1cec79c3333d005821291d2d2b8 7d17d45c8d13881469592f60723c82f4a6845486 1051963 F20101106_AABDNF bewernitz_m_Page_010.jp2 4d27a837e8ef692afcb8d9acef3c8512 b1e791d4e2fd051b58863b143e28f5dc9cd850f9 8243 F20101106_AABEXK bewernitz_m_Page_157thm.jpg 12ac1588ab20f17f805a623526aae3d8 f70811f03728ff6aa7a86289fabf2d7108a33400 108051 F20101106_AABCQN bewernitz_m_Page_070.jpg f414e733fdd1c0ce0565695b1756f429 ef9cad030490d80cf9fcf2711cfd815c62c4b556 1051958 F20101106_AABDNG bewernitz_m_Page_013.jp2 9fccb34f80866c07c5ce81b5c5eec34d 6534b763d7207633fd3b5bd740adb648ce94b3a0 2222 F20101106_AABEKA bewernitz_m_Page_080.txt 7ee89c7af99d24c3dbdae8b7c53019d8 f76185d838129e85c856956405f907ceff13f2ed 8509 F20101106_AABEXL bewernitz_m_Page_158thm.jpg 2cd39b9f23d745252e3bb98f8feac909 5b7420fa7dacac1b1ea58d9224b663c76327e0ef 8477 F20101106_AABCQO bewernitz_m_Page_167thm.jpg ed74009f6a5279a1c8f0b3afae5c6a66 d095ea323604f52e64ebaaf71843502010712eb8 1051974 F20101106_AABDNH bewernitz_m_Page_014.jp2 be9e31f5f8f5b5c1f2b22c5bc110fe19 db80eebf09dd171d1edca259a055170f0a735d5f 2089 F20101106_AABEKB bewernitz_m_Page_081.txt f630ee75206130d426eb2a4cfaf4e6e1 46d08906a92923fd4f3fc35638896c9f2f71d06e 8590 F20101106_AABEXM bewernitz_m_Page_159thm.jpg da01a40a461b3b62f06cb3801aaa44df a269b877bbb1f0ed389dee1e7fdcdc50ebfaddff 49035 F20101106_AABCQP bewernitz_m_Page_111.pro 77817e4778a5e2d34c8260dadfdef365 67885deb7c2c92d837f6d734f317ba4a0332d1d2 1051916 F20101106_AABDNI bewernitz_m_Page_015.jp2 d5f3e503177e9a6e327244f22cccfb65 362471b2b04ab8ca34067427d150e2337a369fbe 1973 F20101106_AABEKC bewernitz_m_Page_082.txt d911b1794b12d6710a332550020c83bc ea3e4602135207ef04f2b66ef2fe41742ae9044b 36059 F20101106_AABEXN bewernitz_m_Page_161.QC.jpg ec6c591c85c36b823089d4c6c859b9ae 95580bfcd35d08d0d98038eae80e23e37b3a5e83 8712 F20101106_AABCQQ bewernitz_m_Page_129thm.jpg 2800d0c1342980323acfbfdffa2f873a a0f4e7940f35d008675ff4e3988c735ec07820d7 1051962 F20101106_AABDNJ bewernitz_m_Page_016.jp2 e7d1eee928237e8ae14ab032100d1cea a44baea927d8a15d87669deb80f7d083dfa31509 1759 F20101106_AABEKD bewernitz_m_Page_085.txt f3d54618d9df0d3dfeb94ada78fe5b03 d94ee3b98d463267a873585eeff9c6a8ecdc3ad0 8911 F20101106_AABEXO bewernitz_m_Page_161thm.jpg 154e08267d67998a69d740310cafe7e3 d201644076595ebace28d48d9a17cd3a9f31ed0e 111228 F20101106_AABCQR bewernitz_m_Page_225.jpg 707f3b944206f064f74b8c38b7dd1d15 912012295e04d5c3adc6289f979e0dc289e88b37 40799 F20101106_AABDNK bewernitz_m_Page_017.jp2 5fc433b9c7e64acb72255e2e90524657 21394ba2d23eb7eb1da667342aacd41f0397a03f 2140 F20101106_AABEKE bewernitz_m_Page_086.txt 8180a743d57cfb142bf245d3b673ba8b 758c8d0285bb2f2b3fd5895fb7c74c2025ee79c1 F20101106_AABDAA bewernitz_m_Page_143.tif 53251967131248320f6d09cfd5a33959 20142617f4b227cb9c24e62e0943dd92491cec08 8430 F20101106_AABEXP bewernitz_m_Page_162thm.jpg 2992e07f57f54d78fc0d0162cdde8a1f 74b6ea34f490c9c897e46189d16b292eef18daac 8770 F20101106_AABCQS bewernitz_m_Page_220thm.jpg a2cf3e5a9b70cbcb04fc23e9a8437aeb ea33734f252c9f9deca890e21bc4b5629d95eab0 108911 F20101106_AABDNL bewernitz_m_Page_018.jp2 cfd34ee88b0dc2998652d46b39f3066b c80e911ab00402850153afa8ff00160c154b9a3e 1968 F20101106_AABEKF bewernitz_m_Page_087.txt c84fa26d19532f9bc3cca13b7f9915ef 42c369febffa68ecaf877aa9ec90bea8e0c299fb 15869 F20101106_AABDAB bewernitz_m_Page_192.QC.jpg 3aefe741027c5fb2689ff0b4412c38a3 b914f0cc0ac71f465f7dadbc9b0be424278bfa20 35406 F20101106_AABEXQ bewernitz_m_Page_163.QC.jpg ef5f43a0f8412596b32ab8f992e434e3 eb7595dc6100c8f9f7b3ed2ea9775097e1565ce2 36739 F20101106_AABCQT bewernitz_m_Page_050.QC.jpg 5a70e5dd0b8a3bad31669f2692762567 9474606227f1a23a1d289a57f4930a653493a0d4 116056 F20101106_AABDNM bewernitz_m_Page_020.jp2 e7bf9feb164977680c05ac6ebe2bbb68 82aa85f77b11f3642e8ad1144a895d06945e9efd 1781 F20101106_AABEKG bewernitz_m_Page_088.txt 1dda110fe28ef0fef3b1eac16f6fd496 798873a10391981be8e520a77b93f603dcfeaa54 111091 F20101106_AABDAC bewernitz_m_Page_077.jpg ed0ee9bb3d37a6be84594912035120a9 366c8e00464ae579a67a5dd5ee4fef33642ba9e9 8805 F20101106_AABEXR bewernitz_m_Page_163thm.jpg 3f1a86ff831e361f52f61568f553f272 3b2c9ec6d16e40e9b0e71e8b7f2cc0df36f7848e 120376 F20101106_AABCQU bewernitz_m_Page_223.jp2 0150b1c86085dd8ce74c201911f3ceee 224db522c35d37ea3423abe0d1bdfd5d1bff42ba 116350 F20101106_AABDNN bewernitz_m_Page_021.jp2 21a7ff6c10efd5254012c09f33320cab 8bb9b920cdcb0cac10de526214c54c95786b5a76 1798 F20101106_AABEKH bewernitz_m_Page_089.txt 49c5fb52b79f150e896d1381eacf5e3a a51e2f2147d7585316d18f58a66d4dc4a8ded0e3 106799 F20101106_AABDAD bewernitz_m_Page_032.jpg a7ee683e24d30f35144f666dbaa688b9 3d43ba824c7c45452247a3679416cb00d23225ec 35557 F20101106_AABEXS bewernitz_m_Page_164.QC.jpg 70cae38749c9889b315bbe8c7ec72c1c b1ef4ba676cac06599533628cb454abb03a8dc8c 26386 F20101106_AABCQV bewernitz_m_Page_066.QC.jpg ec5190d54db0d82d9a61c8bcbead32ed 146f51bf565897a1f1c8091477940312e1cccada 114844 F20101106_AABDNO bewernitz_m_Page_023.jp2 21fdab5a46ba236b8533a6e234ca4d4f 88d2c332dff12eb71f3e9b04cb9b2b84cf3db516 1687 F20101106_AABEKI bewernitz_m_Page_091.txt 8f07d1aa3917ce121ffba60db16fb459 65ac0631d4bae3724c5ee7c9612b61dee3bc2791 131032 F20101106_AABDAE bewernitz_m_Page_229.jpg 68f0269ccf1f5ca81573b11b7e88d9ec 20732992230724b1e063e07c6a9913c6885ed451 8444 F20101106_AABEXT bewernitz_m_Page_164thm.jpg 53308057c8d8aba67fc9750221f2cd38 8fbb961dbd8c2680252e0715ae38d68aed2c7e2e F20101106_AABCQW bewernitz_m_Page_058.tif 3651997916e5c36ba9b7b66b1abccb17 cfa696c11915a8899729e34d39adb50f6f37ebb0 1051943 F20101106_AABDNP bewernitz_m_Page_025.jp2 49bf91d8849a7cfd9eec59c932975d62 f87a6504728199ece86c8d188b3d24e7d58848c5 2206 F20101106_AABEKJ bewernitz_m_Page_093.txt fe5bea0959ead69bebb489dc6fb5cefd a67013aa554c8948dfe519d7a06a9a1487ff88ce 780000 F20101106_AABDAF bewernitz_m_Page_190.jp2 a3108073ab680b35c43db354077e071d 14b61a92f9621156d0c8c6be6a19d5a9a0884178 9083 F20101106_AABEXU bewernitz_m_Page_165thm.jpg 35f04ac9c9edf1e8ff55b82421136dc0 fc66efc037f0df4d57a01e26712de73501ab55a2 9016 F20101106_AABCQX bewernitz_m_Page_026thm.jpg b7aaeed735a98e36d963416eb61a7af0 c2d252a8f6550d7f0f0ac57e08f9998573e53715 1051915 F20101106_AABDNQ bewernitz_m_Page_026.jp2 96c63b516de35e8d282d9f284e475175 9513cdaa3249d3a914b0d170a4d317f6506719bb 1793 F20101106_AABEKK bewernitz_m_Page_095.txt 4e6f07ba6912ec6ed1c9d66a2e542553 b06f2518c3b60056689c944863e111e55924aea5 F20101106_AABDAG bewernitz_m_Page_153.tif f7b50750fc5c7b9fd69c7b1a207d9d84 1826669abab98dd0ca22366999d1ea1ee95c66a9 8852 F20101106_AABEXV bewernitz_m_Page_166thm.jpg fe5241d2ee3c889b2cb95159636b9c53 baaf7776ec386090e8d740e9150bda23fb438374 8589 F20101106_AABCQY bewernitz_m_Page_172thm.jpg 1e5d04496a442d3b582b85263caf4d31 2bdbc296142567af82e721c46d71af444afc8f15 1051929 F20101106_AABDNR bewernitz_m_Page_027.jp2 396bbeb33f30b980343f4c53f05d3a1c dd24ad3bc6d92c80c60d24bd73c909bd1b93cfcb 579 F20101106_AABEKL bewernitz_m_Page_097.txt d7e3555665dadab184c497da7296ed68 ddea11d5bdac5378ab871d785a829328a0a1ea05 110402 F20101106_AABDAH bewernitz_m_Page_125.jp2 3e5812a5169ddb90c1cca31eb3ff80b9 4c005dac47416b5a8ccb916a82f4f43f5212e0fe 35279 F20101106_AABEXW bewernitz_m_Page_167.QC.jpg 9f2f88beb23c7fee195acb128f55141f 8937bae06d59dc5a03b0b02343ac3546f5cbab5e 110560 F20101106_AABDNS bewernitz_m_Page_028.jp2 f4a6f055716bad48b376a7f05adb9088 5e4f516215b96eebc8ab6159dac5a1e1b6176720 436 F20101106_AABEKM bewernitz_m_Page_098.txt 18398ac415e95ce0cac7bcca0a8abcca 43726f5c220b487cfa1e5ac6fe4a6e2dbdf5d1e7 36278 F20101106_AABEXX bewernitz_m_Page_168.QC.jpg 8639c05ed32c2a8cfc4751b2608f4ae5 525c926809887f972bf3b99a55373d88cdcfd63a 54615 F20101106_AABCQZ bewernitz_m_Page_109.pro 81fa54c236c1b420205a8d67c0c1c22b 69c2a2509ecddae670f7037b27ec23ffb4659d1f 120121 F20101106_AABDNT bewernitz_m_Page_029.jp2 68f7a970700200e685b01e67e8f2e579 f3c0058f46d5c15b8265ebf65f9dde7476123247 967 F20101106_AABEKN bewernitz_m_Page_099.txt 443493b34bf6d689fb8ff0e7600295bb 7c43ece1c8d179c318d2dc4472e5e29f61f390ba F20101106_AABDAI bewernitz_m_Page_013.tif 3d4a3641da9965540060763a3b453e65 c20dd63b1be266dab057348da4c723f8412a157f 8939 F20101106_AABEXY bewernitz_m_Page_168thm.jpg 33c22ae36f1cea071c46f31f1a0bf93e dc7cc1fdc6ad1f729d5b456c45af444e2f86ae46 110280 F20101106_AABDNU bewernitz_m_Page_030.jp2 6bba898dcce96af6b95e6313ab708c8f 55fd57e1d37dc6983d2f863dc1c1cf2a5011ab3d 188 F20101106_AABEKO bewernitz_m_Page_101.txt dbcc8677ba966557503918ff42beab51 17d127b10a37302cdfaa69357915d869bc62844b 1051977 F20101106_AABDAJ bewernitz_m_Page_208.jp2 56f645de9e57c079f74ba757508c29d0 797d31ed4b780f9571bfa4e270afce9c444dce99 33938 F20101106_AABEXZ bewernitz_m_Page_169.QC.jpg 927559dd7cb599046b9a9cebc9e6d4e7 a9b2c41b9e2026f7fe3f9a22791df74232e8ad2e 2047 F20101106_AABEKP bewernitz_m_Page_102.txt 0457447bef7a33b3bc32db2a9fef3d93 c711ee3e027a173fe0b52c3b557057dbe12380e1 6516 F20101106_AABDAK bewernitz_m_Page_139thm.jpg fa8d2fcbba5af80bebfaa488b73c4e50 d8d5192bd1e6d0945733a325bb4561f57ba31981 111584 F20101106_AABDNV bewernitz_m_Page_032.jp2 7b4aa964175c1be2a00bdc98ac3e91d3 a351a68611478a27785538e7893a9bbcdd95d264 2207 F20101106_AABEKQ bewernitz_m_Page_103.txt e71b49f15eb7dfb38baa0a2d655c1f66 eb5d2e79e8ec9d3770475a39067409ea75856351 2164 F20101106_AABDAL bewernitz_m_Page_110.txt 34149c49cadea1569237b9c1d2bbdad4 fd7bba4abbf353446abea227e2d2e2986259f5c9 107343 F20101106_AABDNW bewernitz_m_Page_033.jp2 4e753c34469ee6e169766d292912087e a98eb34ea055ac7fe2cb4e874f61c69bab5bea53 34825 F20101106_AABDAM bewernitz_m_Page_047.QC.jpg f5643aa65c511b9af2d4f2c2afde059d f5186f4e8b28af0dff3b9c0d2871baa9aa894cd1 765710 F20101106_AABDNX bewernitz_m_Page_034.jp2 18dcdd06490fec17259d02ff7eb6459a 6296dbf3c41a31bb4e4f2749322e5444d875a6e7 2212 F20101106_AABEKR bewernitz_m_Page_104.txt 2cf7ff5aa641187ff9d8a87db8e82518 0d5472fc61868fcd84efdd4eede0a66953bb20d4 49444 F20101106_AABDAN bewernitz_m_Page_202.pro 95205b721f0707700efffac477f725cc 561f16e45f2beee6114f1d568d53f7ae6c0ddfd2 108019 F20101106_AABDNY bewernitz_m_Page_035.jp2 16903b74459c27c91e73fc08d47fa2a0 34b4e92e22a48cbec896fb77a030cb6df4459874 F20101106_AABEKS bewernitz_m_Page_105.txt d9cca7ed2a2a2a26acaeb2d8861489eb f38dd91d6437f133a20ba08ce5db66050d8e9012 1926 F20101106_AABDAO bewernitz_m_Page_094.txt 52b0d4ac0cbb1814cef37b67fb6a1f70 0b86e43f273c86d520fdfc9cdecf4649029ef3b9 107154 F20101106_AABDNZ bewernitz_m_Page_037.jp2 9b833ffaefab7f53902a3c97b6568b07 64cd5f8c2c70d343603645b4f1492cd65ed8ef8d 2081 F20101106_AABEKT bewernitz_m_Page_106.txt 7d8bfcba18a3edd512a71db22f8980a4 923b80d24f7ae93958a2b9a968549488c5400f99 1475 F20101106_AABDAP bewernitz_m_Page_209.txt f86f8dd9f78e754dfbb8d7e006a8c7df e788e6566314948c6d84e6a0214af0bbc4009b7e 2127 F20101106_AABEKU bewernitz_m_Page_107.txt 140f7a6c14d6b761f6a2cb0b0c31b961 4e984fe36b6dbd321a66e7a7aadb974fe0bcb7e0 242194 F20101106_AABCWA bewernitz_m_Page_138.jp2 fc3676d0e084aead6b7f3aaff862a3f6 29bef683bfb63ea2368c916f0efdc6135f172eb3 102814 F20101106_AABDAQ bewernitz_m_Page_081.jpg 3abe58e25593513043f7af5f225ed487 735938d3aebd2d48eee2e688cd2c601880327d4a 2091 F20101106_AABEKV bewernitz_m_Page_108.txt b7f1eb6ffd37b4b37bf01e20c18513b8 54c74531d03db5ffa1f8f5f2ea00a637b05eb814 F20101106_AABCWB bewernitz_m_Page_134.tif e45dba26cad1192c021c9089de41a7ea 3facd88338381877c3d2d1a46db9a904ab280fec 111575 F20101106_AABDAR bewernitz_m_Page_036.jp2 7cd0029857a075107a683e1b2b489b7d eaea02618f426f78a06f854f9e884a1947d1aa20 2144 F20101106_AABEKW bewernitz_m_Page_109.txt 459d2e897dd591382ead23b9c722d781 5df0993fc71fc46f5c5d58f22b9951fa729d5225 79037 F20101106_AABCWC bewernitz_m_Page_019.jpg 2e8c84c8f0872a0a6fe2ccfb627457ca 6b2f4577690941fd6308b4ec33a595f601d9ab32 33922 F20101106_AABDAS bewernitz_m_Page_208.QC.jpg 9f9ef28735fc8044fff2a4d9a49fae72 1ed9c027c211b203c3161608491f9918f4b245df 1940 F20101106_AABEKX bewernitz_m_Page_111.txt 163ff69ac6ccfa03158eb43568076218 e39536ac9971f343286e018273547fc924661658 16332 F20101106_AABCWD bewernitz_m_Page_175.QC.jpg c5eda2df675fdfced27ff42e3a9ed659 b3056889452eb7718f2f05a42517dfd9b998c6cf 42373 F20101106_AABDAT bewernitz_m_Page_089.pro 838badf4d15605a2b665d476f89fd4bc a308d5f2651d0080184e09431d85ac909fcb6e03 2235 F20101106_AABEKY bewernitz_m_Page_113.txt 5b3014f354200915bfa0cc56c54e9735 9b498b4f5c9ee847baa1ef7d0cf3e160f7fb082f 53113 F20101106_AABCWE bewernitz_m_Page_108.pro 05d98c87d6460795db518692bc84b621 33bcae26b904dd6ff227c2567709564f22f19918 35948 F20101106_AABDAU bewernitz_m_Page_160.QC.jpg 50d3faee2b1dd11de21f34d9890d9135 2088fe0df53b752927fc34a90eb14611c4fdbb2c F20101106_AABEKZ bewernitz_m_Page_115.txt 04ce55bb66a0be03d8c4752315bd9b66 c4fda413074b2c37bbbab375c9652161dcdac77b 7703 F20101106_AABCWF bewernitz_m_Page_101.QC.jpg 718a22b905e7606d2c82fc7aa8c05682 177fe6fcb6b7407225ad535640a90675930dfc3a 29488 F20101106_AABDAV bewernitz_m_Page_186.QC.jpg b1f93632e966c24a1ecd8df93e07702c d34f953baa08255fda3923c72334d4ce60233f6f F20101106_AABCWG bewernitz_m_Page_053.tif eaf4c191a2ba9930fbb75a9936f80b4d 16fd8ace4ef3911a82fbfb0484c516e1ef5159f4 55220 F20101106_AABDAW bewernitz_m_Page_050.pro 804d0a4d328f2e2fb19ce7f8f7709a5b 0533194dd0ef7ffb7ee58956d1824132b1fc2450 54962 F20101106_AABCWH bewernitz_m_Page_026.pro c992ece166a1b588882a287d216c7fb6 7333bd6b2399ef2b3cd95c9b2c6f84b3c6da87c2 111680 F20101106_AABDAX bewernitz_m_Page_065.jp2 c8c7720ce60523cfc84614ea8be244bc ca57334a382e56bd1af9a8717be6645df5086870 657752 F20101106_AABDTA bewernitz_m_Page_216.jp2 f8e49e56488186e7ce5678d9a5cdb869 2618b9d86f59ffafc36d64bd3e5e771485009c64 1051955 F20101106_AABCWI bewernitz_m_Page_183.jp2 5b85fdfcd93bbabf05ef6dfabd27e634 af6d9555cf21e2e36c45a99f521684ed830a4778 1928 F20101106_AABDAY bewernitz_m_Page_204.txt 1219c9d815a9884fc05dc8435bfd70c8 4f6f1d4d3832e4de901c57b92754d8824463b75a 117471 F20101106_AABDTB bewernitz_m_Page_217.jp2 c974ea1a1433a177d50e98490651f216 3d9bcf12ee47a00b58c9e82f7fcebf70dd05338a 36400 F20101106_AABCWJ bewernitz_m_Page_039.QC.jpg 690974339a307d4c9b00199a5fadccf1 438090f0077fc3bed2e993b24642e17ac7e078b8 38228 F20101106_AABDAZ bewernitz_m_Page_228.jp2 52d896f66a55803e9a64c2819220b706 bfe676db9c6084cb530deb4361b5f2f33ee4daae 122371 F20101106_AABDTC bewernitz_m_Page_218.jp2 0519e88d491fce8340cab93ab200b9b6 fc454b7656ccfa7ca6deb200fa20c5266e008e07 1941 F20101106_AABCWK bewernitz_m_Page_205.txt ce407feabaacf8ba9d88c874a02b5169 e35214a6b769e1e695b3594273c3e83bb598e674 121126 F20101106_AABDTD bewernitz_m_Page_219.jp2 e722e2baaaa5ab7d7dc7c5bb52158cf1 e2dbb943e6e46810d7657fce393f09197721ca0d 68401 F20101106_AABCWL bewernitz_m_Page_063.jpg 753446dd802a955346ccc9cae791ef39 c8ccf904d14fc836cbbe4bb3e51c5ab4ffd414b6 119377 F20101106_AABDTE bewernitz_m_Page_221.jp2 e9d9ec3c4ba1e8a27f3b9c400031699b cc4489a4a677bb489c07e9e816f3ec4efc9e9a78 39419 F20101106_AABCWM bewernitz_m_Page_201.pro 37377a719c954c0f907215a6871f8dde 92730688a326bbde6cbd9360683f03ac15b57450 119182 F20101106_AABDTF bewernitz_m_Page_222.jp2 ea18f1e294087517f8583c46f9be2432 3bfb3a43f97aae382d331f1ab0bde1c79de38578 119584 F20101106_AABCWN bewernitz_m_Page_143.jp2 ec28b82f21f1748b5ae8e930cb9eae45 eb7a71af1c5b95b8f41bdee404577437f7a4e68f 118152 F20101106_AABDTG bewernitz_m_Page_224.jp2 a9fad0bd3048aee6f7ea7bc333216a08 ea4cbfa9e530aa7ebfb027863d98d6fb4757d809 540289 F20101106_AABCWO bewernitz_m_Page_175.jp2 3bb011b46c150127e0fe64a759bbf7a5 8f102e1c1352e746752ba9a6b37d2041e8b80bec 120729 F20101106_AABDTH bewernitz_m_Page_226.jp2 dfda3569922c4c9d3490083ad19cb62f bf2dcd86fae3798e98cb8a6b810d3f4cc07912e6 13765 F20101106_AABEQA bewernitz_m_Page_017.QC.jpg f2957eef8389df06aaa5d274c3c2d7ea e5584e2231e089db491d500b34b2045dfc7e44b2 116661 F20101106_AABCWP bewernitz_m_Page_084.jp2 9b7709763b750a2a1b2749c3ccdf4bfa 796ffd5bcf628281de2eb16f9bdff0a9a37a7294 112068 F20101106_AABDTI bewernitz_m_Page_227.jp2 0e1bc17b28a409567af3f5e01015447e 74ec43c8ab9e7d446ab75e26748b1aafcc0e3d7c 3590 F20101106_AABEQB bewernitz_m_Page_017thm.jpg 158b4be4bed668940f33a6be974e7283 5c945bf47b834f308085cb38359825bef8164565 2069 F20101106_AABCWQ bewernitz_m_Page_146.txt 9ba26db9c0af6e11c8d08989b1cf638b 8039e461cac2263cbdaf209d3fa7bb86be838fc5 140829 F20101106_AABDTJ bewernitz_m_Page_229.jp2 3dbe8f735197b8a00e58342d8abd298e a3c0bab881b4f86a014441c711961ac6ae6d2f78 32914 F20101106_AABEQC bewernitz_m_Page_018.QC.jpg 0357bfe26d96cec8c581399459df1545 1b1c80dd059e05c9855444ef105caf668f48a09c F20101106_AABCWR bewernitz_m_Page_247.tif 6fad0d71afb0d0cdcc468c808ccc5834 807835896206ab8408958d6892430f5144631d19 134395 F20101106_AABDTK bewernitz_m_Page_230.jp2 b4e3127e8be6d0dc86f5b31843bd77a1 1959f1cc7638c94f8749092cd620830dd036f039 26612 F20101106_AABEQD bewernitz_m_Page_019.QC.jpg 8b7dc0d430761165a42c43b6b91bfadc 280d73daa018c9b2f20c1eb1b7c0283292ec82af 166651 F20101106_AABDGA bewernitz_m_Page_015.jpg 204c79e09e28c6f6f08746a8688d46f3 bb222359af6e2fdcb3e74d141178a6a6bc714197 45668 F20101106_AABCWS bewernitz_m_Page_122.pro cf2f22e110feb2f580b68eb8e6ab3788 313b031ed95190e0e3d4f81bd0d87bbd0c3cf62e 142744 F20101106_AABDTL bewernitz_m_Page_231.jp2 4353961ac81125cc7c406dc865ed98b6 0f15d6e35c846b054fcf31d40142bc09a7e92d30 6473 F20101106_AABEQE bewernitz_m_Page_019thm.jpg 29e378324c4c15321ec0bf1417a04525 14e5c6e64c4d52e2a526f7c4b3ae024a6e82e56e 117558 F20101106_AABDGB bewernitz_m_Page_016.jpg c466cb8c9d91ae92c585c5749bafcf5a 3ae0c6c2d8ecde15dd4909896ad83466ba44179b 1775 F20101106_AABCWT bewernitz_m_Page_136.txt fbf49b7f46ba192badb3ec1aa436cb25 103bca58318f2eb107bcf9fcd19316eccc85d0ed 1051980 F20101106_AABDTM bewernitz_m_Page_232.jp2 4c8613a1deac381b467e4023e20a3cb1 b3775519a79003b5194d5a8e521464f28e3666c5 8572 F20101106_AABEQF bewernitz_m_Page_020thm.jpg 0626e25df04f541f5f0747ce4a260092 0536ecb72f2df17605c7303c08793b542f4a0173 37937 F20101106_AABDGC bewernitz_m_Page_017.jpg 347379d25e98ac3261eb0dc7b4caffb5 30f866344445419174c42a4419c6897886d14f5c 110810 F20101106_AABCWU bewernitz_m_Page_149.jpg 9965279eff00098fbf0ee98646d0403a e600e0d68c9502ea21f2553411a9b53fae7f0fb1 130955 F20101106_AABDTN bewernitz_m_Page_234.jp2 0256bd88da2c68d24ae1189cff1de531 0dd970252702abd226c46337cb2d390bac2bf4e2 35352 F20101106_AABEQG bewernitz_m_Page_021.QC.jpg 4a84ab47e991d6096e5cab187c6c4766 374c56a90fc09a7f7e2b6d3421413279890066e2 103155 F20101106_AABDGD bewernitz_m_Page_018.jpg dc09556070b8ba05ccd390befbd88d91 ca7685b02d8a6803290a6012256c2c92770fdeaa 540 F20101106_AABCWV bewernitz_m_Page_212.txt 35029979cf7b2e5beda3c5c1dad1b858 2beb3336a88996079e596f227cbef898aa3d8125 136800 F20101106_AABDTO bewernitz_m_Page_235.jp2 90deecb22e1f118f09758cea4ed17e36 2d937e743025be4f174b7043165aeecc4b26de23 8952 F20101106_AABEQH bewernitz_m_Page_021thm.jpg b0e403b740f1e117131e2dc3b0507c70 d81f1a8293f326bdd8eebc8f516b0a1a9482ea46 106740 F20101106_AABDGE bewernitz_m_Page_020.jpg 382929a2dc2a4325c874b18518f38eb9 77b55196553e58c620ca7f2bdee38ada739ef641 F20101106_AABCWW bewernitz_m_Page_162.tif 396448f508693b2002ae4a59eace7d9a bde19c779aab2f6e07ce844aab7625defd95f94b 124968 F20101106_AABDTP bewernitz_m_Page_237.jp2 f8bcf8f37bb7d3491346af823d2da0a4 bb6db4e3e70e2a46af3464f8e9fa06edf95800d8 32021 F20101106_AABEQI bewernitz_m_Page_022.QC.jpg bee9555c8a8d2e8c8e91ad2400c74359 293c82fc81970561621731dc78f6df02c82ed133 108230 F20101106_AABDGF bewernitz_m_Page_021.jpg ed64ca52df7c519f3bb89ef356d2ea15 91ae3bfb37f91fc334c53a203eff4107cf0f2880 34473 F20101106_AABCWX bewernitz_m_Page_023.QC.jpg 3df15819a6ef26afadf3ba2edb14f6ea 3f521cb47a34544f8a5d5fe5dca22bc6095bd9ff 138460 F20101106_AABDTQ bewernitz_m_Page_238.jp2 b52a11db8dd9538f9514e042aff6c730 c8b9df84093abda1d25593cab1cba813b3c90e2e 8202 F20101106_AABEQJ bewernitz_m_Page_022thm.jpg b77dc59465ad28a14d43367554abc809 ea7d757c0a9b06903d15a4a76eb85d738c13818e 106439 F20101106_AABDGG bewernitz_m_Page_023.jpg d482e336e80bd9ed4dea3289e76ff846 8c771d9c45619960aa14c8436f49600514653bae 2025 F20101106_AABCWY bewernitz_m_Page_127.txt 7d3fbf7c999af1bab834ab07eda9e4db b7d569beea9065ad048fb85fcc3f85bcc844a953 1051930 F20101106_AABDTR bewernitz_m_Page_239.jp2 572edc9df81e580a63d8c7491cf71154 ecfebeb667f92a62a7cfa4b40fca326c3d5f6ae7 8564 F20101106_AABEQK bewernitz_m_Page_023thm.jpg 17bf1557c842cc50bf44b918ace2f25f a46141f860f51831d4cd4044cedb6dae45cfe285 110034 F20101106_AABDGH bewernitz_m_Page_024.jpg c51e81ec97f85f0f6edb85997b8c49a7 0ad0c75ce514ac60a05bbc3f810e41341647feda 53072 F20101106_AABCWZ bewernitz_m_Page_042.pro e18cfa464b94e22b6b00c89737d4f4b5 21e449276524d88b04dbd552ed02a60d49ee13c4 52602 F20101106_AABEDA bewernitz_m_Page_086.pro 2c1bc597dac1172ff1f66566ab84b8e4 df2699bea33c240c6d5ac4a4ce8af8104a8a6b09 133449 F20101106_AABDTS bewernitz_m_Page_240.jp2 d8c2116764be646e098a4927212ee791 ad4007c46990c1027ffa35dd4d91dbaf4c1cd49b 36213 F20101106_AABEQL bewernitz_m_Page_024.QC.jpg 63eac4bb9ae73e02dc6970cab2231e03 3cf8f036e39323f0c31ec2aff56ba0cf30cf6ba4 115489 F20101106_AABDGI bewernitz_m_Page_025.jpg 58399734b663a36f8f21a0e738567b0b 06c0b00f9003663d939b9d57366d6f703832322e 49554 F20101106_AABEDB bewernitz_m_Page_087.pro 0dc4c966ce97d7c89c2a6173537437ca c49206b32def5be3befeec09ce12a7d38b350e38 136295 F20101106_AABDTT bewernitz_m_Page_241.jp2 ea2cb4a71f426900e1f395746d5eec8c bb304dd90cc4ef77f8f72235f84eb11da3b12548 8354 F20101106_AABEQM bewernitz_m_Page_024thm.jpg 391f11a663253cad2482abb4485eee26 8012d39473ede1a23c94359e6238cac720441563 110465 F20101106_AABDGJ bewernitz_m_Page_026.jpg c78ce575bcc8f4961162a9c85d0d43ec ba2a88afdce0ae70abc10c529106a47c49847a8d 44087 F20101106_AABEDC bewernitz_m_Page_088.pro 571eeea3aa95a77019786d6e2104fa51 8b02af9b503f215099761891f8c11e39183479f5 138268 F20101106_AABDTU bewernitz_m_Page_242.jp2 5ee4ccb397f71fcbc0affff56912e93b e03832de92505a699a8032242836b635225977eb 37623 F20101106_AABEQN bewernitz_m_Page_025.QC.jpg 797c26b963bf499c365a3a2e5aea4216 8a57dac5be89d288ecc083810ffd2a0301c50f28 104037 F20101106_AABDGK bewernitz_m_Page_027.jpg 53d80c6f9faed9eaaedadf459519e7ad 5c91ad62d4f585e76cee2cb5b65100e5d8845772 37123 F20101106_AABEDD bewernitz_m_Page_090.pro 53e80b4ca28fb3d9b5e4ca0626d95dc4 1bc73969b78af8013fdc611958c10d3cb84aa69d 133484 F20101106_AABDTV bewernitz_m_Page_243.jp2 17fdcc2765d82c1ee005339ddc654887 c55837b41c3410b1ef7b6c9277f4eddae5cb5d1a 9080 F20101106_AABEQO bewernitz_m_Page_025thm.jpg 879c2a397568a7bdde268989aff8034a 900d11c8453f5e6cd72cf752364900dcc9b849f8 100318 F20101106_AABDGL bewernitz_m_Page_028.jpg e29cc0e3de1ab0f9822c9b262a45727c 0e6afbad02feb9b3cb57f770989b30cee3b06595 54140 F20101106_AABEDE bewernitz_m_Page_092.pro 4a806eba90fcdc7ba1e55e480135ef65 79cd86286f09b3960e04fe50c5b4c2f25a70f0f5 F20101106_AABDTW bewernitz_m_Page_244.jp2 bbdb83f85c27111f18883e16d9b953ce fd3d8a481c80e4b087e528783240005e8abdf1dd 36419 F20101106_AABEQP bewernitz_m_Page_026.QC.jpg 16457ce69b2f809c7ebb61f342536a76 ca6bf7521b1f463a82e686777968abea1fc028d7 112398 F20101106_AABDGM bewernitz_m_Page_029.jpg c9c15f5317d6a52c29552fecb7160e34 f173182ee5f4a250399e4edc94f33b0090545cfc 56062 F20101106_AABEDF bewernitz_m_Page_093.pro db57401c44210926023fb12ab93affc9 65cdcd248aa5e1ab331fc94e6811166af15adf92 31831 F20101106_AABDTX bewernitz_m_Page_246.jp2 1299cef3165814b465dcc147d109ba86 36d4447a10f0448278f4e29ce5075c220c609800 8973 F20101106_AABEQQ bewernitz_m_Page_027thm.jpg 3331c4ff9096fccede3aa844d02c6f95 514a69cf4485b7955936c2869a9dddb54a0a8aa0 100112 F20101106_AABDGN bewernitz_m_Page_033.jpg aa9a43db696a79b80f5f80bc725097cf c1a1b94913813805d03df7024ee8f41fdc834c72 40828 F20101106_AABEDG bewernitz_m_Page_095.pro 73cffd67fdd8344a510b1394374e50d9 acca323fb541285a730ede4914a00f87c59f5eba 90771 F20101106_AABDTY bewernitz_m_Page_247.jp2 49dd5194d3ccde1b7ef8695edb522426 0f10eb8279b84eea596066ce9a512f8091ce53de 33421 F20101106_AABEQR bewernitz_m_Page_028.QC.jpg 8c907761b8b7b8d8dc49409b8cf614c9 771faeaca37ac4a899919632860febc6dea4b365 42234 F20101106_AABEDH bewernitz_m_Page_096.pro 9d3f3999f7bb0ade715c3fad3a156a1c 85205c21d00f6d7bc8e66b5365cd9ea34ff33ea7 F20101106_AABDTZ bewernitz_m_Page_001.tif 1f8600053733141b23a18524106c804b f1e53043efbc96308b27ff3c18b894ae61244a22 7820 F20101106_AABFAA bewernitz_m_Page_204thm.jpg 477441d3873adbdfca2e168c48ecb83b 17fea5eec211e04076062422d3e90e037f277edb 8203 F20101106_AABEQS bewernitz_m_Page_028thm.jpg 4f6a797b320307b6783a6c4d2a8ba24c a5219b804325e0b735a97bb4af6d3fd88037c2d4 76501 F20101106_AABDGO bewernitz_m_Page_034.jpg f02d78bcade6b64ef5eac3c3ba1116f5 4ea16292c38f5fe3ef0d63068af0b90e99dd612b 13550 F20101106_AABEDI bewernitz_m_Page_097.pro 51a16b0309d7434f59399e5de6fa4be0 ba8e3905671d2b5069b973b2c35fa9e3e098696a 8473 F20101106_AABFAB bewernitz_m_Page_205thm.jpg 3cb232df0f43e3568fae195505cf95db e8369cf85f13e5d82d62617bc49c77ea062cbfd5 34188 F20101106_AABEQT bewernitz_m_Page_029.QC.jpg f0ae79d2f821a8d3b9836193611a4714 6f7144ec4d859dc482f2f2bb9c745abb7fbb8738 97446 F20101106_AABDGP bewernitz_m_Page_035.jpg bf848b2674d5410a26e5afc7e9fac10f 94068e394a08cbc05e249f858df673f890996616 6098 F20101106_AABEDJ bewernitz_m_Page_098.pro 5cdcc363d9e375bb185aca6a4d74a720 d6c6dc4ff11967d0ab843bfae8571661dd55e835 34054 F20101106_AABFAC bewernitz_m_Page_206.QC.jpg 955cefff4c4486c7207b0aad3f932e02 073bf4e9109635664ea53a7db40e20ed47b24ed7 33116 F20101106_AABEQU bewernitz_m_Page_030.QC.jpg a785125967a75b2bf276d2943880fddf b41a43f09aaac22030b3f977b54a80896c5f3c4d 102635 F20101106_AABDGQ bewernitz_m_Page_036.jpg bd5c88cc8e54e07d99f9f937b27cf87e 7b3bc5668714130ed97893a7ab4317b35372e849 8331 F20101106_AABFAD bewernitz_m_Page_206thm.jpg b578f1bb10b4eaea02c4820325f89f17 85aa93c24c6678a72544b614433e1528499bd245 7934 F20101106_AABEQV bewernitz_m_Page_030thm.jpg 43ffc66dc1a47ce5d562df4fd96faf25 230ad7af4243b0e49ad2dde6a2c89a2c8e18c4f9 100197 F20101106_AABDGR bewernitz_m_Page_037.jpg 66545f5a71323def978ca9267cbbd5b5 ec13fc41bc06b0873a39de83fc38ef16038fd799 13706 F20101106_AABEDK bewernitz_m_Page_099.pro 2a8c3e6c6e7b04d801ce2d711c5b92a2 d1a3ea968fdbcf5dc4154a3f236ae689097f8178 26373 F20101106_AABFAE bewernitz_m_Page_207.QC.jpg 2040fc1a5ababd2671f2c071ffc282e1 cb57760ed1cf77cb6201d80d635ce2686ff42432 1453 F20101106_AABEQW bewernitz_m_Page_031thm.jpg babdf208f7b8538aaacb44465b398eee ee5fbb8cc394fa5c813cfaa4bdcebb23c2bc1a32 116119 F20101106_AABDGS bewernitz_m_Page_038.jpg 2c0b0eb85087e9d7beaa2b3c9ab4ea45 f5e2ebf752e7be0ad7b935864395bc408346b1c0 4127 F20101106_AABEDL bewernitz_m_Page_101.pro ee1f6663566340a3e73a5afdc691bf10 8a1b0adc17b6f625f0f03bec6644c7ebaad13cef 8398 F20101106_AABFAF bewernitz_m_Page_208thm.jpg 4a332ed9f0149dafd09e5f6863e9ae1a 91469a986b28dd640255774e5998ba6440b7ba4f 96985 F20101106_AABDGT bewernitz_m_Page_040.jpg c82889518be7a5f5f1b6db40f80315f4 ff96e397cccd56cc0dd28f199a8cb8d07aa8ec1c 50178 F20101106_AABEDM bewernitz_m_Page_102.pro a7064b624f89536946ece62ed402961c 0ed0181f858a555701a1bdfbdf2a3282bcace27f 35506 F20101106_AABEQX bewernitz_m_Page_032.QC.jpg 783cd9f751cd8299f95567219673115e f1e172c18be2c64ca091eb4e343129fcd2e821aa 111073 F20101106_AABDGU bewernitz_m_Page_041.jpg 807487892edb8bebb132f5945ae00fdc b7d86d8ec3a5e3ce2d2968267d0f3c902637ed37 55364 F20101106_AABEDN bewernitz_m_Page_103.pro ebd07c9e7db1a07355fb47c31e59599e 865cca2b76ffcf7dbfee08c186aa3f86bcac1d2f 25368 F20101106_AABFAG bewernitz_m_Page_209.QC.jpg d256e225cb8df64e65f55b148ac1e283 dc90d31974416e1dd09398997e5301b7ff38c751 8871 F20101106_AABEQY bewernitz_m_Page_032thm.jpg d9bd2676f24d4b19c57275b20ed83a27 5e9789e18a059f82ebf1d4d7579b36528adac62f 106510 F20101106_AABDGV bewernitz_m_Page_042.jpg 7042ffd3ba28346c726cdbe8248fe958 5afa63849b267a3020fb6bbf0bc65999801acd02 56443 F20101106_AABEDO bewernitz_m_Page_104.pro 5a6b0b4aa363691ebfeeafb73d640af0 1bc4afec08bf70d45a08b71a60efc33000057fac 26443 F20101106_AABFAH bewernitz_m_Page_210.QC.jpg b90790aa6d0d022eaac7dca2e31139be 431a2caec2b39e9c4377a949f6b8ae01fc8e367b 32460 F20101106_AABEQZ bewernitz_m_Page_033.QC.jpg 3153bd230fd4d82433ea6bda656ef590 3a2cfb81725fd166c1089bb143c55f8bab703c32 107717 F20101106_AABDGW bewernitz_m_Page_043.jpg 2c81ca59a2f4d6614523ca73f06a00eb 79a61a719ae4f08fb51b6df30b8824476e9c283f F20101106_AABDZA bewernitz_m_Page_189.tif d3b2672fb9f35c1ff5f15b6b6ce7cd46 a616175742df4493c9006fac6d9f2870ae300d70 54444 F20101106_AABEDP bewernitz_m_Page_105.pro c1cf6fb9fd48dea5b6cd0b182dd83242 1dfbe6003f757f0eca0c9c009bb8fc2f70f5a0b7 6235 F20101106_AABFAI bewernitz_m_Page_210thm.jpg 61df210f1b88e109bec9d0bbe64a8b39 ed734e38e3247f5b00ba12970d6634a6466c2cc7 110952 F20101106_AABDGX bewernitz_m_Page_044.jpg 23a7128f421033bbab663363ec4307b6 728af9f20fbcf17102f0ef31ba3837a0203dd914 52795 F20101106_AABEDQ bewernitz_m_Page_106.pro 3ed9f4267640bdfafd61c8c287dede91 aa24fe3b8d21131b35ca97601d4f854dbbb3833f 16274 F20101106_AABFAJ bewernitz_m_Page_211.QC.jpg f5942d8ac43e3047ab0ec3af1844cf13 f8aab336a2fd31d7c7b21d48a4080e66431dc1a1 108333 F20101106_AABDGY bewernitz_m_Page_045.jpg ad5d693e78dc6e59f2c3b34e617e2f4b 1d4d521a036603af524a0b55914378f9bb60a97a F20101106_AABDZB bewernitz_m_Page_190.tif 76a0fcf77ad6f9ef186cfb4e99650178 9b4612910af499a7cc544175e98595b0b4da8ffa 53959 F20101106_AABEDR bewernitz_m_Page_107.pro 76b5746bb823535319bf311b639007d1 f167242a0fb5cbbd1788d1db87964208b14b2dda 21185 F20101106_AABFAK bewernitz_m_Page_212.QC.jpg 0fa1556ea67ed0b7ebcaf7a58409a868 f31d5cbe0eddf90e89de8ee8c7c1880c920ee274 100837 F20101106_AABDGZ bewernitz_m_Page_046.jpg 1a40708c41ddfd55878783e4074f87a1 703142c7d83d61a27a0fec49969749d147857700 F20101106_AABDZC bewernitz_m_Page_191.tif 65a4ab14f29732e1b87179df240fb622 404d5fdcfc577e2fd57f4c3bf4f31134816552ca 55074 F20101106_AABEDS bewernitz_m_Page_110.pro d206fc3eb1e207c67916227217938e88 7d1f3182326ef2afe908f5bd54e0bd028ec8935e 5642 F20101106_AABFAL bewernitz_m_Page_212thm.jpg e3cdb6509e6141d45809f78904cd3152 5f4722259e64a5731934fd3c6e51ba2ab89a4c93 F20101106_AABDZD bewernitz_m_Page_193.tif 6e674863c3ab92e02cbe78d6e1421fbe 5824d7b2ed46c8d38ea94d1c64df3e0e53d6fa32 55679 F20101106_AABEDT bewernitz_m_Page_113.pro 1817aa7724e0e376f56f79752d7f6ece 15b5758bfc6616d390065f390a17fb8252b3e9a4 13529 F20101106_AABFAM bewernitz_m_Page_213.QC.jpg af9c040b00d8f075a3afdebed4a3281a d26fd424b260396cf9bab3b013c40c11a26d336b F20101106_AABDZE bewernitz_m_Page_194.tif 2df918c606a183224ff186ea0202f0d4 edb303ccb203708a11e16cddd0bf66afa3387727 51218 F20101106_AABEDU bewernitz_m_Page_114.pro 4e8d5bc775534cbe0e6ec988da0d13db 622fece6b913af7bce06bf52155bdd0697d9e454 3827 F20101106_AABFAN bewernitz_m_Page_213thm.jpg 5e248321ba0095474acf32848eeb9315 08b8993cf2549a4d608b0afdec500afcf39810d9 132946 F20101106_AABCPA bewernitz_m_Page_010.jpg df4447aefe0d68e82364845184360b0d d0af8118bbf188f6fea367fcd03c0f2e9f2d2a79 F20101106_AABDZF bewernitz_m_Page_195.tif 03ea7bc3d9af8a919631babff2206202 90cbdafec392ab3c424c065d715b519670ba5c8b 54298 F20101106_AABEDV bewernitz_m_Page_115.pro 3148185298743615c4cc8ea98942fc24 f5f0aedae3031d35f51fed07fa9c86bc143feb69 27645 F20101106_AABFAO bewernitz_m_Page_214.QC.jpg df2d6b0174b32ffcf85194cc4e6b3e74 20b5230987cba3d203aa6bcca6419db3142cafda F20101106_AABCPB bewernitz_m_Page_223.txt 8f974b50531157399f0d3d5f18dbaf4e 5a87a6273ab4dc24c836b6027cd20d952d29dac6 F20101106_AABDZG bewernitz_m_Page_196.tif f9317c472b62950fe7ba1d6e47803c17 dd46429a9cb067d12e34c02db3b0beb6da121b3e 55782 F20101106_AABEDW bewernitz_m_Page_116.pro 56a746efb93697fd48f317f1b2f200c7 d327db1152221a998eeb7d791048edb78fe17fe1 8120 F20101106_AABFAP bewernitz_m_Page_214thm.jpg 899210914cc9f83b0f98f54e1c8774ee 595d6601a89a7bf0c2e0edd8d7aee18810437d1a F20101106_AABCPC bewernitz_m_Page_112.txt 707a17e0f022f69b63b5c90b1378bb7c db8520925146b27e38320804ab7a405486e123e8 F20101106_AABDZH bewernitz_m_Page_197.tif 268b0e260f626a71372d8a67ec7f91a8 9d633b038b3b4ae35f453fb1f7061f75882c0133 50676 F20101106_AABEDX bewernitz_m_Page_118.pro 8a6365bfa45eb135618c3ae8aabfe5cb 51a601e893556f86b37c3192404eea1ee33e6c3c 27851 F20101106_AABEWA bewernitz_m_Page_132.QC.jpg 7563b5173dc2600d34163c9d5144a0fc a789a04358e792f31b76a7bc005fe35f7542d604 26750 F20101106_AABFAQ bewernitz_m_Page_215.QC.jpg 8bf7850ca3ddf3bfdc11ecd543fb4186 e02300207888d035a657d86a4b92d2f764a2cd2d F20101106_AABCPD bewernitz_m_Page_185.tif a0075dc6cc091187b9a8adc52509f31b 0c3eb629336a54ba6d482655d548a1e49954f8b8 F20101106_AABDZI bewernitz_m_Page_198.tif 2eca4184ceab453bb9579d14e6160a26 575a30b753e984aa55e99dc81c510688b7563e8c 53439 F20101106_AABEDY bewernitz_m_Page_119.pro 82aeb1e7d610ec158f33736e2c864049 6e11887746aaa142a0ad92ed00784d359b68ea8c 21866 F20101106_AABEWB bewernitz_m_Page_133.QC.jpg 5f23f3b00e58f3a804ee6253d174b074 1c4f6834c1acc22bf042cfe10a971c776c2eebbd 7853 F20101106_AABFAR bewernitz_m_Page_215thm.jpg a200252904ee6576fdc02713ac3602d7 6f73b978cc797938fb69a70fc0571736f71910fc F20101106_AABCPE bewernitz_m_Page_060.tif ef9aa411b97b3f88f5dc70e8d1d3cce2 0ab2d9aedff549809b273e3d9aabcc411f022c36 F20101106_AABDZJ bewernitz_m_Page_200.tif df6fcf3b994e05fe2116102a7f53a53d 56b67a7fc765df3bb926683875fc367f6c4bc473 50850 F20101106_AABEDZ bewernitz_m_Page_120.pro 279f3ea4abb6e9202b39ffbb2fc903c4 1a0438d4d8967570985befacfdf09f98bbfd3323 5767 F20101106_AABEWC bewernitz_m_Page_133thm.jpg bc31c48ee9607bf0335e8fb507ffc830 a6fa3d8d3af858a0d65a4c9d4e07361f3d585223 26867 F20101106_AABFAS bewernitz_m_Page_216.QC.jpg a27647f258dce766f9944daef96a7655 628840e33f65dd09d777074cef0baaef41e1a545 52845 F20101106_AABCPF bewernitz_m_Page_020.pro c5c099038eba8667bb6a206d72bd0840 7a499f6bc976aa2481a34a794be0b67b068da8a7 F20101106_AABDZK bewernitz_m_Page_201.tif 6b30d86f9b4bb790109851962d945c7c b40f014a5092c5c2f226083bace704096c83af98 3221 F20101106_AABEWD bewernitz_m_Page_134thm.jpg eacb6d5dbd991a902fde1ca3a15bcb06 4b254324d953402b037e9abc78ed096db35f9157 7959 F20101106_AABFAT bewernitz_m_Page_216thm.jpg 320f2b3aae1265bb3480d89949d3d7aa a88feeb6f54f0144afef396c6353a8dd41593f70 7610 F20101106_AABCPG bewernitz_m_Page_094thm.jpg e6d8f398d04ce5f43cdf7b98ccee1b40 3a294bf54435a77d58498eab9892b8243f931826 F20101106_AABDZL bewernitz_m_Page_203.tif c153bb801d2c7206630b74ebb709da20 8e91693115c83f87aca888b24264e7154a55b772 15308 F20101106_AABEWE bewernitz_m_Page_135.QC.jpg 7a3461bec2af3373686edfd106ba2fa4 4dfc93519ae747c1f766de6a7e65c0ddd6f9a5cc 8748 F20101106_AABFAU bewernitz_m_Page_217thm.jpg a5a5d926f9a3162edddcbc0f7c5e107b 95f51bbd55654f44e64bcdbcbc5dbb4709e10e51 102871 F20101106_AABCPH bewernitz_m_Page_202.jpg f6964bfd643def8019c22fc89396e15a f564f2b63a1308074e1549cb2a9bd836cc63f9c4 110219 F20101106_AABDMA bewernitz_m_Page_217.jpg 9142140a3df7c8063cb5621e5142e474 bb3c7e7123c993266737b9360137f634df47258a F20101106_AABDZM bewernitz_m_Page_204.tif 9b640ea321ca8ad6e61aaecca69c59f1 d1255758a33ca18c49e43190fdec8af5bde9a6ec 4830 F20101106_AABEWF bewernitz_m_Page_135thm.jpg 69b27c01727c76db7b5d9c02ea8f13c6 ee55bda34f7fb4eeef33462d2a1bd9045b72902b 37664 F20101106_AABFAV bewernitz_m_Page_218.QC.jpg 7a3c3f2d8472d3e3341f3ad339a75a7f 693d8510428b0c573cca1c98f83f9041a9806ea7 11436 F20101106_AABCPI bewernitz_m_Page_138.pro f71ea5209f38412165a450ddb14009f3 0048ae1dbf692ab34ce5f01f303bc76337f69312 114894 F20101106_AABDMB bewernitz_m_Page_218.jpg 258ec4553d03a2f79eda58749dfbd285 36b5b21a5f55541394200e98d7308d2dd7b74f89 F20101106_AABDZN bewernitz_m_Page_205.tif 54d324308af2043aa5cd2af22e998518 895ebd490a28ca1aeedc7ab59f903b4a07ec0093 6590 F20101106_AABEWG bewernitz_m_Page_136thm.jpg ba8713f3aa43d98e97bb9a78dfcbaddf 69117ffa43f4a2862b078876c4347ff4cd2d63a3 37307 F20101106_AABFAW bewernitz_m_Page_219.QC.jpg e37bd7993a3e8834a14f55dd8f83c06a e94c21de81b7fd689dc4c5476ad5a3c91182f5e5 95049 F20101106_AABCPJ bewernitz_m_Page_121.jpg 016ae73409016520a06a9eca0db9d035 b026a65f434f843b6a5c13d9935703ac3de031ec 114940 F20101106_AABDMC bewernitz_m_Page_219.jpg 9e4f55269aca74bde0e25bcf4b422088 b6d3d04e528db0152dc20d18d934fe669be85c8b F20101106_AABDZO bewernitz_m_Page_206.tif 8e09cbc2265d727be94487dd9ddb3558 40b9ad241372994463c6d3f8aa8fef2ee2064e7e 13345 F20101106_AABEWH bewernitz_m_Page_137.QC.jpg edf1ed5352dcf51f75b55d4bbd313bda 982469737096f13d02723d79776c3e8e6dd1ee32 9148 F20101106_AABFAX bewernitz_m_Page_219thm.jpg 3496a7c25698948193381f2eb99fe858 e54da8c60aa24300eb2aed0d91a651f20864018d F20101106_AABCPK bewernitz_m_Page_036.tif 8ad8d25e542a2d42cead08a2f3681d74 94c9a439ccb0842a895837a1e2ad3784c2a290b7 109926 F20101106_AABDMD bewernitz_m_Page_220.jpg b8abbeccd558593fc75d6efcafd09fb4 ffd180e11371c6143f17816a3de9153c27ff6e63 F20101106_AABDZP bewernitz_m_Page_207.tif 98a2d9ad01f08b9cbff1e0c4411cdec5 732b550dda4d3d58bfe8fb2e1d9c903536da66fc 3950 F20101106_AABEWI bewernitz_m_Page_137thm.jpg 446647ab51b6294f74ebf3355d8a9c72 6dcc6ac81fb91d5a37e94c5ca5465e4a7fd1ac70 35420 F20101106_AABFAY bewernitz_m_Page_220.QC.jpg 08120b593a9678a3107d3d9f32ccb8f2 acc3932e043ee615a2271ad49f09f34639ec0fac F20101106_AABCPL bewernitz_m_Page_244.tif 8bb27cbf044957ca87d7c379fe6a5034 b97d9ab196d58c295dbdde0ebd64e4cbb4af0f92 112341 F20101106_AABDME bewernitz_m_Page_221.jpg 754129eb66583ea99629cd70b644873e 0956f2e3d22a7561f4e546f51fcaf329aed8e5ad F20101106_AABDZQ bewernitz_m_Page_209.tif f3b7ee8b9368c54eca075924d0d0ec35 b128f6fe5c63bec6174319e2f9d0562e7007683e 21434 F20101106_AABEWJ bewernitz_m_Page_139.QC.jpg 5467768cea701ac2b43c0c172a68ff8b 786aac5d8e04ed76c3453f1eb4a69d46121dc475 36908 F20101106_AABFAZ bewernitz_m_Page_221.QC.jpg a10607e963f3cd483514fdf10b05205d a714ab71f0d6058cf0989d539f0b553244d8df01 F20101106_AABCPM bewernitz_m_Page_134.QC.jpg 0737f1f70710d762354ab2615ce69bc2 3e66ebb516f409da43aa2164a514fff76c508384 113674 F20101106_AABDMF bewernitz_m_Page_222.jpg ad89f44bc7cd17721e38c43053b9fe6d 8fd51110f90e7de7bba0a175fec62c72a30b0a2e F20101106_AABDZR bewernitz_m_Page_210.tif c4d983acb691e3a66c7eeabeafa622fc 2c2ee2d9afe178c70289d131e2036cde662b8c2f 20009 F20101106_AABEWK bewernitz_m_Page_140.QC.jpg e3af3d9ae26649f81ad0b643c8c8e559 06b02c38d887117d4c7da6a8b181a1026ba0a38e 10226 F20101106_AABCPN bewernitz_m_Page_015thm.jpg a7236ddfc9ebf2773529dd905395f0e6 c6d024d259981a06dd6c571ead72710ce087c2f8 113571 F20101106_AABDMG bewernitz_m_Page_223.jpg d6a6bda32afbd8a6460802ce0520bfaa 82a7d6aafa17384203212825c1a294eee70c26d0 2124 F20101106_AABEJA bewernitz_m_Page_043.txt 0640bc8d343587bfa5cd8abb3aa9d1e6 4fcbdd14414bae9f4cd9e72f9261879a966022a8 F20101106_AABDZS bewernitz_m_Page_213.tif 244ccd9545c4f5d3eb06cbbec717afdb 31a136df2a9611288243ca0e78b562e061fe6881 6524 F20101106_AABEWL bewernitz_m_Page_140thm.jpg 14fe230f3a9e5b21c9776879653dd1b7 e63d6b1e663c851c833d55ad56d902d7bf3939de 23076 F20101106_AABCPO bewernitz_m_Page_141.jp2 52d95818d2c4e4cd38423480bef07a5f b9d058e3713857482398240a6b656a0850dc7fe8 112705 F20101106_AABDMH bewernitz_m_Page_224.jpg 4598d93fc46990c34f97110d6f229a0c d1db516249cf079c0d41095ec41aa9cba99e0ed5 2139 F20101106_AABEJB bewernitz_m_Page_044.txt 7d64718abaf81bd5f68c2ea818ad7114 412c21eb12df6de31bcee39fdcbb866c76d1ed65 F20101106_AABDZT bewernitz_m_Page_214.tif d101b281cb0d8a9527d30f6fbdcde86c af1ac9560d1d848f9e14e0137d52759bea37b082 7494 F20101106_AABEWM bewernitz_m_Page_141.QC.jpg 9beaccb41c047b598497e59a3a57e66e c3cf39446b376283f7e758b8400ec4de300cf13a 35894 F20101106_AABCPP bewernitz_m_Page_053.QC.jpg c050e8b52820f536a6360c28ce5c34eb 307feac6ba56832b8cd00688b1cbc849c274aa87 115230 F20101106_AABDMI bewernitz_m_Page_226.jpg f0033008b886db579a680a642f062450 8cfa856ea4bcfcb93e8abfe8f103de58ab38dcd2 2142 F20101106_AABEJC bewernitz_m_Page_045.txt 54a9829fddbe1a456016d524adbd51aa 56295283dff56ce556121977f2e574b7addaef6d F20101106_AABDZU bewernitz_m_Page_216.tif 840b5dfe9f5225a2e817f1c7b5851c73 099400a854bb781712af3296711786e820dd4db5 2026 F20101106_AABEWN bewernitz_m_Page_141thm.jpg 3d32b5d20ceb80baf88bf4f141d5c7bd 4336a30945e13ea68407bf277590a20d2d5a5ba8 64093 F20101106_AABCPQ bewernitz_m_Page_241.pro a18a488845298ab0a0b961f27c403e70 14405c726affc4d73da470ed7daef85ba807ac92 104091 F20101106_AABDMJ bewernitz_m_Page_227.jpg 73159ddf6fd9ca71b5ef972e0b5e1b38 0d957d869edc1c902b9fde2572ac219560e64543 1978 F20101106_AABEJD bewernitz_m_Page_046.txt 5f6684562c47eb0bf1a8d1e2ad7b9de4 7c692b99ae1ef1579fbd2ca99dfc65d6b409ef3b F20101106_AABDZV bewernitz_m_Page_217.tif 3259d036c7fa57b39149a24611ad6db9 c6933bba9b3f6bf4a0b03ae70a9d4a1e5d1b236c 33086 F20101106_AABEWO bewernitz_m_Page_142.QC.jpg 68e6e93156cf849abb6148ae3942567d d4a3c543784915ec79f4d5ba4257b68c166ea19f 14732 F20101106_AABCPR bewernitz_m_Page_031.jpg e28a72909111756bbadf495efa96750d 9b734b0b4b42d2888cdc1df0946fb9f80a8c6a6e 35348 F20101106_AABDMK bewernitz_m_Page_228.jpg 651b069a76428f5d4c9592583d758a54 e8c7a02bc183867217239a6b900ef9bead044b39 2049 F20101106_AABEJE bewernitz_m_Page_047.txt f8f4e7736700e53a79dbda40992f63bb 97ee94838e3fe8d58dcb4ad887bfff2936a80bf6 F20101106_AABDZW bewernitz_m_Page_219.tif 9022519c15c8e0cb3f2c80c7290bc48a a264d1c2a1700697325e16b997d8da3318e5f9e5 8404 F20101106_AABEWP bewernitz_m_Page_142thm.jpg e6c248249dc407cfbf47875d8fac5279 6235d8bf9d8bddbf26b4aeddff2d7abc7667b6e7 91522 F20101106_AABCPS bewernitz_m_Page_130.jpg 85f99e9772cdab44b5c870cfefd1007c 8c8952b0929e6b3a8249a0d9336c1d1d7a757199 137903 F20101106_AABDML bewernitz_m_Page_231.jpg 11095a4ab4efc4ba5f13dd36086c2e6d a2e34bf464a323ee5df6c766a2f3ec93fdde2cdf 2040 F20101106_AABEJF bewernitz_m_Page_049.txt ca2a46f9b1e0a0bee2c183fceefda0cd 2f8f69b1cc8fae9f68262bc5a034270a66e7b1d5 F20101106_AABDZX bewernitz_m_Page_220.tif ae0977e816d163ee0445ee9b43ac5270 6464a168f07589ccfa6682845d3102c7d651716b 8653 F20101106_AABEWQ bewernitz_m_Page_144thm.jpg 4ad8a153e147d2a191f0ed0db28cf89d 0b490e46c61397b9cf304470695005d837cdf1f7 45966 F20101106_AABCPT bewernitz_m_Page_082.pro 0dcb430bcaa5ddbb4a1bdf0b3c97d4ed 042c332d633f0bc79d6b2352471ac0efbf3824d6 129987 F20101106_AABDMM bewernitz_m_Page_232.jpg 8973fda8a008bf78ee2fda8f0bb4f7d5 03bd4cbb4f115eb0baf8a1101251c62560c2417a 2167 F20101106_AABEJG bewernitz_m_Page_050.txt ab694067649d11f96a0ca4a075a856b1 4f5907e40c510afa2c9eb6e41ed76839c3e1e7c4 F20101106_AABDZY bewernitz_m_Page_221.tif 91fb363103763ec823f31cedd4ee26ae 077fafc8ef6be13e890a9e8b43ea4641f863a821 8908 F20101106_AABEWR bewernitz_m_Page_145thm.jpg ef0b1209d82874d9b555bb4d3c1db7d7 fb5c85f76c1a2b475a3aa9cd893ad793e60fe614 1051898 F20101106_AABCPU bewernitz_m_Page_212.jp2 75a253fecb5081a3ea99dd2d0b5d2480 48b1967d9985a2b74452e24b33adab38849337a5 117864 F20101106_AABDMN bewernitz_m_Page_233.jpg a8847f9e0ac4f2e0c5e7c6a6b0babafb 26e00916e54f431660d4cd6c7887c2919e4d2444 2148 F20101106_AABEJH bewernitz_m_Page_053.txt da4218211a58b4f35403108e090c0617 07fa6c2eccd5845bba7f7da49157de01ab3a1bd2 F20101106_AABDZZ bewernitz_m_Page_222.tif 5cb118fc09cd1b396d9bdf55636d0f81 67248f36cf057e230bf3e019bec0aa437e899fa0 35907 F20101106_AABEWS bewernitz_m_Page_146.QC.jpg 62b58f264d5fe948d948fea9ee6755a6 2e10850f85ce6379d44e58218235dff6561698e0 F20101106_AABCPV bewernitz_m_Page_011.tif f05c16cb31985c2c8daf6a53f00a923e e88a6a9a26531c68b92f8e49d14b1014d0c474fe 123965 F20101106_AABDMO bewernitz_m_Page_234.jpg 2b80c224b918a5574d68f3320165cd05 b8b9b35fcc656faf26ad22af90e3b5d1499ddbe4 2044 F20101106_AABEJI bewernitz_m_Page_054.txt 33fe05a881462507038291e61c575f69 66efa1dc15d6898680dcecd41893e99911154bc5 9168 F20101106_AABEWT bewernitz_m_Page_147thm.jpg 0659aa7dcf037dde519c6ed83c0c7b4c b96e653ab6906c47760c9fb5874b0df5fd19e455 38410 F20101106_AABCPW bewernitz_m_Page_231.QC.jpg a5bb16c109d7cb9142a748616ee06ade f01e7c06d30dacf7fd59578d4d442e074ed25715 129281 F20101106_AABDMP bewernitz_m_Page_235.jpg 41248c6e0f715a4d1ff6e22f8064d786 a872914389ce9d49bb228fe8684a1c9992111c18 1284 F20101106_AABEJJ bewernitz_m_Page_055.txt db5655d0173ebe8d06902bcd8a7c62a2 58a15f35507b125e92a19788f640a4fe95039a80 33514 F20101106_AABEWU bewernitz_m_Page_148.QC.jpg c764abb7030e3565825b90e959e7f152 ef18a5815b4672e6e7629290ff8db4500f6aa776 F20101106_AABCPX bewernitz_m_Page_021.tif 10ebe09c47789d34832dc181780c675a e8b603106e743db673b44e878c38eb226d57de24 113989 F20101106_AABDMQ bewernitz_m_Page_237.jpg 6308c13cbb70ebdff057de8847d69547 d45b51e6f18abb2755942a9efa4de9e404eba5ca 1890 F20101106_AABEJK bewernitz_m_Page_056.txt 46a1f47a8e6f3bfe0fd9a6842f5048f9 57a68489e527a0a77b989359d392837453e50d4e 8837 F20101106_AABEWV bewernitz_m_Page_148thm.jpg 7adfa23162c24f247b50955cae0442ce 20aba0bcec8add586e18e5d58b99b8fc0638ea8a 135273 F20101106_AABDMR bewernitz_m_Page_238.jpg e3fe8ab2050f7c0dc8d30192b7ec7808 17202f7a8cbb5548a63444949032df7d0b63b186 1635 F20101106_AABEJL bewernitz_m_Page_058.txt 7bfc837c9c82a3682f30b06988e2510f 904f161c872a646404a1fd974cf462549c92829a 36522 F20101106_AABEWW bewernitz_m_Page_149.QC.jpg 4c4d3e634b3d9e64aca43282dc477329 3d52f9ac22c74435e3437d9fddb1bf2578bb0325 F20101106_AABCPY bewernitz_m_Page_246.tif e1b146e2b16943ea8a04312d9d7a646b cff2cf136f80456a94c7f0347fd5b0796237479b 123010 F20101106_AABDMS bewernitz_m_Page_239.jpg 9d6d407bbc3499ab221a82f0cef83d42 73aceec2fb8e6465eee26ecad342c22e36a5c802 1784 F20101106_AABEJM bewernitz_m_Page_059.txt 0ab77c421e926e8cd149f7c647e06d85 c1241e13bb46bac68ba8fc52537d28885f3be675 36024 F20101106_AABEWX bewernitz_m_Page_150.QC.jpg 6504a85481a181ae37726c78bacaba49 6dfd81318bb1a8a739d1b7dfb7b446635629633f 36986 F20101106_AABCPZ bewernitz_m_Page_145.QC.jpg a4c0d297962146860152e82ddbe2a31f a83c10ad5610efd49a00b0e79e1cc09513234ffb 129247 F20101106_AABDMT bewernitz_m_Page_240.jpg 57c1ecec832a4cab1777b0b21524e511 313e36ba430ac9f516939f507d1a87fe35a3579f 1902 F20101106_AABEJN bewernitz_m_Page_061.txt afc7f7200756699205ec042993cd3b7e 9f8027e4ecbd59b6247100f3b641f8ac4b4b572c F20101106_AABEWY bewernitz_m_Page_150thm.jpg 5765aef56762aa8ef6c19e1263fee684 345ecebc374dffd57b024a92c1b74380697c748e 1691 F20101106_AABEJO bewernitz_m_Page_063.txt 44330a591e91d33f387bd01d08cee062 00efbeb13d9435c8e274a86a7dc87cd9e5c092a7 33739 F20101106_AABEWZ bewernitz_m_Page_151.QC.jpg 61268e2414aab6b7d3424575b8df55b7 20c8dd952aba4621f549048c573b355c10697d63 126395 F20101106_AABDMU bewernitz_m_Page_241.jpg c5cb806f620f9d15f2f4f3cb9b18e842 7366e76a5f307a5aace1b14e759aaade1c1a7225 1877 F20101106_AABEJP bewernitz_m_Page_064.txt eeb0f773cc1fe95797e91cf8a7c07070 781bed9de842304c363c5c7411cf3d883dcbb893 134007 F20101106_AABDMV bewernitz_m_Page_242.jpg 25468b01924b893d48977daa3e55fa8f 787b158910519662bc3578528701520f32602d8b 121277 F20101106_AABDMW bewernitz_m_Page_243.jpg 733a96647048fa5752a15af86a0f6ea5 dfc18abe6b65438fc7b0eac476e0fa2125714577 2046 F20101106_AABEJQ bewernitz_m_Page_065.txt 13ec9f1e48c314ea172f3e6eaf99a306 dc90195bba188a3a595ac3585c5710fe9889de50 134707 F20101106_AABDMX bewernitz_m_Page_245.jpg 12e2802208bc8362cac9c98e799f8924 d0ce8b506d54260a37394e77522aaa54962bdaf4 1753 F20101106_AABEJR bewernitz_m_Page_066.txt e4d201ef81eedd575c41033ef4275d21 ef3496633e395ab012b9f2162efe11cd8345ed57 31045 F20101106_AABDMY bewernitz_m_Page_246.jpg 63cde331a1c07707d0ed8290bf15020b d749ef5200aa762d1f79a4021af2a894d6403d31 1697 F20101106_AABEJS bewernitz_m_Page_067.txt cbb580c60618dc29c810fe413174053d 7b92bcac1fae32f95caa864ddcfa7c9ded077b12 86710 F20101106_AABDMZ bewernitz_m_Page_247.jpg bc468fa0b68291b006b8eafefad2053b 85211af9e16f881df0675ba74b27768299cfeafc 2117 F20101106_AABEJT bewernitz_m_Page_069.txt c6c2753b4e0e5a613d66c2d511d28c4d 4e171280b4adc6e7c3614475429b79eefaff9028 F20101106_AABEJU bewernitz_m_Page_070.txt 05a084fd774bbcd114e2996f04740ca4 77d7e0f276aced7c8c8f6ebf447b0fb8b08a05ab 35598 F20101106_AABCVA bewernitz_m_Page_079.QC.jpg 90928c9760c195db950e300bf1fb0829 d99080d47a0eb51d36246a5cf08df69526a15896 1492 F20101106_AABEJV bewernitz_m_Page_071.txt 93a0df974c05be2f85527845ba334c80 e4a9a1e58ae0d888e7cfb5fba5143108a435216a 32028 F20101106_AABCVB bewernitz_m_Page_049.QC.jpg a2c256fb8cf3f34d9228804b480fb102 55db19aaae5292ec2beccb296d5662bdc43368da 1960 F20101106_AABEJW bewernitz_m_Page_072.txt cc1c9e7845ba679821f96e68ebe15e23 0b43539ffcdf1964572c45bf8184b68516cdc45b 1051985 F20101106_AABCVC bewernitz_m_Page_236.jp2 8cea97321fb1315218d6065b92181d7a f000f3eb43415e5984c54c6c6011473c5582a935 1761 F20101106_AABEJX bewernitz_m_Page_073.txt 5c7d77de88b082218755f7ebe3540ef9 86a7a420a7bad9399e5a3b041abd24bf7bda397a 55242 F20101106_AABCVD bewernitz_m_Page_221.pro 3b0a875f730a0ef5984d6c4f40fb917e a83cd794272735cccb39ce4f477f593e51ae34b2 2182 F20101106_AABEJY bewernitz_m_Page_077.txt 47f630421a3d7c8c7a1286e6d3817768 71e73706a3ae816ea6308dde32e18a40101ad36c 72159 F20101106_AABCVE bewernitz_m_Page_136.jpg 51231e3b52367708f401228482e58bc1 7dc216c9b514b9f36f5448c1f3bdf7a02429244c 2392 F20101106_AABEJZ bewernitz_m_Page_078.txt 054ef017dae1371f4e77fbf3ab4af791 9a8a879ac99c6039cad327ff5490c65ba051f160 5745 F20101106_AABCVF bewernitz_m_Page_002.jp2 0fe118c2f7d5af2ce8cbb9f4fcc9f009 9e19f78941f4ca04c4e9aa4ee4e9aa607056885d F20101106_AABCVG bewernitz_m_Page_230.tif 2d1f9d09af87280691ed40a297e13039 77eaa09e2a94e3557a19aabbbf7099b55c5c38cc 5890 F20101106_AABCVH bewernitz_m_Page_063thm.jpg c5a65396a6311e260dc250a4fb93fbe3 aa02f795edf677a7727e41bb019286414e863e1a 1051953 F20101106_AABDSA bewernitz_m_Page_177.jp2 5fd736ffeb410f8bd3801a66c1850d5c 56bff28aef34fe2c1a3b38a8d657186eed5e779c 130738 F20101106_AABCVI bewernitz_m_Page_244.jpg 028ebd20bf65bb1a356e4853e7c98c4a 2de40fb27ad9c721e7a05ab9859d61e66e15eea9 777185 F20101106_AABDSB bewernitz_m_Page_178.jp2 1d2674e0915f05ed0b0e5a9dca419930 e1e5da5ad78577ba2ffac0d296471c6a4860077a 16262 F20101106_AABCVJ bewernitz_m_Page_184.pro a93b55f3f37953f38b02a296aa2e3dea 8184eef5931f8196953feb2d7bc5c9835e7642f6 1051967 F20101106_AABDSC bewernitz_m_Page_179.jp2 6121ab08a8c0dbd48c59fd3e156503b7 3d0d16bccaa6fa4b0738fd73e67095a90b37ca20 102607 F20101106_AABCVK bewernitz_m_Page_048.jpg 624c2db1583a86c491ec101f243e1616 a3f1d1bc38d31ab6e218daab41370704adecff32 1051966 F20101106_AABDSD bewernitz_m_Page_181.jp2 0631b955581d06eb9215a54bf3a9f7a3 842af8a5d8795a8787292f2e53ccad51b6d3e476 F20101106_AABCVL bewernitz_m_Page_115.tif 84a78f8d7b9f78d965c3b9648caf7f3e a14e221d40572dfa3dfd220da33b0bc344347686 1051957 F20101106_AABDSE bewernitz_m_Page_184.jp2 91a10e09d0adb2902a6883adf8361ecf 42c97ae61588ed85e1d1ac381b9e2f9ce06a47fb 52502 F20101106_AABCVM bewernitz_m_Page_156.pro 8730bb1fa51b879d3e6d4e3058dd2468 5d55c1982346d0dcd00c81cb7f4fdf94fc5d30a9 1051822 F20101106_AABDSF bewernitz_m_Page_186.jp2 1f308a8f50b7e7c40b63b286bd241d53 8d4b261cf8804079eca7f25e1280d9e7c1bf7025 F20101106_AABCVN bewernitz_m_Page_192.tif 1e9098ab64dfe18009ddf1879edbbdac de66125b27dc5e06d3dec470a10e6d100c464ee7 116699 F20101106_AABDSG bewernitz_m_Page_187.jp2 213d5a3ab55e1e757e1ccfb5bdd34ccc 7bb1c0ac1627b755e441d607223e6718c20a8689 35706 F20101106_AABCVO bewernitz_m_Page_227.QC.jpg c82e0037ad191a93caaca06fb64547b2 77ed6ac218729db6ca2f8436434c259ce53644e7 797964 F20101106_AABDSH bewernitz_m_Page_188.jp2 a0d94a4becadd3d2bb9b7d2ab3cc8df0 cd67576b47c8d972168ea03f65d692f8850ee78f 8425 F20101106_AABEPA bewernitz_m_Page_001.QC.jpg fdec52935f7c69e26490d0915704cb0e 138d2b021a24233f3ee6d5e446c7ec47474f7fc0 33636 F20101106_AABCVP bewernitz_m_Page_036.QC.jpg ada4e3ab9d666be676ff6ab7c62d2339 f416dd482c154c428934148f8a66f39201e924a5 111290 F20101106_AABDSI bewernitz_m_Page_189.jp2 4c16dbaa685a13db90ed2448eb0bafa1 63d9218242ec11368ff5853d9adeb008b14d0c37 1229 F20101106_AABEPB bewernitz_m_Page_002.QC.jpg 41c1885e1dd9c3bf19926fde9f9ed6a8 94a886c2d10645cbf23982d74c12e3be8fb725e8 F20101106_AABCVQ bewernitz_m_Page_084.tif 99985993ebb726bb191d8514e9773f25 e9c57b5c8f46860dafee14e30fe425243b4f5925 117747 F20101106_AABDSJ bewernitz_m_Page_191.jp2 c1a7dbb45ca9a8eb4a90a77786c4eddc de5335768dd8fad1e4a72fdd53a9192d3bfc30d4 534 F20101106_AABEPC bewernitz_m_Page_002thm.jpg 26e920b7dd2aec2737929d9123417894 d24771382058676d5c63314d30dfaf8e6df4075a 49935 F20101106_AABCVR bewernitz_m_Page_052.pro dd80a3250e183192b17530f0b6e69fca 37ddf8dee1ebe492cf4f72ad4e5d92418d8d5429 514522 F20101106_AABDSK bewernitz_m_Page_192.jp2 b8b76d3563e5dc5572de285197aed9ea 43979295b900c0ae8bbf045e38d3c70d774bbc63 2776 F20101106_AABEPD bewernitz_m_Page_003.QC.jpg b96cda307ad8ffd91d4425ab65223eb6 6d2098bb3918488fcbc4b97ca13c0e285d013fc6 2147 F20101106_AABDFA bewernitz_m_Page_084.txt 5675d4ded65defe941d0cdaa93fbc894 c0e10734e1d4d11a71b82efb15140f4671ae9b93 F20101106_AABCVS bewernitz_m_Page_180.jp2 4876f5b8c53e692034de88b67ad33302 4e75ff9c3cd89519894aa4d6ae3700c3d072c180 31997 F20101106_AABDSL bewernitz_m_Page_193.jp2 a5550eaa724765e1b9b6f68b11e920dc 116d26807141eed59d5911d2d7bf6295897d3af9 1015 F20101106_AABEPE bewernitz_m_Page_003thm.jpg c640278535462624d6311440e7664a44 098bf7ac03756ede8802bc0befe37d3b6cd8b093 6129 F20101106_AABDFB bewernitz_m_Page_073thm.jpg c9e841b30b74bc2d14738db3aeb8ac6f 6bc09f29847c96e6e00dff5cb8734158562ba457 373 F20101106_AABCVT bewernitz_m_Page_195.txt 7325e8430de5ae7193a5bed0a5c75e30 593f6fafd2a9dcbb954815fd70102d67e168b5a4 115029 F20101106_AABDSM bewernitz_m_Page_194.jp2 c2313c495eda9f2593b431a4363e7d40 a1ba686326fc997af6ce2b0f135d780adb1a674f 34883 F20101106_AABEPF bewernitz_m_Page_004.QC.jpg 134454f715b5c90960590fdad9bea651 c64ce6705355a8341c21d3c8b92a61f4e6c52fff 108865 F20101106_AABDFC bewernitz_m_Page_057.jp2 110ce525f6c877263585131221918863 1ac9606d25cd2ffc956eefa915a7cda3729ac290 139328 F20101106_AABCVU bewernitz_m_Page_245.jp2 0d005cbed0ab047f301a898917ddc9a1 16d062f5e458d9cd22c52a23f137c619e7069fda 552609 F20101106_AABDSN bewernitz_m_Page_195.jp2 386365e6c531ea2aef7e5f00321b8871 bf03626db6f20fb5ffa3400b2b7175d6375e511d 33670 F20101106_AABEPG bewernitz_m_Page_005.QC.jpg 86f984786336fecc9861b6b4f97a2650 b324425f01150e8712b898d723a9c50fef4f85be 108447 F20101106_AABDFD bewernitz_m_Page_164.jpg 87a30a6150ce71b276edcb377ab81a81 39112f42833ad8c5217603c9c33a2795b1f244f5 1540 F20101106_AABCVV bewernitz_m_Page_019.txt f937d843b18974f0a5c1e9d5fed8f487 bbbf5d3fa9ae04fce41134a9d24012bbc5ad1be4 598403 F20101106_AABDSO bewernitz_m_Page_196.jp2 5a7007a19735cc971461f9d2756636f4 bfbbdf8bae9b120a26dde60483c1cc89e4c012af 8593 F20101106_AABEPH bewernitz_m_Page_005thm.jpg 9d7f9449a45d852f551ec4f359581fdf 4d8ee532f61ee421df4c28c652defaf3015c2681 580 F20101106_AABDFE bewernitz_m_Page_179.txt 9b761b2cc6d192467c88e3a3afe76b3c b9c0d00994dbd93b667d3f0065c1ad66f92f4942 51984 F20101106_AABCVW bewernitz_m_Page_081.pro 7b4bc36ef40814a271133a5f9a49d673 25f500779d269c2325c332471355df26a11e540a 275876 F20101106_AABDSP bewernitz_m_Page_198.jp2 59360157700247dad2f67c6344d47aee bd134ad30c68eee325a6219ddf511043ade85626 19874 F20101106_AABEPI bewernitz_m_Page_006.QC.jpg 839f29dbe3eb5584addc4a6fda6ff55e 4ffa455f1644faef7382b6c0ab84058de3ddb9ed 35649 F20101106_AABDFF bewernitz_m_Page_009.QC.jpg 32595952fde2f12f6db35ffe936cbd39 c9db11138e3a40a099a39b74d6b3077e01a9416d F20101106_AABCVX bewernitz_m_Page_185.jp2 edb53f6b6bbbe21a52495de173febe93 b8392b08522c9027cd61264543dd200435e0032a 111434 F20101106_AABDSQ bewernitz_m_Page_199.jp2 7bb3862c102ebbcac0ee8ccac6f4dfdb 56df779969aeb78014c4bf5b7390babd58d52e51 4900 F20101106_AABEPJ bewernitz_m_Page_006thm.jpg 16fc6616ec95f9ef013a8ba01d8dc29c c374b15ab57cdfe64f2ac322ac8a63d940aa8fca 34957 F20101106_AABDFG bewernitz_m_Page_057.QC.jpg 064b569cd2b10e57ad9954d664419951 283904784401056dbd65db82a406be51b1010de4 F20101106_AABCVY bewernitz_m_Page_231thm.jpg 34164721edfc9fd6166fd5929257d953 715abf60306c60272ffb3bfb0011d9279fffefb2 108285 F20101106_AABDSR bewernitz_m_Page_202.jp2 ceb1d84d49084f7a38ab64f0bd358036 6d26748bd44dc9a9827df99480dc535bf85fae21 27633 F20101106_AABEPK bewernitz_m_Page_007.QC.jpg 2bfe913832278bdb99bbfaba7994903b 7a497bd8281c8cac1b33fddad4adb1b48dea689e 7488 F20101106_AABDFH bewernitz_m_Page_132thm.jpg b94c85abae93f8a70e3dcbc0f3366aee ad9cef664e981f4c3eee6c4d35c8ec8f0f963f88 F20101106_AABCVZ bewernitz_m_Page_229.tif 76edbe9690d9112fcad3148e3d38bf1c 976bfa9a8b97333f4213974a81767c20e33eabf4 54886 F20101106_AABECA bewernitz_m_Page_053.pro b1770836480792d69293fc53a32bb04e 4e2f81649d2c9727540dd2200502ebb48ac4a7d4 87764 F20101106_AABDSS bewernitz_m_Page_203.jp2 0e5421f84cb499f446a32d31c1a5532d 431cab8e86f32b223156e14774efbf97a6404669 6688 F20101106_AABEPL bewernitz_m_Page_007thm.jpg 0dc60165c2f1354f686950bae9b0cbcb 1f05880710f35e2cb8e25ff6c1826f721fdc069c 111527 F20101106_AABDFI bewernitz_m_Page_110.jpg d23aff41a47245a299f2879033d63960 511fe6695d241f6056955c8f64323b6fa74f5c19 23637 F20101106_AABECB bewernitz_m_Page_055.pro 6e10868d495c3edeaf6edcad0b622667 bb90371c564ccc9557725d648ff62bbc674bc4c2 107443 F20101106_AABDST bewernitz_m_Page_205.jp2 036ccf1c9da9a5f9eeb8261c1bef88a2 7a7919854e7cfe45fe8520540b26efa3ba064b20 31213 F20101106_AABEPM bewernitz_m_Page_008.QC.jpg 8e91977f5988ca62ac785cf2371c4c3b bfbe943f7197aba042460c0b986cb747e63b71f8 1051982 F20101106_AABDFJ bewernitz_m_Page_173.jp2 0845ef1ada5123f71713cfa72afd4486 781a35b0bb09eb766341d300b30aea613e84f239 44810 F20101106_AABECC bewernitz_m_Page_056.pro dfffb2db1d42a08ad8a9f471f1f58a68 daa6a1679c2972b2d2895cfd6213ccc373d0740c 81978 F20101106_AABDSU bewernitz_m_Page_209.jp2 f1a16272c6061799afabd6066680bea4 3276683c05231c24e09ea97dbe9b464d92031ccc 7143 F20101106_AABEPN bewernitz_m_Page_008thm.jpg 05b47f943d73810898f186c93c75192d 094426f53d37635761ac18b52e831eebad0b3315 60268 F20101106_AABDFK bewernitz_m_Page_239.pro 6b5c475635b75faf95c8a19cf1d4290f cce965406206ace9deecfd8f7a13d7e38a7abac5 38253 F20101106_AABECD bewernitz_m_Page_058.pro b4c31717af3d076b43235a9772be7973 927e27ba4c09f9bbf8b3cde2789fd6b8886c83ac F20101106_AABDSV bewernitz_m_Page_210.jp2 0d6ffeb5472cd16a98b6b2fd4f7da715 c3d8c54a0adaad4307ae7eff616f70e82482d111 8299 F20101106_AABEPO bewernitz_m_Page_009thm.jpg 030801ea2d2a870d572e1e115afe6d9a bca447fdce2ce52cf9fa252a92224a35fe592074 7984 F20101106_AABDFL bewernitz_m_Page_018thm.jpg 0b91d04df4925f51ed03e059ef6a174e 7b7edf3585b12c95fc0735f3cac708ec9fbd27d5 42492 F20101106_AABECE bewernitz_m_Page_059.pro 2496fa0b0a62a9bacb66c20f151ee50a aa2990071e76b979f320a2445fc509df9dd949ff 1051965 F20101106_AABDSW bewernitz_m_Page_211.jp2 f6437957f28d38fcb8c4697c155b564d f2cf29507bf926734ca24e20366b1763c44a195c 31306 F20101106_AABEPP bewernitz_m_Page_010.QC.jpg 1ad2eeb7b1ce9e7c18efd4b7cfc074c4 82e9cef08e07e975379287b92336a4c51af5098b F20101106_AABDFM bewernitz_m_Page_171.tif 5b1b37672851f65681eb8b2509bafe04 7755e195072ddd02ea3c4a9d10fe1e5c78de405d 38725 F20101106_AABECF bewernitz_m_Page_060.pro 312cea421421c9dc50d93f4590b65377 a0c3bc2c97152a019c41724d7825a001a1b4971e 55263 F20101106_AABDSX bewernitz_m_Page_213.jp2 1f2e83f7cd5cd0f0439338a1cad62707 9edae37c5dbec81c2892c9fc87d81555c5496991 7327 F20101106_AABEPQ bewernitz_m_Page_010thm.jpg 372fa2fd6dc65f68740050421e5b60af ac66927b822f2426a07eb55581ab26c5103c10d9 46995 F20101106_AABECG bewernitz_m_Page_061.pro b36cbc5059facbc46dde2ea63dac556d 7ef84ae00907e10e44b8cc1ed66c54054fb7cd9a 660457 F20101106_AABDSY bewernitz_m_Page_214.jp2 eb0824e3ceb721408919e6b612bf152f 45ca2a356bc204eeda53a0c7907603698d9e2158 37360 F20101106_AABEPR bewernitz_m_Page_011.QC.jpg 58bd415344a689a43c7dff81f510b3e0 494d17c09c9928899d02af63f275a40bda109282 372211 F20101106_AABDFN UFE0022059_00001.xml FULL 36e658371d6b49c8fe4622f210501943 fadc66eadfd7ea0979a154fa2b183b846711b165 42219 F20101106_AABECH bewernitz_m_Page_062.pro 8faa64b4442bdf58a8310767706d12d3 2ff9bbc10176b3fc045e90b6c2298bfe4a48adad 661914 F20101106_AABDSZ bewernitz_m_Page_215.jp2 c48cd6216a2c93af171ae5a6fd6b597b 9602d949324d2dd922577a4c98c70a3351ab8cdc 8704 F20101106_AABEPS bewernitz_m_Page_011thm.jpg 87baef9d5b962b8008249d00903fc09f 6251c23cc7abdd0a709a52545c2be4be62824349 44697 F20101106_AABECI bewernitz_m_Page_064.pro 09401f07f041b7f2152dccead9f3c7e6 c4a8ab85567cc4f9819eaa738b68cfcfc66c4762 9653 F20101106_AABEPT bewernitz_m_Page_012thm.jpg 35e5420d5ab5b9f4d9e64a200e718be3 a882fea15d9fa2a5ed5aee0f8f351fa2eb810032 43952 F20101106_AABEPU bewernitz_m_Page_013.QC.jpg 0517e1fef92dbbc281ca77ea0df6251f 421b474bf8e64a796bb221453349b0d0a6ba0451 27082 F20101106_AABDFQ bewernitz_m_Page_001.jpg deb363d560d96566c7f7fc88a84501d2 d9f287316a6aedaa4043f7c7105d1306b36e4604 51044 F20101106_AABECJ bewernitz_m_Page_065.pro f19b9dcf566c2b2982326378eb4fde4e 8889305feee667dd3c77f1fd0d014e8502e04f1e 10035 F20101106_AABEPV bewernitz_m_Page_013thm.jpg 3a515b6284a83c5f4d4cff219b9ab2ca 828c80fddc69a93c729a78c452ffc2b4665aa934 4022 F20101106_AABDFR bewernitz_m_Page_002.jpg cdbdaca77dab8bb75296cc8f8193a31a 9d6aa1078627a6a2f6392c1c57b4253c84b6a3e9 39806 F20101106_AABECK bewernitz_m_Page_066.pro e886380f9ed8bdc2e322a19a604ee853 7f9af0ff997ac05ca4c76176afa267390fd5dd0b 8798 F20101106_AABDFS bewernitz_m_Page_003.jpg 813ababaf5df703e40fc625ca0bb1c25 f99b5726331f57980aa9158b6ae1b2c65af7bbb3 36377 F20101106_AABECL bewernitz_m_Page_067.pro db7ce8a5f29d5a44220e9551f7eca2d0 7e0e9cbb34472214163501d3f2a163262cd4dfa7 10150 F20101106_AABEPW bewernitz_m_Page_014thm.jpg 87415143826b1fb79aaaa71b1bcfb24b 783bac7a2cef85d24a72c358dc0faca0b8028d78 107876 F20101106_AABDFT bewernitz_m_Page_004.jpg 0abb76f9f10db37530412296582be587 6a99b0058e82ffabb733638f459007a4b5fe420f 43932 F20101106_AABECM bewernitz_m_Page_068.pro 14dde76a775d9dfab66e8453f75caa0f 0b1ae63679ba7edce81ae9c3eccd4ac74a78fa29 42580 F20101106_AABEPX bewernitz_m_Page_015.QC.jpg 218bd5c995cc7937146e3753fb1d6c22 d8ac48fcbe81833f42ddef75d9358e71f4c41865 103948 F20101106_AABDFU bewernitz_m_Page_005.jpg 6ec68f810a65c04892e41dec2f070280 0ac14c0b132d56d3b39a961c360b72575e99f5e5 53747 F20101106_AABECN bewernitz_m_Page_069.pro 9cba9e32bd3739d09146bc8dea4595d0 ad961a3ae0884e5151f2261d0569f13c7f667950 30786 F20101106_AABEPY bewernitz_m_Page_016.QC.jpg 2dd7d940c2bbe82c41640f742aba46c0 3572c190a63662d22aca67cde0515236097564a5 61208 F20101106_AABDFV bewernitz_m_Page_006.jpg b8b9b9f8624f8bef70ca8dfde0ce4259 cf85b85376d008caa8c362b4e97f6fb733b61225 53961 F20101106_AABECO bewernitz_m_Page_070.pro f05d429d1d95a3677c3ac43700712949 dfcbbe56669f5a50a92ce10605c7b8d788cc10b1 7483 F20101106_AABEPZ bewernitz_m_Page_016thm.jpg e48296673e8fdbe3e7a0a2d9465cfa0c 780999d5ab26cfd2c8d3c7a6035c1f3fee2bbf08 127327 F20101106_AABDFW bewernitz_m_Page_007.jpg 3c40acfc76477eed2a33ba3eaef25005 670544f292e643d321be5d8341f0c290bda3aebc 34478 F20101106_AABECP bewernitz_m_Page_071.pro f3ee902b8e1ee6983364fde78afc2cf7 3bf5deaed2003e8a1beaaf4d0b56fd2000a5ac50 161359 F20101106_AABDFX bewernitz_m_Page_009.jpg 3a7e5dc1013c0873f7d0101bfd627569 99bcecb936c01abf64a90c60ac8631c7039404cd F20101106_AABDYA bewernitz_m_Page_155.tif 19fe725b2a0f9479213ea3282e049bb4 9b3588f2830e0bc12c564b0fdfd3da2e5282a96f 49420 F20101106_AABECQ bewernitz_m_Page_072.pro 4e1cee1678e579005a83c9024fe676c4 b57b8b2884cfacd63e3fe6625ba80b25b756e75f 141496 F20101106_AABDFY bewernitz_m_Page_011.jpg 146761e194e94142a395ce13775c4296 ac59bbd465dbb3808b17b36ffd3c5cb32d676013 F20101106_AABDYB bewernitz_m_Page_156.tif aa0252750606f49e0e475caaa38a3cfb 1baf5579b2655d8a45d5cdda5a624eda326a9f77 37108 F20101106_AABECR bewernitz_m_Page_073.pro 2b78c9c26dcbe732eb2eda0efaa7d1b9 ed4ab8c70f32d7cadf4d700dd223338e7a3857b7 145819 F20101106_AABDFZ bewernitz_m_Page_012.jpg fe542887aa6eb7592dbc1c4f11cceefc d6ef0b0169a9a2d6b7939da294b9e4a0b2185467 F20101106_AABDYC bewernitz_m_Page_157.tif 423a5073598e87005d47af06f72dce1d a1b924a86385665e6325143a5cac0b45d689e3bb 35926 F20101106_AABECS bewernitz_m_Page_074.pro 3122ef93ee150615a021b0dd5b82184c 03edcdfae43b959b418a47ac81a96045aa269d45 F20101106_AABDYD bewernitz_m_Page_158.tif 703f23e3dd7888490dc005e10c09aaa0 9c23e98dd46bfeceee1abd6961f3601d43619ae5 50317 F20101106_AABECT bewernitz_m_Page_075.pro cc3349e42db28c6823d0824b9885262d a19e12d46a2b32060dcdd4b142111dfd1652aaa1 F20101106_AABDYE bewernitz_m_Page_159.tif a95337c50c8b89e5e17184eab903665e c02e285a93102bf872b65cb8812dd0079c799856 55500 F20101106_AABECU bewernitz_m_Page_077.pro 546f484abaa7486615e29900e4007154 1fb947f1920a0e537d2d5aa5b3f5952a5479c787 8629 F20101106_AABCOA bewernitz_m_Page_117thm.jpg 9b04058e209a9b734859d6172ff69a26 de78f9503eb2b805c2b725f9f11b127f8e199b3a F20101106_AABDYF bewernitz_m_Page_160.tif 8843d7f1adbc7b6fc114d78fb81f66ee 7c0c1302f2ed107b286c84cd7f8ee75c4d9c2359 55870 F20101106_AABECV bewernitz_m_Page_078.pro e277ffc23f208fd689f33889021d2ee3 d5165f2761e6c2d0e22a4bdb32d20d05c6161d5f 106301 F20101106_AABCOB bewernitz_m_Page_194.jpg 5a47694e4a85c7ef56d851debbf24470 b63f0ff9b2ea80533104c353ae5c1dd1d8adf156 F20101106_AABDYG bewernitz_m_Page_161.tif 1481648461d3d4593689bbdec517e43e 55b4b499c04e4ae878ff67ff0e88f061ca50f16e 60316 F20101106_AABECW bewernitz_m_Page_079.pro aa8dd9c349eb3f3d050bb29d0e820e77 a13bf51119a0297bbe9e785332adf0666060efa7 2254 F20101106_AABCOC bewernitz_m_Page_218.txt 45399bab52ed1eb976041e98e5b6615b 8fd59169367abaa9338717cb0c0133a51e633d51 F20101106_AABDYH bewernitz_m_Page_163.tif cd7c58a5677a7c0a72c1d03c150e5d8b 6eb585e7f1f78446c5bfdf4aa93e91a1c343016a 56659 F20101106_AABECX bewernitz_m_Page_080.pro 4714dc0f2d0f9ad704c433cc07c15f1c 61c5bb5150eedab2136792c1a57992cc81263a0a 36646 F20101106_AABEVA bewernitz_m_Page_115.QC.jpg c12b7e8cca830b85185ff9ac1058f61d 2419a5a6cc28882acd2138830d40445290455e98 F20101106_AABCOD bewernitz_m_Page_211.tif 6414ce2f1aee0f2abed117b7fceff004 33c068babea6a090af267af9f621c603d7b5bea4 F20101106_AABDYI bewernitz_m_Page_164.tif db1e4f10f867950fb54c6201eda49b8e e27e7a58f0218e04394cd6a115082f8255b6edb9 46894 F20101106_AABECY bewernitz_m_Page_083.pro 6fd93cefb74c854dc42f450b98e42fa6 46f2e6d3bbbed8e0f7ccb18b4e05599b502a0404 8577 F20101106_AABEVB bewernitz_m_Page_115thm.jpg ce789592bcde61c4fea4e14fcde24a66 0f5aba667d883a3d3f009ab2ee53db17f8796a49 F20101106_AABCOE bewernitz_m_Page_011.jp2 8920bd01a6e2289bed1556e62db1e087 79bf2001cf2a3c45b8898eae6c8ab22866a25faf F20101106_AABDYJ bewernitz_m_Page_167.tif c0c118c87cbdea0c24c28b6412c8733e 0f1e94781484ed8897f1e8e90cc9cc92c079cf52 54553 F20101106_AABECZ bewernitz_m_Page_084.pro 43f714d4e6100346c677e13d476e378f f846b9806db43492ac235b44e4e8519a080ce637 36782 F20101106_AABEVC bewernitz_m_Page_116.QC.jpg 5a388f5b852634e49cecf3bc26338ed9 0944a1ae5231527d2cfed513ea028b7794bfc89a 9129 F20101106_AABCOF bewernitz_m_Page_244thm.jpg ebc4cef47e1bdd98d7339a0372b57b26 19bd445fbde930e72a3278fe1d40f67dba817b24 F20101106_AABDYK bewernitz_m_Page_168.tif 737d722d47c08176a993bb8251a8d96c b8c6dc032c12fffc7e854f5dd0d354821767ae6c 9023 F20101106_AABEVD bewernitz_m_Page_116thm.jpg b21c453907a6c316ccf4a9177fb559f4 3ebfa18d45548e7e9064d88fb5ffcff0bb88af9f 8476 F20101106_AABCOG bewernitz_m_Page_154thm.jpg 918d2addbef4407e1fd293b08ee0cdcc 8ea0e9c1dad5b9e07094400ba5a95aa15a5cd163 95446 F20101106_AABDLA bewernitz_m_Page_186.jpg b31052f514f6401638500d278431304f fa6b0beb61278c0fd4ef972aa0fc72bc19963171 F20101106_AABDYL bewernitz_m_Page_169.tif 77ef2983c9c6a43edcca430312840a7b 5689300f205453119c9d0fa7030dae08bad77b2d 34947 F20101106_AABEVE bewernitz_m_Page_117.QC.jpg 07e92cc6ee0de032fd65ca036e6657e1 7cb45d67671116adb08040ab935db8cc1605efb3 37380 F20101106_AABCOH bewernitz_m_Page_147.QC.jpg cc63ba269c5878331a649d7cf251b30d 099bf3b1439b6048dd4ceac6a84f62a728991941 108659 F20101106_AABDLB bewernitz_m_Page_187.jpg a5cca8fb4db775306032c60d108d0ee6 74aaa3ea853a6db06b7811425f5e1d4db9e72f37 F20101106_AABDYM bewernitz_m_Page_170.tif 5b7d83b3e7aadffd41a6c9fbca29b352 5a9912f756eeb685ef5f84fd888cc33562a23653 33993 F20101106_AABEVF bewernitz_m_Page_118.QC.jpg 236c9e3245cb43059d160dc82a550dbf 50eda7902fc93f4dd668f0486d18616871cbe32f 2037 F20101106_AABCOI bewernitz_m_Page_075.txt 96ba942e8dd58346018a7fe437b875a3 14bf0254a82de382ec35c909d82e067ea905031a 75087 F20101106_AABDLC bewernitz_m_Page_188.jpg cce45e23a45fa3d945a56749d729916d 52de82e4c50d3bb44f57e0185c3459e0633a527d F20101106_AABDYN bewernitz_m_Page_172.tif 7473d8ef5b4fdac924a76a2eb4b414aa 813b8f2159cf9ce9debfa066a99c820d913bdf35 34429 F20101106_AABEVG bewernitz_m_Page_119.QC.jpg 1f3449ddc00be89b52aaee2b3a7887b3 c3b7e304bf19b0b1e22f4669284b9702aff24042 112946 F20101106_AABCOJ bewernitz_m_Page_143.jpg f07ce47d4c53fd4d185b6434b56613cd 09c41f06ecdbf84c4f4b2fc131c27cfc7c682452 109279 F20101106_AABDLD bewernitz_m_Page_189.jpg 608cdb3867949a1cd84a610d4347e208 fb77d193aefec6af323d3ac58476ccc093705382 F20101106_AABDYO bewernitz_m_Page_173.tif 88f1d996b5db996b9b82f84e1ed45ab6 26b456e65a9ec295e517561dfb4be7e7aba100f7 8747 F20101106_AABEVH bewernitz_m_Page_119thm.jpg 71ba20b7f314128301f476fa33e024e0 ca8b0720cfe0c5eb5d6c1def2a87daf9302946de 36105 F20101106_AABCOK bewernitz_m_Page_217.QC.jpg 48ff97d6aa7a499f56055c008104f5aa 1809cbd9c6a046d59c1b21745948cf05c5a3d1b1 F20101106_AABDYP bewernitz_m_Page_175.tif a27e664ab25864083acb42880b13f100 24ddf99df66e6c69f15e9920cbb653e9e7db8d55 8566 F20101106_AABEVI bewernitz_m_Page_120thm.jpg e6a843431d6bcd3522b7cc4fb09b2e1d c9c4105178394c07d19df2d3da37d2ad1d6538c6 85080 F20101106_AABCOL bewernitz_m_Page_062.jpg d1260016fec80ede6ccbd6ce74b8bd18 31fc3d8501f44f79be6bbd4d369437a0e8f586fa 70692 F20101106_AABDLE bewernitz_m_Page_190.jpg adec1a1da8856b2ce93f03d3f8b43f7e bcf43f59d13dcfe99b8afc003ad53ecac7b53795 F20101106_AABDYQ bewernitz_m_Page_176.tif ab397bf874b69919318749e511653a29 df884a7267c004a3aa4a0f227b3c647b2872f236 32258 F20101106_AABEVJ bewernitz_m_Page_121.QC.jpg cd1bafbb655c7f0dcba9258d88b7a35a 1cf4257c4059a33cbec11378fb3f6c75431291fb 113730 F20101106_AABCOM bewernitz_m_Page_163.jp2 42962476078da604fb11d6a3e4512132 eb377b92c60214ba85bfb05dfb78e6623f697f24 108258 F20101106_AABDLF bewernitz_m_Page_191.jpg 02769733f0a3f00e796d33a4327c3f55 398334d34e9376fcf84420b53cb42f2fda365022 F20101106_AABDYR bewernitz_m_Page_177.tif 935ca45edc643a5599df1c6f9dd536a6 906a6eabe615a60124ac8ef5838c675b0f512195 7951 F20101106_AABEVK bewernitz_m_Page_121thm.jpg f07ce0cbcd33aef318581a8f1b0167a7 80f2925aeea0aafdacd23791c55d93b149148cd9 9103 F20101106_AABCON bewernitz_m_Page_218thm.jpg 7c55dd71ff0c3503e0442c7b9ee24f1e aa1ae5c238227a913d6124b2d97494b53abff5c0 44925 F20101106_AABDLG bewernitz_m_Page_192.jpg 7b3455e1d0103022b89f98c149e8bea1 239845e2dcadb6a94444c136b734c54d4a632aeb 3883 F20101106_AABEIA bewernitz_m_Page_010.txt 9dab9876e010189a332d1790403129d8 a8f8390740788b01db399e2294ebc501d8d804b4 F20101106_AABDYS bewernitz_m_Page_178.tif ba243da3d16e381b43be74c43d80bc13 b4a949fecb9aac271c3c1b5c51de876912d7dda7 30644 F20101106_AABEVL bewernitz_m_Page_122.QC.jpg b4c4799540c73b0f1c5301c2c3723c19 cbc61b14f6191b05a9c205a05e2a7037e3defb8e 88554 F20101106_AABCOO bewernitz_m_Page_207.jp2 ef8396bf4e5cba7b78b265a56c914061 adcb3bbfc4dbbf18c70268e1cc7b2a4c13d64549 33078 F20101106_AABDLH bewernitz_m_Page_193.jpg 3202fdfdab77b8976a8ac307cecc0f24 05f8cc027799022da564fe7b84c8629763493f6f 2934 F20101106_AABEIB bewernitz_m_Page_011.txt 8c0a5b4982db76b777928a059c70dbbe 20f2c011ef74d167584013e8189aa344a05fd744 F20101106_AABDYT bewernitz_m_Page_179.tif c34f1e00ab3a9cac7ab0d66be473e556 523dd848d315974d01d0e5e437158a500fe08970 7569 F20101106_AABEVM bewernitz_m_Page_122thm.jpg 6f0d92a84c9076a24ebe04d84905ef12 3a8c6ece5dcb948bf84a0f59377915f61855565b 16611 F20101106_AABCOP bewernitz_m_Page_195.QC.jpg 453bb4a8be488400d1cdff654984971f ea6d4dc7805cc17f473d1ea6559156d8d86eb3b7 45358 F20101106_AABDLI bewernitz_m_Page_195.jpg 4ad3f873a6b10492e3ef8bb03823135c f9b6654b3ccf49a07b6950325f9d3ce3c9e41352 3255 F20101106_AABEIC bewernitz_m_Page_012.txt 723bc544746c8002fe4271cfa105c866 cc5befdf8ec5fe4c7123f9aacb70295ec15ab39d F20101106_AABDYU bewernitz_m_Page_181.tif 3b6165f3dc5b8d807e455cc15cc339ce ab345f050ff90bfbe57ddf54ba144bfe4e97cc70 30067 F20101106_AABEVN bewernitz_m_Page_123.QC.jpg 4422fb19939dab2c57e4df7c8679bf7c 3c877a4b8d82564aeaca4f5e249fd313bda938f6 51129 F20101106_AABCOQ bewernitz_m_Page_117.pro fa68318dfc326564e58408b372aa351a af6a94fdf4acc367c59f71ea0f1dc79c677c07e4 60422 F20101106_AABDLJ bewernitz_m_Page_197.jpg d6f62fbe424b782662beb1e23535bfac 8dc95efbc8e44dcd509501c4ed20c5f9832ee355 3547 F20101106_AABEID bewernitz_m_Page_013.txt f149e6249921c2aac2dc94416bdd45bd 7198059b0135ca99fd39a8829ef0260e9a310da2 F20101106_AABDYV bewernitz_m_Page_182.tif 91d171b0eabc0c5b1657082955527283 3deb316bcdbbd21b9e041023b96ad651edb75455 7485 F20101106_AABEVO bewernitz_m_Page_123thm.jpg c793b250e9b649fc7c5465e8f4f5e31d 5e110e7a7815611de8a833d4ddf13c505e59177a F20101106_AABCOR bewernitz_m_Page_016.tif b6617c93d02f18f2556bacc20f638755 e041ced402f9a8b9ed0447231edd60ce40fb1b6a 33300 F20101106_AABDLK bewernitz_m_Page_198.jpg 7c214c2c8e92db1eda1f9a0a48456347 cf7def93baa122521039dc27540cd63e211bac5c 3620 F20101106_AABEIE bewernitz_m_Page_014.txt 8c1ae17f2e5a30e18766ee49693f099c 07a145625d54be40cf7b02b9c599d20f41c15863 F20101106_AABDYW bewernitz_m_Page_183.tif 6b1b910eb04964b85d8305d2483811c8 e7b1336f5c94b5f678cec76da59dd76896196c6a 9071 F20101106_AABEVP bewernitz_m_Page_124thm.jpg 69349a2c7ac68e3b8bcd14479eb83dc2 ded4176cdb556bf19695db5dbb029ad567611462 F20101106_AABCOS bewernitz_m_Page_014.tif 6b2cf36cd96fdf45222d4148b5c43a86 69104b341103c94e75537f14fcc580b388bad36e 103842 F20101106_AABDLL bewernitz_m_Page_199.jpg b8e4a4d7b9ffc1ef1dcb7b8ec2f97560 59e80378d7e5ceb3fc98f426ab262df7cd6fb5e9 2463 F20101106_AABEIF bewernitz_m_Page_016.txt 13031d26be013e52905ba60bc267bef2 a6b13df503673c3172c05cc935cad9685fabd25b F20101106_AABDYX bewernitz_m_Page_184.tif 1ad5e77b184f999c739dbc97d04afc38 3be04a7e924cb09067fa59cfb4ea54adeda5d75f 34196 F20101106_AABEVQ bewernitz_m_Page_125.QC.jpg 8296ee8450f57549b1b9c7107b49a0c9 f237051a397e26ef541e5653bfabf8e42f7df8ab F20101106_AABCOT bewernitz_m_Page_151.txt 2c471400a8a4634deee1da36c82d3ecc 6dd211f712b91d8ba65ed6a71070c3dada78f0ed 76251 F20101106_AABDLM bewernitz_m_Page_200.jpg cef9fd086887079f718c49a48de93f06 08f84e8d3639e9faa091f9d9ca2c06f108941012 978 F20101106_AABEIG bewernitz_m_Page_017.txt 843f568f28cbe799f1b9cce25c3bd53f e996571fbcb1754e37c35a954bd31a07f1ba5277 F20101106_AABDYY bewernitz_m_Page_186.tif ecd4450f2f85e61a66f0cf57ead77747 2ce7c9b05350ea03354f82980e6d9516527227c7 8561 F20101106_AABEVR bewernitz_m_Page_125thm.jpg f02a0eb4dc638dde16571d81cd4083e6 c79795b09d120ff8335841b3de3646f69848d4e2 8420 F20101106_AABCOU bewernitz_m_Page_057thm.jpg d6a99d6adc062cdda93ea22ac16202a0 b02da616b8750aceb3528dc3cfc554d0e5ed2f2f 78243 F20101106_AABDLN bewernitz_m_Page_201.jpg 3810c43297745809526ebbbf3838b7f9 b74cc9c8249b49876405daf1540c041bad3d2fc5 2128 F20101106_AABEIH bewernitz_m_Page_018.txt a7c648f8523b0fb7bd2d004ea3a287be 249f75c4f69138fae41485b8d1fc5d610281867d F20101106_AABDYZ bewernitz_m_Page_187.tif 444e0c2934460a77c69100e023e8e989 4aa629f9aa5b36046bdf1bc1f1e8061d633410ae 34459 F20101106_AABEVS bewernitz_m_Page_126.QC.jpg 8bae7a3fec5ffb5b3abaeeac45983687 21a832b505d525318c7ebc647e19291c56f4bf52 7989 F20101106_AABCOV bewernitz_m_Page_111thm.jpg 706e1240f8ef869eb12191249aa7237f 343c99c74688a4e128bff464e29a55c2fef80024 81499 F20101106_AABDLO bewernitz_m_Page_203.jpg 17a2cbb1dd859be9c360e2fca84f6cf9 1c671e9cb3c5230607f60e5650ea658594baa1d9 2114 F20101106_AABEII bewernitz_m_Page_021.txt 986eaa9930b3195f1d68f2b76c4fd3af ff46c73166a822561f2eaef22b1c288d7d89b7d6 8491 F20101106_AABEVT bewernitz_m_Page_126thm.jpg 9c82fee4ba49aee3ba49c44e164a4b1e 7f1a08e5b6650de362a41d9d7a40693c2961386c 2041 F20101106_AABCOW bewernitz_m_Page_206.txt 7de30748189e14ee15ae3c4e1eddbc00 8187f483d65e3d43b2f76a132a96aa3fa24f0b7f 92592 F20101106_AABDLP bewernitz_m_Page_204.jpg 9d0291babb89fd52b69ddf7ea161fd86 ed75100f91a231ce50c9ce12745f427125ea6c9d 1939 F20101106_AABEIJ bewernitz_m_Page_022.txt b14b956ea63565357214e46b9711bdf6 5dc0abc24b0afa3ea9c9d17a7be2f3685e69061e 34509 F20101106_AABEVU bewernitz_m_Page_127.QC.jpg 7324181fcae53bb629a63827f6bb3d75 29b348fafd1653d4da71ca44b244ebbce4cd20ea 102325 F20101106_AABDLQ bewernitz_m_Page_205.jpg d7d29cbaa4e413905622c6bcc7371b72 1baed0b9a732338ed85e3588c2e5c56cf72ab999 2100 F20101106_AABEIK bewernitz_m_Page_023.txt 07e0997a85340e0c238e6ba034e0bbc7 952ec63e3f1efaf657eaa06054afbeed71d21f6e 8254 F20101106_AABEVV bewernitz_m_Page_127thm.jpg 1f4b2f441cca4d830a5f49a619a49641 da3975025259f2273c1e33aa6a41567b02953a83 41255 F20101106_AABCOX bewernitz_m_Page_135.jpg ca9520aac7510b25183321c7ddbf36fb b1075d1f6d26c5ba48319b1f8fcc3ad4406eb28f 81557 F20101106_AABDLR bewernitz_m_Page_207.jpg f47502b929e28c3be5faf0490132a6c8 d7419b70e7a3a1629d8ebff00d68adcad319999e 2146 F20101106_AABEIL bewernitz_m_Page_024.txt 17ac59f1ecae344de1c2dd3b097dce63 449d91481d770684ab25d4fc3494c0b7f33b51bb 35128 F20101106_AABEVW bewernitz_m_Page_128.QC.jpg 29abb8363e81f1d79f92921331712160 262d9af21d3b4130f69ded0761361f9887720657 2283 F20101106_AABCOY bewernitz_m_Page_246thm.jpg 1a84eb285777809a6a40941303e7c6fe 1459b9f57251d166d038a31560aec401e95e80b4 101812 F20101106_AABDLS bewernitz_m_Page_208.jpg f9b6f81a0a2948b4964944bddd8b57bf ee217ab9aec92474eae0e2d7fac3cac1efea15ec 2152 F20101106_AABEIM bewernitz_m_Page_026.txt f96078b3dc9421132ea4a2f25ab5a7e3 2dd8a7ecfbbbfe92a7a66758b64645e31f4916e1 8864 F20101106_AABEVX bewernitz_m_Page_128thm.jpg 21df13f5d119c9ea38ae14366ba9727a db9f1804fd457f80855fa93fc1d4722f31e2c105 8966 F20101106_AABCOZ bewernitz_m_Page_105thm.jpg e3808b56eb65f2c8f2b6276623231763 e3c4597cbaa199b8b41a3b8b808926f56d1a4d80 2077 F20101106_AABEIN bewernitz_m_Page_027.txt 3439c6e9e1cad795f0092119cb8cddeb 333ebb3dd7bb1c8ff7dd5df83ad178c89a9f75d5 30506 F20101106_AABEVY bewernitz_m_Page_130.QC.jpg 9f309551a64f7e5e872032190d9a6677 2c55eb781b7c9755dc9fa3c23ffd6d1fc33271b3 75882 F20101106_AABDLT bewernitz_m_Page_209.jpg d0c69e5bd18f31549fa78c783a5c434a aa68084bfb40f45513844071769fe6baae4e61c4 2055 F20101106_AABEIO bewernitz_m_Page_028.txt e1c06f043823c7c00985d92415c66439 e75bc91d72db447e256a5e51fc84b3e2f4de8251 7066 F20101106_AABEVZ bewernitz_m_Page_130thm.jpg b49744b5c46fcacd82342e694849f5a0 0c4dadb61d3b6a9b8c414b80a77436fe457756dd 93405 F20101106_AABDLU bewernitz_m_Page_210.jpg 00c4d3546a34c4acf1df219c0ffa015d 2815e5a7c8996f48c1342240dec63fc7dbade266 59095 F20101106_AABDLV bewernitz_m_Page_211.jpg 62623582dd5dad4fb5193f73a716de4e 52311cf990f6b7d869e43d1803bf84a3a043f4c3 2022 F20101106_AABEIP bewernitz_m_Page_030.txt 3bf7bfb4bbccc0152047dbb3a8bd1def 7b91244d0ec4e6d0a009e99b24f9d3ecf6439f5d 77227 F20101106_AABDLW bewernitz_m_Page_212.jpg c92476d6965f76d65b8e7997ceee52e6 1cb23ed6346b6247b40257d251df3cabf57562de 241 F20101106_AABEIQ bewernitz_m_Page_031.txt b051e785e8464a807a33a97442ec7f81 eb2c7dc961564347f52ad02d4429630cc75d48bd 49910 F20101106_AABDLX bewernitz_m_Page_213.jpg b947817b24cc4fda32fae044992cba61 c8517866e2b804a5ebd1c3872c62c7abaf8b89c0 2120 F20101106_AABEIR bewernitz_m_Page_032.txt 4a67354e5bb39abe7b3557b130452abd 6373a6d01ea67e591564101a69a1e751834284be 77773 F20101106_AABDLY bewernitz_m_Page_214.jpg 2f6a01e5a2f5a6c7d6e68cfc8f68be89 3d815ea5a53d3dabca1514833568691774ebc6a0 1934 F20101106_AABEIS bewernitz_m_Page_033.txt 7e111383b52e57c7d841e621c68dbe80 22a90c543814285e5a36bf560367181db88dc579 75005 F20101106_AABDLZ bewernitz_m_Page_215.jpg 63a1cf33a32136fc2314b85bbc9ab1c8 620b4ef4c7d7a 