Operant conditioning of the EEG in two patients with epilepsy: Methodologic and clinical considerations

Methodologic and clinical considerations are discussed in sensorimotor rhythm (SMR) biofeedback research on two dissimilar but severe epileptic males. The first case, an akinetic epileptic who prior to feedback training experienced 80–100 clinical seizures every 10 hours, showed considerable seizure reduction after 6 months of SMR and epileptiform training. A number of methodologic and instrumentation advances were pioneered with the akinetic patient: (1) development of and ultra-sharp band-pass filter; (2) use of epileptiform inhibit and feed-back circuitry; (3) use of monetary rewards as additional incentive; (4) use of correlational analysis for evaluation of acquisition in the major dependent variables and; (5) use of noncontingent feedback and rein-forcement as control techniques. The second case, a psychomotor epileptic, also showed therapeutic benefit from SMR training. Clinical information regarding the effect of anticonvulsant medications on the course and therapeutic outcome of SMR training are described. In conjunction with operant conditioning of 12 Hz activity, corresponding changes for other EEG parameters are examined.     

Short-Term Kinesthetic Training for Sensorimotor Rhythms: Effects in Experts and Amateurs

The authors’ aim was to examine whether short-term kinesthetic training affects the level of sensorimotor rhythm (SMR) in different frequency band: alpha (8–12 Hz), lower beta (12.5–16 Hz) and beta (16.5–20 Hz) during the execution of a motor imagery task of closing and opening the right and the left hand by experts (jugglers, practicing similar exercises on an everyday basis) and amateurs (individuals not practicing any sports). It was found that the performance of short kinesthetic training increases the power of alpha rhythm when executing imagery tasks only in the group of amateurs. Therefore, kinesthetic training may be successfully used as a method increasing the vividness of motor imagery, for example, in tasks involving the control of brain–computer interfaces based on SMR.     

Operant conditioning of epileptic neurons in monkeys and its theoretical application to EEG operant conditioning in humans

This paper reviews a series of previous reports which summarize the physiology of chronic experimental epileptic foci in monkeys. It is shown that such monkeys can be trained to bidirectionally control the firing rates of normal and epileptic neurons which comprise the epileptic focus. As a result of this acquired operant performance, the monkeys show both a decrease in clinical seizures as well as a decrease in single unit epileptic activity. The EEC correlate of this change in single unit epileptic actvity is generalized EEG desynchronization. The conclusion from these data would indicate epileptic neurons can be operantly controlled and this control is not correlated with any specific EEG pattern. This brings to question the specificity of the SMR in EEG biofeedback paradigms which treat human epilepsy. This author feels that the result from such biofeedback studies are the result of the patient learning to manipulate electrical events within the CNS pathways through which the seizure propagates and is not contingent upon specific EEG frequencies.     

Amplitude measures of operant response: Implementation with Apple Pascal

Because operant conditioning studies involving force of response as a dependent variable require high-speed A/D conversion, conventional operant software, which treats the input datum as a dimensionless event, is generally unsuited for this kind of work. The author describes a complete Apple-based hardware-software ensemble that measures and records on diskette the peak force, duration, time integral of force, and interresponse time for individual operant responses. Data acquisition and control programs were written in Apple Pascal linked to selected assembly language modules. The real-time base was derived from an inexpensive crystal clock interfaced     

Stimulus-reinforcer and response-reinforcer relations in the control of conditioned appetitive headpoking (“goal tracking”) in rats

Experiment 1 studied the effect of several Pavlovian appetitive conditioning procedures on rats' headpoking into a food tray (goal tracking). The procedures included forward delay conditioning, CS-alone extinction, differential conditioning, and simultaneous compound conditioned inhibition training. In general, the headpoke behaved in all of these treatments much like a Pavlovian CR; however, one could also say that the headpoke behaved like an adventitiously reinforced operant for which the CS was an S^D. Experiment 2, therefore, used the differential-nondifferential technique (E. Gamzu & D. R. Williams, Science, 1971, 171, 923–925), and Experiment 3 used an omission technique (F. D. Sheffield, in W. F. Prokasy, Ed., Classical conditioning, New York: Appleton-Century-Crofts, 1965; D. R. Williams & H. Williams, Journal of the Experimental Analysis of Behavior, 1969, 12, 511–520), to try to separate the role of stimulus-reinforcer and response-reinforcer relations in controlling the headpoke. These techniques proved inadequate. The results of Experiment 2 could be given either operant or Pavlovian interpretations. Those of Experiment 3 showed that headpoking is dominated by response-reinforcer, rather than by stimulus-reinforcer, relations when the two compete but forced no conclusion about which dominates when the two act together as in acquisition. Implications for pigeon autoshaping are discussed.     

Relationship between automatically analyzed quantitative EEG data and psychological performance parameters in patients with epilepsy

A report is given on results of comprehensive studies in which significant positive correlations between automatically analysed parameters reflecting the frequency behaviour of the EEG background activity and psychometrically recorded relatively complex psychic and psychomotoric tempo performances as well as some partial aspects of the re-adjustment capability in epileptics were found. EEG indicator values could be ascertained which point to psychic performance disturbances in epileptics.     

Water deprivation associated with operant conditioning inhibits hypertensive disease in young spontaneously hypertensive rats

The development of high blood pressure in young spontaneously hypertensive rats (SHR) is inhibited by operant conditioning motivated by chronic water deprivation. The present study showed that the inhibition of hypertension was not due to the operant conditioning,per se, but was a result of chronic water deprivation (23.5 hr schedule) imposed on the rats from five through 12 weeks of age. Blood pressures were measured directly using a carotid artery cannula and light enflurane anesthesia. The behaviorally conditioned SHR and the water-deprived SHR controls had equal blood pressures and were significantly less hypertensive than untreated or enriched environment SHR groups. The antihypertensive action of water deprivation was not detected by weekly indirect blood pressure measurements made in the awake state. Nonetheless, the chronicity of the deprivation-induced inhibition of hypertension was confirmed by a lesser degree of left ventricular hypertrophy in the deprived SHR relative to the nondeprived SHR. Our behavioral results again demonstrated hyperreactivity in the SHR relative to the Wistar Kyoto (WKY). This behavioral hyperreactivity in the SHR may explain the exaggerated increase in drinking in the deprived SHR groups when returned toad lib conditions. The data of this study and our previous work suggest that arousal differences between SHR and WKY strains are more reliably differentiated by fixed interval schedules of reinforcement than by a fixed ratio schedule. Hyperarousal may precede hypertension in the SHR, but it is undetermined whether hypertension can be found in the absence of hyperarousal in these rats.     

Correlation between evening and morning waking EEG and spatial orientation

The prefrontal, frontal, and parietal EEG of 16 healthy young adults (seven men, nine women; age=22.57+/-4.2) was recorded during the waking state (eyes closed) in the evening before and the morning following a second consecutive night spent in a sleep laboratory. Following the morning EEG recording session, participants were tested in a human-size maze upon five learning trials of a four-intersection route. Results on the fifth trial served as the learning index. We found a significant positive correlation between time taken to carry out the route and prefrontal, frontal EEG alpha-2 (10.0-12.75 Hz), and sigma (11.5-14.5 Hz) frequency bands. We also found that prefrontal and frontal theta activity correlated negatively with number of errors. No correlation was found between performance and neither alpha-1 (8.0-9.75 Hz) nor parietal EEG activity. These results confirm the involvement of the prefrontal and frontal cortices in the mechanisms responsible for modulating spatial orientation.     

QEEG markers of superior shooting performance in skilled marksmen: An investigation of cortical activity on psychomotor efficiency hypothesis

For elite performers, psychomotor behavior's success or failure can be traced to differences in brain dynamics. The psychomotor efficiency hypothesis suggests refined cortical activity through 1) selective activation of task-relevant processes and 2) inhibition of non-essential processes. The use of electroencephalography (EEG) has been applied to investigate psychomotor performance's neural processes. The EEG markers that reflect an elevation of psychomotor efficiency include left temporal alpha (T3 alpha), frontal midline theta (Fm theta), sensorimotor rhythm (SMR), and the coherence between frontal and left temporal regions. However, the relationship between elite performers' task-relevant and non-essential neural processes is still not well understood. Therefore, this study aimed to explore how each task-relevant and inhibition of non-essential processes contribute to superior psychomotor behavior. Thirty-five highly skilled marksmen were recruited to perform 30 shots in the shooting task while the EEG was recorded. The marksmen were divided into two groups (superior & inferior) based on a median split of shooting performance. The superior group exhibited higher accuracy and precision, with a reduction in movement jerk. EEG measures revealed that the superior group exhibited higher SMR before the trigger pull than the inferior group. In addition, the superior group demonstrated reduced Fz-T3 coherence in their bull's eye shots than the missed shots. These results suggest that the superior group exhibited less effortful engagement of task-relevant processes and lower interference from non-essential cortical regions than the inferior group. The study's overall findings support the psychomotor efficiency hypothesis. When comparing highly skilled performers, the slight differences in brain dynamics ultimately contribute to the success or failure of psychomotor performance.     

Meeting novel experimental needs with an Apple Pascal controlled interfacing system

In this article, we describe how to combine an inexpensive interface with an independent timing card to solve some common timing and programming problems. Problems were encountered when we tried, by modifying commercial software, to create novel programs that would accurately control events in our operant conditioning chambers. The solution was to combine a Life Science Associates (LSA) Apple Interfacing System with an Applied Engineering Timemaster II H.O. timing card. Three aspects of the solution are described: (1) LSA’s interfacing hardware; (2) the Timemaster II H.O. timing card; and (3) the Pascal commands necessary to access the timing card. An example, a program to control a concurrent variable-interval schedule, shows how the timing card is used in conjunction with the interface to control and monitor experiments. The system offers many advantages over earlier researcher-built approaches and provides a flexible, accurate, and inexpensive alternative to commercial systems.     

Pavloviana inPsychology of the 20th Century: A special review

In the encyclopedicPsychology of the 20th Century three volumes are relevant to the work of I. P. Pavlov, his predecessors, contemporaries, and followers. Volume 1 (1976) provides an extensive account of the history of non-introspective, “objective” psychology. In Volume 4 (1977), examined in this review and consisting of sections on “Theories of Learning” and “Behavior Modification,” separate chapters are devoted to Pavlov’s life and work, and its continuation in the Soviet Union. Classical conditioning is considered in the context of S-R learning theories, interaction with operant conditioning, and development of behavior therapy. Additional materials are likely to be presented in Volume 6 (to be published) dealing with animal psychology, ethology, and physiological psychology.     

Diurnal time courses in psychomotor performance and waking EEG frequencies

The present study examined the similarities between the diurnal time courses in the waking EEG activity and the psychomotor performance. The aim was to verify if some ongoing changes in the excitability of the cortical nerve cells across the daytime could facilitate the sensorimotor processing. EEG recordings and performance results for the Four Choice Reaction Time Test (FCRTT) were obtained every two hours, from morning to late evening period, in 8 young normal subjects (21.3 +/- 0.5 years). ANOVAs were used to verify the presence of diurnal variations in the two measures. Nonparametric correlations were obtained to test the similarity between the changes across the day in the two measures. Three EEG frequency bands (delta, sigma, and beta1) and the reaction time measures varied across the daytime. The changes in the sigma (12.00-13.75 Hz) and the beta1 (14.00-19.75 Hz) bands were similar to the diurnal variations in the reaction time measures. It is suggested that the changes in the sigma and the beta1 bands may facilitate the processing of the sensorimotor treatment.     

A study of EEG coherence in DCD children during motor synchronization task

This paper investigates the hypothesis that the coordination difficulties of DCD children are associated with an increased coherence in the cortical motor regions, which persists with age. Forty-eight children participated in the study (24 DCD and 24 Controls). Their ages ranged from 8 to 13 years, divided into three groups (8-9, 10-11, and 12-13 years old). Children were required to perform finger flexion or extension either in synchrony or in syncopation with a rhythmic metronome, while a 32-channel EEG was recorded. Along with stability measures of motor performance, we analyzed the spectral EEG coherence between intrahemispheric (left frontal/left central; left central/left parietal) and interhemispheric (left central/right central) sites. Spectral coherence assesses functional coupling between distant areas of the brain. Two frequency bands related to sensorimotor activation were chosen: alpha (8-12 Hz) and beta (12-30 Hz). The synchrony task was chosen as a rest condition against which the two syncopation conditions at 0.5 Hz and 1.3 Hz were contrasted. For intrahemispheric comparison, 8-9-year-old DCD children showed that coherence between fronto-central regions increased for both rhythms and conditions, as compared to controls. No difference was found for interhemispheric comparisons. As frontal sites are related to motor planning, our results suggest that youngest DCD children were forced to maintain a high level of pre-programming to compensate for the difficulties caused by the perceptual-motor requirements of the task in light of their coordination disorder.     

Hippocampal theta (3-8Hz) activity during classical eyeblink conditioning in rabbits

In 1978, Berry and Thompson showed that the amount of theta (3–8 Hz) activity in the spontaneous hippocampal EEG predicted learning rate in subsequent eyeblink conditioning in rabbits. More recently, the absence of theta activity during the training trial has been shown to have a detrimental effect on learning rate. Here, we aimed to further explore the relationship between theta activity and classical eyeblink conditioning by determining how the relative power of hippocampal theta activity [theta/(theta + delta) ratio] changes during both unpaired control and paired training phases. We found that animals with a higher hippocampal theta ratio immediately before conditioning learned faster and also that in these animals the theta ratio was higher throughout both experimental phases. In fact, while the hippocampal theta ratio remained stable in the fast learners as a function of training, it decreased in the slow learners already during unpaired training. In addition, the presence of hippocampal theta activity enhanced the hippocampal model of the conditioned response (CR) and seemed to be beneficial for CR performance in terms of peak latency during conditioning, but did not have any effect when the animals showed asymptotic learning. Together with earlier findings, these results imply that the behavioral state in which hippocampal theta activity is absent is detrimental for learning, and that the behavioral state in which hippocampal theta activity dominates is beneficial for learning, at least before a well-learned state is achieved.     

The operant and the classical in conditioned orientation of Drosophila melanogaster at the flight simulator

Ever since learning and memory have been studied experimentally, the relationship between operant and classical conditioning has been controversial. Operant conditioning is any form of conditioning that essentially depends on the animal's behavior. It relies on operant behavior. A motor output is called operant if it controls a sensory variable. The Drosophila flight simulator, in which the relevant behavior is a single motor variable (yaw torque), fully separates the operant and classical components of a complex conditioning task. In this paradigm a tethered fly learns, operantly or classically, to prefer and avoid certain flight orientations in relation to the surrounding panorama. Yaw torque is recorded and, in the operant mode, controls the panorama. Using a yoked control, we show that classical pattern learning necessitates more extensive training than operant pattern learning. We compare in detail the microstructure of yaw torque after classical and operant training but find no evidence for acquired behavioral traits after operant conditioning that might explain this difference. We therefore conclude that the operant behavior has a facilitating effect on the classical training. In addition, we show that an operantly learned stimulus is successfully transferred from the behavior of the training to a different behavior. This result unequivocally demonstrates that during operant conditioning classical associations can be formed.     

Pharmacological analysis of conditioning in sensorimotor cortex neurons in a model

In awake mobile rabbits, with electrodes implanted in the medial lemniscus, midbrain tegmental reticular nucleus, and pyramidal tract, combined stimulation of two brain structures resulted in elaboration of conditional connections in sensorimotor cortex neuronal populations. The main criterion of the conditioning was the appearance of changes in the neuronal activity on omission of the second stimulus. These changes represented a complex of electrical events, some of which were similar to and others different from the evoked responses to the second stimulus. Application of atropine, sulfate, chlorpromazine hydrochloride, serotonin creatinine sulfate, andγ-aminobutyric acid (GABA) to the cortex at the site of the recording exerted a modulating effect on the conditional neuronal activity patterns. Of the above substances, GABA and atropine had the most pronounced effect. The GABA removed the short-latency components of the conditional changes which were similar to evoked responses. The atropine abolished the long-latency changes which differed from evoked responses.     

Cholinergic modulation of tonic immobility in the rabbit (Oryctolagus cuniculus).

The present study was performed to determine the effects of the anticholinergic agent scopolamine and the cholinergic agent physostigmine on tonic immobility in rabbits. Recordings of the electroencephalographic (EEG) activity from cortex and hippocampus were also made before, during, and after each test session. Scopolamine significantly prolonged the response and produced large amplitude slow wave activity in the EEG of both cortex and hippocampus. Physostigmine significantly shortened the duration of immobility and increased rhythmic slow activity in the frequency range of 5.5-9.1 Hz in the hippocampus while producing a desynchronized cortical rhythm. It is suggested that the cortex and hippocampus play a role in modulating tonic immobility duration by inhibiting the brain-stem structures thought to control this response.     

Autonomic learning

Academic achievement was resolved into its intellectual and motivational components. IQ, personality variables, and parameters of operant and classical conditioning of autonomic nervous system controlled variables were examined in 99 black inner-city high school seniors. Six physiological variables(respiration, heart rate, finger plethysmogram, frontalis muscle potential, palmar skin conductance, and palmar skin potential) were analyzed by computer using analog-to-digital conversion and a Points of Interest (PI) program. Psychological measures were full WAIS IQ, Edwards Personality Inventory(EPI), Cattell Sixteen Personality Factor Questionnaire(16PF), McClelland need Achievement test(n Ach), Object Sorting test, Minnesota Counseling Inventory(MCI), Level of Aspiration Board, and Rotter—Miller Locus of Control. Achievement(Ach) was defined as the residuals of total grade point average(GPA) regressed on IQ. Each of 19 variables which discriminated significantly between high and low achievers was employed in step-wise regression analyses for GPA and Ach separately. In a regression analysis of variance of GPA, IQ=20.44%, EPI=9.08%, and physiological measures =21.37%(operant conditioning =18.70%; classical conditioning =2.67%). Combined measures of motivation(psychological and physiological) =30.45% of the variance in GPA. The entire psychological and physiological test battery, including IQ, contributed a total of 50.89% of the variance in GPA. In a regression analysis of variance in achievement, psychological measures, other than IQ(six EPI and one 16PF), =11.0% and physiological measures =30.3%. As a replication, this study demonstrated significant correlation between autonomic conditioning and school achievement.     

The electrophysiological correlates of dream recall and nonrecall from stage 2 sleep

This research examined the relationship between cortical activation, defined by electroencephalographic (EEG) measures, and the ability to recall dreams following awakenings from Stage 2 sleep. Period-analyzed EEG data from 40 subjects were examined for the preawakening, postawakening, and preawakening-to-postawakening time intervals. Recall differed from nonrecall at the postawakening and preawakening-to-postawakening periods on measures of muscle activity and time spent in the sigma (12-16 Hz) frequency band. There were no distinctions in recall ability on EEG hemispheric asymmetry measures. Generally, the findings do not support the hypothesis linking increased recall ability to increases in cortical activation prior to awakening. However, the recall groups depicted a different pattern of arousal in their transition from sleep to wakefulness.     

A note on conditional reflex studies of schizophrenia in France

In France, beginning with 1946, the method of Ivanov-Smolenski was used to study schizophrenia, but after 1957, sensory conditioning procedures have been employed (EEG sound-light, evoked potentials in children, SAE conditioning in adults) and more recently eye blink and operant conditioning).