Simulation of human problem-solving behavior

In the simulation of human behavior on a digital computer, one first attempts to discover the manner in which subjects (Ss) internally represent the environment and the rules that they employ for acting upon this representation. The interaction between the rules and the environmental representation over a period of time constitutes a set of processes. Processes can be expressed as flow charts which, in turn, are stated formally in terms of a computer program. The program serves as a theory which is tested by executing the program on a computer and comparing the machine's performance with S's behavior.     

The conditioning of textual responses using “extrinsic” reinforcers

Six 4-year-old Ss were presented with a textual program consisting of 26 words arranged so the word stimuli were gradually combined into sentences and then short “stories.” Three Ss were given the No-Reinforcement condition first, and only social reinforcers were presented. They were switched to the Reinforcement condition as soon as they requested discontinuance of the activity. The other three Ss were given Reinforcement—No Reinforcement—Reinforcement treatments. The No-Reinforcement treatment in this case lasted until S requested discontinuance of the activity. The reinforcers were mixed edibles and trinkets, as well as tokens backed up by small plastic toys on a 1:24 ratio. The unit of response was the number of new texts acquired as a result of each of the 45-min experimental sessions. It was demonstrated that the program, procedure, and reinforcement conditions produced curves which are analogous to those produced in common operant-conditioning procedures. The results indicate that other operant principles may be studied in this significant area of human behavior, with important practical consequences.