AN INFORMATION-THEORETIC APPROACH TO PARTIAL REINFORCEMENT EFFECT DETERMINATION OF THE EFFECTIVE ORDER OF ENTROPY ASSOCIATED WITH REINFORCEMENT PATTERN

YOSHIMASA HABU; SHIGERU ONO

doi:10.4992/psycholres1954.11.76

AN INFORMATION-THEORETIC APPROACH TO PARTIAL REINFORCEMENT EFFECT

DETERMINATION OF THE EFFECTIVE ORDER OF ENTROPY ASSOCIATED WITH REINFORCEMENT PATTERN

YOSHIMASA HABU, SHIGERU ONO

著者情報

ジャーナルフリー

1969 年 11 巻 2 号 p. 76-87

DOI https://doi.org/10.4992/psycholres1954.11.76

詳細

Published: 1969 Received: 1969/07/12 Available on J-STAGE: 2009/02/24 Accepted: - Advance online publication: - Revised: -
訂正情報
訂正日: 2009/02/24 訂正理由: - 訂正箇所: 論文抄録訂正内容: Wrong : The basic assumption is that with a constant percentage of reinforcement, resistance to extinction (RE) would be a function of uncertainty associated with a reinforcement pattern. 3 groups of rats (double-alternation, 50% random, and continuous) were run in a runway. The last group extinguished most rapidly. No difference in RE was found between the other 2 groups. The conditional entropy of reinforcement-response sequences for the alternation group, as com-pared with the random group, failed to decrease when its orders were the 3rd or higher. These findings indicate that the second-order conditional entropy will be appropriate for quantifying the uncertainty in question. It was proposed that the RE as determined by uncertainty would be accounted for through intelligi-bility hypothesis, arousal hypothesis, or probability learning hypothesis.
Right : The basic assumption is that with a constant percentage of reinforcement, resistance to extinction (RE) would be a function of uncertainty associated with a reinforcement pattern. 3 groups of rats (double-alternation, 50% random, and continuous) were run in a runway. The last group extinguished most rapidly. No difference in RE was found between the other 2 groups. The conditional entropy of reinforcement-response sequences for the alternation group, as compared with the random group, failed to decrease when its orders were the 3rd or higher. These findings indicate that the second-order conditional entropy will be appropriate for quantifying the uncertainty in question. It was proposed that the RE as determined by uncertainty would be accounted for through intelligibility hypothesis, arousal hypothesis, or probability learning hypothesis.

訂正日: 2009/02/24 訂正理由: - 訂正箇所: 引用文献情報訂正内容: Wrong : ANDERSON, N. H. 1960 Effect of first-order conditional probability in a two-choice learning situation. J. exp. Psychol., 59, 73-93.
ASAMI, CHIZUKO 1954 The effects of patterns in the partial reinforcement., Jap. J. Psychol., 24, 268-276.
BARRY, H., III. 1958 Effects of strength of drive on learning and extinction. J. exp. Psychol., 55, 478-481.
BERLYNE, D. E. 1960 Conflict, arousal, and curiosity. New York: McGraw-Hill.
BERLYNE, D. E. 1967 Arousal and reinforcement. In D. Levine (Ed.), Nebraska Symposium on Motivation, 1-110, Univ. Nebraska Press.
BLOOM, J. M., & CAPALDI, E. J. 1961 The behavior of rats in relation to complex patterns of partial reinforcement., J. comp. physiol. Psychol., 54, 261-265.
CAPALDI, E. J. 1958 The effect of different amount of training on the resistance to extinction of different patterns of partially reinforced responses. J. comp. physiol. Psychol., 51, 367-371.
CAPALDI, E. J. 1964 Effect of N-length, number of different N-lengths, and number of reinforcements on resistance to extinction. J. exp. Psychol., 68, 230-239.
CAPALDI, E. J. 1966 Partial reinforcement: a hypothesis of sequential effects. Psychol. Rev., 73, 459-477.
CAPALDI, E. J., VEATCH, R. L., & STEFANIAKE, D. E. 1966 Stimulus control of patterning behavior. J. comp. physiol. Psychol., 61, 161-164.
CAPALDI, E. J., & WARGO, P. 1963 Effects of transitions from nonreinforced to reinforced trials under spaced-trial conditions. J. exp. Psychol., 65, 318-319.
COFER, C. N., & APPLEY, M. H. 1964 Motivation: Theory and research. New York: Mc-Graw-Hill.
DUFFY, E. 1957 The psychological significance of the concept of “arousal” or “activation”. Psychol. Rev., 64, 265-275.
ENGLER, J. 1958 Marginal and conditional simulus and response probabilities in verbal conditioning. J. exp. Psychol., 55, 303-317.
EYSENCK, H. J. 1967 The biological basis of person-aliy. Springfield, Illinois: Thomas.
FUJITA, O. 1967 Several aspects of exteroceptive stimulation (Part 1)-Analysis of exploratory behavior-. Bulletin of the Faculty of Education, Tokyo University of Education, 13, 85-97.
GOODNOW, J. J., LUBIN, A., & RUBINSTEIN, I. 1960 Response to changing patterns of events. Amer., J. Psychol., 73, 56-67.
GRANT, D. A., & SCHIPPER, L. M. 1952 The acquistition and extinction of conditioned eyelid responses as a function of the percentage of fixed-ratio random reinforcement., J. exp. Psychol., 43, 313-320.
HAKE, H. W., & HYMAN, H. 1953 Perception of the statistical structure of a random series of binary symbols. J. exp. Psychol., 45, 64-74.
HEBB, D. O. 1955 Drives and the C. N. S. (conceptual nervous system). Psychol. Rev., 62, 243-254.
ISHIHARA, SHIZUKO 1964 Schedules of reinforcement and induction-several aspects of be-havior in the semi-circular maze (26)-, Jroceedings of the 28th Annual Meeting of the Japanese Society for Animal Psychology (appearing in the Ann. Anim. Psychol, , 18, p. 48)
IWAHARA, S. 1964 The effect of age and interresponse interval upon guessing sequences- An analysis in terms of information theory. Bulletin of the Faculty of Education, Tokyo University of Education, 10, 69-82.
JENSEN, G. D., & COTTON, J. W. 1960 Successive acquisitions and extinctions as related to percentage of reinforcement. J. exp. Psychol., 60, 41-49.
KIMBLE, G. A. 1960 Hilgard and Marquis' Con-ditioning and learning. New York: Appleton-Century-Crofts.
KLEINSMITH, L. J., & KAPLAN, S. 1963 Paired-associate learning as a function of arousal and interpolated interval. J. exp. Psychol., 65, 190-193.
KLEINSMITH, L. J., & KAPLAN, S. 1964 Interaction of arousal and recall interval in nonsense syllable paired-associate learning. J. exp. Psychol., 67, 124-126.
LEWIS, D. J., & COTTON, J. W. 1957 Learning and performance as a function of drive strength during acquisition and extinction. J. comp. physiol. Psychol., 50, 189-194.
MILLER, G. A., HEISE, G. A., & LICHTEN, W. 1951 The intelligibility of speech as a function of the context of the test materials. J. exp. Psychol., 41, 329-335.
MOWRER, O. H. 1960 Learning theory and behavior. New York: Wiley.
MOWRER, O. H., & JONES, H. 1945 Habit strength as a function of the pattern of reinforcement., J. exp. Psychol., 35, 293-311.
O'KELLEY, L. I., & HEYER, A. W. Jr. 1948 Studies in motivation and retention. I. Retention of a simple habit. J. comp. physiol, Psychol., 41, 466-478.
ONO, S., & HABU, Y. 1967 An analysis of partial reinforcement effect in informational terms (1). Proceedings of the 31st Convention of Jap. Psychol. Assoc., p. 192.
SURRIDGE, C. T., & AMSEL, A. 1966 Acquisition and extinction under single alternation and random partial-reinforcement conditions with a 24-hour intertrial interval. J. exp. Psychol., 72, 361-368.
TYLER, D. W., WORTZ, E. C., & BITTERMAN, M. E. 1953 The effect of random and alternating partial reinforcement on resistance to extinction in the rat. Amer., J. Psychol., 66, 57-65.
WITTE, R. S. 1959 A stimulus-trace hypothesis for statistical learning theory. J. exp Psychol., 57, 273-283.
WITTE, R. S. 1961 Conditional response probability in a T-maze., J. exp. Psychol., 62, 439-447.
YOSHII, N., & TSUKIYAMA, K. 1952 EEG studies on conditioned behavior of the white rat. Jap. J. Physiol., 2, 186-193.

Right : ANDERSON, N. H.1960 Effect of first-order conditional probability in a two-choice learning situation. J. exp. Psychol., 59, 73-93.
ASAI, CXRZUKO 1954 The effects of patterns in the partial reinforcement. Jap. J. Psychol., 24, 268-276.
BARRY, H., III. 1958 Effects of strength of drive on learning and extinction. J. exp. Pcychol., 55, 478-481.
BERLYNE, D. E. 1960 Conflict, arousal, and curiosity. New York: McGraw-Hill.
BERLYNE, D. E. 1967 Arousal and reinforce ment. In D. Levine (Ed.), Nebraska Symposium on Motivation, 1-110, Univ. Nebraska Press.
BLOOM, J. M., & CAPALDI, E. J. 1961 The behavior of rats in relation to complex patterns of partial reinforcement. J. comp. physiol. Psychol., 54, 261-265.
CAPALDI, E. J. 1958 The effect of different amount of training on the resistance to extinction of different patterns of partially reinforced responses. J. comp. physiol. Psychol., 51, 367-371.
CAPALDI, E. J. 1964 Effect of N-length, number of different N-lengths, and number of reinforcements on resistance to extinction. J. exp. Psychol., 68, 230-239.
CAPALDI, E. J. 1966 Partial reinforcement: a hypothesis of sequential effects. Psychol. Rev., 73, 459-477.
CAPALDI, E. J., VEATCH, R. L., & STEFANIAKE, D. E. 1966 Stimulus control of patterning behavior. J. comp. physiol. Psychol., 61, 161-164.
CAPALDI, E. J., & WARGO, P. 1963 Effects of transitions from nonreinforced to reinforced trials under spaced-trial conditions. J. exp. Psychol., 65, 318-319.
COFER, C. N., & APPLEY, M. H. 1964 Motivation: Theory and research. New York: McGraw-Hill.
DUFFY, E. 1957 The psychological significance of the concept of “arousal” or “activation”. Psychol. Rev., 64, 265-275.
ENGLER, J. 1958 Marginal and conditional simulus and response probabilities in verbal conditioning. J. exp. Psychol., 55, 303-317.
EYSENCK, H. J. 1967 The biological basis of personality. Springfield, Illinois: Thomas.
FUJITA, O. 1967 Several aspects of exteroceptive stimulation (Part 1)-Analysis of exploratory behavior-. Bulletin of the Faculty of Education, Tokyo University of Education, 13, 85-97.
GOODNOW, J. J., LUBIN, A., & RUBINSTEIN, I. 1960 Response to changing patterns of events. Amer. J. Psychol., 73, 56-67.
GRANT, D. A., & SCHIPPER, L. M. 1952 The acquistition and extinction of conditioned eyelid responses as a function of the percentage of fixed-ratio random reinforcement. J. exp. Psychol., 43, 313-320.
HAKE, H. W., & HYMAN, H. 1953 Perception of the statistical structure of a random series of binary symbols. J. exp. Psychol., 45, 64-74.
HEBB, D. O. 1955 Drives and the C. N. S.(conceptual nervous system). Psychol. Rev., 62, 243-254.
ISHIHARA, SHIZUXO 1964 Schedules of reinforcement and induction-several aspects of behavior in the semi-circular maze (26)-. Proceedings of the 28th Annual Meeting of the Japanese Society for Animal Psychology (appearing in the Ann. Anim. Psychol., 18, p.48)
IWAHARA, S. 1964 The effect of age and interresponse interval upon guessing sequences An analysis in terms of information theory. Bulletin of the Faculty of Education, Tokyo University of Education, 10, 69-82.
JENSEN, G. D., & COTTON, J. W. 1960 Successive acquisitions and extinctions as related to percentage of reinforcement. J. exp. Psychol., 60, 41-49.
KIMBLE, G. A. 1960 Hilgard and Marquis'Conditioning and learning. New York: Appleton-Century-Crofts.
KLEINSMITH, L. J., & KAPLAN, S. 1963 Pairedassociate learning as a function of arousal and interpolated interval. J. exp. Psychol., 65, 190-193.
KLEINSMITH, L. J., & KAPLAN, S. 1964 Interaction of arousal and recall interval in nonsense syllable paired-associate learning. J. exp. Psychol., 67, 124-126.
LEWIS, D. J., & COTTON, J. W. 1957 Learning and performance as a function of drive strength during acquisition and extinction. J. comp. physiol. Psychol., 50, 189-194.
MILLER, G. A., HEISE, G. A., & LICHTEN, W. 1951 The intelligibility of speech as a function of the context of the test materials. J. exp. Psychol, 41, 329-335.
MOWRER, O. H. 1960 Learning theory and behavior. New York: Wiley.
MOWRER, O. H., & JONES, H. 1945 Habit strength as a function of the pattern of reinforcement. J. exp. Psychol., 35, 293-311.
O'KELLEY, L. I., & HEYER, A. W. Jr. 1948 Studies in motivation and retention. I. Retention of a simple habit. J. comp. physiol, Psychol, 41, 466-478.
ONO, S., & HABU, Y. 1967 An analysis of partial reinforcement effect in informational terms (1). Proceedings of the 31st Convention of Jap. Psychol. Assoc., p.192.
SURRIDGE, C. T., & AMSEL, A. 1966 Acquisition and extinction under single alternation and random partial-reinforcement conditions with a 24-hour intertrial interval. J. exp. Psychol., 72, 361-368.
TYLER, D. W., WORTZ, E. C., & BITTERMAN, M. E. 1953 The effect of random and alternating partial reinforcement on resistance to extinction in the rat. Amer. J. Psychol., 66, 57-65.
WITTE, R. S. 1959 A stimulus-trace hypothesis for statistical learning theory. J. exp Psychol., 57, 273-283.
WITTE, R. S. 1961 Conditional response probability in a T-maze. J. exp. Psychol., 62, 439-447.
Yosxn, N., & TSUKIYAMA, K. 1952 EEG studies on conditioned behavior of the white rat. Jap. J. Physiol., 2, 186-193.

訂正日: 2009/02/24 訂正理由: - 訂正箇所: PDFファイル訂正内容: -

訂正日: 2009/02/24 訂正理由: - 訂正箇所: 引用文献情報訂正内容: Wrong : ANDERSON, N. H.1960 Effect of first-order conditional probability in a two-choice learning situation. J. exp. Psychol., 59, 73-93.
ASAI, CXRZUKO 1954 The effects of patterns in the partial reinforcement. Jap. J. Psychol., 24, 268-276.
BARRY, H., III. 1958 Effects of strength of drive on learning and extinction. J. exp. Pcychol., 55, 478-481.
BERLYNE, D. E. 1960 Conflict, arousal, and curiosity. New York: McGraw-Hill.
BERLYNE, D. E. 1967 Arousal and reinforce ment. In D. Levine (Ed.), Nebraska Symposium on Motivation, 1-110, Univ. Nebraska Press.
BLOOM, J. M., & CAPALDI, E. J. 1961 The behavior of rats in relation to complex patterns of partial reinforcement. J. comp. physiol. Psychol., 54, 261-265.
CAPALDI, E. J. 1958 The effect of different amount of training on the resistance to extinction of different patterns of partially reinforced responses. J. comp. physiol. Psychol., 51, 367-371.
CAPALDI, E. J. 1964 Effect of N-length, number of different N-lengths, and number of reinforcements on resistance to extinction. J. exp. Psychol., 68, 230-239.
CAPALDI, E. J. 1966 Partial reinforcement: a hypothesis of sequential effects. Psychol. Rev., 73, 459-477.
CAPALDI, E. J., VEATCH, R. L., & STEFANIAKE, D. E. 1966 Stimulus control of patterning behavior. J. comp. physiol. Psychol., 61, 161-164.
CAPALDI, E. J., & WARGO, P. 1963 Effects of transitions from nonreinforced to reinforced trials under spaced-trial conditions. J. exp. Psychol., 65, 318-319.
COFER, C. N., & APPLEY, M. H. 1964 Motivation: Theory and research. New York: McGraw-Hill.
DUFFY, E. 1957 The psychological significance of the concept of “arousal” or “activation”. Psychol. Rev., 64, 265-275.
ENGLER, J. 1958 Marginal and conditional simulus and response probabilities in verbal conditioning. J. exp. Psychol., 55, 303-317.
EYSENCK, H. J. 1967 The biological basis of personality. Springfield, Illinois: Thomas.
FUJITA, O. 1967 Several aspects of exteroceptive stimulation (Part 1)-Analysis of exploratory behavior-. Bulletin of the Faculty of Education, Tokyo University of Education, 13, 85-97.
GOODNOW, J. J., LUBIN, A., & RUBINSTEIN, I. 1960 Response to changing patterns of events. Amer. J. Psychol., 73, 56-67.
GRANT, D. A., & SCHIPPER, L. M. 1952 The acquistition and extinction of conditioned eyelid responses as a function of the percentage of fixed-ratio random reinforcement. J. exp. Psychol., 43, 313-320.
HAKE, H. W., & HYMAN, H. 1953 Perception of the statistical structure of a random series of binary symbols. J. exp. Psychol., 45, 64-74.
HEBB, D. O. 1955 Drives and the C. N. S.(conceptual nervous system). Psychol. Rev., 62, 243-254.
ISHIHARA, SHIZUXO 1964 Schedules of reinforcement and induction-several aspects of behavior in the semi-circular maze (26)-. Proceedings of the 28th Annual Meeting of the Japanese Society for Animal Psychology (appearing in the Ann. Anim. Psychol., 18, p.48)
IWAHARA, S. 1964 The effect of age and interresponse interval upon guessing sequences An analysis in terms of information theory. Bulletin of the Faculty of Education, Tokyo University of Education, 10, 69-82.
JENSEN, G. D., & COTTON, J. W. 1960 Successive acquisitions and extinctions as related to percentage of reinforcement. J. exp. Psychol., 60, 41-49.
KIMBLE, G. A. 1960 Hilgard and Marquis'Conditioning and learning. New York: Appleton-Century-Crofts.
KLEINSMITH, L. J., & KAPLAN, S. 1963 Pairedassociate learning as a function of arousal and interpolated interval. J. exp. Psychol., 65, 190-193.
KLEINSMITH, L. J., & KAPLAN, S. 1964 Interaction of arousal and recall interval in nonsense syllable paired-associate learning. J. exp. Psychol., 67, 124-126.
LEWIS, D. J., & COTTON, J. W. 1957 Learning and performance as a function of drive strength during acquisition and extinction. J. comp. physiol. Psychol., 50, 189-194.
MILLER, G. A., HEISE, G. A., & LICHTEN, W. 1951 The intelligibility of speech as a function of the context of the test materials. J. exp. Psychol, 41, 329-335.
MOWRER, O. H. 1960 Learning theory and behavior. New York: Wiley.
MOWRER, O. H., & JONES, H. 1945 Habit strength as a function of the pattern of reinforcement. J. exp. Psychol., 35, 293-311.
O'KELLEY, L. I., & HEYER, A. W. Jr. 1948 Studies in motivation and retention. I. Retention of a simple habit. J. comp. physiol, Psychol, 41, 466-478.
ONO, S., & HABU, Y. 1967 An analysis of partial reinforcement effect in informational terms (1). Proceedings of the 31st Convention of Jap. Psychol. Assoc., p.192.
SURRIDGE, C. T., & AMSEL, A. 1966 Acquisition and extinction under single alternation and random partial-reinforcement conditions with a 24-hour intertrial interval. J. exp. Psychol., 72, 361-368.
TYLER, D. W., WORTZ, E. C., & BITTERMAN, M. E. 1953 The effect of random and alternating partial reinforcement on resistance to extinction in the rat. Amer. J. Psychol., 66, 57-65.
WITTE, R. S. 1959 A stimulus-trace hypothesis for statistical learning theory. J. exp Psychol., 57, 273-283.
WITTE, R. S. 1961 Conditional response probability in a T-maze. J. exp. Psychol., 62, 439-447.
Yosxn, N., & TSUKIYAMA, K. 1952 EEG studies on conditioned behavior of the white rat. Jap. J. Physiol., 2, 186-193.

Right : ANDERSON, N. H.1960 Effect of first-order conditional probability in a two-choice learning situation. J. exp. Psychol., 59, 73-93.
ASAMI, CHIZUKO 1954 The effects of patterns in the partial reinforcement. Jap. J. Psychol., 24, 268-276.
BARRY, H., III. 1958 Effects of strength of drive on learning and extinction. J. exp. Psychol., 55, 478-481.
BERLYNE, D. E. 1960 Conflict, arousal, and curiosity. New York: McGraw-Hill.
BERLYNE, D. E. 1967 Arousal and reinforcement. In D. Levine (Ed.), Nebraska Symposium on Motivation, 1-110, Univ. Nebraska Press.
BLOOM, J. M., & CAPALDI, E. J. 1961 The behavior of rats in relation to complex patterns of partial reinforcement. J. comp. physiol. Psychol., 54, 261-265.
CAPALDI, E. J. 1958 The effect of different amount of training on the resistance to extinction of different patterns of partially reinforced responses. J. comp. physiol. Psychol., 51, 367-371.
CAPALDI, E. J. 1964 Effect of N-length, number of different N-lengths, and number of reinforcements on resistance to extinction. J. exp. Psychol., 68, 230-239.
CAPALDI, E. J. 1966 Partial reinforcement: a hypothesis of sequential effects. Psychol. Rev., 73, 459-477.
CAPALDI, E. J., VEATCH, R. L., & STEFANIAKE, D. E. 1966 Stimulus control of patterning behavior. J. comp. physiol. Psychol., 61, 161-164.
CAPALDI, E. J., & WARGO, P. 1963 Effects of transitions from nonreinforced to reinforced trials under spaced-trial conditions. J. exp. Psychol., 65, 318-319.
COFER, C. N., & APPLEY, M. H. 1964 Motivation: Theory and research. New York: McGraw-Hill.
DUFFY, E. 1957 The psychological significance of the concept of “arousal” or “activation”. Psychol. Rev., 64, 265-275.
ENGLER, J. 1958 Marginal and conditional simulus and response probabilities in verbal conditioning. J. exp. Psychol., 55, 303-317.
EYSENCK, H. J. 1967 The biological basis of personality. Springfield, Illinois: Thomas.
FUJITA, O. 1967 Several aspects of exteroceptive stimulation (Part 1)-Analysis of exploratory behavior-. Bulletin of the Faculty of Education, Tokyo University of Education, 13, 85-97.
GOODNOW, J. J., LUBIN, A., & RUBINSTEIN, I. 1960 Response to changing patterns of events. Amer. J. Psychol., 73, 56-67.
GRANT, D. A., & SCHIPPER, L. M. 1952 The acquistition and extinction of conditioned eyelid responses as a function of the percentage of fixed-ratio random reinforcement. J. exp. Psychol., 43, 313-320.
HAKE, H. W., & HYMAN, H. 1953 Perception of the statistical structure of a random series of binary symbols. J. exp. Psychol., 45, 64-74.
HEBB, D. O. 1955 Drives and the C. N. S.(conceptual nervous system). Psychol. Rev., 62, 243-254.
ISHIHARA, SHIZUKO 1964 Schedules of reinforcement and induction-several aspects of behavior in the semi-circular maze (26)-. Proceedings of the 28th Annual Meeting of the Japanese Society for Animal Psychology (appearing in the Ann. Anim. Psychol., 18, p.48)
IWAHARA, S. 1964 The effect of age and interresponse interval upon guessing sequences An analysis in terms of information theory. Bulletin of the Faculty of Education, Tokyo University of Education, 10, 69-82.
JENSEN, G. D., & COTTON, J. W. 1960 Successive acquisitions and extinctions as related to percentage of reinforcement. J. exp. Psychol., 60, 41-49.
KIMBLE, G. A. 1960 Hilgard and Marquis' Conditioning and learning. New York: Appleton-Century-Crofts.
KLEINSMITH, L. J., & KAPLAN, S. 1963 Pairedassociate learning as a function of arousal and interpolated interval. J. exp. Psychol., 65, 190-193.
KLEINSMITH, L. J., & KAPLAN, S. 1964 Interaction of arousal and recall interval in nonsense syllable paired-associate learning. J. exp. Psychol., 67, 124-126.
LEWIS, D. J., & COTTON, J. W. 1957 Learning and performance as a function of drive strength during acquisition and extinction. J. comp. physiol. Psychol., 50, 189-194.
MILLER, G. A., HEISE, G. A., & LICHTEN, W. 1951 The intelligibility of speech as a function of the context of the test materials. J. exp. Psychol,, 41, 329-335.
MOWRER, O. H. 1960 Learning theory and behavior. New York: Wiley.
MOWRER, O. H., & JONES, H. 1945 Habit strength as a function of the pattern of reinforcement. J. exp. Psychol., 35, 293-311.
O'KELLEY, L. I., & HEYER, A. W. Jr. 1948 Studies in motivation and retention. I. Retention of a simple habit. J. comp. physiol, Psychol,, 41, 466-478.
ONO, S., & HABU, Y. 1967 An analysis of partial reinforcement effect in informational terms (1). Proceedings of the 31st Convention of Jap. Psychol. Assoc., p.192.
SURRIDGE, C. T., & AMSEL, A. 1966 Acquisition and extinction under single alternation and random partial-reinforcement conditions with a 24-hour intertrial interval. J. exp. Psychol., 72, 361-368.
TYLER, D. W., WORTZ, E. C., & BITTERMAN, M. E. 1953 The effect of random and alternating partial reinforcement on resistance to extinction in the rat. Amer. J. Psychol., 66, 57-65.
WITTE, R. S. 1959 A stimulus-trace hypothesis for statistical learning theory. J. exp Psychol., 57, 273-283.
WITTE, R. S. 1961 Conditional response probability in a T-maze. J. exp. Psychol., 62, 439-447.
YOSHII, N., & TSUKIYAMA, K. 1952 EEG studies on conditioned behavior of the white rat. Jap. J. Physiol., 2, 186-193.

抄録

The basic assumption is that with a constant percentage of reinforcement, resistance to extinction (RE) would be a function of uncertainty associated with a reinforcement pattern. 3 groups of rats (double-alternation, 50% random, and continuous) were run in a runway. The last group extinguished most rapidly. No difference in RE was found between the other 2 groups. The conditional entropy of reinforcement-response sequences for the alternation group, as compared with the random group, failed to decrease when its orders were the 3rd or higher. These findings indicate that the second-order conditional entropy will be appropriate for quantifying the uncertainty in question. It was proposed that the RE as determined by uncertainty would be accounted for through intelligibility hypothesis, arousal hypothesis, or probability learning hypothesis.

責任著者(Corresponding author)

訂正情報

J-STAGEへの登録はこちら（無料）