Content-basedや、学習者中心型授業でプロジェクト・ワーク等に学生が取り組んだ場合など、その評価段階で社会文化能力、批判的思考力、問題解決能力等、従来の項目別客観テストでは計りきれない力を評価する代替的方法が求められる。ここでは評価の概念、言語学習観、教授観、学生と教師の力関係などを根本から捉えなおし多肢選択問題から脱却したよりインターラクティブで、個を反映したポートフォリオに焦点を当てる。ポートフォリオはある期間中の学習者の作品、体験、自己評価、などを系統的に集めたもので学習者の目標、それに向けての努力、成長、プロセス、結果、今後の方向性などを知ることができるデータである。筆者が担当する教授法、Critical Thinking Skills、アメリカ社会(DVに焦点を当てる)のクラスで試みたポートフォリオ及び、その評価法を紹介し、学生の反応、今後の課題等を議論した。学生にインタービュー、アンケートを行った結果、学生達の大半はポートフォィオを肯定的に捉え、やる気や自信、対話の向上、学び方の会得などをあげていた。本稿では教師の負担を軽減できるよう周到な計画手順をあげ、又妥当性、信頼性の問題を減少すべく、明確な評価基準、複数の採点者等のヒントをあげた。今後、自己評価のあり方について、また電子化についても研究をすすめたい。

抄録全体を表示

In Japan and Taiwan, English is one of the main subjects included in the entrance examinations, which a majority of high school students are required to take to apply for admission to a higher level of education. And the national unified exam (NUE) is administered once a year to all or many of those planning to enter the universities. This paper is concerned with probing into the peculiar nature inherent in each nation's latest NUE English test with a special focus on the reading comprehension sections. For this purpose, the readability of the English passages in the reading section of each NUE English test will be compared. The 'Flesch Score' is a powerful estimate of the level of difficulty in comprehending that the test takers have experienced, and measures readability based on the average numbers of words per sentence and of syllables per 100 words. 'JACET Basic Vocabulary 4000' can also provide other useful information to analyze vocabulary in each reading passage. Utilizing these two, we find that there are not any statistically significant differences in either the average number of syllables per 100 words or the difficulty of the vocabulary used. However, the average numbers of words per sentence are clearly different between the two nations.

抄録全体を表示

English reading ability has conventionally been measured by learner's performance of how they respond to questions that reflect the content of a reading passage. This is a rather indirect way of measuring one's ability when it is compared with how learner's speech or writing is directly evaluated in measuring these abilities. The present study has given a focus on learner's reading speed and tested its validity as a more direct and valid index of reading ability. Furthermore, it has sought factors that account for learner's reading speed. The effects of text type and topic, along with learner's interest, have also been considered as the factors that influence learner's reading speed. The study involved 239 university students (out of which the results of 160 students were used) in taking three different tests of reading speed. The results revealed that reading speed could be considered as a valid index of one's reading ability. The skills such as skimming and scanning highly accounted for learner's reading speed. As for the influence of text type and topic on reading speed, it was found that the text topic affected the reading speed. This means that, when measuring reading speed, it is necessary to prepare at least one passage from a humanity genre and another from a scientific genre. The learner's interest and motivation to read the given passages revealed little influence on their reading speed. This is more evidence that reading speed could be a valid index of a learner's reading ability. Although there were some limitations to the present study, it demonstrated that the reading speed along with the factors that affect it cast a new light in assessing learner's ability and in considering a new way to consider text readability.

抄録全体を表示

The purposes of this paper are a) to investigate whether the Lunic Language Marathon sorts the test-takers into a normal distribution; b) to detect inappropriate items, which are misfitting items, the items with low discrimination power values, or the items with low or high item difficulty values; and c) to investigate whether the results of the LLM show the selection effects of college entrance examinations. A total of 420 college students from four groups participated in this study. The first group consists of 78 students majoring in information technology at a national university. The second group has 105 students majoring in English language at a co-ed private university. Other 122 students, which fall into the third group, are majoring in social science or humanities at the same university as the second group. The last group contains 115 students majoring in English language at a women's private university. The results of this study show that a) Part 1 and 3 of the LLM sort the college students into a normal distribution, but as for Part 2 and 4, the ceiling effect has been observed; b) three items in the LLM are judged as inappropriate items; and c) there is some effect of group difference on the performance of the participants (Wilks' Lamda=.82, F(15, 1137.75)=5.79, p .00, η^2=.07, Power=1.00), but apparent effects of college entrance examinations have not been observed. This paper further discusses the use of the LLM as a diagnostic test at a college, and points out that specifically the scores on Part 1 will tell the instructors much about the learners' variety.

抄録全体を表示

Although L2 listening construct has been hypothesized to consist of the ability to understand literal messages and the ability to make inferences, its structure has not beenfully investigated empirically. One exception is Shimada (2000), which has explored the psychometric dimensionality of L2 listening ability and found that L2 listening ability is psychometrically more bidimensional. However, his study seems to suffer from a flaw in its methods of dimensionality analysis. The present research partially replicates Shimada and reexamines the psychometric dimensionality of L2 listening ability. The CELT was taken by 171 Japanese EFL college students and analyzed using item-level confirmatory factor analysis and testlet-based confirmatory factor analysis, which were used to overcome the problem with the analyses and differed from Shimada's methods. The results showed that L2 listening ability was psychometrically more bidimensional, which was congruent with Shimada. The results suggested that (a) when we want to measure the whole range of listening ability, two types of items should be put into a test, and that (b) it may be important to see whether data is psychometrically more unidimensional or bidimensional before using item response theory. The fact that the same conclusion as Shimada was reached using different methods reconfirms that L2 listening ability is psychometrically more bidimensional at least among Japanese EFL students.

抄録全体を表示

In Katagiri (2001a), three Forms of a new vocabulary test based on word difficulty order with only 32 items which can be conducted in less than 10 minutes were developed for quick and approximate estimates of examinees' general English ability. Through Katagiri (2001b, 2002b), the concurrent validity and the reliability of the three Forms were confirmed among senior high school students, and the three Forms were confirmed as parallel tests with one another. In this study, the author, first, examines the concurrent validity and the reliability of the three Forms among university students, using TOEIC as a target of concurrent validity. He, then, attempts to create mathematical formulas to convert the scores of each Form into TOEIC scores. One hundred seventy-five freshmen at university took the three Forms of the new vocabulary tests and TOEIC IP. Significant middle correlations were narrowly confirmed between each Form and TOEIC; a middle-high IRT reliability was also narrowly affirmed on each Form. Using simple regression analysis, mathematical formulas which convert the raw scores of each Form into TOEIC scores was created. It was concluded that (1) the concurrent validity and the reliability of each Form were also confirmed among university students as tests for quick and approximate estimates of general English ability, and (2) the conversion formulas from the scores of each Form into TOEIC scores were calculated and shown with the means of errors, which must be taken into consideration when they are utilized.

抄録全体を表示