| Item type |
学術雑誌論文 / Journal Article(1) |
| 公開日 |
2020-12-14 |
| タイトル |
|
|
タイトル |
Split-Paper Testing: A Novel Approach to Evaluate Programming Performance |
|
言語 |
en |
| 言語 |
|
|
言語 |
eng |
| キーワード |
|
|
言語 |
en |
|
主題 |
evaluating programming performance |
| キーワード |
|
|
言語 |
en |
|
主題 |
constructed response tests |
| キーワード |
|
|
言語 |
en |
|
主題 |
multiple choice tests |
| キーワード |
|
|
言語 |
en |
|
主題 |
computer-based tests |
| キーワード |
|
|
言語 |
en |
|
主題 |
split-paper tests |
| 資源タイプ |
|
|
資源タイプ識別子 |
http://purl.org/coar/resource_type/c_6501 |
|
資源タイプ |
journal article |
| 著者 |
Nakayama, Yasuichi
Kuno, Yasushi
Kakuda, Hiroyasu
|
| 抄録 |
|
|
内容記述タイプ |
Abstract |
|
内容記述 |
There is a great need to evaluate and/or test programming performance. For this purpose, two schemes have been used. Constructed response (CR) tests let the examinee write programs on a blank sheet (or with a computer keyboard). This scheme can evaluate the programming performance. However, it is difficult to apply in a large volume because skilled human graders are required (automatic evaluation is attempted but not widely used yet). Multiple choice (MC) tests let the examinee choose the correct answer from a list (often corresponding to the “hidden” portion of a complete program). This scheme can be used in a large volume with computer-based testing or mark-sense cards. However, many teachers and researchers are suspicious in that a good score does not necessarily mean the ability to write programs from scratch. We propose a third method, split-paper (SP) testing. Our scheme splits a correct program into each of its lines, shuffles the lines, adds “wrong answer” lines, and prepends them with choice symbols. The examinee answers by using a list of choice symbols corresponding to the correct program, which can be easily graded automatically by using computers. In particular, we propose the use of edit distance (Levenshtein distance) in the scoring scheme, which seems to have affinity with the SP scheme. The research question is whether SP tests scored by using an edit-distance-based scoring scheme measure programming performance as do CR tests. Therefore, we conducted an experiment by using college programming classes with 60 students to compare SP tests against CR tests. As a result, SP and CR test scores are correlated for multiple settings, and the results were statistically significant. Therefore, we might conclude that SP tests with automatic scoring using edit distance are useful tools for evaluating the programming performance. |
| 書誌情報 |
en : Journal of Information Processing
巻 28,
p. 733-743,
発行日 2020-11
|
| 出版者 |
|
|
出版者 |
Information Processing Society of Japan (情報処理学会) |
| ISSN |
|
|
収録物識別子タイプ |
ISSN |
|
収録物識別子 |
18826652 |
| DOI |
|
|
関連タイプ |
isIdenticalTo |
|
|
識別子タイプ |
DOI |
|
|
関連識別子 |
10.2197/ipsjjip.28.733 |
| 権利 |
|
|
権利情報 |
(c)2020 Information Processing Society of Japan. Notice for the use of this material The copyright of this material is retained by the Information Processing Society of Japan (IPSJ).This material is published on this web site with the agreement of the author(s) and the IPSJ. Please be complied with Copyright Law of Japan and the Code of Ethics of the IPSJ if any users with to reproduce, make derivative work, distribute or make available to the public any part or whole thereof. |
| 関連サイト |
|
|
|
識別子タイプ |
DOI |
|
|
関連識別子 |
https://doi.org/10.2197/ipsjjip.28.733 |
| 著者版フラグ |
|
|
出版タイプ |
VoR |
|
出版タイプResource |
http://purl.org/coar/version/c_970fb48d4fbd8a85 |
28_733 (1.8 MB)
