语言测试公平性检验框架及其应用

详细信息    查看全文 | 推荐本文 |

英文篇名：Framework and Application of Language Testing Evaluation on Fairness 作者：童扬芬 ; 陈佑林 英文作者：TONG Yangfen;CHEN Youlin; 关键词：语言测试 ; 公平性 ; 检验 英文关键词：language testing;;fairness;;evaluation 中文刊名：GWJX 英文刊名：Foreign Language Learning Theory and Practice 机构：华中师范大学外语学院; 出版日期：2019-02-25 出版单位：外语教学理论与实践 年：2019 期：No.165 基金：教育部人文社会科学重点研究基地重大项目“语言测试的评价标准研究”(12JJD740002);; 中央高校基本科研业务费专项基金项目“语言测试的公平性:理念构建与框架应用”(CCNU16A06043);; 国家留学基金青年骨干教师出国研修项目(201606775090)的阶段性研究成果 语种：中文; 页：GWJX201901011 页数：9 CN：01 ISSN：31-1964/H 分类号：76-84

摘要

语言测试既是一门社会科学,又是一门实践活动,其公平性检验贯穿于测试的整个流程之中。在我国现实测试环境下,语言测试公平性的检测框架应当涵盖对测试开发者、使用者和应试者责权利的界定,在应用实践中需要同时考虑技术公平性需求和社会公平性需求,针对效度、偏差和敏感度三个主要方面进行测量技术检验和人工价值判断,将检验的结果对社会公布并接受监督。建立完善的公平性检测报告制度不仅是提高测试质量的必要举措,亦是保障社会公正的重要措施。
        Language testing is social science as well as practical activity. It has been acknowledged that the fairness of testing should be maintained throughout the entire process of testing. In Chinese context, the evaluation framework on language testing fairness should clarify responsibilities and rights of all stake-holders such as designers, users and testees. To improve the quality of testing, the fairness evaluation should encompass check both on technical fairness and social justice. For the sake of operational application, it is essential to undertake validation, bias review and sensitivity review. It is also suggested that the result of fairness evaluation should be applied to improve fairness under public supervision to ensure it's ongoing test quality and social justice.

引文

American Education Research Association. American Psychological Association & National Council on Measurement in Education. 1985/1999/2014. Standards for Educational and Psychological Testing. Washington, DC.
    Angoff, W. H. 1993. “Perspectives on differential item functioning methodology”. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp.3-24). Hillsdale, NJ: Lawrence Erlbaum Associates.
    Bachman, L. F. 1990. Fundamental Considerations in Language Testing. Oxford: Oxford University Press.
    Bachman, L. F. 2000. “What, if any, are the limits of our responsibility for fairness in language testing?”. In A.J. Kunnan. Fairness and Validation in Language Assessment: Selected Papers from 19th Language Testing Research Colloquium, Orlando, Florida (pp.39-41). Cambridge, U.K.: Cambridge University Press.
    Bachman, L. F. 2005. “Building and supporting a case for test use”. Language Assessment Quarterly, 2(1): 1-34.
    Bachman, L. F. & Palmer, A. S. 2010. Language Assessment in Practice. Oxford UK: Oxford University Press.
    Berlac,H. 2000. “Cultural Politics, the Science of Assessment and Democratic Renewal of Public Education”. In A. Filer (Ed.) Assessment: Social Practice and Social Product (pp.189-207). London: Routledge.
    Canale, M. 1988. “The measurement of communicative competence”. Annual Review of Applied Linguistics, 67(1): 67-84.
    Cole, N.S.,& Zieky, M. 2001. “The new faces of fairness”. Journal of Educational Measurement, 38(4): 369-382.
    Davies, A. 1977. Testing and experimental methods. Oxford University Press.
    Davies, A. 1997. “Demands of Being Professional in Language Testing”. Language Testing, 14(3): 328-339.
    Davies, A. 2010. “Test fairness: a response”. Language Testing, 27(2): 171-176.
    Educational Testing Service. 2014. ETS Standards for Quality and Fairness. Princeton, NJ.
    Filer, A. 2000. Introduction. In A. Filer (Ed.) Assessment: Social Practice and Social Product (pp.1-4). London: Routledge.
    Gregory, C. & Rutgers. 2006. “Test Fairness”. In Brennan (Ed.), Educational Measurement (4th Edition)(pp.221-252). New York: Praeger Publishers.
    Hamp-Lyons,L.2000. “Social, Professional and Individual Responsibility in Language Testing”. System 28: 579-591.
    Joint Committee on Testing Practices. 2004.Code of Fair Testing Practices in Education. Washington, D.C.
    Kane, M. T. 2010. “Validity and fairness”. Language Testing, 27(2): 177-182.
    Karami, H. 2013. “The quest for fairness in language testing”. Educational Research and Evaluation, 19: 2-3, 158-169.
    Kunnan, A. J. 1997. “Connecting fairness and validation”. In A. Huhta, V. Kohonen, L. Kurki-Suomo and S. Luoma, Current Development and Alternatives in Language Assessment (pp.85-105). Jyvaskyla, Finland: University of Jyvaskyla.
    Kunnan, A. J. 2000. “Fairness and Justice for all”. In A.J. Kunnan. Fairness and Validation in Language Assessment: Selected Papers from 19th Language Testing Research Colloquium, Orlando, Florida (pp.1-14). Cambridge, U.K.: Cambridge University Press.
    Kunnan, A. J. 2010. “Test fairness and Toulmin's argument structure”. Language Testing, 27(2): 183-189.
    Lynch, B. K. 2001. “Rethinking assessment from a critical perspective”. Language Testing 18(2): 351-372.
    McNamara,T. & Ryan,K. 2011. “Fairness versus justice in language testing: The place of English Literacy in the Australian Citizenship Test”. Language Assessment Quarterly, 8: 161-178.
    Messick, S. 1988. “The once and future issues of validity: Assessing the meaning and consequences of measurement”. In H. Wainer, H. Braun. Test Validation (pp.1-30). Hillsdale, N.J.: Lawence Erlbaum.
    Ravitch D. 2004. The language police: How pressure groups restrict what students learn. Vintage.
    Shohamy, E. 1997. “Testing methods, testing consequences: are they ethical? are they fair?”. Language Testing, 14(3): 340-349.
    Shohamy, E. 2001. The Power of Tests: A Critical Perspective on the Use of Language Tests. Harlow, England: Longman.
    Stevenson, D.K. 1981. “Beyond faith and face validity: The multitrait-multimethod matrix and convergent and discriminant validity of oral proficiency tests”. In A.S. Palmer, P.J.M. Groot, G.A. Trosper. The Construct of Tests of Communicative Competence (pp.15-30).
    Washington, D.C.: TESOL.
    Walters, F.S. 2012. “Fairness”. In G. Fulcher & F. Davidson (eds.). The Routledge Handbook of Language Testing (pp.469-494). New York, NY: Routledge.
    Weir, C. J. 2005. Language Testing and Validation. Palgrave: Macmillan.
    Willingham, W. W. & Cole, N. S. 1997. Gender and fairness assessment. Mahwah, NJ: Lawrence Erlbaum Associates.
    Willingham, W. W. 1999. “A system view of test fairness”. In S.J. Messick (Ed.) Assessment in higher education: Issues of access, student development, and public policy (pp.213-242). Mahwah, NJ: Lawrence Erlbaum.
    Xiaoming, Xi. 2010. “How do we go about investigating test fairness?”. Language Testing, 27(2): 147-170.
    Zieky, M. 2006. “Fairness review in assessment”. In Downing, S. M. & Thomas, M. H.(Eds.) Handbook of test development (pp.359-376). Mahwah, NJ: Lawrence Erlbaum.
    范劲松,2014,语言测试的公平性研究: 概念、理论与责任,《外语测试与教学》 第2期: 11-19。
    廖平胜,2003,《考试学原理》,武汉: 华中师范大学出版社。
    李清华,2016,语言测试公平性的检验框架,《现代外语》 第4期: 549-560。
    王后雄、詹先君,2011,高考英语测试公平性的多维分析,《课程·教材·教法》第5期: 49-53。
    谢赛、陈贺文,2016,1998—2015我国语言教学中的测试研究——基于篇205 CSSCI 论文的文献计量学分析,《外国语文》第3期: 143-152。
    杨惠中、桂诗春,2007,语言测试的社会学思考,《现代外语》第 4期: 368-374。
    杨惠中,2015,有效测试、有效教学、有效使用,《外国语》第1期: 2-25。
    郑宇静、辜向东,2015,从有效测试到有效使用: 《语言评测季刊》 十年名家访谈录启示,《外语与外语教学》,第2期: 58-63。