AN EVALUATION OF A DOCTORAL PROGRAM IN ENGLISH LANGUAGE TEACHING

Abstract

The aim of this study is to evaluate a doctoral program in English language teaching of a foundation (non-profit, private) university in İstanbul, Turkey. To this end, the CIPP (context, input, process, and product) evaluation framework developed by Stufflebeam (1971) was utilized. In this study, students’ preferences and the encouraging determinants to join the program, program content, and resources, instruction in the program, roles of PhD mentors and lastly expected program outcomes were investigated. Seventeen students who are currently enrolled in the program and three program graduates participated in the study. Qualitative and quantitative data were collected via online questionnaires. Quantitative data analysis was done via descriptive statistics, and content analysis was administered for the qualitative data. The findings of the study illustrated students’ positive perceptions in terms of the certain aspects of the program, such as content, resources, instruction, and PhD mentors while a need of increase in the variety of the courses was also indicated by the students.

Keywords: Program evaluation, CIPP model, doctoral program evaluation, mentoring in higher education, English language teaching

REFERENCES

Akar, H. (2009). Foreign language teacher education : The Polish case. The New Educational Review, 17(1), 185–211.

Alkin, M. C. (1967). Towards an evaluation model: A systems approach (014150). ERIC. Retrieved form https://files.eric.ed.gov/fulltext/ED014150.pdf

Arabaci, I. B., & Ersözlü, A. (2010). Postgraduate students’perceptions of their supervisors’ mentoring skills (Gaziosmanpaşa University example). Procedia - Social and Behavioral Sciences, 2(2), 4234–4238.https://doi.org/ 10.1016/j.sbspro.2010.03.670

Ary, D., Jacobs, L. C., & Sorensen, C. (2013). Introduction to Research in Education (8th ed.). Belmont, CA: Cengage.

Ateş, A. (2012). Instructional technologies and material design course evaluation through lecturer’s and students’ responses.

International Journal of New Trends in Arts, Sports & Science Education, 1(1), 10-20.

Berk, R. A., Berg, J., Mortimer, R., Walton-Moss, B., & Yeo, T. P. (2005). Measuring the effectiveness of faculty mentoring relationships. Academic Medicine, 80(1), 66–71.https://doi.org/10.1097/00001888-200501000-00017

Bilican, R. (2014). Impact of a PhD ELT program on academic development of students at a Turkish state university. Journal International Association of Research in Foreign Language Education and Applied Linguistics ELT Research Journal, 2014(3), 111–139. Retrieved from https://dergipark.org.tr/tr/pub/eltrj/issue/5483/74459

Bozeman, B., & Feeney, M. K. (2007). Toward a useful theory of mentoring: A conceptual analysis and critique. Administration and Society, 39(6), 719–739. https://doi.org/10.1177/0095399707304119

Brown, J. D. (1995). The elements of language curriculum. Boston, MA. Heinlie and Heinle.

Burns, A., & Richards, J. C. (2009). Second language teacher education. New York, NY: Cambridge University Press.

Creswell, J. W. (2012). Educational research: Planning conducting and evaluating quantitative and qualitative research (4th ed.). Boston, MA: Pearson.

Efeoğlu, G., Ilerten, F., & Basal, A. (2018). A utilization focused evaluation of the preparatory school of an ELT program. International Online Journal of Educational Sciences, 10(4), 149–163. https://doi.org/10.15345/iojes.2018.04.009

Elma, İ. (2017). An assessment of academic writing needs of undergraduate ELT students, Unpublished master’s thesis, Bahçeşehir University, İstanbul, Turkey.

Fitzpatrick, J. L., Sanders, J. R., & Worthen, B. R. (2010). Program Evaluation Alternative Approaches and Practical Guidelines (4th ed.).Upper Saddel River, NJ: Pearson.

Ghosh, R. (2013). Mentors providing challenge and support: Integrating concepts from teacher mentoring in education and organizational mentoring in business. Human Resource Development Review, 12(2), 144–176. https://doi.org/10.1177/1534484312465608

Guba, E. G., & Lincoln, Y. (1981). Effective evaluation: Improving the usefulness of evaluation results throuhg responsive and naturalistic approaches. San Francisco, CA: Jossey-Bass.

Gürler, İ. (2018). Evaluation of the current curriculum in ELT departments from the perspectives of lecturers and students: A needs analysis, Unpublished master’s thesis, Atatürk University, Erzurum, Turkey.

Güven, E. (2014). Araştirma görevli̇leri̇ni̇n danişmanlari i̇le i̇li̇şki̇leri̇ni̇n mentorluk bağlaminda değerlendi̇ri̇lmesi̇ [The evaluation of relationship between the research assistants and consultants within the mentoring framework], Unpublished master's thesis, Sakarya University, Sakarya Turkey.

Kader, M. A. (2016). Curriculum Evaluation of professional post-graduate MA in ELT/ TESOL program: A study on Bangladeshi Institution, Unpublished master’s thesis, Brac University, Dhaca, Bangladesh.

Karim, A., Shahed, F. H., Mohamed, A. R., Rahman, M. M., & Ismail, S. A. M. M. (2019). Evaluation of the teacher education programs in EFL context: A testimony of student teachers’ perspective. International Journal of Instruction, 12(1), 127–146. https://doi.org/10.29333/iji.2019.1219a

Kordi, L., & Koosha, M. (2018). A comparative evaluation of Iranian ELT PhD curriculum: Reappraisal of goals, admission criteria and course requirements in Iran. Research in English Language Pedagogy RELP, 6(2), 295–321. https://doi.org/10.30486/RELP.2018.542709

Küçükoğlu, H. (2015). An evaluation of PhD ELT programs in Turkey, Unpublisted doctoral dissertation, Hacettepe University, Ankara, Turkey

Landefeld, T. (2009). Mentoring and diversity. Carson, CA: Springer.

Laverick, D. (2016). Mentoring processes in higher education [e-book]. https://doi.org/10.1007/978-3-319-39217-2

Lea, Y. S. (2011). On mentoring: When the student is ready, The teacher will appear. International Journal of Learning, 18(1), 259–268. https://doi.org/10.18848/1447-9494/cgp/v18i01/47422

Lindgren, U. (2005). Experiences of beginning teachers in a school-based mentoring program in Sweden. Educational Studies, 31(3), 251–263. https://doi.org/10.1080/03055690500236290

Linfield, K. J., & Posavac, E. (2019). Program Evaluation Methods and Case Studies (9th ed.). New York, NY: Routlege.

Marcinkoniene, R. (2005). Lessons to be learnt from the course evaluation: A case study of Kaunas University of Technology. Studies about Languages, 7.

Miles, M. B., & A. Huberman, M. (1994). Qualitative Data Analysis: An expanded sourcebook (2nd ed.). Thousand Oaks, CA: Sage Publications.

Nam, J. M. (2005). Perceptions of Korean college students and teachers about communication-based English instruction: Evaluation of a college EFL curriculum in South Korea, Unpublisted doctoral dissertation, The Ohio State University, Colombus, USA.

Ornstein, A. C., & Hunkins, F. P. (2018). Curriculum: Foundations, Principles, and Issues (7th ed.). Essex, England: Pearson Education.

Öztürk, R. Ö. (2015). An evaluation of master’s program in English language teaching at a Turksh university, Unpublished master’s thesis, Bahçeşehir University, İstanbul, Turkey.

Özutku, R. (2016). The views of instructors and students on Cumhuriyet University School of Foreign Languages English II course curriculum, Unpublished master’s thesis, Erciyes University, Kayseri, Turkey.

Paglis, L. L., Green, S. G., & Bauer, T. N. (2006). Does adviser mentoring add value? A longitudinal study of mentoring and doctoral student outcomes. Research in Higher Education, 47(4), 451–476. https://doi.org/10.1007/s11162-005-9003-2

Peacock, M. (2009). The evaluation of foreign-language-teacher education programmes. Language Teaching Research, 13(3), 259–278.

Roberts, L. R., Tinari, C. M., & Bandlow, R. (2019). An effective doctoral student mentor wears many hats and asks many questions. International Journal of Doctoral Studies, 14, 133–159. https://doi.org/10.28945/4195

Shenton, A. K. (2004). Strategies for ensuring trustworthiness in qualitative research projects. Education for Information, 22, 63–75. https://doi.org/10.1109/IranianCEE.2013.6599777

Stufflebeam, D. L. (1971). The relevance of the CIPP evaluation model for educational accountability. (ED062385). ERIC. Retrieved from https://eric.ed.gov/?id=ED062385

Stufflebeam, D. L. (1983). The Cipp Model for Program Evaluation. In G. F. Madaus, M. Scriven, & D. L. Stufflebeam (Eds.), Evaluation Models (pp. 117–141). Norwell, MA: Kluwer Academic Publishing.

Stufflebeam, D. L. (2000). The CIPP Model for Education. In G. F. Madaus, D. L. Stufflebeam, & T. Kellaghan (Eds.), In Evaluation Models Viewpoints on Educational and Human Services (2nd ed., pp. 279–318). Dordrecht, Netherlands: Kluwer Academic Publishing.

Stufflebeam, D. L., & Coryn, C. L. S. (2014). Evaluation Theory, Models, and Applications (2nd ed.). San Francisco, CA: Jossey-Bass.

Stufflebeam, D. L., & Shinkfield, A. J. (1985). Systematic Evaluation. Dordrecht, Netherlands: Springer.

Waldeck, J. H., Orrego, V. O., Plax, T. G., & Kearney, P. (2009). Graduate student/faculty mentoring relationships: Who gets mentored, how it happens, and to what end. Communication Quarterly, 45(3), 93–109. https://doi.org/10.1080/01463379709370054

Wilde, J. B., & Schau, C. G. (1991). Mentoring in graduate schools of education: Mentees’ perceptions. Journal of Experimental Education, 59(2), 165–179. https://doi.org/10.1080/00220973.1991.10806559