Proposal of statistical analysis to support the assessment method of a Brazilian Industrial Engineering course
Gaudêncio, Juliana Helena Daroz; Scheidegger, Anna Paula Galvão; Pinto, Camila Pereira; Turrioni, João Batista; Turrioni, Ana Maria Silveira
Abstract
The requirement to adapt the university education to demands of society and professional market is improving the teaching methodologies that try to develop skills and prepare the students to deal with day-to-day situations of a business environment. Therefore, this research presents the assessment method utilized in an Industrial Engineering course carried out by a Brazilian public university in partnership with a multinational company. The course had 37 participants, consisting of: 28 students divided into four groups; 1 teacher; 4 university tutors; and 4 company tutors. The main objective is to assess the consistency of grades assigned to students and their work groups using agreement, variance and correlation analyses. As conclusion, the analyses indicated a possible deficiency in the assessment method application since the values of agreement and correlation coefficients were lower than expected but also provided a positive contribution to the improvement of assessment and the course as a whole.
Keywords
References
Agrawal, D. K., & Khan, Q. M. (2008). A quantitative assessment of classroom teaching and learning in engineering education. European Journal of Engineering Education, 33(1), 85-103. http://dx.doi.org/10.1080/03043790701746389.
Al-Nashash, H., Khaliq, A., Qaddoumi, N., Al-Assaf, Y., Assaleh, K., Dhaouadi, R., & El-Tarhuni, M. (2009). Improving electrical engineering education at the American University of Sharjah through continuous assessment. European Journal of Engineering Education, 34(1), 15-28. http://dx.doi.org/10.1080/03043790802710169.
Ayatollahi, S. M. T., Bagheri, Z., & Heydari, S. T. (2013). Agreement analysis among measures of thinness and obesity assessment in Iranian school children and adolescents. Asian Journal of Sports Medicine, 4(4), 272-280. PMid:24800002. http://dx.doi.org/10.5812/asjsm.34247.
Brown, S. (2004). Assessment for Learning. Learning and Teaching in Higher Education, 1, 81-89. Retrieved in 28 August 2016, from http://www2.glos.ac.uk/offload/tli/lets/lathe/issue1/articles/brown.pdf
Chua, K. J., Yang, W. M., & Leo, H. L. (2014). Enhanced and conventional project-based learning in an engineering design module. International Journal of Technology and Design Education, 24(4), 437-458. http://dx.doi.org/10.1007/s10798-013-9255-7.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37-46. http://dx.doi.org/10.1177/001316446002000104.
Donohue, S. (2014). Supporting active learning in an undergraduate geotechnical engineering course using group-based audience response systems quizzes. European Journal of Engineering Education, 39(1), 45-54. http://dx.doi.org/10.1080/03043797.2013.833169.
Eva, K. W. (2001). Assessing tutorial-based assessment. Advances in Health Sciences Education: Theory and Practice, 6(3), 243-257. PMid:11709638. http://dx.doi.org/10.1023/A:1012743830638.
Feletti, G. I., & Sanson-Fisher, R. W. (1983). Measuring tutor ratings in relation to curriculum implementation. Higher Education, 12(2), 145-154. http://dx.doi.org/10.1007/BF00136633.
Goodyear, P., Jones, C., Asensio, M., Hodgson, V., & Steeples, C. (2005). Networked learning in higher education: student’s expectations and experiences. Higher Education, 50(3), 473-508. http://dx.doi.org/10.1007/s10734-004-6364-y.
Heubert, J. P., & Hauser, R. M. (1999). High stakes: testing for tracking, promotion, and graduation. Washington: National Academy Press.
Kritikos, V. S., Woulfe, J., Sukkar, M. B., & Saini, B. (2011). Intergroup peer assessment in problem-based learning tutorials for undergraduate pharmacy students. American Journal of Pharmaceutical Education, 75(4), 73. PMid:21769149. http://dx.doi.org/10.5688/ajpe75473.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159-174. PMid:843571. http://dx.doi.org/10.2307/2529310.
Lee, J., Imanaka, Y., Sekimoto, M., Nishikawa, H., Ikai, H., & Motohashi, T. (2011). Validation of a novel method to identify healthcare-associated infections. The Journal of Hospital Infection, 77(4), 316-320. PMid:21277647. http://dx.doi.org/10.1016/j.jhin.2010.11.013.
Montgomery, D. C. (2012). Design and analysis of experiments. United States of America: John Wiley & Sons.
Montgomery, D. C., & Runger, G. C. (2013). Applied statistics and probability for engineers. United States of America: John Wiley & Sons.
Mückenbergera, E., Togashib, G. B., Páduac, S. I. D., & Miurad, I. K. (2013). Process management applied to the establishment of international bilateral agreements in a Brazilian public institution of high education. Production, 23(3), 637-651. http://dx.doi.org/10.1590/S0103-65132012005000076.
Norcini, J. J. (2003). Peer assessment of competence. The Metric of Medical Education, 37(6), 539-543. PMid:12787377. http://dx.doi.org/10.1046/j.1365-2923.2003.01536.x.
Norton, L., Norton, B., & Shannon, L. (2013). Revitalizing assessment design: what is holding new lecturers back? Higher Education, 66(2), 233-251. http://dx.doi.org/10.1007/s10734-012-9601-9.
Phillips, R. (2005). Challenging the primacy of lectures: the dissonance between theory and practice in university teaching. Journal of University Teaching and Learning Practice, 2(1), 1-12. Retrieved in 28 August 2016, from http://ro.uow.edu.au/jutlp/vol2/iss1/2
Raud, Z. (2010). Active learning power electronics: a new assessment methodology. In Proceedings of the International Power Electronics and Motion Control Conference, Ohrid, Macedonia.
Roberts, M. J., & Russo, R. (1999). A student’s guide to analysis of variance. New York: Routledge.
Sambell, K., Mcdowell, L., & Brown, S. (1997). But is it fair? An exploratory study of student perceptions of the consequential validity of assessment. Studies in Educational Evaluation, 23(4), 349-371. http://dx.doi.org/10.1016/S0191-491X(97)86215-3.
Shahadan, T. N. T., Shafie, N., & Liew, M. S. (2012). Study on subject’s assessment for students’ active learning in a private institution. Procedia: Social and Behavioral Sciences, 69, 2124-2130. http://dx.doi.org/10.1016/j.sbspro.2012.12.176.
Shankland, R., Genolini, C., França, L. R., Guelfi, J. D., & Ionescu, S. (2010). Student adjustment to higher education: the role of alternative educational pathways in coping with the demands of student life. Higher Education, 59(3), 353-366. http://dx.doi.org/10.1007/s10734-009-9252-7.
Shekar, A. (2007). Active learning and reflection in product development engineering education. European Journal of Engineering Education, 32(2), 125-133. http://dx.doi.org/10.1080/03043790601118705.
Struyf, E., Vandenberghe, R., & Lens, W. (2001). The evaluation practice of teachers as a learning opportunity for students. Studies in Educational Evaluation, 27(3), 215-238. http://dx.doi.org/10.1016/S0191-491X(01)00027-X.
Timossi, L. S., Francisco, A. C., Santos Junior, G., & Xavier, A. A. P. (2010). Analyis on quality of work life of employess with different levels of education through an analysis of correlation. Production, 20(3), 471-480. http://dx.doi.org/10.1590/S0103-65132010005000031.
Vieira, F. H. A., & Francisco, A. C. (2012). Corporate education implementation stages and their impacts on Brazilian companies: a multi-case study. Production, 22(2), 296-308. http://dx.doi.org/10.1590/S0103-65132012005000018.
Waters, R., & Mccracken, M. (1997). Assessment and evaluation in problem-based learning. IEEE Xplore Digital Library, 2, 689-693. http://dx.doi.org/10.1109/FIE.1997.635894.
Willey, K., & Gardner, A. (2010). Investigating the capacity of self and peer assessment activities to engage students and promote learning. European Journal of Engineering Education, 35(4), 429-443. http://dx.doi.org/10.1080/03043797.2010.490577.
Facebook
Google+
Twitter
LinkedIn
Mendeley
StumbleUpon
CiteULike
Reddit
Email