Exploring the Role of Multimodal Metaphor through Gestures in Middle School English Education

Main Article Content

Xuanhui Deng
Xinxin Wu

Abstract

Introduction: As scholarly interest in metaphorical gestures has burgeoned in recent years, the exploration of these non-verbal communicative cues has primarily centered on domains, such as speeches, advertisements, and movies. Surprisingly, there exists a notable dearth of research specifically delving into the nuanced role of metaphorical gestures within the realm of English teaching, especially in middle school settings. This study sought to address this gap by strategically selecting two nationally recognized English courses taught in middle school English classrooms. The study aimed to explore the role of multimodal metaphor in gestures and provide some inspiration for middle school English teachers.


Methodology: In this research, two videos from National Excellent Courses were selected for analysis using a multimodal annotation tool, namely EUDICO Linguistic Annotator (ELAN). The course selected was the middle school English teaching design course, and the students involved were from Beijing Normal University, China. All gestures analyzed were classified into three types of metaphors, namely ontological, structural, and orientational.


Results: The findings indicated that ontological metaphors occurred most frequently, followed by orientational metaphors, with structural metaphors being the least frequent This research demonstrated the cognitive process of conceptual metaphor in classroom gestures with concrete examples.


Conclusion: In contemporary middle school English classrooms, relying solely on textual material is insufficient for fully supporting the teaching process. This study substantiates that employing multimodal metaphors in gestures can enhance teachers’ ability to motivate students effectively and facilitate improved interaction and semantic communication. The study provides English teachers with valuable guidance on implementing multimodal teaching strategies utilizing metaphorical gestures.

Article Details

How to Cite
Deng, X., & Wu, X. (2024). Exploring the Role of Multimodal Metaphor through Gestures in Middle School English Education . Journal of Contemporary Language Research, 3(1), 1–9. https://doi.org/10.58803/jclr.v3i1.94
Section
Research Articles

References

Alibali, M. W., & Nathan, M. J. (2014). Teachers' gestures as a means of scaffolding students' understanding: Evidence from an early algebra lesson. Video research in the learning sciences, 349-365.

Calbris, G. (2011). Elements of meaning in gesture. John Benjamins Publishing Company.

Casasanto, D., & Jasmin, K. (2012). The hands of time: Temporal gestures in English speakers. Cognitive Linguistics, 23(4), 643-674. https://doi.org/10.1515/cog-2012-0020

Chen, G. M. (2018). A multi-task empirical study on the temporal indication of “front/back” in Chinese and English: With a brief discussion on the psychological reality of “left/right” dimension of temporal cognition. Language Teaching and Linguistic Studies, (03), 29-38. https://doi.org/10.3969/j.issn.0257-9448.2018.03.003

Cienki, A. J. (1998). Metaphoric gestures and some of their relations to verbal metaphoric expressions. Discourse and cognition: Bridging the gap, 189-204.

Cienki, A., & Müller, C. (2008). Metaphor, gesture, and thought. The Cambridge handbook of metaphor and thought, 483, 501.

Cienki, A., & Müller, C. (Eds.). (2008). Metaphor and gesture (Vol. 3). John Benjamins Publishing.

Cohen, D., Beattie, G., & Shovelton, H. (2011). Tracking the distribution of individual semantic features in gesture across spoken discourse: New perspectives in multi-modal interaction. Semiotica, 185(1–4), 147–88. https://doi.org/10.1515/semi.2011.037

Eggertsson, G. T., & Forceville, C. (2009). Multimodal expressions of the HUMAN VICTIM IS ANIMAL metaphor in horror films. Multimodal metaphor, 429-449.

Forceville, C. (2002). Pictorial metaphor in advertising. Routledge. https://doi.org/10.4324/9780203064252

Forceville, C. (2002). The identification of target and source in

pictorial metaphors. Journal of pragmatics, 34(1), 1-14. https://doi.org/10.1016/S0378-2166(01)00007-8

Forceville, C. (2009). Non-verbal and multimodal metaphor in a cognitivist framework: Agendas for research. Multimodal metaphor, 2, 19-35.

Forceville, C., & Urios-Aparisi, E. (Eds.). (2009). Multimodal metaphor (Vol. 11). Walter de Gruyter.

Gullberg, M. (2008). Gestures and second language acquisition. In P. Robinson, & N. C. Ellis (Eds), Handbook of cognitive linguistics and second language acquisition, (pp. 276-305). Routledge.

Guo, H. W., & Yang, X. Y. (2020). A multimodal study of intersemiosis between teachers’ metadiscourse and gestures. Foreign Language Education, 41(04), 52-57. https://doi.org/10.16362/j.cnki.cn61-1023/h.2020.04.010

Ibáñez Arenós, M., & Bort-Mir, L. (2020). Going Up Is Always Good: A Multimodal Analysis of Metaphors in a TV Ad with FILMIP, the Filmic Metaphor Identification Procedure. https://doi.org/10.5209/cjes.66959

Jiang, G. Y., & Wang, R. H. (2013). A Study on the Integration of Speech-gesture Multimodal Metaphors in English Speech. Foreign Languages Research, (05), 9-16. https://doi.org/10.13978/j.cnki.wyyj.2013.05.012

Lakoff, G., & Johnson, M. (2008). Metaphors we live by. University of Chicago press.

Le, Hong T. X. & Gonzales, C. (2012). A microanalysis of gestures in classroom talk. Hawaii Pacific University TESOL, 13-29.

Li, H. (2020). The Cognitive Uniformity Between Gestural and Verbal Metaphor—A Case Study on the English Speech Contests in China. Journal of Xi'an International Studies University, 21(2), 29-32. https://doi.org/10.16362/j.cnki.cn61-1457/h.2013.02.017

Li, H., & Jiang, G. Y. (2018). The Gestural Expression of Spatial Metaphors for Affective Valance in Chinese. Journal of Foreign Languages, 41(02), 86-93. https://doi.org/10.3969/j.issn.1004-5139.2018.02.009

Lim, V. F. (2019). Analysing the teachers’ use of gestures in the classroom: A systemic functional multimodal discourse analysis approach. Social Semiotics, 29(1), 83-111. https://doi.org/10.1080/10350330. 2017.1412168

Liu, Y. M., & Wang, X. F. (2021). Hotspots and Trends of Domestic Multimodal Studies (2010-2020): Visualization Analysis Based on Cite Space. Foreign Languages and Literature, 37(06):66-74. https://doi.org/10.3969/j.issn.1674-6414.2021.06.009

Macedonia, M., & von Kriegstein, K. (2012). Gestures enhance

foreign language learning. Biolinguitics, (64): 393-416. https://hdl.handle.net/20.500.12528/1489

Matsumoto, Y., & Dobs, A. M. (2017). Pedagogical gestures as interactional resources for teaching and learning tense and aspect in the

ESL grammar classroom. Language Learning, 67(1), 7-42. https://doi.org/10.1111/lang.12181

McCafferty, S. G. (2002). Gesture and creating zones of proximal development for second language learning. The Modern Language Journal, 86(2), 192-203. https://doi.org/10.1111/1540-4781.00144

McNeill, D. (1992). Hand and mind: What gestures reveal about thought. University of Chicago Press.

Mehrabian, A. (1971). Silent messages (Vol. 8, No. 152, p. 30). Belmont, CA: Wadsworth.

Meijers, M. H., Remmelswaal, P., & Wonneberger, A. (2019). Using visual impact metaphors to stimulate environmentally friendly behavior: The roles of response efficacy and evaluative persuasion knowledge. Environmental Communication, 13(8), 995-1008. https://doi.org/ 10.1080/17524032.2018.1544160

Mittelberg, I., & Waugh, L. R. (2009). Metonymy first, metaphor second: A cognitive-semiotic approach to multimodal figures of thought

in co-speech gesture. Multimodal metaphor, 329, 358. https://doi.org/10.1515/9783110215366.5.329

Müller, C. (2004). Forms and uses of the Palm Up Open Hand: A case of a gesture family. The semantics and pragmatics of everyday gestures, 9, 233-256. https://doi.org/10.1075/gest.16.2.05mul

Müller, C. (2009). Metaphors dead and alive, sleeping and waking: A dynamic view. University of Chicago Press. https://doi.org/10.7208/ chicago/9780226548265.001.0001

Peng, Y., & He, A. P. (2017). A Study on the Coordination among Co-speech Gestures and Their Accompanying Discourse Features in Classroom Scaffolding Conversation. Foreign Languages and Their Teaching, (02), 70-80+148-149. https://doi.org/ 10.13458/j.cnki.flatt.004346

Poppi, F. I., Bolognesi, M., & Ojha, A. (2020). Imago Dei: Metaphorical conceptualization of pictorial artworks within a participant-based framework. Semiotica, (236-237), 349-376. https://doi.org/ 10.1515/sem-2018-0077

Repetto, C., Pedroli, E., & Macedonia, M. (2017). Enrichment effects of gestures and pictures on abstract words in a second language. Frontiers in psychology, 8, 285929. https://doi.org/10.3389/fpsyg.2017.02136

Rodríguez-Cuadrado, S., Ojedo, F., Vicente-Conesa, F., Romero-Rivas, C., Sampedro, M. Á. C., & Santiago, J. (2023). Sign iconicity helps learning new words for abstract concepts in a foreign

language. Second Language Research, 39(3), 873-898. https://doi.org/10.1177/02676583221093841

Roth, W. M., & Lawless, D. (2002). Scientific investigations, metaphorical gestures, and the emergence of abstract scientific concepts. Learning and instruction, 12(3), 285-304.

Shu, D. F. (2012). Recent progress and development trend of cognitive linguistics in recent 10 years. Foreign Languages Research, (1), 36-44. https://doi.org/10.13978/j.cnki.wyyj.2012.01.010

Sun, X., & Zhang, D. (2018). An Empirical Study on Gesture Use by Chinese Learners with Different English Proficiency Levels. Modern Foreign Languages, 41(06), 829-839.

Tay, D. (2017). Metaphor construction in online motivational posters. Journal of Pragmatics, 112, 97-112. https://doi.org/10.1016/j.pragma. 2017.03.006

Tsakona, V. (2009). Language and image interaction in cartoons: Towards a multimodal theory of humor. Journal of pragmatics, 41(6), 1171-1188. https://doi.org/10.1016/j.pragma.2008.12.003

Umino, T. (2023). Using multimodal language learning histories to understand learning experiences and beliefs of second language learners in Japan. The Modern Language Journal. https://doi.org/10.1111/modl.12828

Wang, T. Y., & Gan, L. (2015). The Multimodal Cognitive Research under the Visual Field of Post-modernist Philosophy—Taking the Movie Poster of The King’s Speech as an Example. Foreign Language Research, (04), 82-86. https://doi.org/10.16263/j.cnki.23-1071/h.2015.04.017

Wang, Y., & Xiang, E. B. (2016). An Analysis of Multimodal Metaphorical Representation in Domestic and Foreign Automobile Print Advertisement. Foreign Languages and Literature, (02), 85-92.

Wu, L. J. (2022). Research on Multi-modal Teaching Behaviors in Live Video Streaming of Foreign Language Classroom and Its Enlightenment. Modern Educational Technology, 32(10), 53-60.

Wu, S. W., & Niu, Y. L. (2023). The Role of Gestures in Second Language Learning: A Meta-Analysis. Foreign Languages and Their Teaching, (06):62-72+147.

Wu, S. W., & Tong, Y. (2022). An Overview of Gesture Studies in Cognitive Linguistics. Journal of PLA University of Foreign Languages, 45(01), 79-87+161.

Xu, L., Naserpour, A., Rezai, A., Namaziandost, E., & Azizi, Z. (2022). Exploring EFL learners’ metaphorical conceptions of language learning: a multimodal analysis. Journal of Psycholinguistic Research, 51(2), 323-339. https://doi.org/10.1007/s10936-022-09842-2

Yang, X. J. (2005). New theory of metaphor and its classification. Foreign Language Research, (03), 41-45. 10.16263/j.cnki.23-1071/h. 2005.03.007

Zhang, M. (2020). Multimodal Metaphor Analysis of Co-speech Gestures in College English Teacher’s Classroom Discourse. Journal of Jining University, 41(02), 59-64. https://doi.org/10.3969/j.issn.1004-1877.2020.02.010

Zhao, X. F. (2011). New Development of Conceptual Metaphor Studies: Multimodal Metaphor. Foreign Languages Research, (01), 1-10+112.

Zhong, X. Y., & Gao, Y. (2018). An Empirical Study on the Effectiveness of Gesture in L2 Listening Class. Journal of Beijing International Studies University, 40(04), 115-130. https://doi.org/10.12002/j.bisu.134