eISSN: Applied editor@oxfordianfoundation.com
Open Access

Non-Verbal Communication as Multimodal Social Signal: Cultural, Emotional, and Interactional Dynamics Across Human and Mediated Contexts

Department of Media and Communication Studies, Seoul National University, South Korea

Abstract

Non-verbal communication constitutes a fundamental yet frequently underestimated dimension of human interaction. Beyond spoken language, individuals continuously exchange meaning through facial expressions, gestures, posture, gaze, vocal qualities, silence, and spatial behavior. These non-verbal cues play a decisive role in emotional expression, cultural identity, social influence, leadership emergence, and mediated experiences such as film and digital communication. This article presents a comprehensive and theoretically rich examination of non-verbal communication as a multimodal social signal system. Drawing strictly upon established literature in cultural studies, emotion psychology, education, organizational communication, film sound analysis, and social signal processing, the study integrates qualitative and descriptive insights to explore how non-verbal behaviors operate across interpersonal, institutional, and technologically mediated contexts. Particular emphasis is placed on cultural comparisons between Korean and Japanese non-verbal behavior, the emotional power of sound and vocal expression, the role of gesture competence in learning, gendered norms of emotional display, and computational approaches to analyzing social interaction. Rather than treating non-verbal communication as supplementary to language, this article argues that it constitutes a primary channel through which meaning, emotion, and social structure are produced and interpreted. The findings highlight that non-verbal communication is culturally embedded, emotionally grounded, and socially consequential, while also raising critical questions regarding interpretation, bias, and ethical use in automated systems. The article concludes by emphasizing the necessity of interdisciplinary and culturally sensitive approaches to fully understand non-verbal communication in contemporary society.

Keywords

References

📄 1. Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70(3), 614–636.
📄 2. Choi, Y. W., & Chol, J. H. (2019). A qualitative study on the non-verbal communication of executive assistant. Journal of Secretarial Studies, 28(2), 89–115.
📄 3. Fischer, A. H. (2000). Gender and emotion: Social psychological perspectives. Cambridge University Press.
📄 4. Georgakopoulos, A., & Guerrero, L. K. (2007). Student perceptions of teachers' nonverbal and verbal communication: A comparison of best and worst professors across six cultures. International Education Studies, 3(2), 3–16.
📄 5. Hegstrom, T. G. (1979). Message impact: What percentage is nonverbal? Western Journal of Communication, 43(2), 134–142.
📄 6. Kim, H. T., & Lee, Y. J. (2012). The role and analysis of sound in movies based on the movie Inception. Journal of Digital Design, 12(4), 221–230.
📄 7. Kim, K. T. (2006). South Korea, Japan, two people non-verbal action. Emotional expression. Japanese Studies, 28, 73–94.
📄 8. Kwon, B. (1998). The importance of gesture competence in foreign language learning in terms of the relation between culture and gesture. Foreign Language Education Research, 1, 111–137.
📄 9. Lapakko, D. (1997). Three cheers for language: A closer examination of a widely cited study of nonverbal communication. Communication Education, 46(1), 63–67.
📄 10. Min, J. Y. (2013). A comparative study of the non-verbal behavior in Korean and Japanese. Journal of the Humanities, 40, 67–81.
📄 11. Mohammadi, G., & Vinciarelli, A. (2012). Automatic personality perception: Prediction of trait attribution based on prosodic features. IEEE Transactions on Affective Computing, 3(3), 273–284.
📄 12. Pan, W., Dong, W., Cebrian, M., Kim, T., & Pentland, A. (2011). Influence model (dominance) audio: Modeling dynamical influence in human interaction. MIT Press.
📄 13. Sanchez-Cortes, D., Aran, O., Jayagopi, D., Schmid Mast, M., & Gatica-Perez, D. (2012). Emergent leaders through looking and speaking: From audio-visual data to multimodal recognition. Journal on Multimodal User Interfaces.
📄 14. Tanaka, H., Neubig, G., Tomoki, T., Campbell, N., & Nakamura, S. (2012). Non-verbal cognitive skills and autistic conditions: An analysis and training tool. Cognitive Infocommunications.
📄 15. Vinciarelli, A., Pantic, M., & Bourlard, H. (2008). Social signal processing: Survey of an emerging domain.
Views: 0    Downloads: 0
Views
Downloads

Similar Articles

1-10 of 11

You may also start an advanced similarity search for this article.