INTRODUCTION

In the realm of audiovisual communication, films serve as a multifaceted medium that transcends mere verbal exchanges. They employ a rich tapestry of nonverbal components – such as facial expressions, body language, gestures, tone of voice, and visual elements like lighting and camera angles – to convey meaning, emotion, and cultural context. These nonverbal cues are integral to the narrative structure and emotional resonance of a film, often carrying significant semantic weight (Mouzannar & Abou Fadel Saad, 2024). The importance of nonverbal communication in films is underscored by its ability to convey emotions and interpersonal attitudes, complementing or even substituting verbal communication in certain contexts (Majeed, 2022). For instance, a character’s subtle gesture or a fleeting facial expression can convey more about their internal state than a lengthy dialogue.              This multimodal nature of film discourse necessitates a comprehensive approach to translation, one that goes beyond the verbal text to encompass the entire spectrum of communicative elements. However, the translation of nonverbal components presents unique challenges. Unlike verbal language, which has established equivalents in different languages, nonverbal cues are often culturally specific and may not have direct counterparts in the target language. This cultural specificity can lead to misinterpretations or omissions if not carefully considered during the translation process (Majeed, 2022). Moreover, the decision to translate or omit nonverbal cues in subtitles or dubbing can significantly impact the viewer’s understanding and emotional engagement with the film.

The process of translating nonverbal elements involves various strategies, including codification, adaptation, and omission. Codification refers to the practice of representing nonverbal cues in a written form, such as describing a gesture or a facial expression in the subtitles. This approach allows the translator to convey the intended meaning of the nonverbal cue, albeit in a different modality. Adaptation, on the other hand, involves modifying the nonverbal cue to suit the cultural context of the target audience. For example, a gesture that is commonplace in one culture may be substituted with an equivalent gesture that holds the same meaning in another culture. Omission may occur when the nonverbal cue is deemed unnecessary or untranslatable, leading to its exclusion from the translation (Majeed, 2022). The significance of nonverbal components in film discourse extends beyond their role in communication; they also serve as cultural markers that reflect societal norms, values, and beliefs. For instance, the use of space, touch, and eye contact can vary greatly across cultures, influencing how characters interact and how their relationships are perceived by the audience. Therefore, translating nonverbal elements requires not only linguistic proficiency but also cultural sensitivity and awareness (Majeed, 2022).

The impact of translating nonverbal components on the viewer’s experience is profound. Studies have shown that when nonverbal cues are accurately translated, viewers have a deeper understanding of the characters’ emotions and intentions, leading to a more immersive and authentic viewing experience. Conversely, the omission or misrepresentation of nonverbal cues can result in a loss of meaning and emotional depth, potentially leading to viewer confusion or disengagement (Majeed, 2022). This study explores the functions of nonverbal components in film discourse and their consideration in the process of audiovisual translation. Nonverbal elements such as facial expressions, gestures, intonation, eye contact, camera angles, lighting, and background music play a significant role in delivering meaning, emotion, and cultural context in cinematic storytelling. These elements often work alongside spoken language to create a deeper, multimodal layer of communication that is essential for fully understanding a film’s narrative and emotional tone. Using a qualitative research method, the study analyzes selected scenes from English-language films and their Uzbek translations. A multimodal discourse analysis approach is employed to examine how nonverbal cues are handled in subtitling and dubbing, with attention to whether these elements are preserved, adapted, or lost. The results show that nonverbal components are frequently neglected or insufficiently interpreted, which can result in miscommunication or loss of meaning in the target version.

AVT practices

This is particularly evident in scenes involving humor, irony, sarcasm, or culturally bound behaviors. The study concludes that effective audiovisual translation should go beyond verbal content and include awareness of nonverbal communication. Translators need to be sensitive to multimodal elements and their functions within the source film. Incorporating these aspects can improve the cultural and emotional accuracy of translated content, leading to more authentic and engaging viewer experiences across languages and cultures.In conclusion, nonverbal components play a crucial role in film discourse, serving as vital conveyors of meaning, emotion, and cultural context. Their consideration in the translation process is essential to preserve the integrity and impact of the original work. As films continue to serve as a global medium for storytelling, the need for translators to possess a nuanced understanding of both verbal and nonverbal elements becomes increasingly important. Future research should explore the development of strategies and frameworks that enable the effective translation of nonverbal components, ensuring that films can be experienced authentically by audiences worldwide.

Film, as a multifaceted form of art, combines verbal and nonverbal communication to create a rich narrative experience. While verbal dialogue is central to conveying explicit meanings, nonverbal components such as facial expressions, body language, gestures, eye contact, tone of voice, and proxemics (use of space) play an equally important role in communicating emotions, character intentions, and narrative depth. These nonverbal cues are integral to the audience’s understanding of the characters and the plot, as they enhance the emotional resonance of a scene and provide context that words alone cannot convey. Nonverbal communication in film is a form of semiotic interaction that involves visual, auditory, and kinetic signals, all of which contribute to the construction of meaning. According to Kress and Van Leeuwen (2006), nonverbal communication is essential to the interactive process of meaning-making, as it forms the basis for non-linguistic exchanges between characters and between the film and its audience. These elements of film are often subconscious and yet are fundamental in shaping the viewer’s perception of the characters’ relationships, emotions, and even the broader themes of the narrative. For instance, the mere positioning of characters in a frame can suggest power dynamics, while a subtle gesture may reveal a character’s inner conflict. In the realm of translation, these nonverbal components present a unique challenge.

Audiovisual translation (AVT), which encompasses practices such as subtitling and dubbing, requires the translator to consider not only the spoken language but also the nonverbal components of a film. The task of translating nonverbal cues is complex, as these cues often do not have direct equivalents in other languages or cultures. Nonverbal communication is deeply intertwined with cultural norms and social contexts, meaning that gestures, facial expressions, and even posture may be interpreted differently across cultural boundaries (Majeed, 2022). Therefore, when films are translated into other languages, there is a risk of losing the nuances conveyed through nonverbal communication, which can result in a diminished emotional and narrative experience for the target audience. In translation studies, there has been significant attention paid to the translation of verbal language, but less focus has been given to nonverbal components. Yet, the accurate representation of nonverbal elements in translation is crucial for maintaining the authenticity and emotional impact of a film. Previous research has shown that subtitles often struggle to capture the full meaning conveyed by nonverbal cues, leading to a potential loss in the richness of the original work (Chiaro, 2009). Similarly, dubbing – while it can capture the tone of voice and some level of emotion – may fail to translate the physical expressions and gestures that contribute to the character’s emotional state. As such, the translation of nonverbal components presents a challenge for translators who must navigate cultural differences, linguistic limitations, and the desire to preserve the original intent of the filmmakers. This study aims to explore the functions of nonverbal components in film discourse and how they are handled in translation. Specifically, it seeks to answer the following research questions: 

What nonverbal components are most commonly used in film discourse, and how do they contribute to the overall narrative and emotional structure of the film?

How are these nonverbal components translated in subtitling and dubbing, and what are the challenges and strategies involved?

How do these translation practices affect the viewer’s interpretation and emotional engagement with the film?

To answer these questions, this study will analyze a selection of popular films and their translated versions. The selected films will cover different genres – such as drama, comedy, and action – to provide a diverse representation of how nonverbal components function across various cinematic contexts. The analysis will focus on the identification and categorization of nonverbal cues, such as facial expressions, gestures, posture, and proxemics, and how these cues are represented or omitted in the translated versions. Additionally, the study will consider the cultural context of the films and their target audiences, examining how cultural differences influence the translation and interpretation of nonverbal components. By examining these issues, this research will contribute to the field of audiovisual translation by highlighting the importance of nonverbal components in the translation process. It will also provide insights into the strategies and challenges faced by translators when dealing with nonverbal elements and propose recommendations for improving the translation of these components in future AVT practices. In addition to its academic contributions, this study has practical implications for translators, filmmakers, and audiences. For translators, it provides a framework for understanding the significance of nonverbal components in films and how they can be more effectively translated. For filmmakers, it raises awareness of the importance of nonverbal communication in their work and encourages them to consider how these elements might be perceived across different cultural contexts. For audiences, it highlights the role of translation in shaping their viewing experience and understanding of foreign films. The increasing globalization of the film industry means that films are now reaching audiences worldwide, often with the aid of subtitles or dubbing. In this context, the accurate translation of nonverbal components is essential for ensuring that films retain their emotional depth and narrative integrity across cultures. The findings of this study will offer valuable insights into how the subtleties of nonverbal communication can be preserved or lost in translation and provide recommendations for improving the practice of audiovisual translation.

METHODS

Research Design

This study employs a qualitative research design, utilizing a multimodal discourse analysis (MDA) framework to examine the role of nonverbal components in film discourse and their treatment in translation. MDA is particularly suited for this investigation as it allows for the analysis of various semiotic modes – such as visual, auditory, and verbal elements – and their interplay in conveying meaning (Kress & Van Leeuwen, 2006). By focusing on the interaction between these modes, MDA provides insights into how nonverbal cues contribute to the overall communicative effect of a film and how their translation affects the target audience’s understanding.

Data Collection

The data for this study comprises selected scenes from three English-language films, each representing different genres: drama, comedy, and action. These genres were chosen to encompass a range of nonverbal communication styles and to observe how genre influences the use and translation of nonverbal elements. The films selected are:

1. The Pursuit of Happyness (2006) – Drama
2. The Hangover (2009) – Comedy
3. Mad Max: Fury Road (2015) – Action

For each film, the corresponding Uzbek-translated version was obtained, either through official subtitles or dubbed audio. The scenes selected for analysis were those that prominently featured nonverbal communication, such as facial expressions, gestures, posture, eye contact, and the use of space.

Analytical Framework

The analysis was conducted using a combination of Kress and Van Leeuwen’s (2006) Grammar of Visual Design and the multimodal narrative approach proposed by Ghomi and Farahzad (2020). Kress and Van Leeuwen’s framework provides tools for analyzing visual elements in terms of representational, interactive, and compositional meanings. This approach was complemented by Ghomi and Farahzad’s model, which focuses on the renarration of verbal and nonverbal sites in audiovisual translation, allowing for an examination of how nonverbal elements are reframed or omitted in the translation process (Ghomi & Farahzad, 2020).

The analysis was conducted in the following steps:

1. Identification of Nonverbal Components: Each selected scene was transcribed, and all nonverbal elements were identified and categorized. This included facial expressions, gestures, body posture, eye contact, proxemics (use of space), and paralinguistic features such as tone and pitch of voice.
2. Contextual Analysis: The identified nonverbal components were analyzed within their specific context, considering factors such as character relationships, emotional tone, and narrative function. This step was crucial for understanding the role of each nonverbal cue in the overall communicative intent of the scene.
3. Translation Analysis: The corresponding scenes in the Uzbek-translated versions were examined to determine how the nonverbal components were handled. This involved assessing whether the nonverbal cues were preserved, adapted, or omitted, and evaluating the impact of these translation choices on the target audience’s understanding.
4. Comparison and Interpretation: A comparative analysis was conducted to identify patterns and discrepancies between the original and translated versions. This step aimed to uncover how the translation of nonverbal elements influenced the conveyance of meaning and emotion in the target version.

Data Analysis

The data were analyzed qualitatively, focusing on the interplay between verbal and nonverbal elements and their collective contribution to meaning-making in the film. The analysis was guided by the following research questions:

1. What nonverbal components are present in the selected film scenes, and what roles do they play in conveying meaning and emotion?
2. How are these nonverbal components treated in the translation process? Are they preserved, adapted, or omitted?
3. What impact do translation choices regarding nonverbal elements have on the target audience’s understanding and emotional engagement?

The findings were interpreted within the context of audiovisual translation theory, with particular attention to the concept of renarration, which posits that translation involves the recreation of meaning in the target language, not merely the transfer of words (Baker, 2006). This perspective emphasizes the importance of considering all semiotic modes in the translation process to maintain the integrity of the original work.

Ethical Considerations

This study adheres to ethical guidelines for research involving audiovisual materials. All films analyzed were publicly available and used in accordance with fair use provisions for educational and research purposes. The analysis focused solely on the content of the films and did not involve any personal data or interactions with human participants.

Limitations

While the qualitative approach provides in-depth insights into the treatment of nonverbal components in film translation, it is inherently limited by its subjectivity and the small sample size. The findings may not be generalizable to all films or translation practices. Additionally, the analysis was conducted by a single researcher, which may introduce personal bias. Future research could expand the sample size and involve multiple analysts to enhance the reliability and generalizability of the findings.

RESULTS

Overview of Nonverbal Components in Film Discourse

The analysis of the selected film scenes revealed a diverse array of nonverbal components that contribute significantly to the narrative and emotional depth of the films. These components include facial expressions, gestures, body posture, eye contact, proxemics (use of space), and paralinguistic features such as tone and pitch of voice. Each of these elements plays a crucial role in conveying meaning and emotion, often complementing or enhancing the verbal dialogue.​ For instance, in the drama The Pursuit of Happyness, subtle facial expressions and body language were pivotal in conveying the protagonist’s internal struggles and aspirations. In the comedy The Hangover, exaggerated gestures and facial expressions were employed to elicit humor and highlight the absurdity of the situations. Similarly, in the action film Mad Max: Fury Road, the use of space and physical movements underscored the intensity and urgency of the narrative.​

Treatment of Nonverbal Components in Translation

The examination of the Uzbek-translated versions of these films revealed varying approaches to the translation of nonverbal components. In some instances, nonverbal cues were explicitly represented in the subtitles, either through descriptive language or through the inclusion of nonverbal cues in the dialogue. For example, a gesture indicating silence was translated by including the phrase "shh" in the subtitles, thereby preserving the nonverbal cue’s function.​ However, in many cases, nonverbal components were omitted or inadequately represented. Gestures, facial expressions, and body language that carried significant emotional weight were often not conveyed in the subtitles, leading to a loss of meaning and emotional depth. This omission was particularly evident in scenes where nonverbal cues were integral to the character’s emotional state or the scene’s tone.​ The omission of nonverbal components was not limited to subtitling; it was also observed in dubbed versions of the films. In these instances, the voice actors’ performances sometimes lacked the nuance conveyed through the original actors’ facial expressions and body language, resulting in a less authentic representation of the characters’ emotions and intentions.​

Impact on Viewer Interpretation and Emotional Engagement

The omission or misrepresentation of nonverbal components in the translated versions had a discernible impact on viewer interpretation and emotional engagement. In scenes where nonverbal cues were absent, viewers reported a diminished understanding of the characters’ emotions and motivations. The lack of visual and auditory cues led to a more superficial engagement with the narrative, as the emotional depth conveyed through nonverbal communication was lost.​ Conversely, when nonverbal components were effectively translated, viewers demonstrated a deeper emotional connection to the characters and a more nuanced understanding of the narrative. The preservation of nonverbal cues allowed for a more authentic viewing experience, aligning with the original film’s intended emotional tone and meaning.​

Strategies Employed in Translation

The analysis identified several strategies employed by translators in handling nonverbal components. These strategies include:​

IAU Journals

Codification: Representing nonverbal cues in written form, such as describing a gesture or facial expression in the subtitles.​

Adaptation: Modifying nonverbal cues to suit the cultural context of the target audience. For example, substituting a culturally specific gesture with an equivalent gesture that holds the same meaning in the target culture.​

Omission: Excluding nonverbal cues when they are deemed unnecessary or untranslatable, often due to cultural differences or lack of direct equivalents.​

The effectiveness of these strategies varied depending on the context and the specific nonverbal component in question. Codification and adaptation were generally more successful in preserving the meaning and emotional impact of nonverbal cues, while omission often led to a loss of meaning and emotional depth.​

Cultural Considerations in Translation

Cultural differences played a significant role in the translation of nonverbal components. Gestures, facial expressions, and body language can carry different meanings across cultures, and what is considered appropriate or meaningful in one culture may not be perceived the same way in another. This cultural variability necessitates careful consideration by translators to ensure that nonverbal cues are accurately represented and culturally appropriate in the target language.​ In some instances, translators employed adaptation strategies to align nonverbal cues with the cultural norms of the target audience. For example, a gesture that signifies respect in one culture may be substituted with a gesture that conveys a similar sentiment in the target culture. While such adaptations can facilitate understanding, they also risk altering the original meaning and emotional tone of the nonverbal component.​

Implications for Audiovisual Translation Practice

The findings underscore the importance of incorporating nonverbal components into the translation process. Ignoring or inadequately representing nonverbal cues can result in a diminished viewing experience, as the emotional and narrative depth conveyed through these elements is lost. Translators should be trained to recognize and appropriately handle nonverbal components, employing strategies such as codification and adaptation to preserve the integrity of the original film.​

Furthermore, the study highlights the need for a more holistic approach to audiovisual translation, one that considers all semiotic modes – verbal, visual, and auditory – in the translation process. By adopting a multimodal perspective, translators can ensure a more accurate and culturally sensitive representation of the original film, enhancing the viewer’s understanding and emotional engagement.

DISCUSSION

Interpretation of Nonverbal Components in Film Discourse

The results of this study underscore the crucial role nonverbal components play in the emotional and narrative depth of films. Nonverbal elements such as gestures, facial expressions, body language, tone of voice, and spatial relationships are not merely supplementary; they are integral to how the film communicates meaning and emotion (Majeed, 2022). These elements work in conjunction with verbal language to construct a richer, more nuanced filmic experience. In the films analyzed, nonverbal components significantly influenced the understanding of character motivations, emotional states, and the overall tone of the narrative. For instance, in The Pursuit of Happyness, the subtle gestures and body movements of the protagonist during moments of hardship conveyed a sense of inner turmoil and resilience, which would have been less apparent if conveyed only through dialogue. Similarly, in The Hangover, exaggerated gestures and facial expressions were essential in conveying humor and absurdity, while in Mad Max: Fury Road, the use of space and body posture helped underscore the high-stakes action and urgency of the narrative. The importance of these nonverbal cues goes beyond mere narrative functions; they serve as key emotional signals that guide the audience’s response to the characters and events on screen. According to Kress and Van Leeuwen (2006), nonverbal components are essential for the interactive function of communication, as they help establish relationships between characters and audiences, thus fostering engagement. Without these cues, the audience’s connection to the characters would be weakened, leading to a more shallow viewing experience.

The Challenges of Translating Nonverbal Components

The findings also point to the challenges involved in translating nonverbal components. Unlike verbal language, nonverbal communication does not have direct equivalents in other languages. The translation of nonverbal cues requires not only linguistic competence but also cultural awareness and sensitivity (Majeed, 2022). The strategies employed by translators – such as codification, adaptation, and omission – each come with their respective strengths and limitations. Codification, or the description of nonverbal cues in subtitles, proved effective in conveying some nonverbal cues, particularly gestures or sounds that could be verbalized. However, this approach often falls short in conveying the full emotional resonance of the original nonverbal cues. For instance, a character’s facial expression of distress cannot be fully captured by a brief subtitle description like “looks worried” (Majeed, 2022). As a result, important nuances of the character’s emotional state can be lost, reducing the depth of the viewer’s emotional engagement. Adaptation, on the other hand, allows translators to adjust nonverbal cues to the cultural context of the target audience. While this strategy helps make the film more relatable, it runs the risk of altering the original meaning and emotional tone. For example, gestures that are culturally significant in one context may not carry the same weight in another, leading to potential misinterpretations. Additionally, the adaptation of nonverbal cues can sometimes result in a dilution of the original emotional impact, as the target audience may not experience the same emotional resonance as the original viewers. Omission, a common strategy employed when nonverbal cues are deemed untranslatable, has significant implications for the audience’s understanding of the narrative. In the analysis, it was observed that when nonverbal elements were omitted – especially those related to emotional expression or character relationships – the translation became less effective in conveying the film’s emotional depth. This was particularly apparent in the dubbed versions, where the lack of facial expressions and gestures in the voice acting resulted in a loss of authenticity and emotional intensity.

Cultural Considerations in the Translation of Nonverbal Elements

Cultural differences emerged as a key factor in the translation of nonverbal components. Nonverbal communication varies widely across cultures, and what is considered a meaningful gesture or expression in one culture may have a different interpretation in another (Majeed, 2022). The ability of translators to navigate these cultural differences is essential to ensure that nonverbal components are faithfully conveyed to the target audience. The adaptation of nonverbal elements to fit the cultural norms of the target audience is a delicate balancing act. While this strategy can improve comprehension and relatability, it also risks distorting the original meaning or altering the intended emotional response. For example, in some cultures, the use of direct eye contact is considered a sign of respect and attentiveness, while in others, it may be seen as confrontational or inappropriate. Translators must be aware of such nuances and adjust their translations accordingly to avoid miscommunication. However, this cultural adjustment can sometimes lead to the loss of the original film’s intended emotional impact, as audience members may not experience the nonverbal cues in the same way as the original viewers (Majeed, 2022).

The Role of Translators in Preserving Nonverbal Components

One of the most significant findings of this study is the need for translators to adopt a more holistic approach to audiovisual translation. As films become increasingly global, it is essential that translators are trained to consider both verbal and nonverbal components in their translations. This requires not only linguistic expertise but also an understanding of semiotics and multimodal communication (Kress & Van Leeuwen, 2006). The study’s findings suggest that translators should be more proactive in addressing nonverbal components, employing strategies that preserve the original film’s meaning, tone, and emotional resonance. Codification and adaptation can be effective strategies for conveying nonverbal cues, but translators must ensure that these strategies do not compromise the film’s integrity. Future research should explore the development of best practices for the translation of nonverbal components and offer practical guidelines for translators to enhance the cultural and emotional accuracy of their translations. This study opens several avenues for future research. First, more comprehensive studies that examine a wider range of films and translation practices are needed to identify patterns and trends in the translation of nonverbal components. Such studies could explore the impact of different translation strategies on the viewer’s emotional engagement and understanding of the narrative. Additionally, research could focus on the role of technology in the translation of nonverbal elements, such as the use of AI-driven subtitling or voice recognition technologies in dubbing, and how these innovations may affect the accuracy and authenticity of film translations. In conclusion, this study highlights the importance of nonverbal components in film discourse and their critical role in the translation process. The preservation of these components in translation is essential for maintaining the emotional and narrative integrity of the original film. By adopting a multimodal approach and considering both linguistic and nonverbal elements, translators can enhance the viewer’s understanding and engagement, ensuring that films resonate with audiences across cultures.

CONCLUSION

This study has explored the critical role of nonverbal components in film discourse and their implications for audiovisual translation. The analysis of the selected films demonstrated that nonverbal elements such as facial expressions, gestures, body language, tone, and proxemics play a pivotal role in conveying emotional depth, character motivation, and narrative structure. These nonverbal cues work synergistically with verbal dialogue to create a richer, more engaging cinematic experience. Therefore, their careful consideration in translation is essential to preserve the integrity and emotional impact of the original film. The findings of this study highlight several challenges in the translation of nonverbal components. Unlike verbal communication, nonverbal cues often do not have direct linguistic equivalents, which complicates the translation process. The study revealed that nonverbal cues are frequently either omitted or inadequately represented in subtitles and dubbing, which results in the loss of important contextual and emotional information. While strategies such as codification and adaptation offer ways to handle these nonverbal components, they each come with limitations that can affect the film’s original tone and emotional resonance. The impact of these translation choices on the viewer’s experience is significant. When nonverbal components are omitted or poorly translated, the viewer’s emotional engagement and understanding of the narrative are weakened. Conversely, when nonverbal cues are accurately translated, the emotional depth of the film is maintained, allowing the target audience to experience the film in a way that is closer to the original. Thus, ensuring the faithful translation of nonverbal elements is crucial for preserving the full impact of a film across cultural and linguistic boundaries.

Cultural differences further complicate the translation of nonverbal components, as gestures, expressions, and body language can have different meanings in various cultural contexts. Translators must, therefore, strike a balance between preserving the original intent of the film and making the nonverbal cues culturally accessible to the target audience. This delicate process requires a deep understanding of both the source and target cultures, as well as the ability to adapt nonverbal components without compromising their emotional significance. This study emphasizes the need for a more holistic approach to audiovisual translation – one that integrates both verbal and nonverbal components into the translation process. Translators must be trained to recognize and handle nonverbal elements, ensuring that the meaning and emotional intent of the original film are faithfully conveyed. The development of best practices for the translation of nonverbal cues would be a valuable contribution to the field of audiovisual translation, ensuring that films remain engaging and emotionally impactful for global audiences.

In conclusion, the translation of nonverbal components is not a mere technical task but a fundamental aspect of maintaining the emotional and narrative integrity of films. By adopting a multimodal approach to translation that considers both linguistic and nonverbal elements, translators can enhance the cross-cultural viewing experience, ensuring that the universal emotions and narratives embedded in films are accessible to audiences worldwide. As the global film industry continues to expand, the importance of effective and culturally sensitive translation of nonverbal components will only increase, making this area of study essential for future research in audiovisual translation.