多模态语篇分析ppt课件.ppt

《多模态语篇分析ppt课件.ppt》由会员分享，可在线阅读，更多相关《多模态语篇分析ppt课件.ppt（36页珍藏版）》请在三一办公上搜索。

1、Multimodal Discourse Analysis,Foreign Linguistics and Applied LinguisticsZheng Lu,What is multimodality?,A mode,according to Kress and Van Leeuwen,is a semiotic system with rules and regularities attached to it.Multiple modes,namely semiotic modes,can include gestures,posture,proxemics(空间关系学),visual

2、 images,document layout(设计布局),music and architectural design,etc.Meanings are created in texts and interactions in a complex interplay of semiosis across multiple modes but are not limited to written or spoken language.,Multimodal discourse analysis is a fairly new and rapidly developing perspective

3、 on discourse.Another interesting perspective on multimodal discourse analysis is that it not merely attempts to integrate all the possible semiotic modes of expressions but also can integrate various other approaches to discourse analysis.,BACKGROUNDMultimodal discourse analysis has become popular

4、in the western world since the 1990s.Multimodal discourse analysis relies heavily on Hallidays systemic-functional theory of language.Language is a kind of social semiotic,meanwhile,it has many functions,such as ideational function,(概念功能)interpersonal function(人际功能)and textual function(语篇功能).Languag

5、e is inseparable from social activities of man.,Before 1990s,researchers all took textual data,namely,static texts to be the primary resource for social interactions,such as Kress and van Leeuwens grammar of images视觉设计的语法 and OTooles investigation of paintings,sculpture and architecture.There is a w

6、idespread belief now that textual data is not necessarily the most important mode used for the interpretations of social meaning.,In order to study the complexity of human interaction,we have to work on the analysis of more dynamic interactions,and analyze all modes that the participants are utilizi

7、ng.Every interaction is multimodal.Although its relatively short history,multimodal discourse analysis has also had an important influence on other approaches and fields,most notably in the area of literacy and the growing interest in digital literacies and the field of human-computer interaction.,D

8、igital literacy is the ability to locate,organize,understand and analyze information using digital technology.Schools are continually updating their curriculum for digital literacy.This often includes computers in the classroom,the use of educational software to teach curriculum,and course materials

9、 being available to students online.,随着多媒体技术的产生与发展,如何将自然话语同多种模态结合起来进行分析解读是现代语言学,尤其是话语分析研究领域的重要课题。我国多模态话语分析研究主要涉及理论探讨、视觉应用、口语语料库建设、教学应用等领域。国内多模态话语的研究还处在起始阶段，尚未见到专著出版，只有为数不多的论文，其中包括胡壮麟的“社会符号学中的多模态化”，李战子“用系统功能语言学理论对多模态话语理论的研究”,另外朱永生和张德禄等也进行了相应的研究。,The self is not something that exists first and then en

10、ters into relationship with others,but it is,so to speak,an eddy(漩涡)in the social current and so still a part of that current.,American women anthropologistMead 1974:182,Some thoughts on personal identity constructionA multimodal perspective,Sigrid Norris,Associate Professor Auckland University of T

11、echnologyDirector:Multimodal Research Centre sigrid.norrisaut.ac.nzDegrees:Ph.D.LinguisticsGeorgetown University,2002M.S.LinguisticsGeorgetown University,1997B.A.Russian Language and LiteratureGeorge Washington University,1989,Sigrid Norris,OUTLINE,IntroductionSome backgroundTheoretic argumentStruct

12、ureConclusion,.the social actor,speaking on the phone with her employee(multimodal analysis).new thoughts about consciousness(the point of“I”and“me”identity elements),Introduction,Identity is who and what you are.Identity construction is a widely covered topic in studies of discourse.In this chapter

13、,the authors focus is a methodological one that allows the investigation of identity construction from a slightly new perspective,a multimodal approach.,My writing is first of all an extension of Scollons mediated discourse analysis(中介话语分析).Second,this framework is strongly influenced by the work of

14、 Kress and van Leeuwen in multimodality.Besides these two merging directions,the framework of multimodal interaction analysis draws on interactional sociolinguistics of Goffman Gumperz,discourse analysis as in Hamilton or Schiffrin and a historical approach of Wodak.,Some Background,There follows a

15、brief eclectic overview on personal identity construction:Schiffrin or Hamilton-micro discursive constructions,such as pronoun use and show how individuals establish themselves as belonging to one group or another.Wodak-combining text analysis with narrative and interview analysis on national identi

16、ty construction and placing it into a historical perspective.,Hall and Bucholztrying to encompass social psychological and socialcultural forces on analyzing a persons use of language.What all of these approaches to identity have in common is their concentration on language(spoken or written).It is

17、this point that creates the opportunity for this chapter on multimodal personal identity construction.,Theoretic argument,Prioritizing of language may limit our understanding of interaction and it also may limit our understanding of personal identity construction.I untilize and build on the micro an

18、alytical approach,for example,use to analyze spoken language but take multiple embodied modes such as posture,gesture and head movement into consideration.,Further,I investigate disembodied modes such as layout(布局设计)and objects.Identity is not formed in cohesive wholes but as situationally grounded

19、and co-constructed identity elements.When speaking of identity elements I am thinking of an analogy(类比)with chemical elements such as oxygen,hydrogen,or gold.(Please turn to page 134.),gold,Gender identity,oxygen,hydrogen,Occupational identity,Name:Tanya&LucyOccupation:two co-owners of a web-design

20、businessRelationship:colleagues&friends,An example,Image 1 illustrates that the modes of object handling and spoken language take on much weight for Tanya.However,object handling and spoken language are not the only modes that she employs.,Her body pointing away from Lucy,Not to be fixed on any one

21、particular point and may be termed a middle distance gaze.,With legs crossed,Beat gesturesMoving her hands up and down 8 times,These beat gestures are rhythmically organized with her spoken language,emphasizing particular words(this in line 2;all in line 3;whatever in line 4;email,and,fax,everything

22、 in line 5;always in line 6),and we may interpret these gestures as a way for Tanya to force herself to give clear instructions,Six out of the eight times(lines 3 to 6),Tanya simultaneously performs beats with her head,Head movements start with whatever(in line 3),go through her point of instruction

23、 email and fax everything(line 4)and end with always(line 6).Thus,while the hand beats govern the coherence and speed of her utterances,the head beats bracket the actual point that she is trying to get across.,HIGHMODAL DENSITY,Object handling Spoken language Posture Gaze Gesture Head movement,EMPLO

24、YER IDENTITY,When we revisit this picture,we see that Lucy is listening to Tanyas call and chimes(插话)in at the appropriate time,giving Tanya the sentence and then follow up with a phone call,which Tanya repeats without losing her rhythm by saying and then Always follow up with a phone call.,We also

25、notice that layout(布局设计)plays a role,with desks,chairs and computers arranged as they are,making it easily possible for Lucy to overhear the conversation and to chime（插话）in when she deems it necessary.Accordingly,Tanya is interacting with two different people simultaneously.While she is interacting

26、with her employee in the foreground of her attention,Tanya then co-constructs her co-owner identity together with Lucy in the mid-ground of her attention awareness.,Because the sheep and the fence appear closer to us,we say theyre in the foreground of the image.The foothills appear far away,so theyr

27、e in the background.Midground,as you probably guessed,is how we describe parts of the image that appear to be deeper than the foreground but not so deep as the background.,“M”is for the million things she gave me,“O”means only that shes growing old,“T”if for the tears she shed to save me,“H”is for h

28、er heart of purest gold,“E”is for her eyes,with love-light shinning,“R”means right,and right shell always be.Put them all together.They spell“Mother”,a word that means the world to me.,M-O-T-H-E-R By Howard Johnson,M 代表她给予我百万样东西，O 意味着她渐渐老去，T 是她为育我成人而洒落的颗颗泪滴，H 寓意她那金子般至纯至真的心灵，E 是她那双闪耀着慈爱之光的眼睛，R 使我坚信她永

29、远正确无误的言行。把这些字母拼在一起就是“母亲”，一个于我犹如整个世界一样的词语。,An example,The following excerpts that I will look at in detail come from an extensive ethnographic study of two co-owners of a web-design business that I conducted over a period of four months.During this time,I spent most of the days with the two women(who

30、m I will call Tanya and Lucy)during work hours and also spent time with them at their homes.I have met many of their friends,caretakers of their children,husband and ex-husband,and their parents.Here,I focus on Tanya and her everyday identity construction,reviewing data pieces that are mundane(普通的，平

31、凡的)and not special in any way.,In this chapter I show how identity elements are co-constructed in clock-time,are then moved in consciousness into memory and to a different level of attention and awareness.Here,I illustrate two aspects:one,that the identity elements that reside in memory can(and do)s

32、hape clock-time actions;and two,that there is a lag-time between the ending of one action and identity formation and the next.,Digital literacy is the ability to locate,organize,understand and analyze information using digital technology.Schools are continually updating their curriculum for digital literacy to keep up with accelerating technological developments.This often includes computers in the classroom,the use of educational software to teach curriculum,and course materials being available to students online.,