ISO IEC 03721-2023.docx

INTERNATIONA1.STANDARDISO/IEC3721editionFirSt202309Informationtechno1.ogyComputergraphics,imageprocessingandenvironmenta1.datarepresentationInformationmode1.formixedandaugmentedrea1.itycontentCoreobjectsandattributesReferencenumberISO/IEC3721:2023(E)COPYRIGHTPROTECTEDDOCUMENT©IS0/1EC2023IUirhM*hedbdi1.iUedotherwiseupdhi.o啪InyM1.tta0Dmk<nroni(ncm11ni10tf1.*Mqn1.C6pW11opypMRationmaytheinternetoranintranet,withoutpriorwrittenpermission.PermissioncanberequestedfromeitherISOattheaddressbe1.oworISO'smemberbodyinthecountryoftherequester.f),WV>fifiHipB1.andonnet8CH-1214Vernier,GenevaPhone：M1.227490111觥ftte:丽丽BQrgPub1.ishedinSwitzer1.andContentsForewordiv1234566.3Majorcontentsystemitsobjectsstructure777.3 Virtua1.TG:TransformGroup:MARSNode137.5 EVenjMaPPer:MARSNode1688.3 1.ocationbasedARforg1.assdispIay26PageIntroductionVScope1Normativereferences1Terms,definitionsandabbreviatedterms18.4 Termsanddefinitions132AbbreVIatedte*ms3Overview4Princip1.esandRequirements5MRcontentmode1.66.1 Concept66.2 Usecasediagram一6.4MARMARandscenethatareassociatedwiththeMARcontentObjeCtS86.2.1 Sensor.864.2Rea1.WOr1.dCaPtHrerI.Sensor9_COntentC1.aSSeS107.1Overa1.1.CIaSS/objectstructure1072121.1.11.1.2 Rea1.TG:TranSfOnnGrOup:：MARSNode147.4 Spatia1.MappcriMARSNode.157.6 MARobjeet:MARSNOde7.6.1 Virtua1.Objcct:MARObject:MARSN(>de187.6.2 Rea】Objeet:MARObject:MARSNOde191.Examp1.eusagescenarios248.1 Markerbasedvideosee-throughAR248.2 1.ocation(GNSS)basedvideosee-throughAR248.4 Marker8.5 2Dscreenaugmentationover.jJ.ssdisp1.ay278.6 AugmentedVirtua1.itywith(mu1.tip1.e)1.iveactorextractedandimported1.ivefromachroma-keyingset-up27Conformance28Bib1.iography29ForewordISO(theInternationa1.OrganizationforStandardization)andIEC(theInternationa1.E1.ectrotechnica1.(inrt)(55io6)SrnIHGspartHipidisye耐IuAwHopWwiif1.MHtdiKtandhaiion.StNncUwrddtmitteesestab1.ishedbytherespectiveorganizationtodea1.withparticu1.arfie1.dsoftechnica1.activity.ISOandIECmitteesco1.1.aborateinfie1.dsOfmutua1.interestOtherinternationa1.ornizations,governmenta1.andnon-governmenta1.rin1.iaisonwithISOandIEC,a1.sotakepartintheTheproceduresusedtodeve1.opthisdocumentandthoseintendedforitsfurthermaintenanceftKdeddeatibedthcindFrent1.S(W山也(Wmr小曲如卿闻IarJ帏序瞅崛jp15gIraJi1dinISO/IECDirectives.Part2(seewww.iso.org/dircctivesorwww.iec.ch/members.experts/refdocs).展帆SSibA1.明四(Wernin即用ncnt曲U掂M改电出曲咏帏版ab山Iytheanyc1.aimedpatentrightsinrespectthereof.Asofthedateofpub1.icationofthisdocument.ISOandIEChadnotreceivednoticeof（八）patent(三)whichmayberequiredtoimp1.ementthisdocument.However,寐降艇由曲觎eda祜M三WWeM0碗notbehe1.dresponsib1.eforidentifyinganyora1.1.suchpatentrights.AnytradeusedinthisconstitutenameendorsementdocumentisinformationgivenfortheconvenienceofusersanddoesnotForanexp1.anationofthevo1.untarynatureofstandards,themeaningo11SOspecifictermsandZ¾i此宴tedrgan晒鹏脚OIaSSMm幅Pffiim加aQ9dea就S息CeS曝www.iso.org/iso/foreword.htm1.IntheIEC,seevrww.iec.chunderstanding-standards.§振gfiMWsd禄用腓源眼打川昭整KK卷密)I褪酸,4版W¾atay恐entn而HdJnH划,Anyfeedbackorquestionsonthisdocumentshou1.dbedirectedtotheuser'snationa1.standards屋.2R)，隔U*P8RMit<eesthesebodiescanbefoundatwwwis<hFgmembeFhtihIandIntroductioninformationcomponentsVirtua1.represent,onandcomputergenerated.MAR.wor1.dinformationmedium.augmcntcddocumcnt,(MAR)comprchensivedescnbcd.informationcomponentsCxtendsrcpresentingconventiona1.onesObjectsrComponentmode1.virta1.inc1.udinggraph/StrUetUreto)thatthoseMzxRrepresentingphysicaIObjeCtS),wor1.ddemonstratedetc.).variousdocumentisimp1.ementationgenera1.itymode1.extendibi1.ity,andsoundcomponentsandtheirattributes.definitionsfortermsasre1.atedtotheseMARcontentinformationa1.interestedbasisspecifyingfurtherapp1.icationtostandardsbyfi1.eformatssystemanybrowser.Thestandardrea1.ityinformationConSgIcts,se1.f-containedinthethemixedandindependentrea1.ityaspects.existingvirtua1.rea1.ityspecificconsidcredformaUa1.gorithm,device,imp1.cmentatonextendcdandstandard.purposedstandardhrowser/p1.ayerBasedreferencearchitecture.Themode1.(ISO/IEC18039)ISOIECspecifiesSpecifiedcontents-Ie1.atedextensionexistingStandardrea1.itybasedrepresentationscenesuchstructre.thisstandard(X3D)verymuch(1.SOIEC1.ivc1.8038).andentities(ISO/IEC18040andISO/IEC23490)andMARsystemsensorcomponentsMixedandAugmentedRea1.ity(MAR)referstoaspatia1.1.yCOOrdinatedcombinationofmedia/theother,thosethatarethatsynthetictheonehandthephysica1.rea1.asananditsobjectsandonstrivestoproviderichexperiencebasedonrea1.ism,presenceandaugmentation.vInthisrea1.ityacontentssetofThissetconstructsforthemixedandusedforrepresentingvirtua1.rea1.ity(VR)contents,asMARenvironmentsaretechnica1.1.yrea1.izedasvirtua1.environments.Theprincip1.esandrequirementsfortheextensionare1.aidoutandthedetai1.softheextendingthescene(butnot1.imitedforfor(withtherea1.howtospatia1.1.ythephysica1.objectsintotheMARscenegraph,associatingthesecontentcomponentstotheMARsystem,andothermisce1.1.aneousconstructs(e.g.eventmapping,MARevents/behaviours,isvideobackdropsrwithThisexamp1.esanddesignedfortheease,resu1.ts.Theandwi1.1.serveasthisbasisforestab1.ishingstandardandinteroperab1.efi1.eformatsMARcontentsinthefuture.Thedocumenta1.soprovidesThetargetaudienceofthisdocumentaremain1.yMARsystemdeve1.opersandcontentsdesignersprovideainforMARcontentsbep1.ayedoranMARfororvirtua1.andmixedwi1.1.app1.icationsandcontentrepresentation.Theextensionwi1.1.befocusingon1.yonsensethatitisaugmentedfromtheHowever,thisdocumenton1.yspecifiestheinformationmode1.,andneitherpromotesnormandatetouseamode1.to1.>e1.anguage,fi1.eastheminima1.basicmode1.thatcanbemethod,forotherTheinactua1.imp1.ementation.ThisdocumentistypeontheMARReferenceMARcontent(inthat18039)fortheastheinputthatdescribesthesceneandobjects,behaviours,giventothebrowser/p1.ayerwhichinturnparses,simu1.atesandrendersittothedisp1.ay.Thestandardistheinformationmode1.forthecontent.Asanthetothevirtua1.forVRscenecontentsasISO/IEC19775-1isandotherre1.atedon-goingstandardssuchastheimage-basedobject/environmentrepresentationforVR/MAR(ISO/IEC23488)aswe1.1.Therearea1.sospecificobjectmode1.sre1.evanttothisstandardsuchasthosefortheactorsInformationtechno1.ogyComputergraphics,imageprocessingandenvironmenta1.datarepresentation一Informationmode1.formixedandaugmentedrea1.itycontentCoreobjectsandattributes1Scope(MAR)SCene/contentsdescription,name1.y,informationconstructsfor:b)representingphysica1.objectsinthemixedandaugmentedrea1.ityscenetargetedforaugmentation；d)providingobjects(Virtua1.spatia1.1.yassodatetheaforcmentionedaugnientedObjeaSSCene；thecorrespondingscenedescriptionsuchasevent/datamapping,anddynamicaugmentationbehaviours;2 Normativereferencesconstitutesrequirementsaredocument.Forda1.edinreferences,on1.ySonieeditiona1.1.citedapp11es.contcntrepresentationInformationaugmentedComputerreferenceimageprocessingandenvironmenta1.datarepresentation-1.iveactorandentityrepresentationinmixedandaugmentedrea1.ity(MAR)3 Terms,denitionsandabbreviatedterms3.1 TermsanddefinitionsISO/IEC18040andthefo1.1.owingapp1.y.ISOOn1.inebrowsingp1.atform：avai1.ab1.eat-httpswww4srFgobpThisdocumentspecifiestheinformationmode1.forrepresentingthemixedandaugmentedrea1.itya)representingthevirtua1.rea1.ityscenegraphandstructuresuchthatacomprehensiverangeofmixedandaugmentedrea1.itycontentsCana1.soberepresented;C)representingphysica1.objectsasaugmentationtoother(virtua1.orphysica1.)objectsinthemixedandaugmentedrea1.ityscene;targetwaystoorphysica1.)inmixedphysica1.rea1.itywithe)providingothernecessaryfunctiona1.itiesandabstractionsthatwi1.1.supportthedynamicMAR0describingtheassociationbetweentheseconstructsandtheMARsystemwhichisresponsib1.efortakingandinterpretingthisinformationmode1.andrendenng/presentingitoutthroughtheMARdisp1.aydevice.Thefo1.1.owingdomentsofthisreferredinthetextsuchawaythattheoroftheirForundatedreferences,the1.atesteditionofthereferenceddocument(inc1.udinganyamendments)app1.ies.ISO1EC18039r-Mixedandtechno1.ogy-rea1.ity(MAR)graphics,mode1.ISO/IEC18040,Informationtechno1.ogyComputergraphics,imageprocessingandenvironmenta1.dataForthepurposesofthisdocument,thetermsanddefinitionsgiveninfromISO/IEC18039andISOandIECmaintaintermino1.ogydatabasesforuseinstandardizationatthefo1.1.owingaddresses：-IECE1.ectropedia:avai1.ab1.eathttps:/www.e1.ec1.ropedia.org/©ISO/IEC2023-A1.1.rightsreserved3.1.1aggregation3.1.2association1.anguage1.iteraturej)ggregationisaspecificformofanassociationasdefinedandusedintheUnifiedMode1.1.ing3.1.3behaviour3.1.4contentMARcontentMARscene3.1.5componentMARcomponentobjectMRobject3.1.61toentry:InthecontextofMARcontentsorsystem,acomponenthasare1.evantMARfunctiona1.ity.componentmode1.objectmode1.3.1.7eventmapping3.1.8g1.ass-based3.1.9inheritanceparentasdefinedandgenera1.,intheUnifiedMode1.1.ing1.anguageotherwise,wi1.1.inherittheattributemode1.ofthe3.1.10nodere1.ationamongObjCCMComPOiWn凶thatspecifiesawho1.e-partre1.ationshipasdefinedandusedintheUnifiedMode1.1.ing1.anguage1.iteraturere1.ationamongObjCCg/components(andtheirinstances)thattheycanbe1.inkedtoeachotherorcombined1.ogica1.1.yorphysica1.1.yintoanaggregationNote1toentry:Anobjectorcomponentthatdescribeshowcertainobjectsandtheirattributeva1.ueschangeintimeand/orinresponsetoeventsdescriptionofmixedandaugmentedrea1.itybasedexperiencetoend-usersbypub1.ishersormediaproducersse1.f-containedcomputationa1.entityormode1.thathasoneormoreinputchanne1.sand/oroneormoreoutputchanne1.sNotemode1.ofaco1.1.ectionofcomputationa1.objectsandtheirre1.ationshipsservingaparticu1.arpurposeorco1.1.ectivefunctionobjectorcomponentthatmapseventsproducedbytheMARsystemandmaps/re1.atesthemtothecorrespondingonesintheMARscene/concentspacetypeofanoptica1.see-throughdevicethathastheformfactorofoptica1.g1.assesassociationrepresentingaparentandchi1.dre1.ationshipNote1toentry:Inusedchi1.dobject,ifnotspecified1.iterature.termreferredtoanactua1.imp1.ementationorspecificformatofanobjectorcomponentusersJavaScriptdocumentreisteredtrademarkconstituteOrac1.eendorsementbyThisinformationisgivenfortheconvenienceof4MARreferstotheinteractivemediumthatusesandmergestherea1.(orphysica1.)andvirtua1.objects.6totworepresentativerea1.ofMARarewhi1.einrea1.itywhere(AV)rea1.wor1.daddedobjectrepresentationsareaddedtothevirtua1.environment.Thecontinuedinnovationsandadvancesincomputervision,mobi1.e/c1.oudcomputingandportab1.edisp1.aydeviceshavebroughtaboutarenewedmanyMAR,buta1.socanempowerusersdai1.yactivitiesbyspatia1.1.yMARnothasinformationtokeyinteractionobjects.Traditiona1.1.y,MRSerViCeS/contentshavebeendeve1.opedasasing1.eapp1.icationusingpopu1.arapp1.icationprogramminginterfaces(APIs).Whi1.etherearemovestostandardizetheAPIp网,therea1.sostrongnatura1.andtowardtheseparationofsimi1.ar1.ythoseforwebdocuments.X3DoffersisinfactandextendedMARspecifyings.Suchvirtua1.structure(andstandards)canpromotethepro1.iferationofthegivenmediaandassociatedcontentform.Thus,inthisdocument,aminima1.(yetab1.etocoveracomprehensiveandreasonab1.e,typica1.MARcontents)setofinformationusedforMARvirtua1.rea1.itycontents(suchX3D)rasextendenvironmentsareusedfortheimp1.ementationp1.atformformixedrea1.itycontentsaswe1.1.First,theinduding(but1.imitedto)forforextensionareandthedetai1.softheextendingthevirtua1.scenegraph/StrUCtUretothatforMAR(withtherea1.objects),howtospatia1.1.ytherea1.objectsintotheMARscenegraph,associatingthesecontentcomponentstotheMARsystem,andotherstandarddesignedfortheease,mapping,MARevents/andthisvideobackdrops,etc.).Theexamp1.esandimp1.ementationresu1.ts.Themode1.wi1.1.serveasasoundbasisforestab1.ishingstandardandinteroperab1.efi1.eformatsMARcontentsinthefuture.MostMRinit.been1.ibrariesaAPIs.TheGPSwiththeandandassetshavemadewaysfor1.ocationbasedaugmentedrea1.itysevices(e.g.providingguidesforcommercia1.pointsofinterestandtourism).Suchaservicenecessitatedtheseparationofcontents(anditsformatspecification)theandp1.ayer(toofMARthenotionofoneonthecontents).andextendab1.econtentmode1.(andfi1.eformat).Forexamp1.e,thefi1.eformatfor1.ocationbasedARSerVieeca1.1.edtheARM1.(AugmentedRea1.ityMark-up1.anguage)hasbeenadoptedasastandardfortheOpenGPScoordinatesandARM1.a1.1.owsdefiningcontents(e.g,text,orimage).TheWeb3Dconsortiumhasa1.sobeenconsideringaddingnewcomponentsforMARfunctiona1.itytoX3Drthespecifiedandandextendednodesto111.efRua1.fbrvideosee-throughAR.SUChasthe1.ivevideobackground,extendedcamerasensornodes(9.Someofitsworkisref1.ectedinthisstandardaswe1.1.Asthevideoaugmentedcontentisapopu1.arfonnofMR,theMPEGhasproposedtheARF(ARandSpatiaIIyFormat)thatusesotherMPEGstandardsAnotherc1.assofapproachofrea1.izingxtcndingandspecifyingforMARfunctiona1.ityandbehaviourismarkerandimagepatchtracking|io)hastoexpressesowncontentstoX3Dthrough(e.forvirtua1.objects(asexpressedbytheusua1.X3Dforma1.ism)canbeassociatedwiththeposition/posetrackedea1.WOrIdPhySiCa1.objects.Therearesevera1.simi1.arweb-basedMARsystemsthatcanpresentARcontentswithJavascriptijprogrammingn-i3.Despitetheseapproaches,thecurrentstatewith1)ofthisIsaanddoesnotofanCorporation.ISOIEC.did。eBKmWxjoctam)bbddif1.dur.c>UkiM!iIJi1.ah>)MAfttsrdnrcm0du1.tpSfiytEeit8fiaft)nout1.inesthemode1.architectureofaprototypica1.MARsystemandindirect1.ypointstotheinformationa1.needsofanMARcontentasaninputtothesystem.Inthenextc1.auseisdescribed,thekindOfneworexpandedMARcomponents(equiva1.ent1.yfunctiona1.ities)tobeabstractedandrepresented.AgawUUniphasizedthattheMARcontentistheinputtothesystem(purp1.eboxinthe1.eftpartOfFigurc1)whichcomprisestheentitiessuchasthesensor,capturestracker,recognizer,simu1.ator,Fi晚Per,c6馅components,theNotethattheextensionwi1.1.bese1.f-containedinthesensethatitisindependentfromtheexistingRrtua1.眈M1.ia8林林犯8#然IStrUC6focusingon1.yonthemixedandaugmentedrea1.ityaspects.6.1ConceptMARcontentsarctechnica1.1.yrea1.izedasvirtua1.rea1.itycontentsWithitsscenecontainingspecia1.typetft叭Ws1.cchniciiap住Wn1.tI1.eiten1.PtMMrIdeObfOr山IheorNgrds卬iws>nt响kcfc.T1.MRc÷vidersmaybedefined1.ogica1.1.yorspatia1.1.ywithrespecttothevirtua1.scene.Thesesoca1.1.edspecia1.typep1.aceho1.derobjectsmayneedadditiona1.informationofhowitmighthespatia1.1.yregisteredintotheREaItUmthM附；dbject6bbSye1.hIMsek8ddwtoduied11!dgbdM虱1efM4Rf1.mfdcNNheb购811orange),andFigure2Theconceptofextendingvirtua1.rea1.ityscenestructureforMRcontentsFigure2i1.1.ustratesthebasicconceptinwhichvirtua1.objects(ortherootofthevirtua1.scene)providea'111.好RW料四bMNbrtaj或W3Jjects两期im川胡网第蹒谕p*哪瑜Mh辍11uwWJRMtKture.Forexamp1.e,avirtua1.objectcanbespatia1.1.ydefinedwithrespecttoarea1.wor1.dphysica1.object(oritsp1.aceho1.der).Notethatthevirtua1.scenemaynotneces