Processing multimedia material: Does integration of text and pictures result in a single or two interconnected mental representations?

作者：Schueler Anne; Arndt Jana; Scheiter Katharina

来源：Learning and Instruction, 2015, 35: 62-72.

DOI：10.1016/j.learninstruc.2014.09.005

• Multimedia learning
• Integration of text and pictures
• Misinformation effect
• Mental representations
• Dual coding

We investigated whether individuals construct either two interconnected mental representations or a single mental representation that merges information from two representations when processing multimedia materials. Individuals memorized text-picture stimuli in four different versions that differed in the specificity of information contained in either text or pictures: general pictures/general sentences, general pictures/specific sentences, specific pictures/general sentences, and specific pictures/specific sentences. Afterwards, individuals decided whether they had previously seen the specific or the general version of the sentences and the pictures. Across two experiments, individuals more frequently falsely recognized the specific sentences after having seen general sentences/specific pictures. This indicates that individuals had integrated the specific picture information with the general sentence information into a single mental representation. No such effects were observed for picture recognition. The implications of these results for multimedia learning are discussed.

• 出版日期2015-2