New approaches to plastic language: Prolegomena to a computer-aided approach to pictorial semiotics
-
Everardo Reyes
und
Göran Sonesson
Abstract
In this paper we summarize observations bridging the declared aspirations of pictorial semiotics and its real achievements. Pictorial semiotics is here understood as the general study of pictures as signs and it constituted a fundamental step beyond the art historical captivation with individual images. In the first part of our contribution we present a review of the most important methods that have been proposed as an answer to deal with several pictorial problems (multiple instances, segmentation, non-figurative meaning). In the second part, we offer some positive and on-going implementations designed to remedy the shortcomings observed. What is suggested is the proof of concept that human researchers need the assistance of computing methodologies. However, computers can only do their job once an adequate phenomenology of human experience is fed into the process.
References
Barthes, R. 1964. Rhétorique de l’image. Communications 4. 40–51.10.3406/comm.1964.1027Suche in Google Scholar
Chen, C.-Y., D. Jayaraman, F. Sha & K. Grauman. 2017. Divide, share, and conquer: Multi-task attribute learning with selective sharing. In R. S. Feris, C. Lampert & D. Parikh (eds.), Visual attributes, 50–85. Cham: Springer.10.1007/978-3-319-50077-5_4Suche in Google Scholar
Del Bimbo, A. 1999. Visual information retrieval. San Francisco: Morgan Kaufmann.Suche in Google Scholar
Deledalle, G. 1979. Théorie et pratique du signe. Paris: Payot.Suche in Google Scholar
DeLoache, J. 2004. Becoming symbol-minded. Trends in Cognitive Sciences 8(2). 66–70.10.1016/j.tics.2003.12.004Suche in Google Scholar
Eco, U. 1976. A theory of semiotics. Bloomington: Indiana University Press.10.1007/978-1-349-15849-2Suche in Google Scholar
Floch, J.-M. 1978. Roland Barthes: “Sémiotique de l’image”. Bulletin du Groupe de Recherches Sémio-linguistiques 4(5). 27–32.Suche in Google Scholar
Floch, J.-M. 1981. Kandinsky: Sémiotique d’un discours plastique non-figuratif. Communications 34. 134–158.10.3406/comm.1981.1511Suche in Google Scholar
Floch, J.-M. 1984. Petites mythologies de l’oeil et l’esprit. Paris: Hadès.10.1075/as.1Suche in Google Scholar
Floch, J.-M. 1986. Les formes de l’empreinte. Périgueux: Pierre Fanlac.Suche in Google Scholar
Floch, J.-M. 1990. Sémiotique, marketing et communication. Paris: PUF.Suche in Google Scholar
Gonzalez, R. & R. Woods. 2008. Digital image processing. Upper Saddle River, NJ: Pearson.Suche in Google Scholar
Greimas, A. & J. Courtés. 1979. Sémiotique: Dictionnaire raisonné de la théorie du langage. Paris: Hachette.Suche in Google Scholar
Groupe µ. 1992. Traité du signe visuel. Paris: Seuil.Suche in Google Scholar
Groys, B. 2016. In the flow. London: Verso.Suche in Google Scholar
Hribar, A., G. Sonesson & J. Call. 2014. From sign to action: Studies in chimpanzee pictorial competence. Semiotica 198(1/4). 205–240.10.1515/sem-2013-0108Suche in Google Scholar
Jappy, T. 2010. Introduction to Peircean visual semiotics. London: Bloomsbury.Suche in Google Scholar
Kirsch, J. & R. Kirsch. 1988. The anatomy of painting style: description with computer rules. Leonardo 21(4). 437–444.10.2307/1578708Suche in Google Scholar
Krampen, M. (ed.). 1983. Visuelle kommunikation und/oder verbale kommunikation. Hildesheim & Berlin: Olms Verlag/Hochschule der Kiinste.Suche in Google Scholar
Lenninger, S. 2012. When similarity qualifies as a sign: A study in picture understanding and semiotic development in young children. PhD dissertation, Lund University.Suche in Google Scholar
Lindekens, R. 1976. Éléments de sémiotique visuelle. Paris: Klincksieck.Suche in Google Scholar
Manovich, L. 2011. What is visualization? Visual Studies 26(1). 36–49.10.1080/1472586X.2011.548488Suche in Google Scholar
Müller, W., T. Nocke & H. Schumann. 2006. Enhancing the visualization process with principal component analysis to support the exploration of trends. In Asia-Pacific Symposium on Information Visualization (APVIS’06), 121–130. Darlinghurst: Australian Computer Society.Suche in Google Scholar
Parker, J. R. 2011. Algorithms for image processing and computer vision. Indianapolis: Wiley.Suche in Google Scholar
Russ, J. 2011. The image processing handbook. Boca Raton: CRC.Suche in Google Scholar
Sonesson, G. 1988. Methods and models in pictorial semiotics. Lund: Lund University.Suche in Google Scholar
Sonesson, G. 1989a. Pictorial concepts. Lund: Lund University Press.Suche in Google Scholar
Sonesson, G. 1989b. Semiotics of photography: On tracing the index. Lund: Lund University.Suche in Google Scholar
Sonesson, G. 1994. Les rondeurs secrètes de la ligne droite: A propos de “Sans titre” de Rothko. Les Nouveaux Actes Sémiotiques 34–35. 41–76.Suche in Google Scholar
Sonesson, G. 2010. Pictorial semiotics. In T. Sebeok & M. Danesi (eds.), Encyclopedic dictionary of semiotics. Berlin: Mouton. https://www.degruyter.com/view/EDS/pictorial_semiotics (accessed 26 August 2019).Suche in Google Scholar
Sonesson, G. 2011. La rhétorique des transformations homogènes. In T. Migliore (ed.), Retorica del visibili, 309–320. Rome: Aracne.Suche in Google Scholar
Sonesson, G. 2014. The psychology and semiotics of the picture sign. In D. Machin (ed.), Handbook of visual communication, 23–50. Berlin: DeGruyter.10.1515/9783110255492.23Suche in Google Scholar
Sonesson, G. & S. Lenninger. 2015. The psychological development of semiotic competence: From the window to the movie by way of the mirror. Cognitive Development 36. 191–201.10.1016/j.cogdev.2015.09.007Suche in Google Scholar
Thürleman, F. 1982. Paul Klee: Analyse sémiotique de trois peintures. Lausanne: L’age de l’homme.Suche in Google Scholar
Thürleman, F. 1990. Vom bild zum raum. Köln: DuMont.Suche in Google Scholar
Zlatev, J., A. Madsen, S. Lenninger, T. Persson, S. Sayehli, G. Sonesson & J. van de Weijer. 2013. Understanding communicative intentions and semiotic vehicles by children and chimpanzees. Cognitive Development 28. 312–329.10.1016/j.cogdev.2013.05.001Suche in Google Scholar
© 2019 Walter de Gruyter GmbH, Berlin/Boston
Artikel in diesem Heft
- Frontmatter
- Introduction to Meaningful data/Données signifiantes
- A data-driven computational semiotics: The semantic vector space of Magritte’s artworks
- New approaches to plastic language: Prolegomena to a computer-aided approach to pictorial semiotics
- Mesures et savoirs : Quelles méthodes pour l’histoire culturelle à l’heure du big data ?
- Visual semiotics and automatic analysis of images from the Cultural Analytics Lab: How can quantitative and qualitative analysis be combined?
- Uncertain infographics: Expressing doubt in data visualization
- Quelques expériences pour développer l’expression de sens en cartographie thématique
- Raw data or hypersymbols? Meaning-making with digital data, between discursive processes and machinic procedures
- Differential heterogenesis and the emergence of semiotic function
- Regular Articles
- Semiotic alignment: Towards a dialogical model of interspecific communication
- Modal functioning of rhetorical resources in selected multimodal cartoons
- The mission of the Chinese puzzle: From a quest for order to seeking entertainment
- Memes, genes, and signs: Semiotics in the conceptual interface of evolutionary biology and memetics
- Formalisation sémiotique de la traduction : Le modèle transformationnel d’Alexandre Ljudskanov
- Glossopoesis in Thomas More’s Utopia: Beyond a representation of foreignness
- Playing peripatos: Creativity and abductive inference in religion, art and war
- Borders and translation: Revisiting Juri Lotman’s semiosphere
- Peirce’s philosophy of communication and language communication
- Mythic symbolic type, utopia, and body without organs
- The contribution of narrative semiotics of experiential imaginary to the ideation of new digital customer experiences
- Transference of brand personality in brand name translation: A case study on the Chinese-English translation of men’s clothing brands
- Intertextuality as a strategy of glocalization: A comparative study of Nike’s and Adidas’s 2008 advertising campaigns in China
- The semiotic web of the research proposal
- Sic vita est: Visual representation in painting of the conceptual metaphor LIFE IS A JOURNEY
Artikel in diesem Heft
- Frontmatter
- Introduction to Meaningful data/Données signifiantes
- A data-driven computational semiotics: The semantic vector space of Magritte’s artworks
- New approaches to plastic language: Prolegomena to a computer-aided approach to pictorial semiotics
- Mesures et savoirs : Quelles méthodes pour l’histoire culturelle à l’heure du big data ?
- Visual semiotics and automatic analysis of images from the Cultural Analytics Lab: How can quantitative and qualitative analysis be combined?
- Uncertain infographics: Expressing doubt in data visualization
- Quelques expériences pour développer l’expression de sens en cartographie thématique
- Raw data or hypersymbols? Meaning-making with digital data, between discursive processes and machinic procedures
- Differential heterogenesis and the emergence of semiotic function
- Regular Articles
- Semiotic alignment: Towards a dialogical model of interspecific communication
- Modal functioning of rhetorical resources in selected multimodal cartoons
- The mission of the Chinese puzzle: From a quest for order to seeking entertainment
- Memes, genes, and signs: Semiotics in the conceptual interface of evolutionary biology and memetics
- Formalisation sémiotique de la traduction : Le modèle transformationnel d’Alexandre Ljudskanov
- Glossopoesis in Thomas More’s Utopia: Beyond a representation of foreignness
- Playing peripatos: Creativity and abductive inference in religion, art and war
- Borders and translation: Revisiting Juri Lotman’s semiosphere
- Peirce’s philosophy of communication and language communication
- Mythic symbolic type, utopia, and body without organs
- The contribution of narrative semiotics of experiential imaginary to the ideation of new digital customer experiences
- Transference of brand personality in brand name translation: A case study on the Chinese-English translation of men’s clothing brands
- Intertextuality as a strategy of glocalization: A comparative study of Nike’s and Adidas’s 2008 advertising campaigns in China
- The semiotic web of the research proposal
- Sic vita est: Visual representation in painting of the conceptual metaphor LIFE IS A JOURNEY
