Home Linguistics & Semiotics From Action-Oriented Perception to Language
Article
Licensed
Unlicensed Requires Authentication

From Action-Oriented Perception to Language

  • Michael A. Arbib is the Fletcher Jones Professor of Computer Science, as well as University Professor and a Professor of Biological Sciences, Biomedical Engineering, Electrical Engineering, Neuroscience and Psychology at the University of Southern California. His most recent books are How the Brain Got Language: The Mirror System Hypothesis (Oxford University Press, 2012) and the edited volume Language, Music and the Brain: A Mysterious Relationship (MIT Press, 2013).

    EMAIL logo
Published/Copyright: May 7, 2015
Become an author with De Gruyter Brill

Abstract

This article is primarily an extended summary of a talk presented to the Seventh Conference of the Nordic Association for Semiotic Studies (NASS), Lund University, Sweden in May 2011, presenting the Mirror System Hypothesis, which emphasizes the role of imitation and manual gesture in the evolution of the language-ready brain. An Afterword offers pointers to a number of subsequent publications that build upon the theory presented there.

About the author

Michael A. Arbib

Michael A. Arbib is the Fletcher Jones Professor of Computer Science, as well as University Professor and a Professor of Biological Sciences, Biomedical Engineering, Electrical Engineering, Neuroscience and Psychology at the University of Southern California. His most recent books are How the Brain Got Language: The Mirror System Hypothesis (Oxford University Press, 2012) and the edited volume Language, Music and the Brain: A Mysterious Relationship (MIT Press, 2013).

References

Arbib, Michael A.1972. The Metaphorical brain: An introduction to cybernetics as artificial intelligence and brain theory. New York: Wiley-Interscience.Search in Google Scholar

Arbib, Michael A. & DavidCaplan. 1979. Neurolinguistics must be computational. Behavioral and brain sciences2. 449483.10.1017/S0140525X0006369XSearch in Google Scholar

Arbib, Michael A. & Jane C.Hill. 1988. Language acquisition: Schemas replace universal grammar. In JohnA. Hawkins (ed.), Explaining language universals, 5672. Oxford: Basil Blackwell.Search in Google Scholar

Arbib, Michael A. & GiacomoRizzolatti.1997. Neural expectations: A possible evolutionary path from manual skills to language. Communication and Cognition29. 393424.Search in Google Scholar

Arbib, Michael A.2002. The mirror system, imitation, and the evolution of language. In KerstinDautenhahn & Chrystopher L.Nehaniv, (eds.)., Imitation in animals and artifacts. Complex adaptive systems, 229280. Cambridge: MIT Press.Search in Google Scholar

Arbib, Michael A.2005a. From monkey-like action recognition to human language: An evolutionary framework for neurolinguistics (with commentaries and author’s response). Behavioral and Brain Sciences28. 105167.10.1017/S0140525X05000038Search in Google Scholar

Arbib, Michael A.2005b. From monkey-like action recognition to human language: An evolutionary framework for neurolinguistics. Behavioral and Brain Sciences28. 105124.10.1017/S0140525X05000038Search in Google Scholar

Arbib, Michael A.2005c. Interweaving protosign and protospeech: Further developments beyond the mirror. Interaction Studies: Social Behavior and Communication in Biological and Artificial Systems6. 145171.10.1075/is.6.2.02arbSearch in Google Scholar

Arbib, Michael A.2007. How new languages emerge (Review of D. Lightfoot, 2006, How New Languages Emerge, Cambridge University Press). Linguist List: 18–432, 8 February 2007. http://linguistlist.org/issues/17/17-1250.html.Search in Google Scholar

Arbib, Michael A. & Yin JongLee. 2007. Vision and action in the language-ready brain: From mirror neurons to SemRep. In FrancescoMele, GiulianaRamella, SilviaSantillo & FrancescoVentriglia (eds.), Advances in brain, vision, and artificial intelligence, 104123. Berlin & Heidelberg: Springer-Verlag.10.1007/978-3-540-75555-5_11Search in Google Scholar

Arbib, Michael A. & Yin JongLee. 2008. Describing visual scenes: Towards a neurolinguistics based on construction grammar. Brain Research1225. 146162.10.1016/j.brainres.2008.04.075Search in Google Scholar

Arbib, Michael A., KatjaLiebal & SimonePika.2008. Primate vocalization, gesture, and the evolution of human language. Current Anthropology49. 10531076.10.1086/593015Search in Google Scholar

Arbib, Michael A. & DerekBickerton, eds. 2010. The emergence of protolanguage: Holophrasis vs compositionality. Philadelphia, PA & Amsterdam: John Benjamins.10.1075/bct.24Search in Google Scholar

Arbib, Michael A., 2011. From mirror neurons to complex imitation in the evolution of language and tool use. Annual Review of Anthropology40. 257273.10.1146/annurev-anthro-081309-145722Search in Google Scholar

Arbib, Michael A., 2012. How the brain got language: The mirror system hypothesis. New York & Oxford: Oxford University Press.10.1093/acprof:osobl/9780199896684.001.0001Search in Google Scholar

Arbib, Michael A., VarshaGanesh & BradGasser.2014. Dyadic brain modeling, ontogenetic ritualization of gesture in apes, and the contributions of primate mirror neuron systems. Philosophical Transactions of the Royal Society B, 369(1644). 20130414.Search in Google Scholar

Baker, Mark C.2001. The atoms of language: The mind’s hidden rules of grammar. New York: Basic Books.Search in Google Scholar

Barrès, Victor & JinyongLee. 2014. Template construction grammar: From visual scene description to language comprehension and agrammatism. Neuroinformatics12. 181208.10.1007/s12021-013-9197-ySearch in Google Scholar

Bonaiuto, James J., EdinaRosta & Michael A.Arbib.2007. Extending the mirror neuron system model, I: Audible actions and invisible grasps. Biological Cybernetics96. 938.10.1007/s00422-006-0110-8Search in Google Scholar

Bonaiuto, James J. & Michael A.Arbib. 2010. Extending the mirror neuron system model, II: What did I just do? A new role for mirror neurons. Biological Cybernetics102. 341359.10.1007/s00422-010-0371-0Search in Google Scholar

Byrne, Richard W. & Jennifer M. E.Byrne. 1993. Complex leaf-gathering skills of mountain gorillas (Gorilla g. beringei): Variability and standardization. American Journal of Primatology31. 241261.10.1002/ajp.1350310402Search in Google Scholar

Caro, Tim M. & Mark D.Hauser. 1992. Is there teaching in nonhuman animals?The Quarterly Review of Biology67. 151174.10.1086/417553Search in Google Scholar

Chomsky, Noam & HowardLasnik.1993. The theory of principles and parameters. In JoachimJacobs, Arnimvon Stechow, WolfgangSternefeld, TheoVennemann, (eds.)., Syntax: An international handbook of contemporary research, 506556. Berlin: De Gruyter.10.1515/9783110095869.1.9.506Search in Google Scholar

Croft, William.2000. Explaining language change: An evolutionary approach. Harlow: Longman.Search in Google Scholar

Croft, William.2001. Radical construction grammar: syntactic theory in typological perspective. Oxford: Oxford University Press.10.1093/acprof:oso/9780198299554.001.0001Search in Google Scholar

Deacon, Terrence W.1997. The symbolic species: The co-evolution of language and the brain. New York: W. W. Norton.Search in Google Scholar

Deacon, Terrence W.2007. The evolution of language systems in the human brain. In JonHaas (ed.), Evolution of nervous systems, A comprehensive reference. Volume 4: Primates, 529547. Amsterdam: Elsevier.10.1016/B0-12-370878-8/00020-3Search in Google Scholar

Didday, Richard L., 1970. The simulation and modelling of distributed information processing in the frog visual system. Stanford: Stanford University.Search in Google Scholar

Draper, Bruce A., Robert T.Collins, JohnBrolio, Allen R.Hanson & Edward M.Riseman. 1989. The schema system. International Journal of Computer Vision2. 209250.10.1007/BF00158165Search in Google Scholar

Fagg, Andrew H. & Michael A.Arbib. 1998. Modeling parietal-premotor interactions in primate control of grasping. Neural Networks11. 12771303.10.1016/S0893-6080(98)00047-1Search in Google Scholar

Goldberg, Adele E.2003. Constructions: A new theoretical approach to language. Trends in Cognitive Science7. 219224.10.1016/S1364-6613(03)00080-9Search in Google Scholar

Grafton, Scott T., Michael A.Arbib, LucianoFadiga, GiacomoRizzolatti.1996. Localization of grasp representations in humans by positron emission tomography. Observation compared with imagination. Experimental Brain Research1, 12. 103111.Search in Google Scholar

Hanson, Allen R. & Edward M.Riseman. 1978. VISIONS: A computer system for interpreting scenes. In AllenR. Hanson & EdwardM. Riseman (eds.), Computer vision systems, 129163. New York: Academic Press.Search in Google Scholar

Hecht, Erin E., Lauren E.Murphy, David A.Gutman, John R.Votaw, David M.Schuster, Todd M.Preuss, Guy A.Orban, DietrichStout & Lisa A.Parr.2013. Differences in neural activation for object-directed grasping in chimpanzees and humans. Neuroscience33. 1411714134.10.1523/JNEUROSCI.2172-13.2013Search in Google Scholar

E. E.Hecht, David A.Gutmann, Nada Khreisheh, S. V.Taylor, J.Kilner, A. A.Faisal, B. A.Bradley, ThierryChaminade & DietrichStout.2014. Acquisition of Paleolithic toolmaking abilities involves structural remodeling to inferior frontoparietal regions. Brain Structure and Function. DOI: 10.1007/s00429-014-0789-6.Search in Google Scholar

Hill, Jane Anne Collins. 1983. A computational model of language acquisition in the two-year-old. Cognition and Brain Theory6. 287317.Search in Google Scholar

Kirby, Simon.2000. Syntax without natural selection: How compositionality emerges from vocabulary in a population of learners. In ChrisKnight, MichaelStuddert-Kennedy & JamesHurford (eds.), The evolutionary emergence of language, 99119. Cambridge: Cambridge University Press.10.1017/CBO9780511606441.019Search in Google Scholar

Lesser, Victor R., R. D.Fennel, Lee D.Erman & D.Raj Reddy. 1975. Organization of the HEARSAY-II speech understanding system. IEEE Transactions on Acoustics, Speech, and Signal Processing23(1). 11–24.Search in Google Scholar

Lightfoot, David W.2006. How new languages emerge. Cambridge: Cambridge University Press.10.1017/CBO9780511616204Search in Google Scholar

Oztop, Erhan & Michael A.Arbib.2002. Schema design and implementation of the grasp-related mirror neuron system. Biological Cybernetics87. 116140.10.1007/s00422-002-0318-1Search in Google Scholar

Pinker, Steven & PaulBloom.1990. Natural language and natural selection. Behavioral and Brain Sciences13. 707784.10.1017/S0140525X00081061Search in Google Scholar

Rizzolatti, Giacomo, LucianoFadiga, VittorioGallese & LeonardoFogassi.1996a. Premotor cortex and the recognition of motor actions. Cognitive Brain Research3. 131141.10.1016/0926-6410(95)00038-0Search in Google Scholar

Rizzolatti, Giacomo, Luciano Fadiga, M.Matelli, V.Bettinardi, EraldoPaulesu, DanielaPerani & F.Fazio.1996b. Localization of grasp representations in humans by PET: 1. Observation versus execution. Experimental Brain Research111. 246252.10.1007/BF00227301Search in Google Scholar

Rizzolatti, Giacomo & Michael A.Arbib.1998. Language within our grasp. Trends in Neuroscience21. 188194.10.1016/S0166-2236(98)01260-0Search in Google Scholar

Spivey, Michael J., Daniel C.Richardson, Stanka A.Fitneva.2005. Thinking outside the brain: Spatial indices to visual and linguistic information. In John M.Henderson and FernandaFerreira, (eds.), The interface of language, vision, and action: Eye movements and the visual world, 161190. New York: Psychology Press.Search in Google Scholar

Stokoe, William C.2001. Language in hand: Why sign came before speech. Washington, DC: Gallaudet University Press.Search in Google Scholar

Stout, Dietrich.2010. Possible relations between language and technology in human evolution. In AprilNowell & IainDavidson (eds.), Stone tools and the evolution of human cognition, 159184. Boulder, CO: University Press of Colorado.Search in Google Scholar

Stout, Dietrich, 2011. Stone toolmaking and the evolution of human culture and cognition. Philosophical Transactions of the Royal Society B: Biological Sciences366. 10501059.10.1098/rstb.2010.0369Search in Google Scholar

Stout, Dietrich & ThierryChaminade.2012. Stone tools, language and the brain in human evolution. Philosophical Transactions of the Royal Society B: Biological Sciences367. 7587.10.1098/rstb.2011.0099Search in Google Scholar

Tomasello, Michael.2003. Constructing a language: A usage-based theory of language acquisition. Cambridge, MA: Harvard University Press.Search in Google Scholar

Tomasello, Michael, MalindaCarpenter, JosepCall, TanyaBehne & HenrikeMoll.2005. Understanding and sharing intentions: The origins of cultural cognition. Behavioral Brain Science28. 675691, discussion 691–735.10.1017/S0140525X05000129Search in Google Scholar

Visalberghi, Elisabetta & DorothyFragaszy.1990. Do monkeys ape? In Sue TaylorParker & KathleenRita Gibson (eds.), Language and intelligence in monkeys and apes: Comparative developmental perspectives, 247273. Cambridge: Cambridge University Press.10.1017/CBO9780511665486.011Search in Google Scholar

Visalberghi, Elisabetta & DorothyFragaszy.2001. Do monkeys ape? Ten years after. In KerstinDautenhahn & Chrystopher L.Nehaniv (eds.), Imitation in animals and artifacts, 471500. Cambridge, MA: MIT Press.Search in Google Scholar

Wohlschläger, Andreas, MeridethGattis & HaroldBekkering. 2003. Action generation and action perception in imitation: An instance of the ideomotor principle. Philosophical Transactions of the Royal Society London358. 501515.10.1098/rstb.2002.1257Search in Google Scholar

Wray, Alison.2000. Holistic utterances in protolanguage: The link from primates to humans. In ChrisKnight, MichaelStuddert-Kennedy & JamesHurford, (eds.), The evolutionary emergence of language, 285302. Cambridge: Cambridge University Press.10.1017/CBO9780511606441.018Search in Google Scholar

Published Online: 2015-5-7
Published in Print: 2015-5-1

©2015 by De Gruyter Mouton

Downloaded on 26.3.2026 from https://www.degruyterbrill.com/document/doi/10.1515/cogsem-2015-0005/html
Scroll to top button