Home Complexity in sign languages
Article
Licensed
Unlicensed Requires Authentication

Complexity in sign languages

  • Evie A. Malaia ORCID logo EMAIL logo , Joshua D. Borneman , Emre Kurtoglu , Sevgi Z. Gurbuz , Darrin Griffin , Chris Crawford and Ali C. Gurbuz
Published/Copyright: October 31, 2022

Abstract

Sign languages are human communication systems that are equivalent to spoken language in their capacity for information transfer, but which use a dynamic visual signal for communication. Thus, linguistic metrics of complexity, which are typically developed for linear, symbolic linguistic representation (such as written forms of spoken languages) do not translate easily into sign language analysis. A comparison of physical signal metrics, on the other hand, is complicated by the higher dimensionality (spatial and temporal) of the sign language signal as compared to a speech signal (solely temporal). Here, we review a variety of approaches to operationalizing sign language complexity based on linguistic and physical data, and identify the approaches that allow for high fidelity modeling of the data in the visual domain, while capturing linguistically-relevant features of the sign language signal.


Corresponding author: Evie A. Malaia, Department of Communication Disorders, The University of Alabama, Tuscaloosa, AL, USA, E-mail:

Award Identifier / Grant number: 1734938, 1931861, 1932547

Acknowledgment

Preparation of this article was partially funded by the National Science Foundation under grants #1932547, #1931861 and #1734938.

References

Altmann, Gabriel. 1980. Prolegomena to Menzerath’s law. Glottometrika 2(2). 1–10.Search in Google Scholar

Altmann, Gabriel & Michael H. Schwibbe. 1989. Das menzerathsche gesetz in informationsverarbeitenden systemen. Hildesheim: Georg Olms Verlag.Search in Google Scholar

Andres, Jan, Jiřı Langer & Vladimır Matlach. 2020. Fractal–based analysis of sign language. Communications in Nonlinear Science and Numerical Simulation 84. 105214. https://doi.org/10.1016/j.cnsns.2020.105214.Search in Google Scholar

Battison, Robbin. 1978. Lexical borrowing in American sign language. Silver Spring, MD: Linstok Press.Search in Google Scholar

Bellugi, Ursula & Susan Fischer. 1972. A comparison of sign language and spoken language. Cognition 1(2–3). 173–200. https://doi.org/10.1016/0010-0277(72)90018-2.Search in Google Scholar

Blumenthal-Dramé, Alice & Evie Malaia. 2019. Shared neural and cognitive mechanisms in action and language: The multiscale information transfer framework. Wiley Interdisciplinary Reviews: Cognitive Science 10(2). e1484.10.1002/wcs.1484Search in Google Scholar

Borneman, Joshua D., Evie Malaia & Ronnie B. Wilbur. 2018. Motion characterization using optical flow and fractal complexity. Journal of Electronic Imaging 27(5). 051229. https://doi.org/10.1117/1.jei.27.5.051229.Search in Google Scholar

Borneman, Sean, Julia Krebs, Ronnie B. Wilbur & Evie Malaia. 2021. Application of machine learning to signal entrainment identifies predictive processing in sign language. Proceedings of the Annual Meeting of the Cognitive Science Society 43(43).Search in Google Scholar

Börstell, Carl, Thomas Hörberg & Robert Östling. 2016. Distribution and duration of signs and parts of speech in Swedish sign language. Sign Language & Linguistics 19(2). 143–196.10.1075/sll.19.2.01borSearch in Google Scholar

Bosworth, Rain G., Marian S. Bartlett & Karen R. Dobkins. 2006. Image statistics of American Sign Language: Comparison with faces and natural scenes. JOSA A 23(9). 2085–2096.10.1364/JOSAA.23.002085Search in Google Scholar

Bosworth, Rain G., Charles E. Wright & Karen R. Dobkins. 2019. Analysis of the visual spatiotemporal properties of American sign language. Vision Research 164. 34–43. https://doi.org/10.1016/j.visres.2019.08.008.Search in Google Scholar

Bradley, Chuck, Evie A. Malaia, Jeffrey Mark Siskind & Ronnie B. Wilbur. 2022. Visual form of ASL verb signs predicts non-signer judgment of transitivity. PLoS One 17(2). e0262098. https://doi.org/10.1371/journal.pone.0262098.Search in Google Scholar

Brentari, Diane. 1998. A prosodic model of sign language phonology. Cambridge, MA: MIT Press.10.7551/mitpress/5644.001.0001Search in Google Scholar

Brentari, Diane. 2019. Sign language phonology. Cambridge, UK: Cambridge University Press.10.1017/9781316286401Search in Google Scholar

Brookshire, Geoffrey, Jenny Lu, Howard C. Nusbaum, Susan Goldin-Meadow & Daniel Casasanto. 2017. Visual cortex entrains to sign language. Proceedings of the National Academy of Sciences 114(24). 6352–6357. https://doi.org/10.1073/pnas.1620350114.Search in Google Scholar

Buzsáki, György & Kenji Mizuseki. 2014. The log-dynamic brain: How skewed distributions affect network operations. Nature Reviews Neuroscience 15(4). 264–278.10.1038/nrn3687Search in Google Scholar

Bybee, Joan. 2003. Phonology and language use Cambridge, UK: Cambridge University Press.Search in Google Scholar

Bybee, Joan. 2017. Mechanisms of change in grammaticization: The role of frequency. The handbook of historical linguistics, 602–623. Hoboken, NJ: Blackwell Publishing.10.1002/9781405166201.ch19Search in Google Scholar

Eccarius, Petra & Diane Brentari. 2007. Symmetry and dominance: A cross-linguistic study of signs and classifier constructions. Lingua 117(7). 1169–1201. https://doi.org/10.1016/j.lingua.2005.04.006.Search in Google Scholar

Fenlon, Jordan, Adam Schembri, Ramas Rentelis, David Vinson & Kearsy Cormier. 2014. Using conversational data to determine lexical frequency in British sign language: The influence of text type. Lingua 143. 187–202. https://doi.org/10.1016/j.lingua.2014.02.003.Search in Google Scholar

Gurbuz, Sevgi, Ali Gurbuz, Evie Malaia, Darrin Griffin, Chris Crawford, Emre Kurtoglu, Mahbubur Rahman, Ridvan Aksu & Robiulhossain Mdrafi. 2020a. ASL recognition based on kinematics derived from a multi-frequency RF sensor network. In 2020 IEEE SENSORS conference, 1–4.10.1109/SENSORS47125.2020.9278864Search in Google Scholar

Gurbuz, Sevgi, Ali Gurbuz, Evie Malaia, Darrin Griffin, Chris Crawford, Mahbubur Rahman, Ridvan Aksu, Emre Kurtoglu, Robiulhossain Mdrafi, Ajaymehul Anbuselvam, Trevor Macks & Engin Ozcelik. 2020b. A linguistic perspective on radar micro-doppler analysis of American sign language. In 2020 IEEE international radar conference (RADAR), 232–237.10.1109/RADAR42522.2020.9114818Search in Google Scholar

Gurbuz, Sevgi, Ali Gurbuz, Evie Malaia, Darrin Griffin, Chris Crawford, Mohammad Rahman, Emre Kurtoglu, Ridvan Aksu, Trevor Macks & Robiulhossain Mdrafi. 2020c. American sign language recognition using RF sensing. IEEE Sensors Journal 21(3). 3763–3775. https://doi.org/10.1109/jsen.2020.3022376.Search in Google Scholar

Johnston, Trevor. 2012. Lexical frequency in sign languages. Journal of Deaf Studies and Deaf Education 17(2). 163–193. https://doi.org/10.1093/deafed/enr036.Search in Google Scholar

Krebs, Julia, Evie Malaia, Ronnie B. Wilbur & Dietmar Roehm. 2020. Interaction between topic marking and subject preference strategy in sign language processing. Language, Cognition and Neuroscience 35(4). 466–484. https://doi.org/10.1080/23273798.2019.1667001.Search in Google Scholar

Krebs, Julia, Gerda Strutzenberger, Hermann Schwameder, Ronnie Wilbur, Evie Malaia & Dietmar Roehm. 2021. Event visibility in sign language motion: Evidence from Austrian sign language (ÖGS). In Proceedings of the annual meeting of the Cognitive Science Society, vol. 43.Search in Google Scholar

Liddell, Scott K. 1984. THINK and BELIEVE: Sequentiality in American sign language. Language 60. 372–399. https://doi.org/10.2307/413645.Search in Google Scholar

Malaia, Evguenia, John Borneman & Ronnie B. Wilbur. 2008. Analysis of ASL motion capture data towards identification of verb type. In Semantics in text processing. STEP 2008 conference proceedings, 155–164.10.3115/1626481.1626494Search in Google Scholar

Malaia, Evie. 2017. Current and future methodologies for quantitative analysis of information transfer in sign language and gesture data. Behavioral and Brain Sciences 40. E63. https://doi.org/10.1017/S0140525X15002988.Search in Google Scholar

Malaia, Evie, Linda Ford, Sean Borneman, Julia Krebs & Brendan Ames. 2021a. Salience of low-frequency entrainment to visual signal for classification points to predictive processing in sign language. In proceedings of 30th annual computational neuroscience meeting: CNS*2021. Journal of Computational Neuroscience 49(1 Suppl). 3–208. https://doi.org/10.1007/s10827-021-00801-9.Search in Google Scholar

Malaia, Evie & Ronnie B. Wilbur. 2012. Kinematic signatures of telic and atelic events in ASL predicates. Language and Speech 55(3). 407–421. https://doi.org/10.1177/0023830911422201.Search in Google Scholar

Malaia, Evie A. & Ronnie B. Wilbur & A. Malaia. 2020. Syllable as a unit of information transfer in linguistic communication: The entropy syllable parsing model. WIREs Cognitive Science 11(1). e1518. https://doi.org/10.1002/wcs.1518.Search in Google Scholar

Malaia, Evie, Ronnie B. Wilbur & Marina Milković. 2013. Kinematic parameters of signed verbs. Journal of Speech, Language, and Hearing Research 56. 1677–1688. https://doi.org/10.1044/1092-4388(2013/12-0257).Search in Google Scholar

Malaia, Evie & Ronnie Wilbur. 2019. Visual and linguistic components of short-term memory: Generalized neural model (GNM) for spoken and sign languages. Cortex 112. 69–79. https://doi.org/10.1016/j.cortex.2018.05.020.Search in Google Scholar

Malaia, Evie, Sean Borneman, Julia Krebs & Ronnie Wilbur. 2021b. Low-frequency entrainment to visual motion underlies sign language comprehension. IEEE Transactions on Neural Systems and Rehabilitation Engineering 29. 2456–2463. https://doi.org/10.1109/tnsre.2021.3127724.Search in Google Scholar

McKee, David & Graeme Kennedy. 2006. The distribution of signs in New Zealand sign language. Sign Language Studies 6(4). 372–390. https://doi.org/10.1353/sls.2006.0027.Search in Google Scholar

Milković, Marina. 2011. Verb classes in Croatian sign language (HZJ): Syntactic and semantic properties. Croatia: University of Zagreb PhD dissertation.Search in Google Scholar

Morford, Jill P. & James MacFarlane. 2003. Frequency characteristics of American sign language. Sign Language Studies 3. 213–225. https://doi.org/10.1353/sls.2003.0003.Search in Google Scholar

Quer, Josep, Roland Pfau & Annika Herrmann. 2021. The Routledge handbook of theoretical and experimental sign language research. Milton Park, UK: Routledge.10.4324/9781315754499Search in Google Scholar

Riedl, Thomas R. & George Sperling. 1988. Spatial-frequency bands in complex visual stimuli: American sign language. JOSA A 5(4). 606–616. https://doi.org/10.1364/josaa.5.000606.Search in Google Scholar

Shannon, Claude Elwood. 1948. A mathematical theory of communication. The Bell System Technical Journal 27(3). 379–423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x.Search in Google Scholar

Stokoe, William. 1960. Sign language structure, an outline of the visual communications systems of American deaf. Studies in Linguistics Occasional Paper 8. 3–37.10.1093/deafed/eni001Search in Google Scholar

Strickland, Brent, Carlo Geraci, Emmanuel Chemla, Philippe Schlenker, Meltem Kelepir & Roland Pfau. 2015. Event representations constrain the structure of language: Sign language as a window into universally accessible linguistic biases. Proceedings of the National Academy of Sciences 112(19). 5968–5973. https://doi.org/10.1073/pnas.1423080112.Search in Google Scholar

Tkachman, Oksana, Kathleen Currie Hall, Robert Fuhrman & Yurika Aonuki. 2019. Visible amplitude: Towards quantifying prominence in sign language. Journal of Phonetics 77. 100935. https://doi.org/10.1016/j.wocn.2019.100935.Search in Google Scholar

Torre, Iván G., Bartolo Luque, Lucas Lacasa, Christopher T. Kello & Antoni Hernández-Fernández. 2019. On the physical origin of linguistic laws and lognormality in speech. Royal Society Open Science 6(8). 191023. https://doi.org/10.1098/rsos.191023.Search in Google Scholar

Wilbur, Ronnie B. 1999. Stress in ASL: Empirical evidence and linguistic issues. Language and Speech 42(2–3). 229–250. https://doi.org/10.1177/00238309990420020501.Search in Google Scholar

Wilbur, Ronnie B., Evie Malaia & Robin A. Shay. 2012. Degree modification and intensification in American sign language adjectives. In Proceedings of the 18th Amsterdam colloquim conference on logic, language and meaning, 92–101.10.1007/978-3-642-31482-7_10Search in Google Scholar

Zipf, George Kingsley. 1935. The psycho-biology of language: An introduction to dynamic philology. Boston: Houghton Mifflin.Search in Google Scholar

Zipf, George Kingsley. 1949. Human behaviour and the principle of least-effort, vol. 24. Reading: Addison-Wesley.Search in Google Scholar

Zipf, George Kingsley. 2013. Selected studies of the principle of relative frequency in language. Cambridge, MA: Harvard University Press.Search in Google Scholar

Received: 2021-01-12
Accepted: 2021-09-06
Published Online: 2022-10-31

© 2022 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 19.9.2025 from https://www.degruyterbrill.com/document/doi/10.1515/lingvan-2021-0005/html
Scroll to top button