Top-down vs bottom-up approaches to cognition: Griffiths vs McClelland

There is a battle about to commence.  A battle in the world of cognitive modelling.  Or at least a bit of a skirmish.  Two articles to be published in Trends in Cognitive Sciences debate the merits of approaching cognition from different ends of the microscope.

Structured Probabilistic Thingamy

On the side of probabilistic modelling we have Thom Griffiths, Nick Chater, Charles Kemp, Amy Perfors and Joshua Tenenbaum.  Representing (perhaps non-symbolically) emergentist approaches are James McClelland, Matthew Botvinick, David Noelle, David Plaut, Timothy Rogers, Mark Seidenberg and Linda B. Smith.  This contest is not short of heavyweights.

However, the first battleground seems to be who can come up with the most complicated diagram.  I leave this decision to the reader (see first two images).

The central issue is which approach is the most productive for explaining phenomena in cognition.  David Marr’s levels of explanation include the ‘computational’ characterisation of the problem, an ‘algorithmic’ description of the problem and an ‘implementational’ explanation which focusses on how the task is actually implemented by real brains.  Structured probabilistic takes a ‘top-down’ approach while Emergentism takes a ‘bottom-up’ approach.

Continue reading “Top-down vs bottom-up approaches to cognition: Griffiths vs McClelland”

Fungus, -i. 2nd Decl. N. Masculine – or is it?: On Gender

ResearchBlogging.orgIn an attempt to write out my thoughts for others instead of continually building them up in saved stickies, folders full of .pdfs, and hastily scribbled lecture notes, as if waiting for the spontaneous incarnation of what looks increasingly like a dissertation, I’m going to give a glimpse today of what I’ve been looking into recently. (Full disclosure: I am not a biologist, and was told specifically by my High School teacher that it would be best if I didn’t do another science class. Also, I liked Latin too much, which explains the title.)

It all started, really, with trying to get my flatmate Jamie into research blogging. His intended career path is mycology, where there are apparently fewer posts available for graduate study than in Old English syntax. As he was setting up the since-neglected Fungi Imperfecti, he pointed this article out to me: A Fungus Walks Into A Singles Bar. The post explains briefly how fungi have a very complicated sexual reproduction system.

Fungi are eukaryotes, the same as all other complex organisms with complicated cell structures. However, they are in their own kingdom, for a variety of reasons. Fungi are not the same as mushrooms, which are only the fruiting bodies of certain fungi. Their reproductive mechanisms is rather unexpectedly complex, in that the normal conventions of sex do not apply. Not all fungi reproduce sexually, and many are isogamous, meaning that their gametes look the same and differ only in certain alleles in certain areas called mating-type regions. Some fungi only have two mating types, which would give the illusion of being like animal genders. However, others, like Schizophyllum commune, have over ten thousand (although these interact in an odd way, such that they’re only productive if the mating regions are highly compatible (Uyenoyama 2005)).

Some fungi are homothallic, meaning that self-mating and reproduction is possible. This means that a spore has within it two dissimilar nuclei, ready to mate – the button mushroom apparently does this (yes, the kind you buy in a supermarket.) Heterothallic fungi, on the other hand, merely needs to find another fungi that isn’t the same mating type – which is pretty easy, if there are hundreds of options. Other types of fungi can’t reproduce together, but can vegetatively blend together to share resources, interestingly enough. Think of mind-melding, like Spock. Alternatively, think of mycelia fusing together to share resources.

In short, the system is ridiculously confusing, and not at all like the simple bipolar genders of, say, humans (if we take the canonical view of human gender, meaning only two.) I’m still trying to find adequate research on the origins of this sort of system. Understandably, it’s difficult. Mycologists agree:

“The molecular genetical studies of the past ten years have revealed a genetic fluidity in fungi that could never have been imagined. Transposons and other mobile elements can switch the mating types of fungi and cause chromosonal rearrangements.Deletions of mitochondrial genes can accumulate as either symptomless plasmids or as disruptive elements leading to cellular senescence…[in summary,] many aspects of the genetic fluidity of fungi remain to be resolved, and probably many more remain to be discovered.” (Deacon, 1997: pg. 157)

At this point you’re probably asking why I’ve posted this here. Well, perhaps understandably, I started drawing comparisons between mycologic mating types and linguistic agreement immediately. First, mating-type isn’t limited to bipolarity – neither is grammatical gender. Nearly 10% of the 257 languages noted for number of genders on WALS have more than five genders. Ngan’gityemerri seems to be winning, with 15 different genders (Reid, 1997). Gender distinctions generally have to do with a semantic core – one which need not be based on sex, either, but can cover categories like animacy. Gender can normally be diagnosed by agreement marking, which, taking out genetic analysis of the parent, could be analogic to fungi offspring. Gender can be a fluid system, susceptible to decay, mostly through attrition, but also to reformation and realignment – the same is true of mating types. (For more, see Corbett, 1991)

As with all biologic to linguistic analogues, the connections are a bit tenuous. I’ve been researching fungal replication partly for the sake of dispelling the old “that’s too complex to have evolved” argument, which is probably the most fun point to argue against creationists with. However, I’ve mostly been doing this because fungi and linguistic gender distinctions are just so damn interesting.

If anyone likes, I’ll keep you updated on mycologic evolution and the linguistic analogues I can tentatively draw. For now, though, I’ve really got to get back to studying for my examination in two days. Which means I’ve got to stop thinking about a future post involving detailing why “Prokaryotic evolution and the tree of life are two different things” (Baptiste et al., 2009)…

References:

  • Corbett, G. Gender. Cambridge University Press, Cambridge: 1991.
  • Deacon, JW. Modern Mycology. Blackwell Science, Oxford: 1997.
  • Reid, Nicholas. and Harvey, Mark David,  Nominal classification in aboriginal Australia / edited by Mark Harvey, Nicholas Reid John Benjamins Pub., Philadelphia, PA :  1997.

Uyenoyama, M. (2004). Evolution under tight linkage to mating type New Phytologist, 165 (1), 63-70 DOI: 10.1111/j.1469-8137.2004.01246.x
Bapteste E, O’Malley MA, Beiko RG, Ereshefsky M, Gogarten JP, Franklin-Hall L, Lapointe FJ, Dupré J, Dagan T, Boucher Y, & Martin W (2009). Prokaryotic evolution and the tree of life are two different things. Biology direct, 4 PMID: 19788731

On Phylogenic Analogues

A recent post by Miko on Kirschner and Gerhart’s work on developmental constraints and the implications for evolutionary biology caught my eye due to the possible analogues which could be drawn with language in mind. It starts by saying that developmental constraints are the most intuitive out of all of the known constraints on phenotypic variation.  Essentially, whatever evolves must evolve from the starting point, and it cannot ignore the features of the original. Thus, a winged horse would not occur, as six limbs would violate the basic bauplan of tetrapods. In the same way, a daughter language cannot evolve without taking into account the language it derives from and language universals. But instead of viewing this as a constraint which limits the massive variation we see biologically or linguistically between different phenotypes, developmental constraints can be seen as a catalyst for regular variation.

ResearchBlogging.orgA recent post by Miko on Kirschner and Gerhart’s work on developmental constraints and the implications for evolutionary biology caught my eye due to the possible analogues which could be drawn with language in mind. It starts by saying that developmental constraints are the most intuitive out of all of the known constraints on phenotypic variation.  Essentially, whatever evolves must evolve from the starting point, and it cannot ignore the features of the original. Thus, a winged horse would not occur, as six limbs would violate the basic bauplan of tetrapods. In the same way, a daughter language cannot evolve without taking into account the language it derives from and language universals. But instead of viewing this as a constraint which limits the massive variation we see biologically or linguistically between different phenotypes, developmental constraints can be seen as a catalyst for regular variation.

A pretty and random tree showing variation among IE languages.

Looking back over my courses, I’m surprised by how little I’ve noticed (different from how much was actually said) about reasons for linguistic variation. The modes of change are often noted: <th> is fronted in Fife, for instance, leading to the ‘Firsty Ferret’ instead of the ‘Thirsty Ferret’ as a brew, for instance. However, why the <th> is fronted at all isn’t explained beyond cursory hypothesis. But that’s a bit besides the point: what is the point is that phenotypic variation is not necessarily random, as there are constraints – due to the “buffering and canalizing of development” – which limit variation to a defined range of possibilities. There clearly aren’t any homologues between biological embryonic processes and linguistic constraints, but there are developmental analogues: the input bottleneck (paucity of data) given to children, learnability constraints, the necessity for communication, certain biological constraints to do with production and perception, etc. These all act on language to make variation occur only within certain channels, many of which would be predictable.

Another interesting point raised by the article is the robustness of living systems to mutation. The buffering effect of embryonic development results in the accumulation of ‘silent’ variation.  This has been termed evolutionary capacitance. Silent variation can lay quiet, accumulating, not changing the phenotype noticeably until environmental or genetic conditions unmask them. I’ve seen little research (not that I don’t expect there to be plenty) on the theoretical implications of the influence of evolutionary capacitance on language change – in other words, how likely a language is to make small variations which don’t affect language understanding before a new language emerges (not that the term language isn’t arbitrary based on the speaking community, anyway). Are some languages more robust than others? Is robustness a quality which makes a language more likely to be used in multilingual settings – for instance, in New Guinea, if seven languages are mutually indistinguishable, is it likely the that local lingua franca is forced by its environment to be more robust in order to maximise comprehension?

The article goes on about the cost of robustness: stasis. This can be seen clearly in Late Latin, which was more robust than the daughter languages as it was needed to communicate in different environments where the language had branched off into the Romance languages, and an older form was necessary in order for communication to ensue. Thus, Latin retained usage well after the rest of it had evolved into other languages. Another example would be Homeric Greek, which retained many features lost in Attic, Doric, Koine, and other dialects, as it was used in only a certain environment and was therefore resistant to change. This has all been studied before better than I can sum it up here. But the point I am making is that analogues can be clearly drawn here, and some interesting theories regarding language become apparent only when seen in this light.

A good example, also covered, would be exploratory processes, as Kirschner and Gerhart call them. These are processes which allow for variation to occur in environments where other variables are forced to change. The example given is the growth of bone length, which requires corresponding muscular, circulatory, and other dependant systems to also change. The exploratory processes allow for future change to occur in the other systems. That is, they expedite plasticity. So, for instance, an ad hoc linguistic example would be the loss of a fixed word order, which would require that morphology step in to fill the gap. In such a case, particles or affixes or the like would have to have already paved the way for case markers to evolve, and would have had to have been present to some extent in the original word order system. (This may not be the best example, but I hope my point comes across.)

Naturally, much of this will have seemed intuitive. But, as Miko stated, these are useful concepts for thinking about evolution; and, in my own case especially, the basics ought to be brought back into scrutiny fairly frequently. Which is justification enough for this post. As always, comments appreciated and accepted. And a possible future post: clade selection as a nonsensical way to approach phylogenic variation.

References:

Caldwell, M. (2002). From fins to limbs to fins: Limb evolution in fossil marine reptiles American Journal of Medical Genetics, 112 (3), 236-249 DOI: 10.1002/ajmg.10773

Gerhart, J., & Kirschner, M. (2007). Colloquium Papers: The theory of facilitated variation Proceedings of the National Academy of Sciences, 104 (suppl_1), 8582-8589 DOI: 10.1073/pnas.0701035104

Gerhart, J., & Kirschner, M. (2007). Colloquium Papers: The theory of facilitated variation Proceedings of the National Academy of Sciences, 104 (suppl_1), 8582-8589 DOI: 10.1073/pnas.0701035104

Referential labelling in Diana Monkeys

ResearchBlogging.org Ok, so I was going to write an essay for my Origins of Language module on this but then got distracted by syntax (again) so I thought I’d put my thoughts in a blog post just so they don’t go to waste.

Diana monkeys, like vervet monkeys, use alarm calls to communicate the presence of a predator to other monkeys.

They produce (and respond to) different alarm calls corresponding to how close the predator is, whether the predator is above or below them and whether the predator is a leopard or an eagle.  They respond instantly regardless of how imminent an attack is.

In this post I will explore some of the evidence relating to how sophisticated the Diana monkey’s understanding of the call’s meaning is and also the mental mechanisms relating to the call’s production.

Zuberbühler (2000a) discusses some types of species which have alarm calls but instead of each alarm call representing a different predator, each alarm call represents a different level (or types) of danger. The aim of the Zuberbühler paper then, was to set out if this was the case for Diana monkeys or if they really did have referential ‘labels’ for different predators.

Continue reading “Referential labelling in Diana Monkeys”

Language, Thought, and Space (V): Comparing Different Species

ResearchBlogging.org As I’ve talked about in my last posts (see I, II, III, and IV) different cultures employ different coordinate systems or Frames of References (FoR) when talking about space.  FoRs

“serve to specify the directional relationships between objects in space, in reference to a shared referential anchor” (Haun et al. 2006: 17568)

As shown in my last post these linguistic differences seem to reflect certain cognitive differences:

Whether speakers mainly use a relative, ego-based FoR, a cardinal-direction/or landmark-based absolute FoR, or an object-based, intrinsic based FoR, also influences how they solve and conceptualise spatial tasks.

In my last post I also posed the question whether there is a cognitive “default setting” that we and the other great apes inherited from our last common ancestor that is only later overridden by cultural factors. The  crucial question then is which Frame of Reference might be the default one.

Continue reading “Language, Thought, and Space (V): Comparing Different Species”

Phoneme Inventory Size and Demography

It’s long since been established that demography drives evolutionary processes (see Hawks, 2008 for a good overview). Similar attempts are also being made to describe cultural (Shennan, 2000; Henrich, 2004; Richerson & Boyd, 2009) and linguistic (Nettle, 1999a; Wichmann & Homan, 2009; Vogt, 2009) processes by considering the effects of population size and other demographic variables. Even though these ideas are hardly new, until recently, there was a ceiling as to the amount of resources one person could draw upon. In linguistics, this paucity of data is being remedied through the implementation of large-scale projects, such as WALS, Ethnologue and UPSID, that bring together a vast body of linguistic fieldwork from around the world. Providing a solid direction for how this might be utilised is a recent study by Lupyan & Dale (2010). Here, the authors compare the structural properties of more than 2000 languages with three demographic variables: a language’s speaker population, its geographic spread and the number of linguistic neighbours. The salient point being that certain differences in structural features correspond to the underlying demographic conditions.

With that said, a few months ago I found myself wondering about a particular feature, the phoneme inventory size, and its potential relationship to underlying demographic conditions of a speech community. What piqued my interest was that two languages I retain a passing interest in, Kayardild and Pirahã, both contain small phonological inventories and have small speaker communities. The question being: is their a correlation between the population size of a language and its number of phonemes? Despite work suggesting at such a relationship (e.g. Trudgill, 2004), there is little in the way of empirical evidence to support such claims. Hay & Bauer (2007) perhaps represent the most comprehensive attempt at an investigation: reporting a statistical correlation between the number of speakers of a language and its phoneme inventory size.

In it, the authors provide some evidence for the claim that the more speakers a language has, the larger its phoneme inventory. Without going into the sub-divisions of vowels (e.g. separating monophthongs, extra monophtongs and diphthongs) and consonants (e.g. obstruents), as it would extend the post by about 1000 words, the vowel inventory and consonant inventory are both correlated with population size (also ruling out that language families are driving the results). As they note:

That vowel inventory and consonant inventory are both correlated with population size is quite remarkable. This is especially so because consonant inventory and vowel inventory do not correlate with one another at all in this data-set (rho=.01, p=.86). Maddieson (2005) also reports that there is no correlation between vowel and consonant inventory size in his sample of 559 languages. Despite the fact that there is no link between vowel inventory and consonant inventory size, both are significantly correlated with the size of the population of speakers.

Using their paper as a springboard, I decided to look at how other demographic factors might influence the size of the phoneme inventory, namely: population density and the degree of social interconnectedness.

Continue reading “Phoneme Inventory Size and Demography”

Theory of Mind and Language Evolution; What can psychopathology tell us?

Theory of Mind is the ability to infer other persons’ mental states and emotions. It is thought to have evolved as part of the human’s social brain and probably emerged as an adaptive response to increasingly complex primate social interaction.

Brüne and Brüne-Cohrs (2006) explore the ‘evolutionary cost’ of language evolution:

This sophisticated ‘metacognitive’ ability comes at an evolutionary cost, reflected in a broad spectrum of psychopathological conditions. Extensive research into autistic spectrum disorders has revealed that theory of mind may be selectively impaired, leaving other cognitive faculties intact. Recent studies have shown that observed deficits in theory of mind task performance are part of a broad range of symptoms in schizophrenia, bipolar affective disorder, some forms of dementia, ‘psychopathy’ and in other psychiatric disorders.

Now it’s fairly uncontroversial to assert that without the ability of theory of mind humans would have never evolved language (Sperber and Wilson, 2002). This is due to the fact that if one can’t attribute another to have a ‘mind’ like ones own, or assume that other minds hold different information to ones own then one would see little point in trying to share information. (I’m sorry for the amount of ‘ones’ in that sentence).

Sooo, it does not seem presumptuous to assume that people interested in the evolution of language should be interested in theory of mind, in fact for many years evolutionary linguists, psychologists and biologists have been looking into this, but mostly through observing the behaviour of animals, and especially primates to see if they display theory of mind capabilities. A good summary of this work can be found here, and a lot of relevant studies can be found on this blog in the What makes humans unique? posts by Michael. I’m not going to look at the animal data in this post, but instead what the deficiencies in some human conditions can tell us about the evolution of theory of mind. That is, what can autism, schizophrenia, bipolar affective disorder, dementia, ‘psychopathy’ and other psychiatric disorders tell us?

Continue reading “Theory of Mind and Language Evolution; What can psychopathology tell us?”

Experiments in communication pt 2: Human Iterated Learning

ResearchBlogging.orgIn the last post, I discussed some of the literature into experimental communication, with the intention of then following it up by looking at recent experiments done at Edinburgh (and beyond). But as Hannah pipped me to the post, with a great overview of the wide range of experiments into language evolution, I’ll instead limit this to two relatively recent papers on Human Iterated Learning (Kirby et al., 2008; Cornish et al., 2009)

Drawing from experimental approaches found in Diffusion Chain and Artificial Language Learning studies, Kirby et al (2008) show that as a consequence of intergenerational transmission languages “culturally evolve in such a way as to maximize their own transmissibility: over time, the languages in our experiments become easier to learn and increasingly structured.” In these experiments a subject is exposed to an alien language, made up of two elements within a finite space: meanings (consisting of a picture with three discernible elements: colour, shape and movement) paired with signals (consisting of a string of letters). Importantly, the subject is only exposed to a set amount of meanings (SEEN items), after which they are then presented with a group of meanings (some SEEN, some UNSEEN) without the corresponding signal — the goal being that they provide a response (be it the correct version or not). On completion of forming the meaning-signal pairs the experiment is repeated, except this time the new subjects are trained on the data provided by the previous generation. This continues until the experiment is finished, which in this case happened at generation ten.

Continue reading “Experiments in communication pt 2: Human Iterated Learning”

Genetic Components and Cultural Differences: The social sensitivity hypothesis

ResearchBlogging.orgCultural differences are often attributed to events far removed from genetics. The basis for this belief is often based on the assertion that if you take an individual, at birth, from one society and implant them in another, then they will generally grow up to become well-adjusted to their adopted culture. Whilst this is more than likely true, even if there may be certain cultural features that may disagree with someone of a different ethnic background (e.g. degrees of alcohol tolerance), the situation is not as clear cut as certain political factions may have you believe.  Yet, largely due to studies on gene-culture coevolution, we are now starting to understand the complex dynamics through which genes and culture interact.

First, a particular culture may exert selection pressures on genes that provide an advantageous benefit to the adoption of a particular cultural trait. This is evident in the strong selection of the lactose-tolerance allele due to the spread of dairy farming. Second, pre-existing gene distributions provide pressures through which culture adapts. Off the top of my head, one proposed example of this is a paper by Dediu and Ladd (2007), which looked at how the distribution of the derived haplotypes of ASPM and Microcephalin may have subtly influenced the development of tonal languages. The paper in question, however, is looking more broadly at culture. Specifically, the authors, Baldwin May and Matthew Lieberman, examine recent genetic association studies and how within-variation of genes involved in central neurotransmitter systems are associated with differences in social sensitivity. In particular, they highlight a correlation between the relative frequencies of certain gene-variants and the relative degree of individualism or collectivism within certain populations.

Continue reading “Genetic Components and Cultural Differences: The social sensitivity hypothesis”

Language evolution in the laboratory

When talking about language evolution there’s always a resistance from people exclaiming;  ‘but how do we know?’, ‘surely all of this is conjecture!’ and, because of this, ‘what’s the point?’

Thomas Scott-Phillips and Simon Kirby have written a new article (in press) in ‘Trends in Cognitive Science’ which addresses some of the techniques currently used to address language evolution using experiments in the laboratory.

The Problem of language evolution

The problem of language evolution is one which encompasses not only the need to explain biologically how language came about but also how language came to be how it is today through processes of cultural evolution. Because of this potential ambiguity arises when using the term ‘language evolution’. To sort this ambiguity the authors put forward the following:

Language evolution researchers are interested in the processes that led to a qualitative change from a non-linguistic state to a linguistic one. In other words, language evolution is concerned with the emergence of language

Continue reading “Language evolution in the laboratory”