Showing posts with label McIver and Carroll. Show all posts
Showing posts with label McIver and Carroll. Show all posts

Friday, May 28, 2010

More on the Flaw in McIver and Carroll's article on detecting copying in the Gospels

In a recent post, I attempted to explain A Flaw in McIver and Carroll's Article about detecting the existence of written sources in the Gospels. The difficulty is that they did experiments with students in English and then applied the resulting criterion (16 or more words suggests copying) to texts in Greek, a problem given the fact that Greek invariably users fewer words to convey similar material. The difference is usually substantial and sometimes overwhelming. In one case, a 24 word conjoined sequence in Greek is represented in standard English translations by a 42 word conjoined sequence (Matt. 7.7 // Luke 11.9).  In other words, the 16 (or 18) word criterion is far too restrictive as a criterion of copying, and should have been greatly reduced to adjust for differences in language.

The difficulties with illegitimate transfer between English experiments and Greek texts does not end there. In this post, I would like to draw attention to a further, related issue that is not considered by McIver and Carroll: they are comparing results from experiments using a non-inflected language (English) with an inflected language (Greek). This is important because their experiments focus specially on conjoined sequences of words. A non-inflected language like English is far more likely to retain word order across two parallels because word order is often intrinstic to the meaning. In Greek, by contrast, word order is less important in the determination of meaning. This has the effect of diminishing the likely extent of parallel conjoined sequences in Greek.

The point can be illustrated with a simple look at the Synopsis. Matt. 9.5-6 // Mark 2.9-10 // Luke 5.23-4 features an eighteen word triple agreement in English translation, the kind of agreement that would satisfy even the stricter McIver and Carroll criterion. Here's the passage in the RSV of Mark, with the triple sequential agreement of eighteen words underlined:

. . . 'Your sins are forgiven,' or to say, 'Rise, take up your pallet and walk'? But that you may know that the Son of man has authority on earth to forgive sins" --he said to the paralytic . . .

In Greek, however, there is no such lengthy agreement because of differences in the ordering of the elements translated above as "has authority" and "Son of Man" and "upon the earth". Take a look at the texts:

Matt. 9.5-6: . . . Ἀφίενταί σου αἱ ἁμαρτίαι, ἢ εἰπεῖν· Ἔγειρε καὶ περιπάτει; ἵνα δὲ εἰδῆτε ὅτι   ἐξουσίαν ἔχει   ὁ υἱὸς τοῦ ἀνθρώπου   ἐπὶ τῆς γῆς   ἀφιέναι ἁμαρτίας, τότε λέγει τῷ παραλυτικῷ . . . .

Mark 2.9-10: . . . . Ἀφέωνταί σου αἱ ἁμαρτίαι, ἢ εἰπεῖν· Ἔγειρε καὶ ἆρον τὸν κράβαττόν σου καὶ περιπάτει; ἵνα δὲ εἰδῆτε ὅτι   ἐξουσίαν ἔχει   ὁ υἱὸς τοῦ ἀνθρώπου   ἀφιέναι ἁμαρτίας   ἐπὶ τῆς γῆς, λέγει τῷ παραλυτικῷ . . .

Luke 5.23-4: . . . . Ἀφέωνταί σοι αἱ ἁμαρτίαι σου, ἢ εἰπεῖν· Ἔγειρε καὶ περιπάτει; 24 ἵνα δὲ εἰδῆτε ὅτι   ὁ υἱὸς τοῦ ἀνθρώπου   ἐξουσίαν ἔχει   ἐπὶ τῆς γῆς   ἀφιέναι ἁμαρτίας, εἶπεν τῷ παραλελυμένῳ . . .

What this illustrates is that the chances for conjoined sequence in parallel passages is greater in contemporary English than it is in first century Greek.  Where English translations of this passage have eighteen words in conjoined sequence across all three Synoptics, the Greek has just eleven (Matthew // Mark) or five (Mark // Luke and Matthew // Luke).

The same kind of thing is easy to illustrate from elsewhere.  Take the following parallel from Matthew and Mark, for example, in which there is conjoined sequence for nineteen English words of the NRSV translation:


Matt. 26.13 (NRSV): Truly I tell you, wherever this good news is proclaimed in the whole world, what she has done will be told in remembrance of her.”

Mark 14.9 (NRSV): Truly I tell you, wherever the good news is proclaimed in the whole world, what she has done will be told in remembrance of her.”


Now contrast this with the Greek texts (NA27) of Matthew and Mark:


Matt. 26.13: ἀμὴν, λέγω ὑμῖν, ὅπου ἐὰν κηρυχθῇ τὸ εὐαγγέλιον  τοῦτο ἐν  ὅλτκόσμῳ,   λαληθήσεται   καὶ ὃ ἐποίησεν αὕτη   εἰς μνημόσυνον αὐτῆς.

Mark 14.9: ἀμὴν δὲ, λέγω ὑμῖν, ὅπου ἐὰν κηρυχθῇ τὸ εὐαγγέλιον  εἰς ὅλον τὸν κόσμον,   καὶ ὃ ἐποίησεν αὕτη   λαληθήσεται   εἰς μνημόσυνον αὐτῆς.


The differing position of λαληθήσεται ("will be told") in Matthew and Mark generates a shorter conjoined sequence of words in Greek than one sees in English translation, only four words in the comparison with the nineteen in the English of the NRSV.

In other words, English is more likely to feature a lengthy conjoined sequences of words given that it is a non-inflected language with fewer options in relation to the ordering of words.  This should have been factored into McIver and Carroll's attempt to transfer their contemporary English experimental results to ancient texts written in Greek.

Wednesday, May 26, 2010

A Flaw in McIver and Carroll's Article about detecting the existence of written sources in the Gospels

I've recently found myself thinking again about Robert K. McIver and Marie Carroll, "Experiments to Develop Criteria for Determining the Existence of Written Sources, and Their Potential Implications for the Synoptic Problem", Journal of Biblical Literature 121/4 (Winter, 2002): 667-687, partly because it is briefly discussed in James R. Edwards's recent book (James Edwards on McIver and Carroll), partly because it came up in Judy Redman's recent post on Speeches of Jesus (3) -- human memory experiments, with which I have been interacting over there on Judy's blog.

I have always been uncomfortable with McIver and Carroll's article, in part for reasons explained in John Poirier, "Memory, Written Sources and the Synoptic Problem: A Response to Robert K. McIver and Marie Carroll", JBL 123/2 (2004): 315–322.  But today I was able to locate the source of my discomfort  and it relates to an important flaw in the way that McIver and Carroll apply the results of their experimental data with students to the texts of the Synoptic Gospels.  The mistake that they make is simple but important: their experimental data is in English whereas the Synoptic Gospels are in Greek.

Now one may well say at this point, "So what?" and "Well, of course their experimental data is in English! Contemporary undergraduate students do not speak fluent first century Koine Greek!"  But here is the problem:  McIver and Carroll make no adjustment for the differences between the English student experiments and the Greek texts of the Gospels.  Their criterion for the determining the presence of a copying from a retained written source in English is 16 words in conjoined sequence (later adjusted in a subsequent article to 18).  This criterion for English material is then transferred without analysis or comment to the Greek Gospels.

This is important because it takes many more words to say something in contemporary English than it takes to say the same thing in Koine Greek. Therefore, 16 (or 18) words in English correlates to fewer words in Greek, and so the 16 (or 18) word criterion is much too high for Greek.  The point can be illustrated by looking at English translations of McIver and Carroll's list of passages in that feature 16 or more words in conjoined sequence.  Notice the kinds of difference between expression in Greek and expression of the same thing in English:

  • The 18 Greek words in conjoined sequence in Matt. 8.2-3 // Luke 5.12-13 (miscounted by McIver and Carroll as 17) are 26 words in the RSV.
  • The 31 Greek words in Matt. 10.21-22 // Mark 13.12-13 becomes 49 words in English translation. 
  • The 24 words in Matt. 3.9-10 // Luke 3.8-9 becomes 29 words in English translation.
  • Matt. 6.24 // Luke 16.13 goes from 26 Greek words in conjoined sequence to 33 in English translation.
  • Matt. 7.7 // Luke 11.9 goes from 24 Greek words in conjoined sequence to 42 in English translation.
  • Matt. 8.9-10 // Luke 7.8-9 goes from 25 conjoined Greek words (miscounted by McIver and Carroll as 21) to 37 in English translation.

In other words, attention to this important point about the difference between English and Greek would have resulted in a vastly greater number of passages that satisfy McIver and Carroll's 16 (or 18) word criterion. They have derived a criterion from work with one language (English) and have applied it to texts in another language (Greek), in spite of the fact that it takes many more words to say the same thing in English than it does in Greek.

And there is a further, related difficulty that I will deal with in my next post.

Monday, May 24, 2010

James Edwards on McIver and Carroll

I have recently finished working through James R. Edwards, The Hebrew Gospel and the Development of the Synoptic Tradition (Grand Rapids: Eerdmans, 2009). I am reviewing the book for CBQ, but I have quite a lot to say about it and there are several things I won't have space for in the review, so I will let them overflow here in the blog.

In no particular order, the first of these is a discussion of Robert K. McIver and Marie Carroll, "Experiments to Develop Criteria for Determining the Existence of Written Sources, and Their Potential Implications for the Synoptic Problem", Journal of Biblical Literature 121/4 (Winter, 2002): 667-687. Edwards brings up McIver and Carroll's work in order to corroborate both Marcan Priority and the notion that "Matthew concludes and consummates the Synoptic tradition" (251), though it is not quite clear what he means by this given that elsewhere "double tradition" is retained as a source for Matthew's and Luke's non-Marcan material (Chapter 7; cf. the diagram on p. 262 in which Matthew and Luke are independent of one another).

Edwards reviews one of the key conclusions of McIver's and Carroll's study, quoting with approval their comment that "Any sequence of exactly the same 16 or more words that is not an aphorism, poetry or words to a song is almost certain to have been copied from a written document" (681; Edwards, 250; italics original). Edwards then draws attention to the 23 parallel passages listed by McIver and Carroll as including 16 words or more in verbatim agreement. He notes that three of the pairs are Mark // Luke, nine are Matthew // Mark and eleven are Matthew // Luke. He then writes:
Of a total of 23 pairs shared by Luke and Mark, or Luke and Matthew, or Mark and Matthew, Matthew shares 20 of them. Matthew, in other words, is almost twice as likely to share material in common with Mark, or in common with Luke, as either Luke or Mark is to share material in common with the other. This statistic suggests that Matthew is either the source of material for Mark and Luke; or, conversely, that Matthew is the recipient of material from either Mark or Luke. (251).
The deduction from the data is puzzling. McIver and Carroll's data clearly show that there is literary dependence of some kind in these passages, but the data tell us nothing in themselves about the direction of dependence. Edwards goes on:
The theory of Markan priority supplies solid and repeated evidence for the assumption that Matthew has been the recipient of Markan material (251).
I am sympathetic with this view, but it cannot be deduced from McIver and Carroll's data. What the data demonstrate is copying of some kind, but there is no indication of direction of dependence.  If there is one thing that might be deduced from their data with respect to Marcan Priority it is that Matthew and Luke are unlikely to have used Mark independently of one another. Two of the eleven Matthew // Luke pairings are actually in triple tradition, Matt. 8.1-4 // Luke 5.12-16 and Matt. 16.21-28 // Luke 9.21-27, i.e. they feature Minor Agreements that generate extended conjoined sequences of verbatim agreement, which suggests that if Matthew and Luke used Mark, there is also a direct link of some kind between Matthew and Luke.

Incidentally, McIver and Carroll appear unaware of this themselves. They list one of these passages, Matt. 8.1-4 // Luke 5.12-16 (Leper) among their pared down list of nine passages that "almost certainly contain copied material" without noticing that this runs contrary to the Two-Source Theory that elsewhere they apparently assume (683, "perhaps Q?"; see further John C. Poirier, "Memory, Written Sources, and the Synoptic Problem: A Response to Robert K. McIver and Marie Carroll", JBL 123/2 (Summer, 2004):  315-322 (316-7).)

But back to Edwards.  His discussion of McIver and Carroll concludes:
The foregoing arguments, and especially the list of examples on pages 249-50 above, argue the same, that Matthew is the recipient of Lukan material. The work of McIver and Carroll seems to supply further statistical evidence that Matthew concludes and consummates the Synoptic tradition. (251).
The "list of examples" on pp. 249-50 of the book consists of suggestions that Matthew is a later Gospel than Luke, itself something I may return to in due course.  But the conclusion here, that McIver and Carroll's work supplies statistical evidence in favour of Matthean posteriority, is not self-evident.  It is simply asserted.

There are several minor issues that are also worth mentioning: (1)  Edwards also speaks of "46 passages" (250), but the figure should be 45 -- he has counted Matt. 16.21-28 twice; (2) McIver and Carroll do not weight these 45 passages equally.  They eliminate 14 pairs because they are aphorisms and distinctive sayings and they put stress on only 9. (3) McIver and Carroll are only dealing with conjoined sequences of words; this work needs to be supplemented with other Synoptic data; (4) The points made in Poirier's perceptive critique (citation above) need to be taken seriously rather than ignored.

Wednesday, December 17, 2008

Contemporary Memory Experiments and Jesus Traditions

April DeConick makes two fresh contributions to the ongoing discussion of the use of contemporary studies on memory and their use in shedding light on antiquity, human memory is THE factor and I was surprised too. I have been waiting for the book in which her article appears to arrive at Duke before adding another comment in this discussion, hence the gap since my last contribution on this topic.

The new article is April DeConick, "Human Memory and the Sayings of Jesus" in Tom Thatcher (ed.), Jesus, the Voice and the Text: Beyond The Oral and Written Gospel (Waco: Baylor University Press, 2008): 135-80. The article is similar in several respects to the earlier piece Robert K. McIver and Marie Carroll: "Experiments to Develop Criteria for Determining the Existence of Written Sources, and Their Potential Implications for the Synoptic Problem," JBL 121 (2002): 667-87 though it improves on that one in avoiding some of its logical errors (for which see John Poirier, "Memory, Written Sources and the Synoptic Problem: A Response to Robert K. McIver and Marie Carroll", JBL 123/2 (2004): 315–322) and in the extent of its realization that "the synoptic problem is mainly a problem of literary dependence" (178-9). McIver and Carroll appeared strangely lukewarm on this issue (especially 683; cf. Poirier 316), though in the end they list several passages that they regard as establishing some kind of literary dependence. DeConick* adds several more (179), though she does not reflect on the fact that the passages she gives are different in nature on her preferred (Two-Source) Theory, direct borrowing (Matt // Mark and Mark // Luke) versus mutual dependence on a third document (Matt // Luke double tradition), an issue that is important because of the high verbatim agreement in these passages (cf. Poirier 317; cf. my blog post on the degree of verbatim agreement in Q).

But the discussion of the Synoptic Problem is peripheral in DeConick's article, where the main focus is on pre-Synoptic traditions, and in particular the question of how memory might have functioned in the transmission of those traditions. So is it possible for experiments with contemporary students' memories to shed light on the memories of the bearers of early Christian traditions about Jesus? I am sceptical about the experiments for the following reasons:

(1) The difficulties of transferring the data. Like McIver and Carroll, DeConick is sanguine about her ability to transfer the results from the experiments to the ancient world. In the conclusion to her article (entitled "What does it all mean?"), for example, the new experimental data is used in order to refute Rudolf Bultmann -- "In this case, the data says that Rudolf Bultmann's form-critical theory about orality was incorrect because his assumptions were wrong" (177). I admire this confidence, but I do not share it. The ways in which the memories of contemporary students are formed and trained are so different from the ways in which the ancients' memories were formed and trained that we simply cannot read off the results from one onto the other. We do not do it when we conceptualize ancient compositional practices and we should avoid it too when we conceptualize ancient memory.

(2) The difficulties of setting up the experiments. There is a related problem. It is not just that we have direct access to the modern mind and only indirect access to the ancient mind through the literary deposits, but it is also that we don't know how to replicate the conditions in which the ancients in general or the evangelists in particular worked. In one of their experiments, McIver and Carroll provided financial incentives for their subjects to repeat a joke word for word (674) and DeConick directed those in her experiments to repeat the materials "as accurately as possible" (142-3). But how far and in what way does this replicate the way in which early Christian tradents worked? Were they attempting to remember and retell what they heard "as accurately as possible", whatever we might mean by that?

(3). The text-based nature of the experiments. DeConick's experiments appear to work with a very text-based model. As far as I can tell from the descriptions of the set up of the experiments (e.g. 142-3), specific, fixed texts were always involved. The students either listened to the text on a tape, or they read it. Unless one thinks that early Christian tradents were at all times performing from a fixed text, what we are dealing with here is therefore quite different from early Christian tradition. Our best guess about the transmission of tradition in the pre-Synoptic period is that the process was a dynamic one in which material was communicated, not read aloud. It is important, in other words, to distinguish between memory of communicated tradition and memory of a text that has been read aloud.

(4). The use of unfamiliar material. DeConick's experiments used texts that would be unfamiliar to the students, a version of Thomas 75, a version of Thomas 97 and the Infancy Gospel of Thomas 10.1-2. The choice of these texts is understandable -- DeConick wishes to avoid contamination from previous memory (143). The difficulty with these choices, though, is that it sets up an experiment in which the students are immediately operating at a distance from the material that is being conveyed to them. In the transmission of early Christian traditions, this experience may have obtained at least once for every hearer, but that one off experience would be replaced subsequently by repeated hearings of the same, now increasingly familiar material. DeConick rightly discusses both short term memory and long term memory, but does not discuss the progress from unfamiliarity to familiarity, in interaction, repetition and creative re-interpretation. In other words, the students' brief exposure to unfamiliar texts is unlikely to replicate the early Christian tradents' encounters with the traditions they subsequently carried.

(5) Composition and creativity. The experiments' focus on memory, and the instruction to the students to attempt to engage in accurate reproduction, means that there is no room to factor in parallels to the creative, compositional work of the evangelists and, for that matter, of the tradents before them. The same difficulty obtains in McIver and Carroll's article -- distance from the source text is measured largely in terms of memory distortion with little attention to attempting to replicate the evangelists' own creativity. (See further Poirier, especially 318 and 322).

Lest I appear too sceptical, too harsh on what are, after all, innovative and interesting studies, let me finish with a positive word. The ancient historian's constant battle is the attempt to understand and describe a world that is so very different from ours. One of the weapons in that battle is the well chosen, contemporary analogy. Sometimes, in our bid to describe and analyze what is distant, we need good analogies. The experimental data on contemporary students' memories might well provide the kind of analogies that aid our attempts to do ancient history. They can help us to craft good questions, to make clear contrasts and to remind us where our evidence of the ancient world is wanting. It is important, though, to remind ourselves that contemporary analogies are always partial, often limited and sometimes misleading.

* I am employing what I take to be academic convention in talking about April DeConick's published work using her surname, where the emerging blogging convention is to use first names when talking about blog posts. I mention this lest anyone thinks that I have developed some unwelcome frostiness!