tag:blogger.com,1999:blog-5759844.post2600525474226773555..comments2024-03-21T14:59:20.729-04:00Comments on NT Blog: The correct interpretation of Dr. Andrey Feuerverger's 1:600 odds calculationMark Goodacrehttp://www.blogger.com/profile/05115370166754797529noreply@blogger.comBlogger13125tag:blogger.com,1999:blog-5759844.post-77670264656708962372007-03-07T12:53:00.000-05:002007-03-07T12:53:00.000-05:00I don't know if this helps, but I noticed this pos...I don't know if this helps, but I noticed this posting at Dr. Feuerverger's web site:<BR/>http://fisher.utstat.toronto.edu/andrey/OfficeHrs.txt<BR/>This is an open letter to statistical collegues.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-5759844.post-11210155316440835472007-03-06T18:44:00.000-05:002007-03-06T18:44:00.000-05:00P.P.S. As a further poker illustration, the odds o...P.P.S. As a further poker illustration, the odds of a full house in five card draw are different than the odds of a full house in Texas Hold'Em, because in the latter you can choose the best five cards out of seven.<BR/><BR/>The calculation shown on the doc website simply ignores the presence of the other ossuaries. This is analogous to calculating seven card odds while only using five cards to calculate with. It skews your results.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-5759844.post-27635007546414631822007-03-06T18:39:00.000-05:002007-03-06T18:39:00.000-05:00P.S. I also agree with much of the sentiments expr...P.S. I also agree with much of the sentiments expressed by dianelos above.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-5759844.post-52008638185531961142007-03-06T18:34:00.000-05:002007-03-06T18:34:00.000-05:00I would like to clarify my earlier remarks regardi...I would like to clarify my earlier remarks regarding "expected values."<BR/><BR/>I think all the folks, including Dr. D'Mello, who mention that you need Bayesian statistics to do any real sort of calculation are directly on point. I didn't mean to contradict that in any way.<BR/><BR/>My point was that the documentary statistics are even worse than people are saying, and that by talking about Bayesian statistics you are giving them too much credit, at least in so far as what was available at the doc website.<BR/><BR/>When I look at the pdf of the statistics provided on the documentary website, what I see is that the methodology they use gives you an expected value. They calculate the probability of finding four particular names at random in one tomb, then multiply by a thousand tombs and by a factor four to correct for biases. I wish I could enter this formula in LaTEX on this blog, because you will see that this corresponds to the formula for expected value.<BR/><BR/>As far as whether the order matters or not, the family relationship has nothing to do with the order, in a statistical sense. Think of a poker hand -- if you draw three queens and two jacks, it doesn't matter what order you draw them in, so long as you end up with those five cards. Similarly, when you are calculating the probability of finding four names at random in one tomb, if you simply multiply the four individual probabilities, you are calculating the odds of finding them in a particular order. This is basic first semester combinatorics.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-5759844.post-74166856607182146062007-03-06T14:54:00.000-05:002007-03-06T14:54:00.000-05:00Well, Prof. Feuerverger the professional statistic...Well, Prof. Feuerverger the professional statistician who in the film says that there is only a 1/600 probability that the Talpiot tomb does not belong to Jesus's family has already backtracked from his claim. See it in his own words here: http://fisher.utstat.toronto.edu/andrey/OfficeHrs.txt (the relevant bit is "I now believe that I should not assert any conclusions connecting this tomb with any hypothetical one of the NT family.") So there is really no question that the statistics in the film are bogus. <BR/>Actually, the discovery site explains the statistics of the movie makers (go to http://dsc.discovery.com/convergence/tomb/explore/explore.html, click on "Enter the Tomb", then on "Supporting Evidence", and finally "Statistical Evidence"). Clearly the question they asked was: How probable is to find this combination of suggestive names in a tomb? The answer given to them by Prof. Feuerverger basically was: The frequencies of "Jesus son of Joseph", "Maria", "Joseph", and "Mariamene" (the relevant names found in the Talpiot tomb) are 1/190, 1/160, 1/20, 1/4 respectively; therefore the probability of finding them all in one tomb is their product, i.e. 1/2,400,000. Let's conservatively cut this number to a quarter of it in order to account for biases in the historical sources; we get then that the probability of finding this particular mix of numbers in one tomb is 1/600,000. There are a thousand tombs around Jerusalem from this era; therefore the probability of any one tomb having these names is 1/600.<BR/><BR/>So? How do they get from this answer to the conclusion that there is "a high statistical probability that the Talpiot tomb is the Jesus Family tomb" as the discovery site says? This would *only* follow if we knew 1) that Jesus family was entombed in Jerusalem and 2) that their tomb would have the names "Jesus son of Joseph", "Maria", "Joseph" and "Mariamene" inscribed in them. But neither 1) nor 2) are likely. Indeed most people would think that 2) is highly unlikely, especially taking into account that also an inscription "Judas son of Jesus" was found in the Talpiot tomb. <BR/><BR/>What's worse, you don't just simply multiply probabilities. Suppose you put two coins in a match box, toss it, open the box and find one coin showing heads and the other tails. How probable is that result? The probability of heads is 1/2 and the probability of tails is also 1/2 so, according to the film's logic, the probability of getting one heads and one tails is their product, i.e. 1/4. But that's grossly wrong. The correct probability of getting one heads and one tails is 1/2 (if you don't believe it try the experiment and count the results :-) The correct probability of finding a tomb around Jerusalem with ossuaries with inscriptions "Jesus son of Joseph", a "Mary", a "Joseph" and a "Mariamene" is in fact approx. 1/170. But again, that probability has little to do with the question at hand. <BR/><BR/>The question at hand of course is: Given that we found a tomb with this combination of suggestive names, what is the probability that this tomb belongs to Jesus's family? This is the question I tried to answer using Monte Carlo simulation. <BR/><BR/>My first analysis shows that there were about 12 families in ancient Jerusalem who might have produced a tomb with just as unlikely a combination of names (that according to the gospels belong to Jesus's family) as the Talpiot tomb. So, *at best*, there is a 1/12 probability of the Talpiot tomb being Jesus's. <BR/><BR/>My second analysis shows that even assuming that the family of Jesus has the members the film makers hypothesize (Jesus son of Joseph, Mary, Joseph, Mary), and even assuming that all these members would be buried in a potential Jesus family tomb, the film makers' method of identifying a tomb as being Jesus's based on the very low probability of finding a particular combination of names in it would be correct in only about 8% of the positive identifications (so again we get at best a probability of 1/12 for the Talpiot tomb being Jesus's). (I have posted details of both these analyses in Usenet.)<BR/><BR/>Some bring up the issue of the inscription "Mariamene". My understanding after reading http://benwitherington.blogspot.com/2007/03/smoking-gun-tenth-talpiot-ossuary_9874.html is that "Mariamene" just an alternative form of the name Mary (or Miriam, or Maria, or Mariamme, etc). There is no good reason to believe that Mary Magdalene was called Mariamene and not Mary, as she is called "Mary" in the gospels and the earliest mention of "Mariamene" was written much later than the gospels (some 100 years later) in a rather primitive Gnostic text (the "Acts of Phillip", see: http://en.wikipedia.org/wiki/Acts_of_Phillip ). Neither do we have reason to believe that Mary Magdalene was married to Jesus and would possibly get a place in Jesus's family tomb, assuming that such tomb exists. In fact the film makers make an assumption that depends on four (count them) "ifs": If Mary Magdalene was known as "Mariamene", and if she was married to Jesus, and if Jesus's family was entombed in Jerusalem, and if Mary Magdalene was entombed in the Jesus's family tomb then it's probable that the Talpiot tomb is Jesus's tomb. I analyzed this case too. It turns out that if we accept all these "ifs" then indeed there is a probability of 90% that the Talpiot tomb belongs to the family of Jesus - but still far less than the 99.8% (or 599/600) probability the film makers suggested as the most conservative one. In short the film's thesis is based on very shaky assumptions, and its math is wrong to boot.Unknownhttps://www.blogger.com/profile/13135072681220762956noreply@blogger.comtag:blogger.com,1999:blog-5759844.post-65265893976206078812007-03-05T12:58:00.000-05:002007-03-05T12:58:00.000-05:00Yes, anonymous, you are correct. He already tried ...Yes, anonymous, you are correct. He already tried to account for the fact that there would be more tombs than we know about. It is disturbing that someone trying to set the record straight would miss this key fact. <BR/>As far as the comment about the specific order being important, there is nothing wrong about that since the order in this case would be the familial relationships, which is important!Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-5759844.post-11059216765248750902007-03-05T11:45:00.000-05:002007-03-05T11:45:00.000-05:00"So, for illustration only, suppose we assumed tha..."So, for illustration only, suppose we assumed that there was a 1 in 10 chance that the Jesus family had their own tomb to begin with.<BR/>...<BR/>We see that P(A and B) = (1/10) * (599/600) = 0.1 (approximately)."<BR/><BR/>-- This is already accounted for. This is the <B>bias error calculation</B>. They've divided by 4 (not 10).<BR/><BR/>It basically means... assuming there are another 3000 tombs undiscovered... the likelihood of finding these THREE names together is 1 in 600.<BR/><BR/>You should find 5 more tombs like this, theoretically, if there are a ton of undiscovered tombs.<BR/>*******<BR/>Then again, if you were looking at alternative calculations... <BR/>they say no other tombs say "Mariamne". So that makes her 1 in 1000. Finding this name in connection with others has gotto increase the odds.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-5759844.post-56815131091002010792007-03-04T16:19:00.000-05:002007-03-04T16:19:00.000-05:00I might be missing something here, but if the stat...I might be missing something here, but if the statistician on the programme is simply talking about expected values, then it seems that the 1/600 figure is pretty meaningless. If all we are saying is that the EV of finding a specific combination of names in 1000 tombs in first century Jerusalem is 1/600, then how does that add to the debate?<BR/><BR/>Within any sample of the population there are bound to be lots of combinations of names that are intrinsically unlikely, but in order to identify a specific combination with an actual family in the wider population, you would need to take into account the whole of the population, not simply the sample. Therefore, even if we are talking about EV's rather than probabilities, I think that Dr. D'Mello's points still hold.<BR/><BR/>Does anyone have any relevant population data for the period?<BR/><BR/>StuartAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-5759844.post-47717591605072140672007-03-03T22:21:00.000-05:002007-03-03T22:21:00.000-05:00I'm afraid that Dr. D'Mello's Interpretation B and...I'm afraid that Dr. D'Mello's Interpretation B and Interpretation C do NOT accurately represent the correct interpretation of Dr. Feueverger's 1/600 calculation.<BR/><BR/>The methodology employed by Feueverger leads to an expected value, not probability odds.<BR/><BR/>What 1/600 represents is the (incorrect) expected value of how many tombs one would find with the four names in that exact order, if 1000 tombs all had exactly four names. We ignore the two other names and the unnamed ossuaries for this calculation.<BR/><BR/>If you look at what Feuerverger did, he multiplied the probabilities of the four names. This gives you the probability in one tomb of finding those four names in that order, if you only have four total names. If you multiply this probability by a 1000, this gives you the expected value.<BR/><BR/>However, when you factor in the fifth name, sixth name, and the four unnamed ossuaries, the expected value changes dramatically. Furthermore this is a drastic simplification as tombs would be expected to have varying numbers of names.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-5759844.post-73719953808475607342007-03-03T19:19:00.000-05:002007-03-03T19:19:00.000-05:00The 1/600 statistic is incorrect on a number of le...The 1/600 statistic is incorrect on a number of levels.<BR/><BR/>First, from an interpretive standpoint you have to understand that the final number they are attempting to calculate is an expected value, not a probability. The number represents the average number of tombs you would expect to find with those names if you could investigate every tomb if there were 1000 total tombs and each tomb had a certain number of names. (This is known as an "expected value" or "average value.") They attempt to calculate the probability of a given tomb having a particular set of names, then multiply that probability by the total number of tombs. This tells you how many tombs you expect to find on average.<BR/><BR/>Therefore, the number they come up with is highly dependent on the number of tombs during that time period. The higher or lower the total number of tombs, the higher or lower number of tombs with those four names you would expect to find.<BR/><BR/>Thus the number they are trying to calculate (even if they got it right, which they don't) does not tell you the likelihood of finding a family during that time with those four or five names in them. In other words, there might be many, many families with people of those names in them, but because only a small percentage of families had tombs, the number of tombs you expect to find is small.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-5759844.post-67696970767868623262007-03-03T16:31:00.000-05:002007-03-03T16:31:00.000-05:00Readers having trouble with the Bayesian statistic...Readers having trouble with the Bayesian statistics see <A HREF="http://yudkowsky.net/bayes/bayes.html" REL="nofollow">An Intuitive Explanation of Bayesian Reasoning</A>.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-5759844.post-64130792528741874482007-03-02T20:37:00.000-05:002007-03-02T20:37:00.000-05:00Your earlier arguments are most germane, Mark, and...Your earlier arguments are most germane, Mark, and so also those of several of<BR/>your commentors. I.e., that additional facts that do not support the Jesus-tomb claim also need to be taken into account in any proper statistical analysis. And there is a sound statistical way to take account of<BR/>all pieces of information that tend not to support a case as well as all<BR/>that support it. It's called Bayesian statistics.<BR/><BR/>There, one must be able to assign a probability, p, to each mutually exclusive piece of information that tends to go against the claim (p less than 0.5), as well as to each one that supports the claim (p greater than 0.5). Then all these individual probabilities can be accumulated, via a relatively simple Bayesian statistics formula, into a single overall probability.<BR/><BR/>Each item of input needs to be as correct as possible. E.g., instead of Dr. Feuerverger's probability (599/600) as one item, one would use the (much smaller) result from Dr. D'Mello's analysis that takes into account the conditional probability. <BR/><BR/>One proviso is that ALL information bearing on the question needs to be<BR/>included in the Bayesian analysis. This would include, e.g., the probability assigned to the lack of mention in the Gospels or elsewhere of Jesus having a wife -- there could be a reason for that, but also reasons against it that would lead to a best estimate of the probability stemming from that one datum point alone.<BR/><BR/>Like Mark, I'm also no statistician, but have studied this type of problem within the framework of Bayesian statistics. <BR/><BR/>Jim DeardorffAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-5759844.post-29414877295955950342007-03-02T20:01:00.000-05:002007-03-02T20:01:00.000-05:00Dr. Richard Bauckham would have all the data that ...Dr. Richard Bauckham would have all the data that you require to make the calculation. Some of it is found in chapter 4 of his recent book 'Jesus and the Eyewitnesses'. He can be contacted at the University of St. Andrews, Scotland, or via:<BR/>rjb@st-andrews.ac.ukAnonymousnoreply@blogger.com