Confirming the appearance of excess success: Reply to van Boxtel and Koch (2016)

van Boxtel and Koch (Psychonomic Bulletin & Review. doi: 10.3758/s13423-016-1010-0 , 2016) reported finding problems in the Test for Excess Success (TES) analysis in Francis (Psychonomic Bulletin & Review, 21, 1180-1187, 2014). They argued that their findings undermined the general analysis and the conclusions of the specific TES analysis for their article (van Boxtel & Koch in Psychological Science, 23(4), 410-418, 2012). As shown in this paper, their reported problems reflect misunderstandings about both the general properties of a TES analysis and how it was applied to their specific set of findings. Another look at the findings and theoretical claims in van Boxtel and Koch (Psychological Science, 23(4), 410-418, 2012) confirms the appearance of excess success.