******************************************************************
      REVERB Challenge SE evaluation tool 
      Instruction for processing the evaluation data
   
  
                                             REVERB challenge organizers
					        reverb-se@lab.ntt.co.jp
      ******************************************************************

This readme file provides instructions to modify the SE evaluation scripts 
to process the evaluation data of the REVERB challenge.


(A) Instruction for running the SE evaluation


    1. First copy the content of "task_files_et" into the original "taskfiles" directory.
       After copying the files, the taskfiles directory should be as shown in (B)

    2. For processing the evaluation data, you need to modify listname and iroot in the 
       following scripts as described below,

       a. skeleton/process_RealData.m
          listname = fullfile(taskdir, ['RealData_et_for_1ch_', dist, '_', room, '_A']);
          iroot = fullfile(download_from_ldc, 'MC_WSJ_AV_Eval');

       b. skeleton/process_SimData.m
          iroot = fullfile(download_from_ldc, 'REVERB_WSJCAM0_et/data');
          listname = fullfile(taskdir, ['SimData_et_for_1ch_', dist, '_', room, '_A']);

    3. For evaluation, you need to modify the following scripts as described below:

       a. evaltools/score_RealData.m:
          origroot = fullfile(download_from_ldc, 'MC_WSJ_AV_Eval');
          tgtlist = fullfile(taskdir, ['RealData_et_for_1ch_', dist, '_room1_A']);
          
          Moreover, to differentiate your results with that of the development set, you may 
          replace the occurences of "dt_" by "et_" in the different occurences of the "name" 
          variable in the script.
          
       b. evaltools/score_SimData.m:
          origroot = fullfile(download_from_ldc, 'REVERB_WSJCAM0_et/data');
          tgtlist = fullfile(taskdir, ['SimData_et_for_1ch_', dist, '_', room, '_A']);	
          reflist = fullfile(taskdir, ['SimData_et_for_cln_', room]);

          Moreover, to differentiate your results with that of the development set, you may 
          replace the occurences of "dt_" by "et_" in the different occurences of the "name" 
          variable in the script.


(B) Content of the taskfiles directory after copying the evaluation task files.

./taskfiles/
|-- 1ch
|   |-- RealData_dt_for_1ch_far_room1_A
|   |-- RealData_dt_for_1ch_near_room1_A
|   |-- RealData_et_for_1ch_far_room1_A
|   |-- RealData_et_for_1ch_near_room1_A
|   |-- SimData_dt_for_1ch_far_room1_A
|   |-- SimData_dt_for_1ch_far_room2_A
|   |-- SimData_dt_for_1ch_far_room3_A
|   |-- SimData_dt_for_1ch_near_room1_A
|   |-- SimData_dt_for_1ch_near_room2_A
|   |-- SimData_dt_for_1ch_near_room3_A
|   |-- SimData_dt_for_cln_room1
|   |-- SimData_dt_for_cln_room2
|   |-- SimData_dt_for_cln_room3
|   |-- SimData_et_for_1ch_far_room1_A
|   |-- SimData_et_for_1ch_far_room2_A
|   |-- SimData_et_for_1ch_far_room3_A
|   |-- SimData_et_for_1ch_near_room1_A
|   |-- SimData_et_for_1ch_near_room2_A
|   |-- SimData_et_for_1ch_near_room3_A
|   |-- SimData_et_for_cln_room1
|   |-- SimData_et_for_cln_room2
|   |-- SimData_et_for_cln_room3
|   `-- SimData_tr_for_1ch_A
|-- 2ch
|   |-- RealData_dt_for_2ch_far_room1_A
|   |-- RealData_dt_for_2ch_far_room1_B
|   |-- RealData_dt_for_2ch_near_room1_A
|   |-- RealData_dt_for_2ch_near_room1_B
|   |-- RealData_et_for_2ch_far_room1_A
|   |-- RealData_et_for_2ch_far_room1_B
|   |-- RealData_et_for_2ch_near_room1_A
|   |-- RealData_et_for_2ch_near_room1_B
|   |-- SimData_dt_for_2ch_far_room1_A
|   |-- SimData_dt_for_2ch_far_room1_B
|   |-- SimData_dt_for_2ch_far_room2_A
|   |-- SimData_dt_for_2ch_far_room2_B
|   |-- SimData_dt_for_2ch_far_room3_A
|   |-- SimData_dt_for_2ch_far_room3_B
|   |-- SimData_dt_for_2ch_near_room1_A
|   |-- SimData_dt_for_2ch_near_room1_B
|   |-- SimData_dt_for_2ch_near_room2_A
|   |-- SimData_dt_for_2ch_near_room2_B
|   |-- SimData_dt_for_2ch_near_room3_A
|   |-- SimData_dt_for_2ch_near_room3_B
|   |-- SimData_dt_for_cln_room1
|   |-- SimData_dt_for_cln_room2
|   |-- SimData_dt_for_cln_room3
|   |-- SimData_et_for_2ch_far_room1_A
|   |-- SimData_et_for_2ch_far_room1_B
|   |-- SimData_et_for_2ch_far_room2_A
|   |-- SimData_et_for_2ch_far_room2_B
|   |-- SimData_et_for_2ch_far_room3_A
|   |-- SimData_et_for_2ch_far_room3_B
|   |-- SimData_et_for_2ch_near_room1_A
|   |-- SimData_et_for_2ch_near_room1_B
|   |-- SimData_et_for_2ch_near_room2_A
|   |-- SimData_et_for_2ch_near_room2_B
|   |-- SimData_et_for_2ch_near_room3_A
|   |-- SimData_et_for_2ch_near_room3_B
|   |-- SimData_et_for_cln_room1
|   |-- SimData_et_for_cln_room2
|   |-- SimData_et_for_cln_room3
|   |-- SimData_tr_for_2ch_A
|   `-- SimData_tr_for_2ch_B
|-- 8ch
|   |-- RealData_dt_for_8ch_far_room1_A
|   |-- RealData_dt_for_8ch_far_room1_B
|   |-- RealData_dt_for_8ch_far_room1_C
|   |-- RealData_dt_for_8ch_far_room1_D
|   |-- RealData_dt_for_8ch_far_room1_E
|   |-- RealData_dt_for_8ch_far_room1_F
|   |-- RealData_dt_for_8ch_far_room1_G
|   |-- RealData_dt_for_8ch_far_room1_H
|   |-- RealData_dt_for_8ch_near_room1_A
|   |-- RealData_dt_for_8ch_near_room1_B
|   |-- RealData_dt_for_8ch_near_room1_C
|   |-- RealData_dt_for_8ch_near_room1_D
|   |-- RealData_dt_for_8ch_near_room1_E
|   |-- RealData_dt_for_8ch_near_room1_F
|   |-- RealData_dt_for_8ch_near_room1_G
|   |-- RealData_dt_for_8ch_near_room1_H
|   |-- RealData_et_for_8ch_far_room1_A
|   |-- RealData_et_for_8ch_far_room1_B
|   |-- RealData_et_for_8ch_far_room1_C
|   |-- RealData_et_for_8ch_far_room1_D
|   |-- RealData_et_for_8ch_far_room1_E
|   |-- RealData_et_for_8ch_far_room1_F
|   |-- RealData_et_for_8ch_far_room1_G
|   |-- RealData_et_for_8ch_far_room1_H
|   |-- RealData_et_for_8ch_near_room1_A
|   |-- RealData_et_for_8ch_near_room1_B
|   |-- RealData_et_for_8ch_near_room1_C
|   |-- RealData_et_for_8ch_near_room1_D
|   |-- RealData_et_for_8ch_near_room1_E
|   |-- RealData_et_for_8ch_near_room1_F
|   |-- RealData_et_for_8ch_near_room1_G
|   |-- RealData_et_for_8ch_near_room1_H
|   |-- SimData_dt_for_8ch_far_room1_A
|   |-- SimData_dt_for_8ch_far_room1_B
|   |-- SimData_dt_for_8ch_far_room1_C
|   |-- SimData_dt_for_8ch_far_room1_D
|   |-- SimData_dt_for_8ch_far_room1_E
|   |-- SimData_dt_for_8ch_far_room1_F
|   |-- SimData_dt_for_8ch_far_room1_G
|   |-- SimData_dt_for_8ch_far_room1_H
|   |-- SimData_dt_for_8ch_far_room2_A
|   |-- SimData_dt_for_8ch_far_room2_B
|   |-- SimData_dt_for_8ch_far_room2_C
|   |-- SimData_dt_for_8ch_far_room2_D
|   |-- SimData_dt_for_8ch_far_room2_E
|   |-- SimData_dt_for_8ch_far_room2_F
|   |-- SimData_dt_for_8ch_far_room2_G
|   |-- SimData_dt_for_8ch_far_room2_H
|   |-- SimData_dt_for_8ch_far_room3_A
|   |-- SimData_dt_for_8ch_far_room3_B
|   |-- SimData_dt_for_8ch_far_room3_C
|   |-- SimData_dt_for_8ch_far_room3_D
|   |-- SimData_dt_for_8ch_far_room3_E
|   |-- SimData_dt_for_8ch_far_room3_F
|   |-- SimData_dt_for_8ch_far_room3_G
|   |-- SimData_dt_for_8ch_far_room3_H
|   |-- SimData_dt_for_8ch_near_room1_A
|   |-- SimData_dt_for_8ch_near_room1_B
|   |-- SimData_dt_for_8ch_near_room1_C
|   |-- SimData_dt_for_8ch_near_room1_D
|   |-- SimData_dt_for_8ch_near_room1_E
|   |-- SimData_dt_for_8ch_near_room1_F
|   |-- SimData_dt_for_8ch_near_room1_G
|   |-- SimData_dt_for_8ch_near_room1_H
|   |-- SimData_dt_for_8ch_near_room2_A
|   |-- SimData_dt_for_8ch_near_room2_B
|   |-- SimData_dt_for_8ch_near_room2_C
|   |-- SimData_dt_for_8ch_near_room2_D
|   |-- SimData_dt_for_8ch_near_room2_E
|   |-- SimData_dt_for_8ch_near_room2_F
|   |-- SimData_dt_for_8ch_near_room2_G
|   |-- SimData_dt_for_8ch_near_room2_H
|   |-- SimData_dt_for_8ch_near_room3_A
|   |-- SimData_dt_for_8ch_near_room3_B
|   |-- SimData_dt_for_8ch_near_room3_C
|   |-- SimData_dt_for_8ch_near_room3_D
|   |-- SimData_dt_for_8ch_near_room3_E
|   |-- SimData_dt_for_8ch_near_room3_F
|   |-- SimData_dt_for_8ch_near_room3_G
|   |-- SimData_dt_for_8ch_near_room3_H
|   |-- SimData_dt_for_cln_room1
|   |-- SimData_dt_for_cln_room2
|   |-- SimData_dt_for_cln_room3
|   |-- SimData_et_for_8ch_far_room1_A
|   |-- SimData_et_for_8ch_far_room1_B
|   |-- SimData_et_for_8ch_far_room1_C
|   |-- SimData_et_for_8ch_far_room1_D
|   |-- SimData_et_for_8ch_far_room1_E
|   |-- SimData_et_for_8ch_far_room1_F
|   |-- SimData_et_for_8ch_far_room1_G
|   |-- SimData_et_for_8ch_far_room1_H
|   |-- SimData_et_for_8ch_far_room2_A
|   |-- SimData_et_for_8ch_far_room2_B
|   |-- SimData_et_for_8ch_far_room2_C
|   |-- SimData_et_for_8ch_far_room2_D
|   |-- SimData_et_for_8ch_far_room2_E
|   |-- SimData_et_for_8ch_far_room2_F
|   |-- SimData_et_for_8ch_far_room2_G
|   |-- SimData_et_for_8ch_far_room2_H
|   |-- SimData_et_for_8ch_far_room3_A
|   |-- SimData_et_for_8ch_far_room3_B
|   |-- SimData_et_for_8ch_far_room3_C
|   |-- SimData_et_for_8ch_far_room3_D
|   |-- SimData_et_for_8ch_far_room3_E
|   |-- SimData_et_for_8ch_far_room3_F
|   |-- SimData_et_for_8ch_far_room3_G
|   |-- SimData_et_for_8ch_far_room3_H
|   |-- SimData_et_for_8ch_near_room1_A
|   |-- SimData_et_for_8ch_near_room1_B
|   |-- SimData_et_for_8ch_near_room1_C
|   |-- SimData_et_for_8ch_near_room1_D
|   |-- SimData_et_for_8ch_near_room1_E
|   |-- SimData_et_for_8ch_near_room1_F
|   |-- SimData_et_for_8ch_near_room1_G
|   |-- SimData_et_for_8ch_near_room1_H
|   |-- SimData_et_for_8ch_near_room2_A
|   |-- SimData_et_for_8ch_near_room2_B
|   |-- SimData_et_for_8ch_near_room2_C
|   |-- SimData_et_for_8ch_near_room2_D
|   |-- SimData_et_for_8ch_near_room2_E
|   |-- SimData_et_for_8ch_near_room2_F
|   |-- SimData_et_for_8ch_near_room2_G
|   |-- SimData_et_for_8ch_near_room2_H
|   |-- SimData_et_for_8ch_near_room3_A
|   |-- SimData_et_for_8ch_near_room3_B
|   |-- SimData_et_for_8ch_near_room3_C
|   |-- SimData_et_for_8ch_near_room3_D
|   |-- SimData_et_for_8ch_near_room3_E
|   |-- SimData_et_for_8ch_near_room3_F
|   |-- SimData_et_for_8ch_near_room3_G
|   |-- SimData_et_for_8ch_near_room3_H
|   |-- SimData_et_for_cln_room1
|   |-- SimData_et_for_cln_room2
|   |-- SimData_et_for_cln_room3
|   |-- SimData_tr_for_8ch_A
|   |-- SimData_tr_for_8ch_B
|   |-- SimData_tr_for_8ch_C
|   |-- SimData_tr_for_8ch_D
|   |-- SimData_tr_for_8ch_E
|   |-- SimData_tr_for_8ch_F
|   |-- SimData_tr_for_8ch_G
|   `-- SimData_tr_for_8ch_H
`-- README.txt