To test the new systems, we constructed 45 input queries, or ``new cases'' and retrieved the most similar cases with KATE and with CBRDM. These are shown with the results in nine series, which are shown with their feature values, and with the number of the case that was retrieved.
KATE was used on computer with a 486 75MHz processor, under Windows 3.11. The retrieval time was usually less than two seconds. CBRDM was used on a computer with a similar processor, under MS-DOS, and the retrieval time was over 4 minutes per case.
The queries are thought to be some typical queries for the CBR system with the casebase constructed from OREDA. The feature value ``NA'' in the queries indicate that the information about the state of the feature is unknown. For some queries, KATE found no matching cases to retrieve, and this is indicated by ``NA'' for all feature values, and ``-'' for Case number.
In the first six series, a value for FD_NO - the failure description, was selected, which was tested with different values of FM_CODE. FAILURE_EVENT was set to ``GASLEAK'' and DC_CODE, Design Class code was set to ``CE'' for centrifugal compressors. Other features were set to ``NA''. The result of these queries with input is given in Tab 5.3 to Tab 5.8.
In series seven, FAILURE_EVENT was set to ``GASLEAK'', FD_NO to ``NA''and FM_CODE was tested with different values.
In series eight, FAILURE_EVENT was given different values, and other features were set to ``NA''.
In series nine, various queries were tested to check how the CBR systems perform with more variables given.
To be able to evaluate the degree of difference between the results of KATE and CBRDM, the number of differences between the resulting output cases in KATE and CBRDM was counted for each series. By differences we here mean feature values that are not equal.
We also counted the number of differences between the query-case and the results from KATE and CBRDM. The results are given in Tab 5.12, where the number between zero and nine indicate the number of differences. The numbers stated in the table are the number of case-pairs that have this difference for the given series.
The accumulated number of differences between the output cases of KATE and CBRDM for all series are shown in Fig 5.4.
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | Case | |
| Query1 | NA | NNF | MECHFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NNF | MECHFAIL | NA | MINOR | CM | MODERATE | CE | CLASSI | 468 |
| CBRDM | 14 | NNF | MECHFAIL | ESD/PSD | MINOR | GG | LOW | CE | CLASSIII | 4049 |
| Query2 | NA | NFI | MECHFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NFI | MECHFAIL | NA | MINOR | CS | MODERATE | CE | CLASSIII | 62 |
| CBRDM | 8 | NFI | MECHFAIL | GASLEAK | MINOR | CM | LOW | CE | CLASSIII | 3078 |
| Query3 | NA | NOT | MECHFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NOT | MECHFAIL | GASLEAK | MINOR | VA | LOW | CE | CLASSI | 16 |
| CBRDM | 1 | NOT | MECHFAIL | GASLEAK | MINOR | VA | LOW | CE | CLASSIII | 59 |
| Query4 | NA | NEF | MECHFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NEF | MECHFAIL | NA | MINOR | MI | LOW | CE | CLASSI | 384 |
| CBRDM | 8 | NFI | MECHFAIL | GASLEAK | MINOR | CM | LOW | CE | CLASSIII | 3078 |
| Query5 | NA | NA | MECHFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NOT | MECHFAIL | GASLEAK | MINOR | VA | LOW | CE | CLASSI | |
| CBRDM | 8 | NFI | MECHFAIL | GASLEAK | MINOR | CM | LOW | CE | CLASSIII | 3078 |
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | Case | |
| Query1 | NA | NNF | MATFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 2 | NNF | MATFAIL | NA | MINOR | CU | HIGH | CE | CLASSI | 1140 |
| CBRDM | 2 | NFI | MATFAIL | NA | MINOR | NA | LOW | CE | CLASSI | 1004 |
| Query2 | NA | NFI | MATFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NFI | MATFAIL | NA | MINOR | CS | MODERATE | CE | CLASSIII | 61 |
| CBRDM | 2 | NFI | MATFAIL | NA | MINOR | NA | LOW | CE | CLASSI | 1004 |
| Query3 | NA | NOT | MATFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NOT | MATFAIL | NA | MINOR | EG | MODERATE | CE | CLASSIII | 150 |
| CBRDM | 14 | NOT | MATFAIL | NA | MINOR | GG | LOW | CE | CLASSIII | 4099 |
| Query4 | NA | NEF | MATFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NEF | MATFAIL | NA | MINOR | LU | LOW | CE | CLASSIII | 235 |
| CBRDM | 2 | NFI | MATFAIL | NA | MINOR | NA | LOW | CE | CLASSI | 1004 |
| Query5 | NA | NA | MATFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NFI | MATFAIL | NA | MINOR | CS | MODERATE | CE | CLASSIII | 61 |
| CBRDM | 2 | NFI | MATFAIL | NA | MINOR | NA | LOW | CE | CLASSI | 1004 |
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | Case | |
| Query1 | NA | NNF | INSTFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE* | 1 | NNF | INSTFAIL | NA | MINOR | PU | MEDIUM | CE | CLASSIII | 305 |
| CBRDM | 1 | NNF | INSTFAIL | NA | NA | LU | LOW | CE | CLASSIII | 373 |
| Query2 | NA | NFI | INSTFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NFI | INSTFAIL | NA | MINOR | CM | MODERATE | CE | CLASSI | 135 |
| CBRDM | 1 | NFI | INSTFAIL | NA | NA | LU | LOW | CE | CLASSI | 385 |
| Query3 | NA | NOT | INSTFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NOT | INSTFAIL | NA | MINOR | VA | LOW | CE | CLASSI | 7 |
| CBRDM | 218 | NOT | INSTFAIL | NA | MINOR | SS | LOW | CE | CLASSIII | 4625 |
| Query4 | NA | NEF | INSTFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NEF | INSTFAIL | NA | MINOR | CM | MODERATE | CE | CLASSIII | 567 |
| CBRDM* | 12 | NEF | INSTFAIL | NA | NA | PO | HIGH | CE | CLASSIII | 3752 |
| Query5 | NA | NA | INSTFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NOT | INSTFAIL | NA | MINOR | VA | LOW | CE | CLASSI | 3 |
| CBRDM | 1 | NNF | INSTFAIL | NA | NA | LU | LOW | CE | CLASSIII | 373 |
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | Case | |
| Query1 | NA | NNF | ELECFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE* | 1 | NNF | ELECFAIL | ESD/PSD | MINOR | EG | MODERATE | CE | CLASSI | 195 |
| CBRDM | 1 | NNF | ELECFAIL | NA | MINOR | CM | LOW | CE | CLASSIII | 467 |
| Query2 | NA | NFI | ELECFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NFI | ELECFAIL | NA | MINOR | MI | MODERATE | CE | CLASSIII | 555 |
| CBRDM | 217 | NFI | ELECFAIL | NA | MINOR | SS | LOW | CE | CLASSIII | 4597 |
| Query3 | NA | NOT | ELECFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NOT | ELECFAIL | NA | MINOR | EG | MODERATE | CE | CLASSI | 489 |
| CBRDM | 12 | NOT | ELECFAIL | NA | MINOR | SS | LOW | CE | CLASSIII | 3728 |
| Query4 | NA | NEF | ELECFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 14 | NEF | ELECFAIL | NA | MINOR | CM | LOW | CE | CLASSIII | 4323 |
| CBRDM | 14 | NEF | ELECFAIL | NA | MINOR | CM | LOW | CE | CLASSIII | 4329 |
| Query5 | NA | NA | ELECFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE* | 1 | NNF | ELECFAIL | ESD/PSD | MINOR | EG | MODERATE | CE | CLASSI | 195 |
| CBRDM | 23 | NNF | ELECFAIL | NA | NA | CM | MEDIUM | CE | CLASSIII | 4417 |
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | Case | |
| Query1 | NA | NNF | EXTFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE* | 5 | NNF | EXTFAIL | NA | MINOR | CU | MODERATE | CE | CLASSIII | 2104 |
| CBRDM | 13 | NNF | EXTFAIL | NA | MINOR | SS | LOW | CE | CLASSIII | 4027 |
| Query2 | NA | NFI | EXTFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE* | 1 | NFI | EXTFAIL | NA | MINOR | VA | LOW | CE | CLASSI | 2 |
| CBRDM | 217 | NFI | EXTFAIL | NA | MINOR | LU | LOW | CE | CLASSIII | 4587 |
| Query3 | NA | NOT | EXTFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NOT | EXTFAIL | NA | MINOR | CM | MODERATE | CE | CLASSI | 600 |
| CBRDM | 9 | NOT | EXTFAIL | NA | MINOR | LU | LOW | CE | CLASSIII | 3302 |
| Query4 | NA | NEF | EXTFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NEF | EXTFAIL | NA | MINOR | CM | MODERATE | CE | CLASSI | 136 |
| CBRDM* | 14 | NEF | EXTFAIL | NA | MINOR | GG | LOW | CE | CLASSIII | 4077 |
| Query5 | NA | NA | EXTFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NFI | EXTFAIL | NA | MINOR | VA | LOW | CE | CLASSI | 2 |
| CBRDM* | 13 | NEF | EXTFAIL | NA | NA | LU | MODERATE | CE | CLASSIII | 4033 |
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | Case | |
| Query1 | NA | NNF | MISCFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE* | 1 | NNF | MISCFAIL | ESD/PSD | MINOR | VA | LOW | CE | CLASSI | 1 |
| CBRDM | 3 | NNF | MISCFAIL | NA | MINOR | CM | LOW | CE | CLASSI | 1883 |
| Query2* | NA | NFI | MISCFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NFI | MISCFAIL | NA | MINOR | CS | MODERATE | CE | CLASSIII | 63 |
| CBRDM | 14 | NFI | MISCFAIL | NA | MINOR | SS | LOW | CE | CLASSIII | 4355 |
| Query3 | NA | NOT | MISCFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE* | 1 | NOT | MISCFAIL | NA | MINOR | EG | MODERATE | CE | CLASSIII | 149 |
| CBRDM | 13 | NOT | MISCFAIL | NA | MINOR | SS | LOW | CE | CLASSIII | 4021 |
| Query4 | NA | NEF | MISCFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 2 | NEF | MISCFAIL | NA | MINOR | CM | MODERATE | CE | CLASSI | 741 |
| CBRDM | 9 | NEF | MISCFAIL | NA | MINOR | CE | LOW | CE | CLASSIII | 3304 |
| Query5 | NA | NA | MISCFAIL | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE* | 1 | NNF | MISCFAIL | ESD/PSD | MINOR | VA | LOW | CE | CLASSI | 1 |
| CBRDM | 6 | NFI | MISCFAIL | NA | NA | SS | MODERATE | CE | CLASSIII | 2661 |
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | Case | |
| Query1 | NA | NNF | NA | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE* | 1 | NNF | MISCFAIL | ESD/PSD | MINOR | VA | LOW | CE | CLASSI | 1 |
| CBRDM | 1 | NNF | INSTFAIL | NA | NA | LU | LOW | CE | CLASSIII | 373 |
| Query2 | NA | NFI | NA | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NFI | EXTFAIL | NA | MINOR | VA | LOW | CE | CLASSI | 2 |
| CBRDM* | 8 | NFI | MECHFAIL | GASLEAK | MINOR | CM | LOW | CE | CLASSIII | 3078 |
| Query3 | NA | NOT | NA | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NOT | MECHFAIL | GASLEAK | MINOR | VA | LOW | CE | CLASSI | |
| CBRDM | 1 | NOT | MECHFAIL | GASLEAK | MINOR | VA | LOW | CE | CLASSIII | 59 |
| Query4 | NA | NEF | NA | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | 1 | NEF | EXTFAIL | NA | MINOR | CM | MODERATE | CE | CLASSI | 136 |
| CBRDM* | 8 | NFI | MECHFAIL | GASLEAK | MINOR | CM | LOW | CE | CLASSIII | 3078 |
| Query5 | NA | NA | NA | GASLEAK | NA | NA | NA | CE | NA | - |
| KATE | NA | NA | NA | NA | NA | NA | NA | NA | NA | - |
| CBRDM* | 8 | NFI | MECHFAIL | GASLEAK | MINOR | CM | LOW | CE | CLASSIII | 3078 |
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | Case | |
| Query1 | NA | NA | NA | ESD/PSD | NA | NA | NA | CE | NA | - |
| KATE | NA | NA | NA | NA | NA | NA | NA | NA | NA | - |
| CBRDM* | 14 | NNF | MECHFAIL | ESD/PSD | MINOR | GG | LOW | CE | CLASSIII | 4049 |
| Query2 | NA | NA | NA | HYDRATE | NA | NA | NA | CE | NA | - |
| KATE | NA | NA | NA | NA | NA | NA | NA | NA | NA | - |
| CBRDM | 23 | NEF | MECHFAIL | NA | NA | CU | MODERATE | CE | CLASSIII | 4458 |
| Query3 | NA | NA | NA | NA | EXPORT | NA | NA | CE | NA | - |
| KATE | 1 | NFI | MECHFAIL | NA | EXPORT | PU | MODERATE | CE | CLASSIII | 663 |
| CBRDM | 8 | NNF | MISCFAIL | NA | EXPORT | CS | LOW | CE | CLASSIII | 2970 |
| Query4 | NA | NA | NA | NA | INJECTION | NA | NA | CE | NA | - |
| KATE* | 6 | NFI | MISCFAIL | NA | INJECTION | PU | HIGH | CE | CLASSIII | 2611 |
| CBRDM | 2 | NFI | MATFAIL | NA | MINOR | NA | LOW | CE | CLASSI | 1004 |
| Query5 | NA | NA | NA | NA | MINOR | NA | NA | CE | NA | - |
| KATE | 1 | NOT | MECHFAIL | GASLEAK | MINOR | VA | LOW | CE | CLASSI | |
| CBRDM | 2 | NFI | MATFAIL | NA | MINOR | NA | LOW | CE | CLASSI | 1004 |
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | Case | |
| Query1 | NA | NA | NA | NA | PRODUCTION | NA | NA | CE | NA | - |
| KATE | 1 | NNF | ELECFAIL | ESD/PSD | MINOR | EG | MODERATE | CE | CLASSI | 195 |
| CBRDM* | 13 | NNF | INSTFAIL | NA | PRODUCTION | CU | LOW | CE | CLASSIII | 3979 |
| Query2 | NA | NNF | ELECFAIL | HYDRATE | PRODUCTION | NA | NA | CE | NA | - |
| KATE | 1 | NNF | ELECFAIL | ESD/PSD | MINOR | EG | MODERATE | CE | CLASSI | 195 |
| CBRDM* | 23 | NNF | ELECFAIL | NA | PRODUCTION | CM | MODERATE | CE | CLASSIII | 4459 |
| Query3 | NA | NNF | GASLEAK | HYDRATE | PRODUCTION | NA | NA | CE | NA | - |
| KATE | 10 | NNF | ELECFAIL | NA | MINOR | CS | MEDIUM | SC | CLASSIII | 3402 |
| CBRDM* | 13 | NNF | INSTFAIL | NA | PRODUCTION | CU | LOW | CE | CLASSIII | 3979 |
| Query4 | NA | NNF | ESD/PSD | HYDRATE | PRODUCTION | NA | NA | SC | NA | - |
| KATE | 5 | NNF | INSTFAIL | NA | PRODUCTION | CM | MODERATE | CE | CLASSIII | 2250 |
| CBRDM | 23 | NNF | MECHFAIL | NA | PRODUCTION | CM | MEDIUM | CE | CLASSIII | 4477 |
| Query5 | NA | NNF | ELECFAIL | ESD/PSD | PRODUCTION | NA | LOW | SC | CLASSIII | - |
| KATE | 13 | NNF | INSTFAIL | NA | PRODUCTION | CU | LOW | CE | CLASSIII | 3975 |
| CBRDM* | 38 | NNF | ELECFAIL | ESD/PSD | MINOR | CS | MODERATE | CE | CLASSIII | 4537 |
| Cases | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | Series |
| CBRDM-KATE | 1 | 2 | 2 | ||||||||
| KATE-Query | 2 | 3 | 1 | ||||||||
| CBRDM-Query | 3 | 2 | |||||||||
| CBRDM-KATE | 1 | 1 | 3 | ||||||||
| KATE-Query | 5 | 2 | |||||||||
| CBRDM-Query | 3 | 2 | |||||||||
| CBRDM-KATE | 3 | 2 | |||||||||
| KATE-Query | 5 | 3 | |||||||||
| CBRDM-Query | 5 | ||||||||||
| CBRDM-KATE | 1 | 1 | 2 | 1 | |||||||
| KATE-Query | 5 | 4 | |||||||||
| CBRDM-Query | 5 | ||||||||||
| CBRDM-KATE | 2 | 2 | 1 | ||||||||
| KATE-Query | 5 | 5 | |||||||||
| CBRDM-Query | 5 | ||||||||||
| CBRDM-KATE | 3 | 1 | 1 | ||||||||
| KATE-Query | 5 | 6 | |||||||||
| CBRDM-Query | 5 | ||||||||||
| CBRDM-KATE | 2 | 2 | 1 | ||||||||
| KATE-Query | 1 | 3 | 1 | 7 | |||||||
| CBRDM-Query | 3 | 2 | |||||||||
| CBRDM-KATE | 1 | 1 | 2 | 2 | |||||||
| KATE-Query | 3 | 2 | 8 | ||||||||
| CBRDM-Query | 3 | 2 | |||||||||
| CBRDM-KATE | 1 | 1 | 1 | 2 | |||||||
| KATE-Query | 1 | 1 | 2 | 1 | 9 | ||||||
| CBRDM-Query | 1 | 1 | 2 | 1 |
![\begin{figure}
\begin{center}
\scalebox {0.45}{\includegraphics*[03cm,12cm][25cm,27cm]{diffgr.eps}}\end{center}\end{figure}](img45.gif)