|
Experiments
Progress Tuning Parameters
These results were achieved using all attirbutes unless noted
otherwise. Using 515 training instances, 16281 (all) test instances.
Uses 4 fold cross validation for each combination of parameters.
Summary of these results:
Combo #
|
Iterations
|
Hidden
|
Learn
|
Momentum
|
Error Sum
|
|
1000
|
1
|
0.0001
|
0.0001
|
46.5
|
|
1000
|
2
|
0.0001
|
0.0001
|
49.5
|
|
1000
|
3
|
0.0001
|
0.0001
|
51.5
|
|
1000
|
4
|
0.0001
|
0.0001
|
55.0
|
|
1000
|
5
|
0.0001
|
0.0001
|
54.5
|
|
1000
|
6
|
0.0001
|
0.0001
|
54.5
|
|
1000
|
7
|
0.0001
|
0.0001
|
63.5
|
|
1000
|
8
|
0.0001
|
0.0001
|
56.5
|
|
1000
|
9
|
0.0001
|
0.0001
|
63.5
|
|
1000
|
10
|
0.0001
|
0.0001
|
68.5
|
|
1000
|
11
|
0.0001
|
0.0001
|
61.5
|
|
1000
|
12
|
0.0001
|
0.0001
|
68.5
|
|
1000
|
13
|
0.0001
|
0.0001
|
63.0
|
|
1000
|
14
|
0.0001
|
0.0001
|
69.5
|
|
1000
|
15
|
0.0001
|
0.0001
|
69.0
|
|
1000
|
16
|
0.0001
|
0.0001
|
78.5
|
|
1000
|
17
|
0.0001
|
0.0001
|
81.5
|
|
1000
|
18
|
0.0001
|
0.0001
|
79.0
|
|
1000
|
19
|
0.0001
|
0.0001
|
84.5
|
|
1000
|
20
|
0.0001
|
0.0001
|
94.5
|
|
1000
|
1
|
0.0001
|
0.0112
|
46.5
|
|
1000
|
2
|
0.0001
|
0.0112
|
49.5
|
|
1000
|
3
|
0.0001
|
0.0112
|
51.5
|
|
1000
|
4
|
0.0001
|
0.0112
|
55
|
|
1000
|
5
|
0.0001
|
0.0112
|
54.5
|
|
1000
|
6
|
0.0001
|
0.0112
|
54.5
|
|
1000
|
7
|
0.0001
|
0.0112
|
63.5
|
|
1000
|
8
|
0.0001
|
0.0112
|
56.5
|
|
1000
|
9
|
0.0001
|
0.0112
|
63.5
|
|
1000
|
10
|
0.0001
|
0.0112
|
68.5
|
|
1000
|
11
|
0.0001
|
0.0112
|
61.5
|
|
1000
|
12
|
0.0001
|
0.0112
|
68.5
|
|
1000
|
13
|
0.0001
|
0.0112
|
63.5
|
|
1000
|
14
|
0.0001
|
0.0112
|
70
|
|
1000
|
15
|
0.0001
|
0.0112
|
69.0
|
|
1000
|
16
|
0.0001
|
0.0112
|
79.5
|
|
1000
|
17
|
0.0001
|
0.0112
|
82
|
|
1000
|
18
|
0.0001
|
0.0112
|
79
|
|
1000
|
19
|
0.0001
|
0.0112
|
84
|
|
1000
|
20
|
0.0001
|
0.0112
|
94.5
|
|
1000
|
1
|
0.0001
|
0.0233
|
|
|
1000
|
2
|
0.0001
|
0.0233
|
|
|
1000
|
3
|
0.0001
|
0.0233
|
|
|
1000
|
4
|
0.0001
|
0.0233
|
|
|
1000
|
5
|
0.0001
|
0.0233
|
|
|
1000
|
6
|
0.0001
|
0.0233
|
|
|
1000
|
7
|
0.0001
|
0.0233
|
|
|
1000
|
8
|
0.0001
|
0.0233
|
|
|
1000
|
9
|
0.0001
|
0.0233
|
|
|
1000
|
10
|
0.0001
|
0.0233
|
|
|
1000
|
11
|
0.0001
|
0.0233
|
|
|
1000
|
12
|
0.0001
|
0.0233
|
|
|
1000
|
13
|
0.0001
|
0.0233
|
|
|
1000
|
14
|
0.0001
|
0.0233
|
|
|
1000
|
15
|
0.0001
|
0.0233
|
|
|
1000
|
16
|
0.0001
|
0.0233
|
|
|
1000
|
17
|
0.0001
|
0.0233
|
|
|
1000
|
18
|
0.0001
|
0.0233
|
|
|
1000
|
19
|
0.0001
|
0.0233
|
|
|
1000
|
20
|
0.0001
|
0.0233
|
|
For the rules these test produced please see the results linked above
(or attached if hardcopy).
|
|