|
|
Experiments
Back Propagation Neural Network:
Numer Input Nodes: 104
Number Hidden Nodes: 2
Number Output Nodes: 2
-I 15000
-E 0.0010
-S 1814022214
-H 2
-M 0.0445
Input Weights:
0.24921926184061372 0.09387413083999485 age
-0.4706336356527112 -0.6269447415427944 workclass=Private
-0.7648722111224213 -0.8782091339104181 workclass=Self-emp-not-inc
0.4646152589352113 0.13716891270477882 workclass=Self-emp-inc
0.9480050463603951 0.13000821725427847 workclass=Federal-gov
-0.24412086498749508 0.9802326279458786 workclass=Local-gov
0.3787420083100268 -0.7836652588114834 workclass=State-gov
-0.036581266086612274 0.2912545822185306 workclass=Without-pay
-0.8012785609720987 -0.7856045344103553 workclass=Never-worked
0.19173021238078647 -0.23091526529704454 fnlwgt
-0.7117006307143645 0.9131667604158094 education=Bachelors
0.7456092377046333 0.11839412744679145 education=Some-college
0.9297528685773571 0.2669960689802515 education=11th
0.3676770976345183 0.029849673419965583 education=HS-grad
-0.5740965762221912 0.2181215448964111 education=Prof-school
-0.8501952070938192 0.7847185049690899 education=Assoc-acdm
0.551079055821059 -0.11030103836115779 education=Assoc-voc
-0.10418647803757386 -0.7996960644250604 education=9th
0.024594635857534408 -0.02270024943343163 education=7th-8th
-0.8186541127733598 0.22106158474659376 education=12th
-0.7545395028577662 -0.4991666269270527 education=Masters
-0.27978929338972547 0.9504262175539633 education=1st-4th
-0.9387230170422043 -0.14929280655629418 education=10th
0.35989239868035217 -0.90650326788535 education=Doctorate
0.1786934836956906 -0.210661057806665 education=5th-6th
-0.6088944657706206 -0.9822659097861386 education=Preschool
0.8656017685403523 -0.8867879502097391 education-num
-0.4901524193657869 0.40842691463540537 marital-status=Married-civ-spouse
-0.6516445239812747 -0.2534106603164612 marital-status=Divorced
0.2016843708628202 0.862324992787892 marital-status=Never-married
-0.6335425372067045 -0.3253945752229197 marital-status=Separated
0.35707360968031066 0.884736410158639 marital-status=Widowed
0.9017909579546453 0.2233188451471222 marital-status=Married-spouse-absent
-0.7527824968052199 -0.6155199197319277 marital-status=Married-AF-spouse
-0.5672088042224805 0.49375188090978006 occupation=Tech-support
0.6098164848735226 -0.25691110687342 occupation=Craft-repair
-0.9470852541811694 -0.6639467849373684 occupation=Other-service
0.37449965799675833 -0.6909819986362629 occupation=Sales
0.4080658914700057 0.03252219514934218 occupation=Exec-managerial
0.7037101445137008 0.2675360953767172 occupation=Prof-specialty
-0.786260626198781 -0.8881001308013405 occupation=Handlers-cleaners
0.5852570126274319 0.38941386609211937 occupation=Machine-op-inspct
-0.23226376383413028 0.5534013134069211 occupation=Adm-clerical
-0.41981558933096497 -0.6128218697632963 occupation=Farming-fishing
0.6303595648280125 -0.4874939606732065 occupation=Transport-moving
0.7403826191675749 0.3210265078054919 occupation=Priv-house-serv
0.8467027867928845 0.9103691634214184 occupation=Protective-serv
0.7445529109732054 0.6056958519505957 occupation=Armed-Forces
-0.3255437246060513 -0.5825546339139347 relationship=Wife
-0.6174326567495834 0.1766054884657311 relationship=Own-child
0.788783845430691 -0.9841452289229955 relationship=Husband
0.41451133294146314 -0.12584741234107977 relationship=Not-in-family
0.9902105154461001 0.2742476998263046 relationship=Other-relative
0.1530939172308381 0.2885772143690777 relationship=Unmarried
-0.7371791783451276 -0.6127336281067244 race=White
0.8217289168031006 0.45754214365962276 race=Asian-Pac-Islander
0.9328448187855536 0.9367395656783566 race=Amer-Indian-Eskimo
0.6242679270344191 0.8014382441965686 race=Other
-0.9298870109085451 -0.9151948030214383 race=Black
-0.33133026954645817 -0.5118635705430858 sex
0.15883930616596964 -0.2846840516733431 capital-gain
-0.5978406069033679 0.603911057637986 capital-loss
0.5354535019222837 0.9479715164452576 hours-per-week
-0.6302672703880108 -0.2712343793518952 native-country=United-States
-0.1608040425870374 -0.1477831560754692 native-country=Cambodia
-0.924965384978814 -0.9756537492539303 native-country=England
0.5291184964670359 0.32137615135337017 native-country=Puerto-Rico
-0.979746966602572 -0.9132589588202908 native-country=Canada
0.765955129743914 -0.4881643032053622 native-country=Germany
0.9910590106883839 0.5341835156815113 native-country=Outlying-US(Guam-USVI-etc)
0.1097381184423174 0.4311738022683542 native-country=India
0.03886070386500462 -0.37579074541418067 native-country=Japan
0.6084934671282078 0.9405398372754623 native-country=Greece
-0.05544371280874083 -0.2468887782408673 native-country=South
0.10805715643387948 0.23163645671265565 native-country=China
-0.8818552832489048 -0.7966955623563523 native-country=Cuba
-0.25003665433382083 -0.29756460588802325 native-country=Iran
0.6333109362629343 0.28589284905026147 native-country=Honduras
-0.5108300391711451 0.8870894054358651 native-country=Philippines
-0.5044751109628351 0.48454359753634035 native-country=Italy
0.49556028295453936 -0.16303620922783124 native-country=Poland
-0.7798941099385366 0.3446568027474133 native-country=Jamaica
-0.96410556787343 -0.9123643491364113 native-country=Vietnam
-0.3793136569813149 -0.2355126267589327 native-country=Mexico
-0.00686657199828411 0.41116839617603707 native-country=Portugal
0.4898886775898519 0.721774166648014 native-country=Ireland
0.7885254735867124 -0.8822039849456711 native-country=France
-0.9521155952725002 0.09376803346094609 native-country=Dominican-Republic
-0.05701722054129532 -0.7460757337763271 native-country=Laos
-0.06033663070055173 0.4772768864756334 native-country=Ecuador
-0.2437113406976139 -0.9946024673758551 native-country=Taiwan
0.8208817627344382 -0.7408366266001591 native-country=Haiti
0.09751405105375488 0.6613766830534971 native-country=Columbia
0.6714090371246377 0.6910970063533055 native-country=Hungary
0.6833918935734766 -0.8262556147829869 native-country=Guatemala
-0.2547684306553426 -0.4565259026818458 native-country=Nicaragua
-0.33724893540760603 -0.44771364237275746 native-country=Scotland
-0.8209724749416796 0.8042364808180924 native-country=Thailand
-0.8923495351906385 0.8033089136110478 native-country=Yugoslavia
0.7570746289557555 0.6945400622801392 native-country=El-Salvador
-0.9874670457451749 0.928934641931406 native-country=Trinadad&Tobago
0.02852759767976787 -0.565696438529399 native-country=Peru
0.5922409152486394 -0.42011588182190396 native-country=Hong
-0.9004294467375469 0.23980914954136878 native-country=Holand-Netherlands
Hidden Weights:
-0.9736451317337307 0.09968201057077608
0.8412148510247306 0.6643415015987919
>50K <=50K
Error sum for iteration 100 = 4462.694998760271
Error sum for iteration 200 = 4643.736816257961
Error sum for iteration 300 = 4677.868912476329
Error sum for iteration 400 = 4708.188248362593
Error sum for iteration 500 = 4738.976158027316
Error sum for iteration 600 = 4764.872085872112
Error sum for iteration 700 = 4783.8105829396
Error sum for iteration 800 = 4797.219945548178
Error sum for iteration 900 = 4807.235576174012
Error sum for iteration 1000 = 4815.451113008527
Error sum for iteration 1100 = 4822.876779945301
Error sum for iteration 1200 = 4830.18585745168
Error sum for iteration 1300 = 4837.831917612772
Error sum for iteration 1400 = 4846.163819549942
Error sum for iteration 1500 = 4855.461099425331
Error sum for iteration 1600 = 4865.994691991908
Error sum for iteration 1700 = 4878.052426191847
Error sum for iteration 1800 = 4891.953856218471
Error sum for iteration 1900 = 4908.027446820844
Error sum for iteration 2000 = 4926.641699797011
Error sum for iteration 2100 = 4948.1847739253835
Error sum for iteration 2200 = 4973.046469140692
Error sum for iteration 2300 = 5001.5828354362
Error sum for iteration 2400 = 5034.045552241973
Error sum for iteration 2500 = 5070.518656785568
Error sum for iteration 2600 = 5110.8245826957245
Error sum for iteration 2700 = 5154.486458748521
Error sum for iteration 2800 = 5200.754503883895
Error sum for iteration 2900 = 5248.577449585806
Error sum for iteration 3000 = 5296.714479465272
Error sum for iteration 3100 = 5343.795820233866
Error sum for iteration 3200 = 5388.343233249076
Error sum for iteration 3300 = 5428.962113152806
Error sum for iteration 3400 = 5464.476898368137
Error sum for iteration 3500 = 5494.246135751804
Error sum for iteration 3600 = 5518.329150328467
Error sum for iteration 3700 = 5537.543630279742
Error sum for iteration 3800 = 5553.066053384193
Error sum for iteration 3900 = 5566.110230665604
Error sum for iteration 4000 = 5577.752532942032
Error sum for iteration 4100 = 5588.772755145134
Error sum for iteration 4200 = 5599.570902063926
Error sum for iteration 4300 = 5610.303191780805
Error sum for iteration 4400 = 5620.867055602215
Error sum for iteration 4500 = 5631.110246606629
Error sum for iteration 4600 = 5640.833007338276
Error sum for iteration 4700 = 5649.8687807993965
Error sum for iteration 4800 = 5658.126254367076
Error sum for iteration 4900 = 5665.569110787992
Error sum for iteration 5000 = 5672.235758021724
Error sum for iteration 5100 = 5678.202508947367
Error sum for iteration 5200 = 5683.559115132678
Error sum for iteration 5300 = 5688.400812968006
Error sum for iteration 5400 = 5692.8206485892715
Error sum for iteration 5500 = 5696.900714442895
Error sum for iteration 5600 = 5700.712452765026
Error sum for iteration 5700 = 5704.308778300639
Error sum for iteration 5800 = 5707.737663795246
Error sum for iteration 5900 = 5711.036391679609
Error sum for iteration 6000 = 5714.23291993901
Error sum for iteration 6100 = 5717.350925132128
Error sum for iteration 6200 = 5720.408901002639
Error sum for iteration 6300 = 5723.4187548486425
Error sum for iteration 6400 = 5726.390005130619
Error sum for iteration 6500 = 5729.33164067373
Error sum for iteration 6600 = 5732.24758343686
Error sum for iteration 6700 = 5735.141059138456
Error sum for iteration 6800 = 5738.015172086043
Error sum for iteration 6900 = 5740.873073844602
Error sum for iteration 7000 = 5743.713797815176
Error sum for iteration 7100 = 5746.537296466811
Error sum for iteration 7200 = 5749.342063683331
Error sum for iteration 7300 = 5752.128164539855
Error sum for iteration 7400 = 5754.894357347355
Error sum for iteration 7500 = 5757.639877878936
Error sum for iteration 7600 = 5760.363265900604
Error sum for iteration 7700 = 5763.062429948959
Error sum for iteration 7800 = 5765.736185184711
Error sum for iteration 7900 = 5768.383169916781
Error sum for iteration 8000 = 5771.002843171074
Error sum for iteration 8100 = 5773.594845537439
Error sum for iteration 8200 = 5776.157416709658
Error sum for iteration 8300 = 5778.689703744085
Error sum for iteration 8400 = 5781.190873391073
Error sum for iteration 8500 = 5783.660289715816
Error sum for iteration 8600 = 5786.0978311861
Error sum for iteration 8700 = 5788.502377858825
Error sum for iteration 8800 = 5790.874075065405
Error sum for iteration 8900 = 5793.211650109329
Error sum for iteration 9000 = 5795.515037715831
Error sum for iteration 9100 = 5797.784531184194
Error sum for iteration 9200 = 5800.01901030067
Error sum for iteration 9300 = 5802.218399824304
Error sum for iteration 9400 = 5804.38235960701
Error sum for iteration 9500 = 5806.510727384043
Error sum for iteration 9600 = 5808.603642200329
Error sum for iteration 9700 = 5810.661236450312
Error sum for iteration 9800 = 5812.684448081233
Error sum for iteration 9900 = 5814.672559993956
Error sum for iteration 10000 = 5816.626302243858
Error sum for iteration 10100 = 5818.544902062573
Error sum for iteration 10200 = 5820.428498601043
Error sum for iteration 10300 = 5822.277585360504
Error sum for iteration 10400 = 5824.092876090737
Error sum for iteration 10500 = 5825.87374078702
Error sum for iteration 10600 = 5827.620462719532
Error sum for iteration 10700 = 5829.333796248986
Error sum for iteration 10800 = 5831.0137786517425
Error sum for iteration 10900 = 5832.660644795149
Error sum for iteration 11000 = 5834.275053628675
Error sum for iteration 11100 = 5835.857626432838
Error sum for iteration 11200 = 5837.408331296212
Error sum for iteration 11300 = 5838.927979299976
Error sum for iteration 11400 = 5840.416123114485
Error sum for iteration 11500 = 5841.873214370081
Error sum for iteration 11600 = 5843.299663858005
Error sum for iteration 11700 = 5844.6957592252065
Error sum for iteration 11800 = 5846.061816450136
Error sum for iteration 11900 = 5847.398248538017
Error sum for iteration 12000 = 5848.705412972441
Error sum for iteration 12100 = 5849.983690557333
Error sum for iteration 12200 = 5851.2334840016165
Error sum for iteration 12300 = 5852.455304715366
Error sum for iteration 12400 = 5853.649801487433
Error sum for iteration 12500 = 5854.817057178861
Error sum for iteration 12600 = 5855.957792087248
Error sum for iteration 12700 = 5857.072513895387
Error sum for iteration 12800 = 5858.161168744042
Error sum for iteration 12900 = 5859.2241976979985
Error sum for iteration 13000 = 5860.26205524383
Error sum for iteration 13100 = 5861.275160998201
Error sum for iteration 13200 = 5862.263866061526
Error sum for iteration 13300 = 5863.228617298243
Error sum for iteration 13400 = 5864.1698707690575
Error sum for iteration 13500 = 5865.0880371403555
Error sum for iteration 13600 = 5865.98340338387
Error sum for iteration 13700 = 5866.85645267364
Error sum for iteration 13800 = 5867.707566555038
Error sum for iteration 13900 = 5868.537103553545
Error sum for iteration 14000 = 5869.345564237199
Error sum for iteration 14100 = 5870.13425931962
Error sum for iteration 14200 = 5870.903068432252
Error sum for iteration 14300 = 5871.651947034833
Error sum for iteration 14400 = 5872.3812419856185
Error sum for iteration 14500 = 5873.09130041771
Error sum for iteration 14600 = 5873.782912087151
Error sum for iteration 14700 = 5874.456579396751
Error sum for iteration 14800 = 5875.112345111943
Error sum for iteration 14900 = 5875.750486503509
Error sum for iteration 15000 = 5876.371255978945
Options: -I 15000 -H 2 -E 0.001 -M 0.0445
Back Propagation Neural Network:
Numer Input Nodes: 104
Number Hidden Nodes: 2
Number Output Nodes: 2
-I 15000
-E 0.0010
-S 1814022214
-H 2
-M 0.0445
Input Weights:
1.4066893685493174 -9.08956527703672 age
-0.18363718969964932 -0.4193224561558004 workclass=Private
0.4544322879378136 -1.1171968496670541 workclass=Self-emp-not-inc
-0.4055824253894197 -0.22597678411218036 workclass=Self-emp-inc
-0.6996479539527547 0.05203919622810491 workclass=Federal-gov
-0.031877104610539955 -0.5327586055009174 workclass=Local-gov
-0.05112964031809161 0.004592214870498053 workclass=State-gov
1.611647384338729 0.41207767222845243 workclass=Without-pay
0.6333641802316499 -0.29153298865471916 workclass=Never-worked
-0.5727363422584764 -0.6739626923674495 fnlwgt
-0.3181297157236973 -0.12426163985709576 education=Bachelors
-0.2329104428912804 0.31573234653197446 education=Some-college
0.9339057664067947 -1.6283025837045015 education=11th
-0.07842643905685712 0.3617638934448616 education=HS-grad
-1.1441069186505437 0.49719368417234283 education=Prof-school
-0.1464630756253527 0.4542261542008151 education=Assoc-acdm
-0.2967052823878518 0.4039495583475548 education=Assoc-voc
0.6281586450985003 -0.3533920325409096 education=9th
0.61597948716277 -0.8367198511973392 education=7th-8th
0.30695294248573807 -0.38371331990707735 education=12th
-0.6077998836999298 0.19806860584215574 education=Masters
-0.12440561231919264 0.7527009894571232 education=1st-4th
0.19939491451827127 0.17756280464553276 education=10th
-1.411767855170646 0.7242781181821271 education=Doctorate
0.5365118091346271 -0.840962929740971 education=5th-6th
1.4368718004205694 -0.7694552449504978 education=Preschool
-1.6380756416283901 0.5362477841891793 education-num
-1.1062426020576304 0.3550537255121835 marital-status=Married-civ-spouse
0.6530344680393635 0.19621481252835565 marital-status=Divorced
0.7548992701368705 0.02417024409975742 marital-status=Never-married
0.916732244333615 -0.891276178548217 marital-status=Separated
0.1803373875537111 0.5135755776952939 marital-status=Widowed
0.710125850586075 0.3105093024340559 marital-status=Married-spouse-absent
-1.4386217539331727 0.13031020603649693 marital-status=Married-AF-spouse
-0.6347856136989628 0.8327478277661079 occupation=Tech-support
-0.009500170342091618 0.49739360366892443 occupation=Craft-repair
1.2845892963885042 -1.370430597719551 occupation=Other-service
-0.14927567979286893 0.24772827556080204 occupation=Sales
-0.5382243254478787 0.3948386454534982 occupation=Exec-managerial
-0.06075579963418219 0.09493397675380166 occupation=Prof-specialty
1.0317157014771343 -0.8023877472269261 occupation=Handlers-cleaners
0.3893558722571705 0.03275589235229223 occupation=Machine-op-inspct
0.10971928716260033 0.021941220523974746 occupation=Adm-clerical
1.087157947071359 -0.583861453012049 occupation=Farming-fishing
0.38879233448113887 -0.16058079474381168 occupation=Transport-moving
1.7868937650143792 -0.5516756542189691 occupation=Priv-house-serv
-0.2238774157220528 0.047412678641347066 occupation=Protective-serv
0.7777367614251917 0.4719561493335222 occupation=Armed-Forces
-0.7403105188206884 0.9494924622911783 relationship=Wife
1.8914945431713281 -2.1884724464273324 relationship=Own-child
0.43364604767064174 0.3206788568781185 relationship=Husband
-0.03683169377865877 0.49395823556704677 relationship=Not-in-family
1.3568966530658129 -1.328695330745821 relationship=Other-relative
0.12071024167040739 0.2903919867329955 relationship=Unmarried
0.32494401888642194 0.02257055215383139 race=White
0.28875543987151153 0.2944325929945812 race=Asian-Pac-Islander
1.2951461137218712 -1.620663012114127 race=Amer-Indian-Eskimo
-0.062091240661543784 1.2144389396590305 race=Other
0.3711473245999645 0.28387804104358744 race=Black
-0.888594185556285 0.8316719573972734 sex
-5.4150688002518255 -0.1291142178106914 capital-gain
-1.805570783276259 0.19892147278422273 capital-loss
-1.7752451189991285 0.5288800767259846 hours-per-week
-0.17491721553469872 -0.20176375074333214 native-country=United-States
-1.992900288273627 1.088294556791546 native-country=Cambodia
-0.3562138660579725 -0.0686104376725271 native-country=England
0.38988888042743136 0.2076334403391959 native-country=Puerto-Rico
-0.577312843318483 0.40707508247602814 native-country=Canada
-0.6020018162084787 0.20255080584704876 native-country=Germany
1.3301604189172103 0.4237712079022805 native-country=Outlying-US(Guam-USVI-etc)
0.7588661559482627 -2.1327248898540687 native-country=India
0.06786362636701584 -0.8373804702283034 native-country=Japan
0.8598927681722736 -0.025218177583184724 native-country=Greece
0.8904426644868583 -0.6001843632266652 native-country=South
0.29711580216268907 0.11226220809662363 native-country=China
-0.009353556156317036 -1.5963576454509807 native-country=Cuba
-0.1030469015121825 -0.0922319260636278 native-country=Iran
0.706106384158859 0.1588292931649862 native-country=Honduras
-0.28701640209960344 -0.4883834879043178 native-country=Philippines
-1.3666477239996353 1.7444879935829183 native-country=Italy
-0.7627571821511218 1.935817535629553 native-country=Poland
0.23688158075099167 -0.9716162336531904 native-country=Jamaica
1.6225873214736997 -2.0918565849588626 native-country=Vietnam
0.46338475163620424 -0.2230872362787999 native-country=Mexico
-0.0022306251629443962 -0.09862412170881653 native-country=Portugal
-0.8937835906383352 0.1796642394131569 native-country=Ireland
-0.46109416629487554 -0.8826871985303665 native-country=France
1.057587930679489 -0.0058896766939741385 native-country=Dominican-Republic
0.7383593225796504 -0.5272318146808216 native-country=Laos
-0.40456366902670715 0.6198639253820791 native-country=Ecuador
0.21365352482999353 -0.6962186287133312 native-country=Taiwan
-0.9739057256598945 1.6764534246791112 native-country=Haiti
0.9218792446576997 0.3320133058107612 native-country=Columbia
-0.6678979436416078 1.412347097071503 native-country=Hungary
0.6129404022987608 -1.2215872935609637 native-country=Guatemala
1.0067055584347064 -0.8877570312487874 native-country=Nicaragua
-0.5934584355685895 1.2457338256004662 native-country=Scotland
0.7285908513199961 -1.6286525058745507 native-country=Thailand
-0.4696145491224539 0.12298143999255381 native-country=Yugoslavia
-0.2942652081562288 0.7769744714674248 native-country=El-Salvador
0.19185243560746243 1.3096545865210016 native-country=Trinadad&Tobago
0.8487887174016969 -0.8023956833227167 native-country=Peru
0.12683516090623054 -0.8032249578371087 native-country=Hong
-0.7258783313583622 0.22833202667170946 native-country=Holand-Netherlands
Hidden Weights:
-5.149024675769105 5.149024675769105
-4.418574806900421 4.418574806900416
>50K <=50K
=== Error on training data ===
Correctly Classified Instances 27575 84.6872 %
Incorrectly Classified Instances 4986 15.3128 %
Mean absolute error 0.2701
Root mean squared error 0.3353
Relative absolute error 73.8733 %
Root relative squared error 78.4158 %
Total Number of Instances 32561
=== Confusion Matrix ===
a b <-- classified as
4730 3111 | a = >50K
1875 22845 | b = <=50K
=== Error on test data ===
Correctly Classified Instances 13738 84.3806 %
Incorrectly Classified Instances 2543 15.6194 %
Mean absolute error 0.2712
Root mean squared error 0.3374
Relative absolute error 74.6432 %
Root relative squared error 79.4361 %
Total Number of Instances 16281
=== Confusion Matrix ===
a b <-- classified as
2272 1574 | a = >50K
969 11466 | b = <=50K
|
|
|
