实验:3*3卷积核10分类9*9图片卷积核数量最优值
(0,1,2,3,4,5,6,7,8,9)--con(3*3)*n—49*n*30*10
將mnist的圖片用間隔取點的辦法處理成9*9,用3*3的卷積核,卷積核的數量從1個到57個,收斂標準是1e-4,每個收斂標準收斂199次取平均值,比較卷積核數量的最優值是多少。
?
得到的表格
| ? | f2[0] | f2[1] | f2[2] | f2[3] | f2[4] | f2[5] | f2[6] | f2[7] | f2[8] | f2[9] | 迭代次數n | 平均準確率p-ave | δ | 耗時ms/次 | 耗時ms/199次 | 耗時 min/199 | 最大值p-max |
| 3層無核 | 0.03018 | 3.75E-05 | 0.221124 | 0.0101 | 0.015106 | 0.467342 | 0.0151 | 0.241225 | 3.71E-05 | 3.24E-05 | 1689378 | 0.927924 | 1.00E-04 | 28948.91 | 5760833 | 96.01388 | 0.93572 |
| 1 | 0.145746 | 2.19E-05 | 0.492465 | 0.125672 | 0.065336 | 0.050283 | 0.030176 | 0.090478 | 3.02E-05 | 1.93E-05 | 1990817 | 0.909972 | 1.00E-04 | 107722 | 21436683 | 357.2781 | 0.92138 |
| 2 | 0.145755 | 2.03E-05 | 0.47236 | 0.050298 | 0.055293 | 0.065354 | 0.050276 | 0.160823 | 2.77E-05 | 2.25E-05 | 933442.8 | 0.923857 | 1.00E-04 | 94093.7 | 18724673 | 312.0779 | 0.933915 |
| 3 | 0.115611 | 0.005053 | 0.467338 | 0.010103 | 0.030173 | 0.0553 | 0.135697 | 0.175895 | 0.005056 | 2.65E-05 | 726211.9 | 0.931374 | 1.00E-04 | 105439.1 | 20982392 | 349.7065 | 0.941536 |
| 4 | 0.130689 | 0.005055 | 0.52763 | 0.005073 | 0.050271 | 0.040225 | 0.135702 | 0.105548 | 3.68E-05 | 2.61E-05 | 618438.8 | 0.935437 | 1.00E-04 | 124103.7 | 2.47E+07 | 411.6105 | 0.943041 |
| 5 | 0.145763 | 0.010083 | 0.457287 | 0.010091 | 0.055295 | 0.040228 | 0.160822 | 0.120625 | 3.47E-05 | 2.67E-05 | 566818.9 | 0.937962 | 1.00E-04 | 138056 | 2.75E+07 | 457.8857 | 0.946149 |
| 6 | 0.170888 | 0.010082 | 0.417093 | 4.68E-05 | 0.06032 | 0.030179 | 0.145754 | 0.160824 | 0.005054 | 2.88E-05 | 536011.3 | 0.940188 | 1.00E-04 | 159576.3 | 3.18E+07 | 529.2614 | 0.947052 |
| 7 | 0.090493 | 0.025163 | 0.427142 | 0.015118 | 0.105542 | 0.045249 | 0.130674 | 0.160822 | 3.83E-05 | 2.83E-05 | 509640.6 | 0.940918 | 1.00E-04 | 177534.1 | 3.53E+07 | 588.8213 | 0.949458 |
| 8 | 0.145764 | 0.015114 | 0.407045 | 0.005069 | 0.060324 | 0.020126 | 0.155799 | 0.180915 | 0.010085 | 3.05E-05 | 513235.8 | 0.942645 | 1.00E-04 | 202541.2 | 40305709 | 671.7618 | 0.949559 |
| 9 | 0.140737 | 0.04024 | 0.38192 | 0.020143 | 0.040221 | 0.070378 | 0.165848 | 0.135698 | 0.005059 | 3.32E-05 | 502784.7 | 0.943339 | 1.00E-04 | 226370.5 | 4.50E+07 | 750.7956 | 0.950461 |
| 10 | 0.085475 | 0.025163 | 0.412065 | 4.29E-05 | 0.025152 | 0.065354 | 0.241218 | 0.145739 | 3.62E-05 | 2.84E-05 | 504104.1 | 0.943965 | 1.00E-04 | 259250 | 51590768 | 859.8461 | 0.949659 |
| 11 | 0.110591 | 0.025163 | 0.472363 | 4.90E-05 | 0.025149 | 0.045249 | 0.150774 | 0.155791 | 0.015118 | 2.63E-05 | 513026.2 | 0.944301 | 1.00E-04 | 280405.5 | 5.58E+07 | 930.0117 | 0.951464 |
| 12 | 0.120644 | 0.035213 | 0.45729 | 0.010097 | 0.030175 | 0.025151 | 0.165851 | 0.150769 | 0.005064 | 2.63E-05 | 510466.6 | 0.944593 | 1.00E-04 | 307725.6 | 6.12E+07 | 1020.623 | 0.953369 |
| 13 | 0.105568 | 0.030192 | 0.452263 | 0.00507 | 0.040224 | 0.040228 | 0.180919 | 0.120621 | 0.025161 | 2.75E-05 | 520095 | 0.945371 | 1.00E-04 | 329515.8 | 6.56E+07 | 1092.894 | 0.953771 |
| 14 | 0.085466 | 0.040242 | 0.412071 | 0.015121 | 0.055302 | 0.055301 | 0.195994 | 0.135695 | 0.005065 | 3.02E-05 | 512976.8 | 0.945288 | 1.00E-04 | 357932 | 7.12E+07 | 1187.141 | 0.952667 |
| 15 | 0.115616 | 0.025168 | 0.3769 | 0.010091 | 0.085448 | 0.025154 | 0.145747 | 0.190967 | 0.025155 | 3.67E-05 | 500753.4 | 0.94602 | 1.00E-04 | 368507.9 | 7.33E+07 | 1222.218 | 0.953771 |
| 16 | 0.080443 | 0.035216 | 0.432164 | 0.005072 | 0.050275 | 0.035198 | 0.165845 | 0.185943 | 0.010084 | 3.60E-05 | 504062.4 | 0.946325 | 1.00E-04 | 402002.3 | 8.00E+07 | 1333.308 | 0.952266 |
| 17 | 0.105571 | 0.04024 | 0.412068 | 4.35E-05 | 0.025151 | 0.035201 | 0.226144 | 0.140719 | 0.015113 | 2.81E-05 | 506346.1 | 0.9465 | 1.00E-04 | 425022.5 | 8.46E+07 | 1409.658 | 0.952467 |
| 18 | 0.100535 | 0.07039 | 0.407043 | 0.025171 | 0.050272 | 0.035201 | 0.100524 | 0.201022 | 0.010088 | 3.65E-05 | 512183.6 | 0.946328 | 1.00E-04 | 451628.7 | 8.99E+07 | 1497.902 | 0.954071 |
| 19 | 0.105567 | 0.055313 | 0.417092 | 0.005071 | 0.045251 | 0.040227 | 0.180923 | 0.145745 | 0.005062 | 3.16E-05 | 527430.3 | 0.946778 | 1.00E-04 | 487771.7 | 9.71E+07 | 1617.776 | 0.952667 |
| 20 | 0.125661 | 0.065361 | 0.442215 | 0.020146 | 0.040225 | 0.050272 | 0.125653 | 0.125651 | 0.005061 | 3.22E-05 | 523399.3 | 0.946712 | 1.00E-04 | 504626.9 | 1.00E+08 | 1673.679 | 0.953369 |
| 21 | 0.090493 | 0.065365 | 0.447237 | 0.015122 | 0.025153 | 0.055296 | 0.145747 | 0.145746 | 0.010088 | 2.98E-05 | 524106.1 | 0.947292 | 1.00E-04 | 542822.5 | 1.08E+08 | 1800.361 | 0.954473 |
| 22 | 0.115617 | 0.01512 | 0.412064 | 0.005071 | 0.025151 | 0.070375 | 0.165848 | 0.185939 | 0.005063 | 3.20E-05 | 532478.9 | 0.94718 | 1.00E-04 | 577178.9 | 1.15E+08 | 1914.31 | 0.954673 |
| 23 | 0.13571 | 0.055316 | 0.457288 | 4.62E-05 | 0.045252 | 0.025151 | 0.130675 | 0.135701 | 0.015115 | 3.43E-05 | 528054.6 | 0.947536 | 1.00E-04 | 603914.4 | 1.20E+08 | 2002.983 | 0.95367 |
| 24 | 0.100541 | 0.05029 | 0.467339 | 0.01512 | 0.050274 | 0.070369 | 0.105549 | 0.12565 | 0.015115 | 3.06E-05 | 529138 | 0.947381 | 1.00E-04 | 615613.9 | 1.23E+08 | 2041.786 | 0.954272 |
| 25 | 0.130688 | 0.050295 | 0.44724 | 4.60E-05 | 0.0352 | 0.030177 | 0.125654 | 0.170869 | 0.010084 | 3.17E-05 | 546074.9 | 0.947314 | 1.00E-04 | 665942 | 1.33E+08 | 2208.708 | 0.954071 |
| 26 | 0.05532 | 0.050294 | 0.412067 | 0.005074 | 0.035204 | 0.065346 | 0.15077 | 0.180919 | 0.045261 | 3.54E-05 | 539120.5 | 0.947706 | 1.00E-04 | 701803.6 | 1.40E+08 | 2327.649 | 0.956077 |
| 27 | 0.110587 | 0.065366 | 0.396991 | 4.40E-05 | 0.025157 | 0.060325 | 0.140724 | 0.19097 | 0.010087 | 3.38E-05 | 528761.1 | 0.947495 | 1.00E-04 | 699371.5 | 1.39E+08 | 2319.582 | 0.955174 |
| 28 | 0.070391 | 0.065369 | 0.432163 | 0.005071 | 0.040225 | 0.055296 | 0.1156 | 0.201018 | 0.015115 | 3.33E-05 | 533398 | 0.947871 | 1.00E-04 | 757388.8 | 1.51E+08 | 2512.006 | 0.954773 |
| 29 | 0.075415 | 0.070392 | 0.427138 | 4.86E-05 | 0.050277 | 0.030177 | 0.150771 | 0.185942 | 0.010086 | 3.39E-05 | 541848.7 | 0.947554 | 1.00E-04 | 807377.7 | 1.61E+08 | 2677.803 | 0.957581 |
| 30 | 0.095516 | 0.060343 | 0.407042 | 0.010091 | 0.035205 | 0.055297 | 0.170874 | 0.160823 | 0.005065 | 3.25E-05 | 544324.9 | 0.947917 | 1.00E-04 | 822086.7 | 1.64E+08 | 2726.588 | 0.955275 |
| 31 | 0.115612 | 0.060342 | 0.447241 | 0.005072 | 0.025148 | 0.070371 | 0.080429 | 0.19097 | 0.005063 | 3.17E-05 | 534737.7 | 0.948017 | 1.00E-04 | 813579.5 | 1.62E+08 | 2698.372 | 0.954773 |
| 32 | 0.03522 | 0.040246 | 0.457289 | 0.005076 | 0.030177 | 0.06032 | 0.135694 | 0.216089 | 0.020137 | 3.22E-05 | 532392.2 | 0.947611 | 1.00E-04 | 854092.9 | 1.70E+08 | 2832.742 | 0.954673 |
| 33 | 0.060346 | 0.040247 | 0.472355 | 0.015122 | 0.035202 | 0.060321 | 0.165847 | 0.140721 | 0.010091 | 3.35E-05 | 552430.2 | 0.948273 | 1.00E-04 | 903742.2 | 1.80E+08 | 2997.412 | 0.954673 |
| 34 | 0.080436 | 0.045271 | 0.417091 | 0.020143 | 0.030179 | 0.055298 | 0.165846 | 0.155794 | 0.030188 | 3.04E-05 | 551996.2 | 0.947777 | 1.00E-04 | 930373 | 1.85E+08 | 3085.737 | 0.953971 |
| 35 | 0.065366 | 0.035221 | 0.497483 | 0.005075 | 0.030177 | 0.050272 | 0.1357 | 0.160821 | 0.020137 | 3.31E-05 | 550661.4 | 0.948086 | 1.00E-04 | 959975.9 | 1.91E+08 | 3183.92 | 0.954874 |
| 36 | 0.105563 | 0.070392 | 0.44221 | 0.015118 | 0.02515 | 0.045251 | 0.135695 | 0.16082 | 4.26E-05 | 3.18E-05 | 554639.1 | 0.948436 | 1.00E-04 | 1005877 | 2.00E+08 | 3336.16 | 0.955576 |
| 37 | 0.095512 | 0.055321 | 0.396993 | 4.82E-05 | 0.045256 | 0.030176 | 0.160823 | 0.19097 | 0.025159 | 3.44E-05 | 550949.5 | 0.948139 | 1.00E-04 | 1012059 | 2.01E+08 | 3356.661 | 0.955375 |
| 38 | 0.115609 | 0.030192 | 0.457286 | 0.005071 | 0.050273 | 0.060319 | 0.090479 | 0.165845 | 0.025164 | 3.28E-05 | 563623.2 | 0.948436 | 1.00E-04 | 1385627 | 2.76E+08 | 4595.663 | 0.954473 |
| 39 | 0.060343 | 0.060346 | 0.447238 | 4.92E-05 | 0.060322 | 0.100519 | 0.095503 | 0.170871 | 0.005068 | 3.19E-05 | 557487.6 | 0.947838 | 1.00E-04 | 1398310 | 2.78E+08 | 4637.73 | 0.955375 |
| 40 | 0.07039 | 0.050296 | 0.467333 | 0.005073 | 0.015104 | 0.045248 | 0.100521 | 0.241213 | 0.005064 | 3.26E-05 | 566256.8 | 0.947848 | 1.00E-04 | 1467852 | 2.92E+08 | 4868.377 | 0.953971 |
| 41 | 0.075415 | 0.075414 | 0.447238 | 0.015121 | 0.060322 | 0.050275 | 0.120626 | 0.14575 | 0.010088 | 2.98E-05 | 564198.8 | 0.948148 | 1.00E-04 | 1478772 | 2.94E+08 | 4904.595 | 0.955174 |
| 42 | 0.105561 | 0.065364 | 0.427138 | 0.005071 | 0.0352 | 0.085447 | 0.125651 | 0.145747 | 0.005064 | 3.53E-05 | 552787.5 | 0.948351 | 1.00E-04 | 1490932 | 2.97E+08 | 4944.926 | 0.955475 |
| 43 | 0.080442 | 0.050296 | 0.447234 | 0.010094 | 0.0352 | 0.095495 | 0.100529 | 0.175892 | 0.005064 | 3.36E-05 | 565870.1 | 0.948116 | 1.00E-04 | 1569244 | 3.12E+08 | 5204.659 | 0.955275 |
| 44 | 0.09049 | 0.07039 | 0.366843 | 0.005068 | 0.030178 | 0.060326 | 0.145745 | 0.211066 | 0.020136 | 3.37E-05 | 566309.8 | 0.948049 | 1.00E-04 | 1616391 | 3.22E+08 | 5361.029 | 0.955275 |
| 45 | 0.085466 | 0.060342 | 0.47236 | 5.08E-05 | 0.040225 | 0.045248 | 0.100527 | 0.185946 | 0.010085 | 3.12E-05 | 562188.4 | 0.948042 | 1.00E-04 | 1642851 | 3.27E+08 | 5448.788 | 0.954773 |
| 46 | 0.055314 | 0.075417 | 0.402015 | 0.005072 | 0.025156 | 0.080422 | 0.125648 | 0.221115 | 0.010087 | 3.41E-05 | 572334 | 0.948496 | 1.00E-04 | 1717233 | 3.42E+08 | 5695.488 | 0.955174 |
| 47 | 0.060339 | 0.085464 | 0.482406 | 4.91E-05 | 0.010079 | 0.065346 | 0.085451 | 0.195994 | 0.005064 | 0.010082 | 578191.8 | 0.94894 | 1.00E-04 | 1770200 | 3.52E+08 | 5871.163 | 0.956578 |
| 48 | 0.095515 | 0.06034 | 0.442211 | 0.010095 | 0.035204 | 0.0352 | 0.100528 | 0.201019 | 0.010088 | 0.010081 | 579663.2 | 0.948068 | 1.00E-04 | 1799978 | 3.58E+08 | 5969.928 | 0.955174 |
| 49 | 0.085464 | 0.045266 | 0.437187 | 0.010091 | 0.020129 | 0.065347 | 0.135699 | 0.195994 | 0.005064 | 3.67E-05 | 583931.7 | 0.947682 | 1.00E-04 | 1855855 | 3.69E+08 | 6155.252 | 0.954573 |
| 50 | 0.065368 | 0.040246 | 0.45226 | 0.010096 | 0.020128 | 0.085448 | 0.10555 | 0.201018 | 0.020136 | 3.38E-05 | 561001 | 0.948082 | 1.00E-04 | 1826165 | 3.63E+08 | 6056.78 | 0.954272 |
| 51 | 0.085465 | 0.05029 | 0.437186 | 4.86E-05 | 0.040231 | 0.075399 | 0.120624 | 0.165847 | 0.025166 | 3.41E-05 | 583785.6 | 0.948031 | 1.00E-04 | 1912474 | 3.81E+08 | 6343.038 | 0.955676 |
| 52 | 0.080437 | 0.045269 | 0.507531 | 0.010098 | 0.030179 | 0.050274 | 0.1357 | 0.140721 | 4.11E-05 | 3.10E-05 | 570127.3 | 0.948323 | 1.00E-04 | 1929319 | 3.84E+08 | 6398.908 | 0.954071 |
| 53 | 0.105558 | 0.05029 | 0.467334 | 0.005075 | 0.050272 | 0.050273 | 0.065358 | 0.180919 | 0.020137 | 0.005057 | 595435.6 | 0.94851 | 1.00E-04 | 2030153 | 4.04E+08 | 6733.341 | 0.955375 |
| 54 | 0.115609 | 0.055316 | 0.452267 | 4.56E-05 | 0.030181 | 0.060323 | 0.140725 | 0.140724 | 0.005067 | 3.14E-05 | 579110.6 | 0.948439 | 1.00E-04 | 2037337 | 4.05E+08 | 6757.167 | 0.955275 |
| 55 | 0.120636 | 0.030194 | 0.402018 | 0.020146 | 0.015102 | 0.040228 | 0.135699 | 0.226141 | 0.010085 | 3.40E-05 | 596657.2 | 0.948081 | 1.00E-04 | 2129191 | 4.24E+08 | 7061.817 | 0.954071 |
| 56 | 0.055318 | 0.070393 | 0.442214 | 0.0101 | 0.020129 | 0.060321 | 0.10555 | 0.216092 | 0.020137 | 3.41E-05 | 592937.8 | 0.948166 | 1.00E-04 | 2166024 | 4.31E+08 | 7183.979 | 0.956077 |
| 57 | 0.060342 | 0.060346 | 0.412065 | 5.21E-05 | 0.020131 | 0.09047 | 0.115599 | 0.221115 | 0.015111 | 0.00506 | 607269.6 | 0.948324 | 1.00E-04 | 2247650 | 4.47E+08 | 7454.704 | 0.956278 |
?
這個實驗累計持續了超過18萬分鐘,一共收斂了58*199次,將平均準確率畫成圖
這張圖是10個核到57個核的pave數據,可以觀察到con<=47時網絡性能隨著卷積核數量的增加而上升,當con=47時pave取得最大值0.94894。
這張圖是con=20到con=57,這張圖可以更加清楚的看到con=47時形成的pave峰,
雖然并不排除當卷積核數量大于57個以后可能會出現更大的pave,但這個網絡當卷積核數量大于36個時已經變得不穩定,再實驗更大的卷積核數量實用性并不強。
?
是否可能用簡單的三層網絡減小收斂標準的辦法實現多卷積核網路的性能?
| f2[0] | f2[1] | f2[2] | f2[3] | f2[4] | f2[5] | f2[6] | f2[7] | f2[8] | f2[9] | 迭代次數n | 平均準確率p-ave | δ | 耗時ms/次 | 耗時ms/199次 | 耗時 min/199 | 最大值p-max |
| 0.03018 | 3.75E-05 | 0.221124 | 0.0101 | 0.015106 | 0.467342 | 0.0151 | 0.241225 | 3.71E-05 | 3.24E-05 | 1689378 | 0.927924 | 1.00E-04 | 28948.91 | 5760833 | 96.01388 | 0.93572 |
| 0.025153 | 3.38E-05 | 0.326647 | 0.010101 | 0.035195 | 0.376899 | 2.57E-05 | 0.226146 | 3.20E-05 | 2.44E-05 | 1943678 | 0.928104 | 9.00E-05 | 32832.36 | 6533641 | 108.894 | 0.934316 |
| 0.015099 | 3.06E-05 | 0.301523 | 0.01512 | 0.030172 | 0.452264 | 0.005049 | 0.18092 | 3.22E-05 | 2.23E-05 | 2085566 | 0.928547 | 8.00E-05 | 35165.06 | 6997849 | 116.6308 | 0.934015 |
| 0.035197 | 2.90E-05 | 0.311569 | 0.010086 | 0.015094 | 0.437193 | 0.020122 | 0.17087 | 2.40E-05 | 2.24E-05 | 2525136 | 0.929116 | 7.00E-05 | 42976.27 | 8552289 | 142.5382 | 0.934316 |
| 0.025142 | 2.07E-05 | 0.321618 | 3.20E-05 | 0.020117 | 0.38192 | 0.005042 | 0.246242 | 2.21E-05 | 1.78E-05 | 2890698 | 0.929858 | 6.00E-05 | 48981.99 | 9747438 | 162.4573 | 0.934617 |
| 0.030165 | 1.96E-05 | 0.291466 | 0.010074 | 0.020114 | 0.452263 | 0.005039 | 0.190965 | 1.93E-05 | 1.42E-05 | 3459593 | 0.930397 | 5.00E-05 | 58262.53 | 11594249 | 193.2375 | 0.936923 |
| 0.005036 | 1.60E-05 | 0.271365 | 0.005046 | 0.020112 | 0.452265 | 0.010061 | 0.236186 | 1.40E-05 | 1.18E-05 | 4164640 | 0.930715 | 4.00E-05 | 70300.02 | 13989711 | 233.1619 | 0.935519 |
| 0.005033 | 1.17E-05 | 0.236187 | 0.010065 | 0.035182 | 0.447239 | 0.005034 | 0.261312 | 1.08E-05 | 1.00E-05 | 7064859 | 0.931386 | 3.00E-05 | 120923.6 | 24063811 | 401.0635 | 0.938026 |
| 0.00503 | 7.82E-06 | 0.296486 | 1.04E-05 | 0.025131 | 0.396988 | 0.025131 | 0.251259 | 7.56E-06 | 5.63E-06 | 1.40E+07 | 0.931936 | 2.00E-05 | 237084 | 47179720 | 786.3287 | 0.936823 |
?
實驗表明用81*30*10的網絡10分類mnist的0-9當收斂標準等于1e-5的時候就幾乎無法收斂。用簡單的三層網絡只能達到約4個核的性能。因此對于二分類或者三分類的網絡才可能通過減小收斂標準的辦法用簡單的3層網絡來快速的實現多核網絡的性能,但對于多分類的網絡卷積核是有巨大的性能優勢。
再比較前面的實驗數據用3*3的卷積核二分類0和2的卷積核最優值是4個,而10分類是47個,可以大致估算每增加一個分類對象需要多加5個卷積核。
總結
以上是生活随笔為你收集整理的实验:3*3卷积核10分类9*9图片卷积核数量最优值的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: 神经网络的耦合作用与规范场
- 下一篇: 鲍威尔讲话在哪里看