娣卞害娈嬪樊缃戝涔犲湪鍥惧儚鍒嗙被涓婄殑搴旂敤
浣曞嚡鏄?/p>
寮犵繑瀹?/p>
浠诲皯鍗?/p>
瀛欏墤
寰蒋鐮旂┒闄?/p>
{kahe, v-xiangz, v-shren,jiansun}@microsoft.com
鎽樿
褰撳墠锛屾繁搴︾缁忕綉缁滄瘮鏅�氱缁?/p>
缃戠粶鏇撮毦璁粌銆傛垜浠彁鍑轰簡涓�绉嶅噺杞?/p>
缃戠粶璁粌璐熸媴鐨勬畫宸涔犳鏋讹紝杩欑
缃戠粶姣斾互鍓嶄娇鐢ㄨ繃鐨勭綉缁滄湰璐ㄤ笂灞傛
鏇存繁銆傛垜浠槑纭湴閲嶅畾涔夎繖灞備负瀛︿範
杈撳叆灞傜浉鍏崇殑娈嬪樊鍑芥暟锛岃�屼笉鏄涔?/p>
鏈煡鐨勫嚱鏁般�傚悓鏃讹紝鎴戜滑鎻愪緵浜嗗叏闈?/p>
缁忛獙鏁版嵁锛岃繖浜涙暟鎹瘉鏄庢畫宸綉缁滄洿
瀹规槗浼樺寲锛屽苟涓斿彲浠ヤ粠娣卞害澧炲姞涓ぇ
澶ф彁楂樼簿搴︺�傛垜浠湪
ImageNet
鏁版嵁
闆嗙敤
152
灞?/p>
--
姣?/p>
VGG
缃戠粶
[41]
娣?/p>
8
鍊?/p>
鐨勬繁搴︾缁忕綉缁滄潵璇勪及娈嬪樊缃戠粶锛屼絾
瀹冧粛鍏锋湁杈冧綆鐨勫鏉傚害銆傚湪
ImageNet
娴嬭瘯闆嗕腑锛岃繖浜涙畫宸綉缁滄暣浣撹揪鍒颁簡
3.57%
鐨勮宸�傝缁撴灉鍦?/p>
2015
骞村ぇ瑙?/p>
妯¤瑙夎瘑鍒寫鎴樿禌鍒嗙被浠诲姟涓耽寰椾簡
绗竴銆傛澶栵紝鎴戜滑杩樼敤浜?/p>
100
鍒?/p>
1000
灞傛繁搴﹀垎鏋愪簡鐨?/p>
CIFAR-10
銆?/p>
瀵逛簬澶ч儴鍒嗚瑙夎瘑鍒换鍔★紝娣卞害
琛ㄧず鏄潪甯搁噸瑕佺殑銆傛寮忕敱浜庝娇鐢ㄦ瀬
娣辩殑琛ㄧず锛屽湪
COCO
瀵硅薄妫�鏌ユ暟鎹泦
涓婏紝鎴戜滑灏卞緱鍒颁簡杩?/p>
28%
鐩稿叧鐨勬敼
杩涖�傛繁搴︽畫宸綉缁滄槸鎴戜滑鎻愪氦缁?/p>
ILSVRC
鍜?/p>
COCO 2015
绔炶禌
[1]
鐨勫熀
纭�锛岃�屼笖鍦?/p>
ImageNet
妫�娴嬩换鍔★紝
ImageNet
瀹氫綅锛?/p>
COCO
妫�娴嬪拰
COCO
鍒嗗壊绛夐鍩熻耽鎴戜滑涔熼兘鑾峰緱浜嗙涓�銆?/p>
1.
绠�浠?/p>
娣卞害鍗风Н缃戠粶
[21,22]
寮曢浜嗕竴绯?/p>
鍒楀浘鍍忓垎绫讳笂鐨勭獊鐮?/p>
[21,50,40]
銆傛繁搴?/p>
缃戠粶閫氳繃灞傜殑鍙犲姞
(
娣卞害
)
锛岃嚜鐒惰�岀劧
鐨勪互涓�绉嶇鍒扮鐨勫灞傛ā寮忛泦鎴愪簡浣?/p>
/
涓?/p>
/
楂樼骇鐨勭壒寰?/p>
[50]
鍜屽垎绫诲櫒锛屽苟涓旂壒
寰佺殑
鈥?/p>
姘村钩
鈥?/p>
閮借兘鍙樺緱鏇村姞涓板瘜銆傛渶杩?/p>
璇佹嵁
[41,44]
琛ㄦ槑缃戠粶娣卞害闈炲父閲嶈锛?
骞朵笖
ImageNet
鏁版嵁闆?/p>
[36]
鎸戞垬璧涗腑棰?/p>
鍏堢殑缁撴灉
[41,44,13,16]
閮芥槸鍦ㄦ帰绱?/p>
鈥?/p>
寰?/p>
娣?/p>
鈥漑41]
鐨勬ā鍨嬶紝杩欎簺妯″瀷浠?/p>
16
灞?/p>
[41]
鍒?/p>
30
灞?/p>
[16]
銆傝澶氬叾浠栫殑閲嶅ぇ鐨勮瑙?/p>
璇嗗埆浠诲姟
[8,12,7,32,27]
涔熼兘浠庢繁搴︽ā
鍨嬩腑鑾风泭鑹銆?/p>
鍦ㄦ繁搴︾殑鎰忎箟椹变娇涓嬶紝涓�涓棶棰?/p>
鍑虹幇浜嗭細瀛︿範鏇村ソ鐨勭綉缁滄槸涓嶆槸鍜屽彔
鍔犲眰鏁颁竴鏍峰鏄撳憿锛熻В鍐宠繖涓棶棰樼殑
涓�涓殰纰嶅氨鏄偅涓噸鍚嶆槶钁楃殑姊害娑?/p>
澶?/p>
/
鐖嗙偢
[1,9]
闂锛屼粬浠庝竴寮�濮嬪氨闃荤
浜嗙綉缁滅殑鏀舵暃銆傜劧鑰岋紝杩欎釜闂寰堝ぇ
绋嬪害涓婅褰掍竴鐨勫垵濮嬪寲
[23,9,37,13]
鍜?/p>
涓棿灞傚綊涓�鍖?/p>
[16]
瑙ｅ喅浜嗭紝瀹冧滑纭繚
鏁?/p>
10
灞傜殑缃戠粶寮�濮嬬敤鍙嶅悜浼犳挱绠楁硶
浠ラ殢鏈烘搴︿笅闄?/p>
(SGD)
鐨勬柟寮忔敹鏁?/p>
[22]
銆?/p>
褰撴洿娣辩殑缃戠粶鑳藉寮�濮嬫敹鏁涙椂锛?/p>
闄嶇骇闂鐨勯棶棰樺紑濮嬪嚭鐜帮細闅忕潃缃戠粶
娣卞害鐨勫鍔狅紝绮惧噯搴﹀紑濮嬮ケ鍜岋紙杩欏苟
涓嶄护浜哄悆鎯婏級
锛岀劧鍚庤繀閫熶笅闄嶃�傞鏂?/p>
涔嬪鐨勬槸锛屽湪
[11,42]
涓姤閬撳苟涓旂粡杩?/p>
鎴戜滑瀹為獙楠岃瘉鍙戠幇锛岀簿鍑嗗害鐨勪笅闄嶅苟
涓嶆槸鐢辫繃搴︽嫙鍚堥�犳垚鐨勶紝鑰屼笖鍦ㄥ悎閫?/p>
鐨勬繁搴︽ā鍨嬩腑澧炲姞鏇村鐨勫眰鏁帮紝浼氶�?/p>
鎴愭洿楂樼殑璁粌璇樊銆傚浘
1
灞曠ず浜嗕竴涓?/p>
缁忓吀鐨勫疄渚嬨�?/p>
鍥?/p>
1 CIFAR-10
鏁版嵁闆嗕笂鐨?/p>
20
灞傚拰
56
灞傜殑
鈥?/p>
骞?/p>
鈥?/p>
缃戠粶鐨勮缁冭宸紙宸︼級鍜屾祴璇曡宸?/p>
锛堝彸锛?/p>
銆傛洿娣辩殑缃戠粶鏈夋洿楂樼殑璁粌璇樊鍜屾祴
璇曡宸紝鍥?/p>
4
鏄剧ず浜嗗湪
ImageNet
涔熸湁鐩镐技
鐨勭幇璞?/p>
锛堝湪璁粌闆嗕笂绮惧害锛夐檷绾ф樉绀哄苟