瀹炵敤鏍囧噯鏂囨。
鏂囨澶у叏
澶ф暟鎹垎鏋?/p>
璇剧▼鏍囧噯
涓�銆佽绋嬪畾浣?/p>
鐜板湪浼佷笟涓轰簡鎻愬崌瀹汉浣跨敤浣撻獙锛屾彁楂樹笟鍔℃晥鐜囷紝鍦ㄥぇ鏁版嵁钃媰鍙戝睍鐨勯樁娈甸噷锛?/p>
闇�瑕佸鐜版湁涓氬姟绯荤粺杩涜杞瀷鍗囩骇锛涗綔涓哄ぇ鏁版嵁鏍稿績閮ㄥ垎锛屽ぇ鏁版嵁鐮斿彂宸ョ▼甯堝簲鐢ㄦ垚涓?/p>
鏈夊ぇ閲忔暟鎹殑浼佷笟蹇呭浜烘墠锛屽湪鏁版嵁澶勭悊锛屾暟鎹垎鏋愭柟闈紝澶ф暟鎹爺鍙戞槸涓嶅彲鎴栫己鐨勬妧
鑳姐�?/p>
闅忕潃澶ф暟鎹簲鐢ㄧ殑澶ч噺鏅強锛?/p>
寮�婧愭鏋讹紝
姣斿
hadoop
锛?/p>
spark
绛夛紝
涔熷緱鍒伴暱瓒冲彂灞曘�?/p>
鏈绋嬮櫎浜嗙潃鍔涗簬缁熸暟鎹殑鏀堕泦鍜屾惌寤猴紝浣垮緱浣滀负澶ф暟鎹殑鐮斿彂
/
鍒嗘瀽甯︽潵鍩虹璁炬柦锛?/p>
璁╁鍛樻帉鎻★紝鍚屾椂锛屽澶ф暟鎹殑绂荤嚎
/
瀹炴椂澶勭悊鍜岄儴鍒嗘暟鎹垎鏋愯繘琛屾繁搴︾悊瑙ｅ拰鎶婃彙銆?/p>
閫氳繃鏈绋嬶紝鎺屾彙澶ф暟鎹钩鍙板苟涓斿澶ф暟鎹垎鏋愮殑鍩烘湰鎶�鑳藉拰鏂规硶锛屼负灏嗘潵鍦ㄤ紒涓氬垎鏋?/p>
澶ф暟鎹仛鍐崇瓥鎵撲笅鍩虹銆?/p>
浜屻�佽绋嬫�ц川涓庝綔鐢?/p>
璇剧▼鎬ц川
澶ф暟鎹垎鏋愯绋嬨�?/p>
璇剧▼浣滅敤
澶ф暟鎹垎鏋愭槸鏁版嵁娓呮礂杩囧悗浣垮緱鏁版嵁浜х敓浠峰�肩殑杩囩▼銆傚湪浼佷笟涓板瘜搴旂敤鍦烘櫙涓紝閫?/p>
杩囨爣鍑嗙殑澶ф暟鎹垎鏋愭柟娉曚笉鑳借儨浠荤殑鎯呭喌涓嬶紝
灏遍渶瑕侀�氳繃鍏堥獙鐭ヨ瘑鏉ラ獙璇佸ぇ鏁版嵁骞舵壘鍑?/p>
瑙勫緥鏉ヨ揪鍒颁笟鍔＄洰鏍囥�傚湪瀹為檯宸ヤ綔涓紝鎺屾彙澶ф暟鎹爺鍒嗘瀽闇�瑕佸睍绀虹殑鏁扮悊缁熻鍒嗘瀽鐨勭煡
璇嗭紝鏁忛攼鐨勬暟鎹瀵熷姏锛屽拰閮ㄥ垎杞欢寮�鍙戠殑鐭ヨ瘑锛屼篃闇�瑕佹瘮杈冩墡瀹炵殑璁＄畻鏈哄熀纭�銆傛湰璇?/p>
绋嬪ぇ绾叉槸瀹屾暣鐨勮绋嬶紝瀹為檯鍩硅璇剧▼涓紝浼氭牴鎹鍛樺疄闄呮儏鍐佃繘琛屽垎缁勩�傞�氳繃鏈绋嬬殑
瀛︿範銆?/p>
涓夈�佽绋嬬洰鏍?/p>
璇剧▼鏁欏浠ョ伒娲昏繍鐢ㄥ垎鏋愭柟娉曚负鐩爣锛屼互瀹為檯椤圭洰涓轰腑蹇冿紝浠ュ悎鐞嗙煡璇嗙粨鏋勫垎瑙ｄ负
鎵嬫锛岀粨鍚堝疄闄呯殑搴旂敤鍦烘櫙锛屽澶ф暟鎹繘琛屾枃鏈紝鍥炬爣绛夊ぇ鏁版嵁杩涜鍒嗘瀽鍜屽涔狅紝涓昏
浠ュ疄闄呮搷浣滆瀛﹀憳瀵圭浉鍏崇煡璇嗙偣鎺屾彙锛岃揪鍒扮悊璁轰笌瀹為檯缁撳悎锛屾暀瀛︿笌浼佷笟铻嶅悎鐨勫唴瀹广�?/p>
瀛﹀憳瀛︽垚鍚庯紝鑳藉鍒╃敤娓呮礂鍚庣殑鏁版嵁锛屾牴鎹彁渚涚殑鍏堥獙鐭ヨ瘑锛屽彲浠ュ仛鍑烘ā鍨嬪苟鑳藉棰勬祴
涓氬姟鏁版嵁銆傝绋嬪唴瀹瑰缁堝洿缁曞叏闈㈡彁鍗囧鐢熺殑鐞嗚鍜屾搷浣滅殑鐔熺粌绋嬪害銆佽鑼冨寲绋嬪害浠ュ強
鑱屼笟绱犺川涓変釜鏂归潰灞曞紑銆?/p>
锛堜竴锛夌煡璇嗙洰鏍?/p>
1.
鐞嗚В澶ф暟鎹蹇靛強搴旂敤鍦烘櫙锛屽厛瀵艰绋?/p>
Linux
鐨勬搷浣?/p>
2.
鎺屾彙寮�鍙戣瑷�
R
鎴?/p>
python