本文共 2920 字,大约阅读时间需要 9 分钟。
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 | 14 / 09 / 20 22 : 41 : 13 WARN util.NativeCodeLoader: Unable to load native -hadoop library for your platform... using builtin-java classes where applicable 14 / 09 / 20 22 : 41 : 13 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 14 / 09 / 20 22 : 41 : 13 INFO input.FileInputFormat: Total input paths to process : 2 14 / 09 / 20 22 : 41 : 14 WARN snappy.LoadSnappy: Snappy native library not loaded 14 / 09 / 20 22 : 41 : 14 INFO mapred.JobClient: Running job: job_local911496586_0001 14 / 09 / 20 22 : 41 : 14 INFO mapred.LocalJobRunner: Waiting for map tasks 14 / 09 / 20 22 : 41 : 14 INFO mapred.LocalJobRunner: Starting task: attempt_local911496586_0001_m_000000_0 14 / 09 / 20 22 : 41 : 14 INFO mapred.Task: Using ResourceCalculatorPlugin : null 14 / 09 / 20 22 : 41 : 14 INFO mapred.MapTask: Processing split: hdfs: //192.168.1.112:9000/txt/yw/mic.php:0+338124 14 / 09 / 20 22 : 41 : 14 INFO mapred.MapTask: io.sort.mb = 100 14 / 09 / 20 22 : 41 : 14 INFO mapred.LocalJobRunner: Starting task: attempt_local911496586_0001_m_000001_0 14 / 09 / 20 22 : 41 : 14 INFO mapred.Task: Using ResourceCalculatorPlugin : null 14 / 09 / 20 22 : 41 : 14 INFO mapred.MapTask: Processing split: hdfs: //192.168.1.112:9000/txt/yw/pip.txt:0+96393 14 / 09 / 20 22 : 41 : 14 INFO mapred.MapTask: io.sort.mb = 100 14 / 09 / 20 22 : 41 : 14 INFO mapred.LocalJobRunner: Map task executor complete. 14 / 09 / 20 22 : 41 : 14 WARN mapred.LocalJobRunner: job_local911496586_0001 java.lang.Exception: java.lang.OutOfMemoryError: Java heap space at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java: 354 ) Caused by: java.lang.OutOfMemoryError: Java heap space at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java: 954 ) at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java: 673 ) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java: 756 ) at org.apache.hadoop.mapred.MapTask.run(MapTask.java: 364 ) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java: 223 ) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java: 441 ) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java: 303 ) at java.util.concurrent.FutureTask.run(FutureTask.java: 138 ) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java: 886 ) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java: 908 ) at java.lang.Thread.run(Thread.java: 619 ) 14 / 09 / 20 22 : 41 : 15 INFO mapred.JobClient: map 0 % reduce 0 % 14 / 09 / 20 22 : 41 : 15 INFO mapred.JobClient: Job complete: job_local911496586_0001 14 / 09 / 20 22 : 41 : 15 INFO mapred.JobClient: Counters: 0 |
解决:
本文转自 梦朝思夕 51CTO博客,原文链接:http://blog.51cto.com/qiangmzsx/1556392
转载地址:http://dopzl.baihongyu.com/