Sample MapReduce output - mikec964/chelmbigstock GitHub Wiki

Robin:hadoop-1.2.1 hadoop$ bin/hadoop jar ../weather/WeatherJob.jar WeatherJob input output
15/01/31 12:05:27 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
15/01/31 12:05:28 INFO input.FileInputFormat: Total input paths to process : 1
15/01/31 12:05:28 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
15/01/31 12:05:28 WARN snappy.LoadSnappy: Snappy native library not loaded
15/01/31 12:05:29 INFO mapred.JobClient: Running job: job_201501311203_0001
15/01/31 12:05:30 INFO mapred.JobClient:  map 0% reduce 0%
15/01/31 12:05:44 INFO mapred.JobClient:  map 11% reduce 0%
15/01/31 12:05:47 INFO mapred.JobClient:  map 20% reduce 0%
15/01/31 12:05:50 INFO mapred.JobClient:  map 29% reduce 0%
15/01/31 12:05:54 INFO mapred.JobClient:  map 38% reduce 0%
15/01/31 12:05:57 INFO mapred.JobClient:  map 48% reduce 0%
15/01/31 12:06:00 INFO mapred.JobClient:  map 50% reduce 0%
15/01/31 12:06:17 INFO mapred.JobClient:  map 50% reduce 8%
15/01/31 12:06:18 INFO mapred.JobClient:  map 54% reduce 8%
15/01/31 12:06:19 INFO mapred.JobClient:  map 61% reduce 8%
15/01/31 12:06:20 INFO mapred.JobClient:  map 61% reduce 16%
15/01/31 12:06:21 INFO mapred.JobClient:  map 76% reduce 16%
15/01/31 12:06:24 INFO mapred.JobClient:  map 90% reduce 16%
15/01/31 12:06:27 INFO mapred.JobClient:  map 96% reduce 16%
15/01/31 12:06:30 INFO mapred.JobClient:  map 100% reduce 16%
15/01/31 12:06:38 INFO mapred.JobClient:  map 100% reduce 25%
15/01/31 12:06:44 INFO mapred.JobClient:  map 100% reduce 67%
15/01/31 12:06:47 INFO mapred.JobClient:  map 100% reduce 78%
15/01/31 12:06:50 INFO mapred.JobClient:  map 100% reduce 90%
15/01/31 12:06:54 INFO mapred.JobClient:  map 100% reduce 100%
15/01/31 12:06:55 INFO mapred.JobClient: Job complete: job_201501311203_0001
15/01/31 12:06:55 INFO mapred.JobClient: Counters: 26
15/01/31 12:06:55 INFO mapred.JobClient:   Job Counters 
15/01/31 12:06:55 INFO mapred.JobClient:     Launched reduce tasks=1
15/01/31 12:06:55 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=118504
15/01/31 12:06:55 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/01/31 12:06:55 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/01/31 12:06:55 INFO mapred.JobClient:     Launched map tasks=4
15/01/31 12:06:55 INFO mapred.JobClient:     Data-local map tasks=4
15/01/31 12:06:55 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=48021
15/01/31 12:06:55 INFO mapred.JobClient:   File Output Format Counters 
15/01/31 12:06:55 INFO mapred.JobClient:     Bytes Written=1823073
15/01/31 12:06:55 INFO mapred.JobClient:   FileSystemCounters
15/01/31 12:06:55 INFO mapred.JobClient:     FILE_BYTES_READ=861553030
15/01/31 12:06:55 INFO mapred.JobClient:     HDFS_BYTES_READ=239162330
15/01/31 12:06:55 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=1203325892
15/01/31 12:06:55 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=1823073
15/01/31 12:06:55 INFO mapred.JobClient:   File Input Format Counters 
15/01/31 12:06:55 INFO mapred.JobClient:     Bytes Read=239161862
15/01/31 12:06:55 INFO mapred.JobClient:   Map-Reduce Framework
15/01/31 12:06:55 INFO mapred.JobClient:     Reduce input groups=25050
15/01/31 12:06:55 INFO mapred.JobClient:     Map output materialized bytes=341494024
15/01/31 12:06:55 INFO mapred.JobClient:     Combine output records=0
15/01/31 12:06:55 INFO mapred.JobClient:     Map input records=9125000
15/01/31 12:06:55 INFO mapred.JobClient:     Reduce shuffle bytes=341494024
15/01/31 12:06:55 INFO mapred.JobClient:     Reduce output records=75150
15/01/31 12:06:55 INFO mapred.JobClient:     Spilled Records=64368060
15/01/31 12:06:55 INFO mapred.JobClient:     Map output bytes=304994000
15/01/31 12:06:55 INFO mapred.JobClient:     Total committed heap usage (bytes)=919076864
15/01/31 12:06:55 INFO mapred.JobClient:     Combine input records=0
15/01/31 12:06:55 INFO mapred.JobClient:     Map output records=18250000
15/01/31 12:06:55 INFO mapred.JobClient:     SPLIT_RAW_BYTES=468
15/01/31 12:06:55 INFO mapred.JobClient:     Reduce input records=18250000