FAILED Execution Error return code 2 from org apache hadoop hive ql exec mr MapRedTask

Question

I am trying to run one Map Reduce task using hive command line. But I am getting this bellow error.

2020-04-14 04:21:25,614 Stage-2 map = 74%,  reduce = 0%, Cumulative CPU 428.9 sec
2020-04-14 04:21:31,757 Stage-2 map = 75%,  reduce = 0%, Cumulative CPU 441.44 sec
2020-04-14 04:21:34,830 Stage-2 map = 76%,  reduce = 0%, Cumulative CPU 447.75 sec
2020-04-14 04:21:37,899 Stage-2 map = 77%,  reduce = 0%, Cumulative CPU 454.08 sec
2020-04-14 04:21:40,969 Stage-2 map = 100%,  reduce = 100%, Cumulative CPU 226.61 sec
MapReduce Total cumulative CPU time: 3 minutes 46 seconds 610 msec
Ended Job = job_1539457190739_0353 with errors
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched:
Stage-Stage-2: Map: 5  Reduce: 120   Cumulative CPU: 226.61 sec   HDFS Read: 100122946 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 3 minutes 46 seconds 610 msec
, Hive SQL state [08S01].
2020-04-14 04:23:54.740 <OnDemandDTM-pool-2-thread-47> SEVERE: [HIVE_1106] The Integration Service failed to run the mapping due to an exception. See the additional error messages for more information.

How can I solve this error?

Answer 1

Hi@akhtar,

This issue generally occurs when the memory configured for the 'Map' task is insufficient to complete the task. To resolve the issue, it would be required to increase the memory for 'Map Task'  from existing value.

To do that you have to edit your mapred-site.xml file and increase the value of the attributes 'mapreduce.map.memory.mb' and 'mapreduce.reduce.memory.mb'

Hope this will help you.