Shi, The key here is the 99% done mapper. Nothing can move on until all mappers complete. Is it possible your data in the larger set has an incomplete record or some such at the end? Kevin -----Original Message----- From: Shi Yu Sent: Thursday, March 24, 2011 3:02 PM To: hadoop user Subject: Program freezes at Map 99% Reduce 33% I am running a hadoop program processing Tera Byte size data. The code was test successfully on a small sample (100G) and it worked. However, when trying it on the full -- Kevin Leach
↧
