Good. Data skew should not look stuck. Try sending status updates so at least you can tell one mapper is still busy. Yes, adding data or including another field into the key can help reduce data skew. Kevin -----Original Message----- From: Shi Yu Sent: Thursday, March 24, 2011 5:56 PM To: common-user@hadoop.apache.org Subject: Re: Program freezes at Map 99% Reduce 33% Hi Kevin, thanks for the suggestion. I think I found the problem, because my code is a chained map / reduce. In the previous -- Kevin Leach
↧
