@avibryant you ever run into parquet-cascading failing to import because it's unable to find the cascading.scheme.Scheme class?
@sorenmacbeth @amcclosky specifically, OutOfMemoryError: Direct buffer memory. Restarting fixes them for a while. Ever seen this? Thoughts?
-
-
@avibryant@amcclosky I’ve not seen that, but I’ll keep an eye out for it.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@busbeytheelder CDH 4.5. Small cluster, increased from 24 to 36 nodes. Running Impala, MR1 (not YARN). -
@busbeytheelder when it gets bad, seeing thousands of OOME per hour, and unresponsive nodes (but still alive according to the namenode).
End of conversation
New conversation -
-
-
@avibryant@sorenmacbeth@amcclosky does your HDFS client process use DBB otherwise? Try increasing -XX:MaxDBB for the process. -
@xefyr@sorenmacbeth@amcclosky yeah, we've tried that, though my understanding is that it defaults to be the same as -Xmx anyway.
End of conversation
New conversation -
-
-
@avibryant@sorenmacbeth I haven't but maybe@busbeytheelder has seen something like that.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.