web | Java

线上Spark Job如何停止?

千锋教育

SparkContext提供了一个取消job的api class SparkContext(config: SparkConf) extends Logging with ExecutorAllocationClient { /** Cancel a given job if it's scheduled or running */ private[spark] def cancelJob(jobId: Int) { dagScheduler.cancelJob(jobId) }