public abstract class HExecutionEngine extends Object implements ExecutionEngine
| Modifier and Type | Field and Description |
|---|---|
static String |
CORE_DEFAULT_SITE |
static String |
CORE_SITE |
protected DataStorage |
ds |
static String |
HADOOP_SITE |
protected Launcher |
launcher |
static String |
LOCAL |
protected Map<OperatorKey,OperatorKey> |
logicalToPhysicalKeys |
static String |
MAPRED_DEFAULT_SITE |
protected Map<Operator,PhysicalOperator> |
newLogToPhyMap |
protected PigContext |
pigContext |
static String |
YARN_DEFAULT_SITE |
static String |
YARN_SITE |
| Constructor and Description |
|---|
HExecutionEngine(PigContext pigContext) |
| Modifier and Type | Method and Description |
|---|---|
PhysicalPlan |
compile(LogicalPlan plan,
Properties properties) |
void |
destroy()
Perform any cleanup operation
|
void |
explain(LogicalPlan lp,
PigContext pc,
PrintStream ps,
String format,
boolean verbose,
File file,
String suffix)
This method handles the backend processing of the Explain command.
|
Properties |
getConfiguration()
Returns the Properties representation of the ExecutionEngine
configuration.
|
DataStorage |
getDataStorage()
Returns the DataStorage the ExecutionEngine is using.
|
org.apache.hadoop.mapred.JobConf |
getExecConf(Properties properties) |
ExecutableManager |
getExecutableManager()
Returns the ExecutableManager to be used in Pig Streaming.
|
Map<LOForEach,Map<LogicalRelationalOperator,PhysicalOperator>> |
getForEachInnerLogToPhyMap(LogicalPlan plan) |
org.apache.hadoop.mapred.JobConf |
getJobConf()
Deprecated.
|
org.apache.hadoop.mapred.JobConf |
getLocalConf() |
Map<Operator,PhysicalOperator> |
getLogToPhyMap() |
org.apache.hadoop.mapred.JobConf |
getS3Conf() |
void |
init()
This method is responsible for the initialization of the ExecutionEngine.
|
void |
kill()
This method is called when user requests to kill all jobs
associated with the execution engine
|
void |
killJob(String jobID)
This method is called when a user requests to kill a job associated with
the given job id.
|
PigStats |
launchPig(LogicalPlan lp,
String grpName,
PigContext pc)
This method is responsible for the actual execution of a LogicalPlan.
|
void |
setConfiguration(Properties newConfiguration)
Responsible for updating the properties for the ExecutionEngine.
|
void |
setProperty(String property,
String value)
Responsible for setting a specific property and value.
|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitinstantiatePigStats, instantiateScriptStatepublic static final String HADOOP_SITE
public static final String CORE_SITE
public static final String YARN_SITE
public static final String CORE_DEFAULT_SITE
public static final String MAPRED_DEFAULT_SITE
public static final String YARN_DEFAULT_SITE
public static final String LOCAL
protected PigContext pigContext
protected DataStorage ds
protected Launcher launcher
protected Map<OperatorKey,OperatorKey> logicalToPhysicalKeys
protected Map<Operator,PhysicalOperator> newLogToPhyMap
public HExecutionEngine(PigContext pigContext)
@Deprecated public org.apache.hadoop.mapred.JobConf getJobConf()
public DataStorage getDataStorage()
ExecutionEnginegetDataStorage in interface ExecutionEnginepublic void init()
throws ExecException
ExecutionEngineinit in interface ExecutionEngineExecExceptionpublic org.apache.hadoop.mapred.JobConf getS3Conf()
throws ExecException
ExecExceptionpublic org.apache.hadoop.mapred.JobConf getLocalConf()
public org.apache.hadoop.mapred.JobConf getExecConf(Properties properties) throws ExecException
ExecExceptionpublic PhysicalPlan compile(LogicalPlan plan, Properties properties) throws FrontendException
FrontendExceptionpublic Map<Operator,PhysicalOperator> getLogToPhyMap()
public Map<LOForEach,Map<LogicalRelationalOperator,PhysicalOperator>> getForEachInnerLogToPhyMap(LogicalPlan plan)
public PigStats launchPig(LogicalPlan lp, String grpName, PigContext pc) throws FrontendException, ExecException
ExecutionEnginelaunchPig in interface ExecutionEnginelp - -- plan to compilegrpName - -- group name for submissionpc - -- context for executionExecExceptionFrontendExceptionpublic void explain(LogicalPlan lp, PigContext pc, PrintStream ps, String format, boolean verbose, File file, String suffix) throws PlanException, VisitorException, IOException, FrontendException
ExecutionEngineexplain in interface ExecutionEnginelp - -- plan to explainpc - -- context for explain processingps - -- print stream to write all output to (if dir param is null)format - -- format to print explainfile - -- directory to write output to. if not null, write to filessuffix - -- if writing to files, suffix to be used for each filePlanExceptionVisitorExceptionIOExceptionFrontendExceptionpublic Properties getConfiguration()
ExecutionEnginegetConfiguration in interface ExecutionEnginepublic void setConfiguration(Properties newConfiguration) throws ExecException
ExecutionEnginesetConfiguration in interface ExecutionEnginenewConfiguration - -- Properties object holding all configuration valsExecExceptionpublic void setProperty(String property, String value)
ExecutionEnginesetProperty in interface ExecutionEngineproperty - to updatevalue - to set for propertypublic ExecutableManager getExecutableManager()
ExecutionEnginegetExecutableManager in interface ExecutionEnginepublic void kill()
throws BackendException
ExecutionEnginekill in interface ExecutionEngineBackendExceptionpublic void killJob(String jobID) throws BackendException
ExecutionEnginekillJob in interface ExecutionEngineBackendExceptionpublic void destroy()
ExecutionEnginedestroy in interface ExecutionEngineCopyright © 2007-2017 The Apache Software Foundation