Skip to main content
Step 14: Ensemble Scoring (Candidate Generation). Generates probability predictions for all learning agents using a target dataset (typically Out-of-Time samples). This step creates the raw evidence base used by all subsequent evaluation workers in the Selection Phase.

Parameters

inputs : AgentsPredictorInput
Custom scoring configuration. If None, resolves defaults from ‘test.ml’ state.
**kwargs : dict
Additional parameters passed to the Predictor worker.
Inputs full schema can be obtained by ctx.workers.agents_predictor.spec with main params:
inputs == None→pipeline data context
data != None→custom data for agent predictions

Returns

AgentsPredictorWorker
The populated instance of AgentsPredictorWorker.
Populates attributes into the worker context:
model→ctx.workers.agents_predictor
inputs→ctx.workers.agents_predictor.spec
result→ctx.workers.agents_predictor.result
state→ctx.workers.agents_predictor.state
stats→ctx.workers.agents_predictor.stats
fitter→ctx.workers.agents_predictor.fitter
Registers data into the datasets context:
predictions→ctx.datasets.predictions.test.agent1
predictions→ctx.datasets.predictions.test.agent2
predictions→ctx.datasets.predictions.test.agent3
predictions→ctx.datasets.predictions.test.agent4
stats→ctx.datasets.stats.agents.prediction

Examples

Defining the Project Context (Control Plane) & Project Scope:

Worker → Model → Fitter

Accessing worker’s inputs schema → parameters & types (shown in the display output):
Accessing model’s fitter options and schema → parameters & types (shown in the display output):
Executing workers with defaults → auto provided by the context:
Once worker has been executed, thus its main model has been built, we have access to all populated attributes.

Model → Fitter

Once worker has been executed, we can obtain internal fitter state and its parametrization (shown in the display output):
The fitted fitter provides all populated attributes.
In the experimenting phase, when various parametrization settings might be under testing (note that internal fitter API (fx_config) can vary with respect to chosen fitter):

Attributes

All worker attributes return None prior its execution.