DataLoaderWorker

from AID.data.interface import DataLoaderWorker

Step 0: Data Ingestion. Initializes the pipeline by importing raw data and initializing the global dataset context. It establishes the baseline ‘raw’ state for all subsequent workers.

Parameters

inputs : DataLoaderInput

Custom input configuration (source paths, etc.). If None, uses defaults.

**kwargs : dict

Additional parameters passed to the DataLoader worker.

Inputs full schema can be obtained by ctx.workers.data_loader.spec.

Returns

DataLoaderWorker

The populated instance of DataLoaderWorker.

Populates attributes into the worker context:

`model`	→	ctx.workers.data_loader
`inputs`	→	ctx.workers.data_loader.spec
`result`	→	ctx.workers.data_loader.result
`state`	→	ctx.workers.data_loader.state
`report`	→	ctx.workers.data_loader.report
`stats`	→	ctx.workers.data_loader.stats
`fitter`	→	ctx.workers.data_loader.fitter

Registers data into the datasets context:

`data`	→	ctx.datasets.input
`data`	→	ctx.datasets.train.raw
`data`	→	ctx.datasets.test.raw
`dtypes`	→	ctx.datasets.dtypes.raw
`stats`	→	ctx.datasets.stats.raw

Examples

Defining the Project Context (Control Plane) & Project Scope:

import aidflow as aid

ctx = aid.ProjectContext()

ctx.genesis(
    project      = 'test',
    input_data   = 'test.csv',
    target       = 'target',
    yy_mm        = 'decision_date',
    yy_mm_format = '%Y-%m-%d'
)
ctx.params()

Worker → Model → Fitter

Accessing worker’s inputs schema → parameters & types (shown in the display output):

ctx.workers.data_loader.spec

Accessing model’s fitter options and schema → parameters & types (shown in the display output):

ctx.workers.data_loader.fitters

Executing worker with defaults → auto provided by the context:

ctx.workers.data_loader()

Once worker has been executed, thus its main model has been built, we have access to all populated attributes.

worker   = ctx.workers.data_loader
inputs   = worker.spec.inputs
result   = worker.result
state    = worker.state
features = worker.features
params   = worker.params
stats    = worker.stats
fitter   = worker.fitter  # jump to chosen internal fitter
...

View to model report of executed worker:

ctx.workers.data_loader.report.show()

Model → Fitter

Once worker has been executed, we can obtain internal fitter state and its parametrization (shown in the display output):

ctx.workers.data_loader.fitter

The fitted fitter provides all populated attributes.

fitter  = ctx.workers.data_loader.fitter
params_ = fitter.params
stats_  = fitter.stats

Direct choice and parametrization of internal fitter:

fx  = ctx.workers.data_loader.fitters[0]
prm = dict(
    flow_vars = ['target1', 'target2'],
    columns_subset = ['fe1', 'fe2']
)
data_loader = ctx.workers.data_loader(fx_choice = fx, fx_params = prm)

In the experimenting phase, when various targets might be under testing (note that ‘target2’ must be present in the data):

cfg = dict(
    target = 'target2',
)
data_loader = ctx.workers.data_loader(fx_config = cfg)

Attributes

All worker attributes return None prior its execution.

Attribute	Type	Description
`inputs`	`ModelInput`	Registered populated inputs containing execution timestamps and feature definitions.
`result`	`ModelResult`	Execution output payload containing model predictions and fit results.
`fitter`	`Fitter`	Underlying fitted estimator instance.
`state`	`ModelState`	Consolidated model state (fitter, choice, params, features, report, stats).
`report`	`DashboardInterface`	Interactive report interface. Call `report.show()` to render the visualization dashboard.
`stats`	`FitStats`	Performance metrics and training metadata gathered during fitting.
`features`	`TransResCols`	Feature schema dataclass required for downstream inference.
`params`	`tuple[FitParams, Parameters, ...]`	Tuple of fit settings, execution parameters, optionally transformer parameters.
`choice`	`RegGet.Choice`	Active configuration parameters including internal fitter choice (`fx_choice`).
`model_signature`	`str`	Unique hash identifier for the fitted model instance.

Execution Interface

Data Interface

Encoding Interface

Training Interface

Selection Interface

Inference Interface

Parameters

Returns

Examples

Worker → Model → Fitter

Model → Fitter

Attributes

​Parameters

​Returns

​Examples

​Worker → Model → Fitter

​Model → Fitter

​Attributes

Parameters

Returns

Examples

Worker → Model → Fitter

Model → Fitter

Attributes