Data Source Mode / Frequency
Current group: Data Source Mode / Frequency
This group starts the Layer 1 hierarchy. Choose the data source mode first: FRED data only, custom data only, or FRED data plus custom data. Then close the analysis frequency. A FRED source-panel choice is shown only when the selected mode uses FRED data.
Custom files are not FRED panels. If the study uses a custom file, provide
leaf_config.custom_source_path. The parser is inferred from the file
extension. The schema is inferred from the file frequency and source mode; the
user should not have to choose a fake FRED-MD/FRED-QD route for custom-only data.
frequency is the final calendar frequency of the Layer 1 source frame. It is
derived for FRED-MD, FRED-QD, and composite FRED panels. It is required for
standalone FRED-SD and custom-only data.
For the current FRED-MD, FRED-QD, and FRED-SD column dictionaries, use 5. FRED-Dataset. This page only defines which source route Layer 1 loads.
Axis |
Choices |
Default / rule |
|---|---|---|
|
|
Default is |
|
|
FRED source-panel choice. Active only when source mode uses FRED data. |
|
|
Derived for FRED-MD/QD/composites. Required for standalone FRED-SD and custom-only data. |
Contracts:
fred_mdandfred_md+fred_sdare monthly.fred_qdandfred_qd+fred_sdare quarterly.standalone
fred_sdmust choose monthly or quarterly because the source contains mixed native frequencies.custom_source_policy: official_onlymeans FRED data only. It requires noleaf_config.custom_source_path;datasetselects the FRED loader.custom_source_policy: custom_panel_onlymeans custom data only. It loads a custom file as the source panel. The UI should ask for file path and frequency, not for a FRED source panel.custom_source_policy: official_plus_customloads the selected FRED panel and appends custom columns. It can be used with single or composite FRED panel routes.User-supplied files are configured with
custom_source_policyplusleaf_config.custom_source_path, not asdatasetvalues.custom sources require
leaf_config.custom_source_path. The compiler inferscsvfrom.csvandparquetfrom.parquet/.pq. Legacy recipes may still setfixed_axes.custom_source_formatwhen a path has no extension.Custom CSV/Parquet schema contract:
first column, or Parquet index, is a parseable date index;
remaining columns are numeric series;
for
custom_panel_only, the target y column must exist in the file;predictor x columns are all non-target numeric columns unless the recipe supplies explicit custom x lists in
leaf_config;appended custom columns may use new names, but duplicate names are renamed with a
__customsuffix at runtime.
In practical terms, a custom file is acceptable if its date index, column shape, and row frequency already match the selected Layer 1 frequency. Monthly routes expect monthly rows. Quarterly routes expect quarterly rows.
Data revision/vintage status is selected later by 4.1.2 Forecast-Time Information, not by the source mode itself.
FRED metadata axes are hidden by default for custom-only studies:
dataset,information_set_type,release_lag_rule,variable_universe,official_transform_policy, andofficial_transform_scope. The same-period predictor rule remains visible because custom files can still define nowcasting-style contemporaneous x availability.variable_universe,official_transform_policy, andofficial_transform_scopeare also hidden by default for standalone FRED-SD, because those axes are FRED-MD/QD metadata controls. FRED-SD uses the dedicated state and series scope controls in 4.1.4 FRED-SD Predictor Scope.
Warning: Custom files are user-supplied source data. The Navigator can enforce the route contract, but it cannot prove that the file’s date index, frequency, column naming, vintage discipline, or T-code handling is correct. Check this page before running custom-source recipes.
Custom file shape by selected Layer 1 frequency:
Selected |
Expected file shape |
Internal loader label |
|---|---|---|
|
Monthly date index, numeric series columns. Column names may be FRED IDs or study-specific IDs. |
Generic monthly custom panel. |
|
Quarterly date index, numeric series columns. Column names may be FRED IDs or study-specific IDs. |
Generic quarterly custom panel. |
Additional custom-source fields:
Field |
Where |
Required when |
Meaning |
|---|---|---|---|
|
|
|
Local file path. This is not an enum axis because it is study-specific. |
Compatibility fields:
Field |
Status |
Meaning |
|---|---|---|
|
hidden legacy fixed axis |
Optional override for extensionless files; otherwise inferred from |
|
hidden legacy fixed axis |
Optional override for older recipes; otherwise inferred from source mode and |
Minimal YAML:
path:
1_data_task:
fixed_axes:
dataset: fred_md
custom_source_policy: official_only
information_set_type: final_revised_data
leaf_config:
target: INDPRO
horizons: [1, 3, 6]
sample_start_date: "1980-01"
sample_end_date: "2019-12"
Replace FRED-MD with a custom CSV:
path:
1_data_task:
fixed_axes:
custom_source_policy: custom_panel_only
frequency: monthly
information_set_type: final_revised_data
leaf_config:
target: INDPRO
horizons: [1]
custom_source_path: /path/to/panel.csv
Append custom state-level columns to FRED-MD:
path:
1_data_task:
fixed_axes:
dataset: fred_md
custom_source_policy: official_plus_custom
frequency: monthly
information_set_type: final_revised_data
leaf_config:
target: INDPRO
horizons: [1, 3, 6]
custom_source_path: /path/to/custom_state_panel.parquet