Skip to content
voiage

voiage.ingestion.cli.normalize

normalize

Section titled “normalize”
normalize([positional or keyword] descriptor: Path = typer.Argument(..., exists=True, readable=True), [positional or keyword] output: Path = typer.Option(..., '--output', '-o'), [positional or keyword] source_root: Path | None = typer.Option(None, '--source-root', file_okay=False, exists=True, readable=True, help='Explicit local root allowed for declared resources.'), [positional or keyword] offline: bool = typer.Option(False, '--offline', help='Require an offline replay.'), [positional or keyword] cache_dir: Path | None = typer.Option(None, '--cache-dir', help='Verified materialization cache directory.'), [positional or keyword] max_resource_bytes: int = typer.Option(512 * 1024 * 1024, '--max-resource-bytes', min=1), [positional or keyword] max_resource_rows: int = typer.Option(10000000, '--max-resource-rows', min=1), [positional or keyword] provider: str | None = typer.Option(None, '--provider', help='Require this registered provider ID for the descriptor.'), [positional or keyword] record_set: str | None = typer.Option(None, '--record-set', help='Explicit Croissant recordSet name.'), [positional or keyword] distribution: str | None = typer.Option(None, '--distribution', help='Explicit Croissant distribution @id.')) -> None

Normalize a descriptor into a deterministic Arrow IPC file.

Parameters:

  • descriptor Path (default: typer.Argument(..., exists=True, readable=True))
  • output Path (default: typer.Option(..., '--output', '-o'))
  • source_root Path | None (default: typer.Option(None, '--source-root', file_okay=False, exists=True, readable=True, help='Explicit local root allowed for declared resources.'))
  • offline bool (default: typer.Option(False, '--offline', help='Require an offline replay.'))
  • cache_dir Path | None (default: typer.Option(None, '--cache-dir', help='Verified materialization cache directory.'))
  • max_resource_bytes int (default: typer.Option(512 * 1024 * 1024, '--max-resource-bytes', min=1))
  • max_resource_rows int (default: typer.Option(10000000, '--max-resource-rows', min=1))
  • provider str | None (default: typer.Option(None, '--provider', help='Require this registered provider ID for the descriptor.'))
  • record_set str | None (default: typer.Option(None, '--record-set', help='Explicit Croissant recordSet name.'))
  • distribution str | None (default: typer.Option(None, '--distribution', help='Explicit Croissant distribution @id.'))

Returns: None