voiage.ingestion.base.SourceAccessPolicy
Fail-closed local source policy for descriptor-relative resources.
Methods
Section titled “Methods”validate_tabular_batch
Section titled “validate_tabular_batch”validate_tabular_batch([positional or keyword] self: None = None, [keyword-only] batch_rows: int = None, [keyword-only] total_rows: int = None) -> NoneReject an oversized parsed batch before it becomes an Arrow table.
Built-in delimited-text providers use Arrow’s streaming CSV reader and call this method for each record batch before retaining it. This keeps the policy at the source boundary rather than letting an unbounded table reach normalization or calculation code.
Parameters:
selfbatch_rowsinttotal_rowsint
Returns: None
resolve
Section titled “resolve”resolve([positional or keyword] self: None = None, [positional or keyword] reference: str = None) -> PathResolve a relative local reference without allowing path traversal.
Parameters:
selfreferencestr
Returns: Path
materialize
Section titled “materialize”materialize([positional or keyword] self: None = None, [positional or keyword] reference: str = None, [keyword-only] sha256: str | None = None, [keyword-only] byte_size: int | None = None) -> PathReturn a digest-verified local materialization, optionally from cache.
This method never performs network I/O. Offline replay is intentionally possible only with an expected digest, so a mutable source cannot be silently substituted for a previously reviewed materialization.
Parameters:
selfreferencestrsha256str | None(default:None)byte_sizeint | None(default:None)
Returns: Path
source_uri
Section titled “source_uri”source_uri([positional or keyword] self: None = None, [positional or keyword] reference: str = None) -> strReturn the validated logical local URI without requiring the source.
Parameters:
selfreferencestr
Returns: str