Skip to content

voiage.core.memory_optimization.chunked_computation

chunked_computation([positional or keyword] func: Callable[[np.ndarray], object] = None, [positional or keyword] data: np.ndarray = None, [positional or keyword] chunk_size: int | None = None, [positional or keyword] memory_optimizer: MemoryOptimizer | None = None) -> list[object]

Perform computation on data in chunks to reduce memory usage.

Args: func: Function to apply to each chunk data: Input data array chunk_size: Size of each chunk. If None, determined automatically. memory_optimizer: MemoryOptimizer instance. If None, creates a new one.

list[object]: List of results from each chunk

Parameters:

  • func Callable[[np.ndarray], object]
  • data np.ndarray
  • chunk_size int | None (default: None)
  • memory_optimizer MemoryOptimizer | None (default: None)

Returns: list[object]