xpark.dataset.from_blocks

xpark.dataset.from_blocks(blocks: List[pyarrow.Table | pandas.DataFrame])

Create a Dataset from a list of blocks.

This method is primarily used for testing. Unlike other methods like from_pandas() and from_arrow(), this method gaurentees that it won’t modify the number of blocks.

Parameters:

blocks – List of blocks to create the dataset from.

Returns:

A Dataset holding the blocks.

DeveloperAPI: This API may change across minor Xpark releases.