xpark.dataset.from_numpy

xpark.dataset.from_numpy(ndarrays: ndarray | List[ndarray]) → Dataset

Creates a Dataset from a list of NumPy ndarrays.

The column name defaults to “data”.

Examples

>>> import numpy as np
>>> import xpark
>>> arr = np.array([1])
>>> xpark.dataset.from_numpy(arr)
Dataset(num_blocks=1, num_rows=1, schema={data: int64})

Create a Xpark Datasetset from a list of NumPy arrays.

>>> xpark.dataset.from_numpy([arr, arr])
Dataset(num_blocks=2, num_rows=2, schema={data: int64})

Parameters:

ndarrays – A NumPy ndarray or a list of NumPy ndarrays.

Returns:

Dataset holding data from the given ndarrays.