CSVDatasetBlockDataStore

Documentation for eth_defi.event_reader.csv_block_data_store.CSVDatasetBlockDataStore Python class.

class CSVDatasetBlockDataStore[source]

Store block data as CSV file.

Methods summary

__init__(path)

param path

floor_block_number_to_partition_start(n)

is_virgin()

Has this store any stored data.

load([since_block_number])

Load data from CSV file

peak_last_block()

Return the last block number stored on the disk.

save(df[, since_block_number, ...])

Save all data to CSV file.

save_incremental(df)

Write all partitions we are missing from the data.

__init__(path)[source]
Parameters

path (pathlib.Path) – Path to the CSV file

is_virgin()[source]

Has this store any stored data.

Returns

There is data to load.

Return type

bool

load(since_block_number=0)[source]

Load data from CSV file

Parameters

since_block_number (int) – Ignored

Return type

pandas.core.frame.DataFrame

save(df, since_block_number=0, check_contains_all_blocks=True)[source]

Save all data to CSV file.

Parameters
  • since_block_number (int) – Ignored. Does not support incremental writing.

  • check_contains_all_blocks – Check that we have at least one data record for every block. Note that trades might not happen on every block.

  • df (pandas.core.frame.DataFrame) –

save_incremental(df)[source]

Write all partitions we are missing from the data.

Parameters

df (pandas.core.frame.DataFrame) –

Return type

Tuple[int, int]

peak_last_block()[source]

Return the last block number stored on the disk.

Return type

Optional[int]