Storage

class olympus.utils.storage.BaseStorage(*args, **kwargs)

Bases: object

Methods

exits
garbage_collect
garbage_collect_in_memory
garbage_collect_on_disk
load
open
read
safe_load
save
set_base
show_memory_usage
write

exits(self, *args, **kwargs)

garbage_collect(self, *args, **kwargs)

garbage_collect_in_memory(self, *args, **kwargs)

garbage_collect_on_disk(self, *args, **kwargs)

load(self, *args, **kwargs)

open(self, *args, **kwargs)

read(self, *args, **kwargs)

safe_load(self, *args, **kwargs)

save(self, *args, **kwargs)

set_base(self, *args, **kwargs)

show_memory_usage(self)

write(self, *args, **kwargs)

olympus.utils.storage.NoStorage(*args, **kwargs)

class olympus.utils.storage.StateStorage(folder='/tmp', time_buffer=300)

Bases: olympus.utils.storage.BaseStorage

Methods

load(self, filename[, device])	Parameters:
safe_load(self, name, device)	Handles a few common exceptions for you and returns None if a file is not found

exits
garbage_collect
garbage_collect_in_memory
garbage_collect_on_disk
open
read
save
set_base
show_memory_usage
write

Kio = 1024

Mio = 1048576

USE_IN_MEMORY_CACHE = False

exits(self, filename)

garbage_collect(self, gc_time)

garbage_collect_in_memory(self, gc_time)

garbage_collect_on_disk(self, gc_time)

load(self, filename, device=None)

Parameters:

filename: str

file to load the state from

device: torch.device

it indicates the location where all tensors should be loaded.

open(self, filename, mode)

read(self, filename)

safe_load(self, name, device)

Handles a few common exceptions for you and returns None if a file is not found

save(self, filename, state)

set_base(self, folder)

show_memory_usage(self)

write(self, filename, data)