BPTTLanguageModelDataHandler.Config

Component: BPTTLanguageModelDataHandler

class BPTTLanguageModelDataHandler.Config[source]

Bases: DataHandler.Config

Configuration class for BPTTLanguageModelDataHandler.

columns_to_read

List[str] – List containing the names of the columns to read from the data files.

bptt_len

int – Input sequence length to backpropagate to.

All Attributes (including base classes)

columns_to_read: List[str] = ['text']
shuffle: bool = True
sort_within_batch: bool = True
train_path: str = 'train.tsv'
eval_path: str = 'eval.tsv'
test_path: str = 'test.tsv'
train_batch_size: int = 128
eval_batch_size: int = 128
test_batch_size: int = 128
bptt_len: int = 35

Default JSON

{
    "columns_to_read": [
        "text"
    ],
    "shuffle": true,
    "sort_within_batch": true,
    "train_path": "train.tsv",
    "eval_path": "eval.tsv",
    "test_path": "test.tsv",
    "train_batch_size": 128,
    "eval_batch_size": 128,
    "test_batch_size": 128,
    "bptt_len": 35
}