![]() It uses to split the text before send it to the vocabulary lookup table. tokenizer: is a function takes as an input a text and tokenises it.The labels_source must be text file(s), each line represents the class that the corresponding sample in the features_source file belongs to. In this case the data layer is supposed to be used in train mode or eval mode. Otherwise, the input pipline will be prepared as labeled data pipeline. labels_source (Optional): If None, the dtat layer only works in the inference mode. ![]() Each line in the file represents one sample.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |