Jul 25, 2019 · Collator spCollator = Collator.getInstance(new Locale("es", "ES")); I expect the output to be a sublist sorted by alphabetical order by the property which you can access with …

Mar 12, 2024 · What should collator do exactly? Asked 1 year, 9 months ago Modified 1 year, 9 months ago Viewed 242 times

Apr 20, 2022 · If you look at this, you'll see that their collator uses the return_tensors="tf" argument. If you add this to your collator, your code for using the collator will work. In short, …

31 I think this what you should be using - Collator The Collator class performs locale-sensitive String comparison. You use this class to build searching and sorting routines for natural …

Aug 10, 2023 · I have some custom data set with custom table entries and wanted to deal with it with a custom collate. But it didn't work when I pass a collate function I wrote (that DOES work …

Sep 26, 2023 · As a result even though each sample in your train_dataset has all the keys, when you send that to data_collator(), the .trainer() automatically removes the unknown columns.

Feb 2, 2023 · I have issues combining a DataLoader and DataCollator. The following code with DataCollatorWithPadding results in a ValueError: Unable to create tensor, you should probably …

Aug 8, 2023 · 1 I have a similar issue. I think you're forgetting to add formatting_func function. Also, by default setting dataset_text_field overrides the use of the collator, so try without that …

Dec 13, 2020 · Basically, the collate_fn receives a list of tuples if your __getitem__ function from a Dataset subclass returns a tuple, or just a normal list if your Dataset subclass returns only one …

Dec 6, 2011 · return compare(s1, s2) == Collator.Equal; This method calls the one that is used for sorting and check if strings are the same. They are not, because Danish specific collation rules …