How to handle sequences longer than 512 tokens in layoutLMV3?

Question

How to work with sequences longer than 512 tokens. I don't wanted to use truncates =True. But actually wanted to handle the longer sequences

Answer 1

You can use the stride with max length parameter to handle the larger documents.

encoding = processor(images, words, boxes=boxes, word_labels=word_labels, truncation=True,padding="max_length", max_length = 512, stride = 128, return_overflowing_tokens = True,return_offsets_mapping = True)

This would help to handle the larger files.

Let me know if this is useful.