Jindřich questions

Jindřich answers

• Implementation details of positional encoding in transformer model?
• Is there a maximum sequence length for the output of a transformer?
• Unsupervised finetuning of BERT for embeddings only?
• How can i use BERT fo machine Translation?
• How to use forward() method instead of model.generate() for T5 model
• How do I translate using HuggingFace from Chinese to English?
• BERT sentence embeddings from transformers
• Text normalization : Text similarity in Python. How to normalize Text spelling mismatch?
• How to get the probability of a particular token(word) in a sentence given the context
• Do I need to pre-tokenize the text first before using HuggingFace's RobertaTokenizer? (Different undersanding)