Logo Questions Linux Laravel Mysql Ubuntu Git Menu
HTML CSS JAVASCRIPT SQL PYTHON PHP BOOTSTRAP JAVA JQUERY R React Kotlin
 

New posts in huggingface-transformers

How does one set the pad token correctly (not to eos) during fine-tuning to avoid model not predicting EOS?

machine-learning pytorch huggingface-transformers huggingface huggingface-tokenizers

How to use Huggingface Trainer with multiple GPUs?

machine-learning pytorch huggingface-transformers huggingface

Transformers PreTrainedTokenizer add_tokens Functionality

pytorch bert-language-model huggingface-transformers

Using HuggingFace pipeline on pytorch mps device M1 pro

nlp pytorch huggingface-transformers

Why does the ProtBERT model generate identical embeddings for all non-whitespace-separated (single token?) inputs?

python nlp bioinformatics huggingface-transformers bert-language-model

How to install pip install torch==2.1.2+cu118 in linux?

pytorch huggingface-transformers dspy vllm

what is the difference between len(tokenizer) and tokenizer.vocab_size

nlp tokenize huggingface-transformers huggingface-tokenizers

The last dimension of the inputs to a Dense layer should be defined. Found None. Full input shape received: <unknown>

python tensorflow keras huggingface-transformers sentence-transformers

How can I make sentence-BERT throw an exception if the text exceeds max_seq_length, and what is the max possible max_seq_length for all-MiniLM-L6-v2?

nlp huggingface-transformers bert-language-model huggingface-tokenizers sentence-transformers

Huggingface MarianMT translators lose content, depending on the model

python huggingface-transformers huggingface-tokenizers machine-translation

How to efficiently mean-pool BERT embeddings while excluding padding?

pytorch nlp huggingface-transformers

HuggingFace's linear scheduler with warmup parameters

optimization huggingface-transformers

Tokenizer.from_file() HUGGINFACE : Exception: data did not match any variant of untagged enum ModelWrapper

json nlp huggingface-transformers huggingface-tokenizers huggingface

Input type into Linear4bit is torch.float16, but bnb_4bit_compute_type=torch.float32 (default). This will lead to slow inference or training speed

pytorch huggingface-transformers large-language-model llama

How to Load a 4-bit Quantized VLM Model from Hugging Face with Transformers?

python nlp huggingface-transformers huggingface quantization

Loading checkpoint shards takes too long

huggingface-transformers h2o huggingface huggingface-tokenizers llama

Huggingface AutoTokenizer can't load from local path

huggingface-transformers

what is so special about special tokens?

nlp tokenize huggingface-transformers bert-language-model huggingface-tokenizers

Transformers pretrained model with dropout setting

python bert-language-model huggingface-transformers
Older Entries »