Questions
Linux
Laravel
Mysql
Ubuntu
Git
Menu
HTML
CSS
JAVASCRIPT
SQL
PYTHON
PHP
BOOTSTRAP
JAVA
JQUERY
R
React
Kotlin
×
Linux
Laravel
Mysql
Ubuntu
Git
New posts in tokenize
Python: Regular Expression not working properly
Dec 09, 2025
python
regex
nlp
nltk
tokenize
Python nltk incorrect sentence tokenization with custom abbrevations
Dec 09, 2025
python
nlp
nltk
tokenize
Split the sentence into its tokens as a character annotation Python
Dec 09, 2025
python
python-3.x
nltk
tokenize
python-re
Why "is" and "to" are removed by my regular expression in NLTK RegexpTokenizer()?
Dec 08, 2025
regex
nltk
tokenize
Only Get Tokenized Sentences as Output from Stanford Core NLP
Dec 08, 2025
python
nlp
stanford-nlp
tokenize
how to use tiktoken in offline mode computer
Dec 07, 2025
python
tokenize
gpt-3
Implementing keyword comparison scheme (reverse search)
Dec 07, 2025
php
mysql
search
keyword
tokenize
C++ Tokenizer Complexity vs strtok_r
Dec 03, 2025
c++
c
tokenize
strtok
Prevent Spacy tokenizer from splitting on specific character
Dec 03, 2025
python
nlp
tokenize
spacy
I need to get a substring from a java string Tokenizer
Dec 01, 2025
java
string
netbeans
substring
tokenize
The size of tensor a (707) must match the size of tensor b (512) at non-singleton dimension 1
Nov 30, 2025
python
tensorflow
pytorch
tokenize
bert-language-model
Tokenize a String and Keep Delimiters Using Regular Expression in C++
Nov 27, 2025
c++
regex
tokenize
Tokenize string with space separated values unless values are wrapped in single quotes
Nov 24, 2025
javascript
string
split
tokenize
solr autosuggest with diacritics
Nov 19, 2025
solr
tokenize
diacritics
autosuggest
How to make string formatting mechanism in Java?
Nov 19, 2025
java
tokenize
RegEx disallow a character unless escaped
Nov 19, 2025
javascript
regex
parsing
arguments
tokenize
AttributeError: 'Tokenizer' object has no attribute 'oov_token' in Keras
Nov 17, 2025
python
nlp
keras
pickle
tokenize
How to tokenize python code using the Tokenize module?
Nov 06, 2025
python-3.x
tokenize
Some doubts about SentencePiece
Nov 03, 2025
tokenize
sentencepiece
byte-pair-encoding
utf8 "\xFF" does not map to Unicode at tokenizer.perl line 44, <STDIN> line 1.
Oct 30, 2025
perl
unicode
utf-8
tokenize
Older Entries »