Alex Rivera | Logout

Questions tagged tokenize

17 questions

Sort by: Newest Votes Active
67
votes
2
answers

How do I tokenize a string sentence in NLTK?

python nlp tokenize nltk
asked 2013-02-24T23:26:12.900
10
votes
3
answers

listunagg function?

string oracle-database csv oracle11g tokenize
asked 2012-11-02T05:02:47.703
9
votes
2
answers

Split tokens on string using Regex in c#

c# regex split tokenize
asked 2012-10-13T17:57:53.257
15
votes
6
answers

Java StringTokenizer.nextToken() skips over empty fields

java string tokenize
asked 2012-07-10T08:22:35.723
72
votes
4
answers

Split string with PowerShell and do something with each token

string powershell tokenize
asked 2012-07-05T16:20:17.087
11
votes
1
answers

Is there way to boost original term more while using Solr synonyms?

solr tokenize synonym solr-schema
asked 2012-05-18T22:44:59.377
13
votes
7
answers

Split a string using whitespace in Javascript?

javascript tokenize
asked 2012-02-22T19:50:03.763
12
votes
3
answers

Boost::Split using whole string as delimiter

c++ string boost tokenize
asked 2011-09-15T20:17:55.503
9
votes
4
answers

what does regular in regex/"regular expression" mean?

regex perl parsing tokenize
asked 2011-01-26T14:47:48.987
10
votes
1
answers

Parser vs. lexer and XML

xml parsing tokenize lexer dfa
asked 2010-09-02T02:07:15.080
9
votes
2
answers

How to tokenize Perl source code?

perl tokenize
asked 2010-08-19T09:08:14.930
24
votes
5
answers

Is there a better (more modern) tool than lex/flex for generating a tokenizer for C++?

c++ windows lex tokenize
asked 2010-01-30T23:01:13.480
17
votes
5
answers

tokenize a string keeping delimiters in Python

python string split tokenize
asked 2009-11-30T15:02:38.163
15
votes
4
answers

Int tokenizer

c++ tokenize
asked 2009-07-17T06:55:13.230
15
votes
3
answers

shlex alternative for Java

java bash shell tokenize
asked 2009-07-04T20:52:37.707
39
votes
6
answers

What is more efficient a switch case or an std::map

c++ parsing tokenize
asked 2009-05-31T11:46:41.617
9
votes
7
answers

Trim string to length ignoring HTML

html string truncate tokenize
asked 2009-04-09T22:50:14.700