string - R: producing a list of near matches with stringdist and stringdistmatrix -

-

i discovered excellent package "stringdist" , want use compute string distances. in particular have set of words, , want print out near-matches, "near match" through algorithm levenshtein distance.

i have extremely slow working code in shell script, , able load in stringdist , produce matrix metrics. want boil down matrix smaller matrix has near matches, e.g. metric non-zero less threshold.

kp <-  c('leaflet','leafletr','lego','levenshtein-distance','logo') kpm <- stringdistmatrix(kp,usenames="strings",method="lv") > kpm                      leaflet leafletr lego levenshtein-distance leafletr                   1                                    lego                       5        6                           levenshtein-distance      16       16   18                      logo                       6        7    1                   19 m = as.matrix(kpm) close = apply(m, 1, function(x) x>0 & x<5) >  close                      leaflet leafletr  lego levenshtein-distance  logo  leaflet                false     true false                false false  leafletr                true    false false                false false  lego                   false    false false                false  true  levenshtein-distance   false    false false                false false  logo                   false    false  true                false false

ok, have (big) dist, how reduce list output like

leafletr,leaflet,1 logo,lego,1

for cases metric non-zero , less n=5? found "apply()" lets me test, need sort out how use it.

the problem not specific stringdist , stringdistmatrix , elementary r, still i'm stuck. suspect answer involves subset(), don't know how transform "dist" else.

you can this:

library(reshape2) d <- unique(melt(m)) out <- subset(d, value > 0 & value < 5)

here, melt brings m long form (2 columns string names , 1 column value). however, since we've melted symmetric matrix, use unique de-duplication.

another way use dplyr (since cool kids using dplyr pipes now):

library(dlpyr) library(reshape2) library(magrittr)  out <- melt(m) %>% distinct() %>% filter(value > 0 & value < 5)

this second option faster have not timed it.


Comments

Post a Comment

Popular posts from this blog

python - jinja2: TemplateSyntaxError: expected token ',', got 'string' -

-
i new jinja2 , having issue using python regular expression (re). in following code bold lines have error string in them. {% block content %} <div class="container"> {% l in lines %} {% if re.search(r"error", l) %} {# <<< throws error #} <b> {{ l }} </b> {% else %} {{ l }} <hr> {% endif %} {% endfor %} </div> {% endblock %} the re.search above throws following error: jinja2.exceptions.templatesyntaxerror templatesyntaxerror: expected token ',', got 'string' raw python code not supported in jinja2 template syntax. {% if re.search(r"error", l) %} replace line with {% if "error" in l %} can fix problem. if logical condition more complicated, should consider defining own custom filters (which can call python code) or complicated things in view layer. go check global namespace .
Read more

node.js - NodeJS remote terminal to Dropbear OpenWRT-Server -

-
i wandering whether there valid solution have remote terminal openwrt-box out of nodejs-app? connecting terminal works: ssh -i ~/.mykeys/id_rsa root@192.168.178.39 busybox v1.23.2 (2015-04-22 23:25:48 utc) built-in shell (ash) root@openwrt:~# the only interactive ssh solution nodejs doesn't interactive part described in readme.md following: var client = require('ssh2').client; var conn = new client(); conn.on('ready', function() { console.log('client :: ready'); conn.shell(function(err, stream) { if (err) throw err; stream.on('close', function() { console.log('stream :: close'); conn.end(); }).on('data', function(data) { console.log('stdout: ' + data); }).stderr.on('data', function(data) { console.log('stderr: ' + data); }); stream.end('ls -l\nexit\n'); }); }).connect({ host: '192.168.100.100', port: 22, username...
Read more

Qt4: how to send QString inside a struct via QSharedMemory -

-
i have struct struct control_data{ int column_number; qstring cell; }; i need send thread of qsharememory. read can't because qstring contains pointers inside. other ways? you have serialize struct byte array. can convert qstring const char* this: mystring.tostdstring().c_str(); but serializing qstring should work. the first step serialize struct qdatastream using qt, example here . then once struct can read , written can pass shared memory. a complete example of using qsharedmemory can found here . here relevant code: // first, test whether shared memory segment attached process. // if so, detach if (sharedmem.isattached()) { sharedmem.detach(); } ... qbuffer buffer; buffer.open( qbuffer::readwrite ); qdatastream out( &buffer ); out << youstruct; int size = buffer.size(); // size of int + size of qstring in bytes if ( !sharedmem.create( size ) ) { return; } // write shared memory sharedmem.lock(); char *to = (char*...
Read more