Ruby - fastest way to select items that belong to two arrays by nested attribute -

-

my ruby query slow. i'm looking faster way select items belong 2 arrays

lista list of objecta attribute name

listb list of objectb attribute name

there can multiple items in lista have same name, nothing in listb same name. there items in lista names not in listb. want function (loop) return items in lista name in listb.

this current solution, it's slow. how can make faster ?

z = 0 new = [] while z < listb.length      hold = lista.select{|obj| obj.name == listb[z].name}     new += hold     z += 1 end

you want maximise lookup speed. best speed can reach lookup o(1) using hashes. method described below 1000x faster code , 350x faster loop include? n=10000

edit 2 : this link explains more in detail why hash lookup fast.

names = {} listb.each{|item| names[item.name] = true} result = lista.select{|item| names[item.name]}

edit : updates benchmark.

  • 03/08/2015 - added user12341234 set method

benchmark code

class myobject   def initialize(name)     @name = name   end    def name     @name   end end  n=10000 k=n/10  lista = (1..n).map{ myobject.new(('a'..'z').to_a.shuffle[0,8].join)} listb = lista.sample(k) listb += (1..(n-k)).map{ myobject.new(('a'..'z').to_a.shuffle[0,8].join)}  require 'benchmark' require 'set'  benchmark.bm |x|     x.report("hash")         names = {}         listb.each{|item| names[item.name] = true}         result = lista.select{|item| names[item.name]}     end      x.report("op's code")         z = 0         new = []         while z < listb.length              hold = lista.select{|obj| obj.name == listb[z].name}             new += hold             z += 1         end     end      x.report("include")       names = listb.map(&:name)       lista.select{|obj| names.include?(obj.name) }     end      x.report("set")          names = listb.map(&:name).to_set         lista.select{|item| names.include?(item.name)}     end end

benchmark

specs :

  • intel core i7 920 @ 2.67 ghz
  • 13 gb ram
  • windows 8 x64
  • ruby 21 x64

results :

algorithm       user     system      total        real hash         0.015000   0.000000   0.015000 (  0.013002) op's code   26.053000   0.016000  26.069000 ( 26.161283) include      9.219000   0.000000   9.219000 (  9.244161) set          0.016000   0.000000   0.016000 (  0.013001)

Comments

Post a Comment

Popular posts from this blog

python - jinja2: TemplateSyntaxError: expected token ',', got 'string' -

-
i new jinja2 , having issue using python regular expression (re). in following code bold lines have error string in them. {% block content %} <div class="container"> {% l in lines %} {% if re.search(r"error", l) %} {# <<< throws error #} <b> {{ l }} </b> {% else %} {{ l }} <hr> {% endif %} {% endfor %} </div> {% endblock %} the re.search above throws following error: jinja2.exceptions.templatesyntaxerror templatesyntaxerror: expected token ',', got 'string' raw python code not supported in jinja2 template syntax. {% if re.search(r"error", l) %} replace line with {% if "error" in l %} can fix problem. if logical condition more complicated, should consider defining own custom filters (which can call python code) or complicated things in view layer. go check global namespace .
Read more

node.js - NodeJS remote terminal to Dropbear OpenWRT-Server -

-
i wandering whether there valid solution have remote terminal openwrt-box out of nodejs-app? connecting terminal works: ssh -i ~/.mykeys/id_rsa root@192.168.178.39 busybox v1.23.2 (2015-04-22 23:25:48 utc) built-in shell (ash) root@openwrt:~# the only interactive ssh solution nodejs doesn't interactive part described in readme.md following: var client = require('ssh2').client; var conn = new client(); conn.on('ready', function() { console.log('client :: ready'); conn.shell(function(err, stream) { if (err) throw err; stream.on('close', function() { console.log('stream :: close'); conn.end(); }).on('data', function(data) { console.log('stdout: ' + data); }).stderr.on('data', function(data) { console.log('stderr: ' + data); }); stream.end('ls -l\nexit\n'); }); }).connect({ host: '192.168.100.100', port: 22, username...
Read more

Qt4: how to send QString inside a struct via QSharedMemory -

-
i have struct struct control_data{ int column_number; qstring cell; }; i need send thread of qsharememory. read can't because qstring contains pointers inside. other ways? you have serialize struct byte array. can convert qstring const char* this: mystring.tostdstring().c_str(); but serializing qstring should work. the first step serialize struct qdatastream using qt, example here . then once struct can read , written can pass shared memory. a complete example of using qsharedmemory can found here . here relevant code: // first, test whether shared memory segment attached process. // if so, detach if (sharedmem.isattached()) { sharedmem.detach(); } ... qbuffer buffer; buffer.open( qbuffer::readwrite ); qdatastream out( &buffer ); out << youstruct; int size = buffer.size(); // size of int + size of qstring in bytes if ( !sharedmem.create( size ) ) { return; } // write shared memory sharedmem.lock(); char *to = (char*...
Read more