hadoop - How can I automate Azure Spark from c#? -

-

i can create cluster how automate scripts?

  var clusterinfo = new clustercreateparametersv2             {                 name = clusterconfig.clustername,                 ...                 clustertype = clustertype.spark             };`

cluster.runscript() ?

can sparkcontext?

https://azure.microsoft.com/en-us/documentation/articles/hdinsight-apache-spark-use-bi-tools/

today use livy server on hdinsight spark cluster on linux.

see documetation here: https://azure.microsoft.com/en-us/documentation/articles/hdinsight-apache-spark-livy-rest-interface/


Comments

Post a Comment

Popular posts from this blog

Qt4: how to send QString inside a struct via QSharedMemory -

-
i have struct struct control_data{ int column_number; qstring cell; }; i need send thread of qsharememory. read can't because qstring contains pointers inside. other ways? you have serialize struct byte array. can convert qstring const char* this: mystring.tostdstring().c_str(); but serializing qstring should work. the first step serialize struct qdatastream using qt, example here . then once struct can read , written can pass shared memory. a complete example of using qsharedmemory can found here . here relevant code: // first, test whether shared memory segment attached process. // if so, detach if (sharedmem.isattached()) { sharedmem.detach(); } ... qbuffer buffer; buffer.open( qbuffer::readwrite ); qdatastream out( &buffer ); out << youstruct; int size = buffer.size(); // size of int + size of qstring in bytes if ( !sharedmem.create( size ) ) { return; } // write shared memory sharedmem.lock(); char *to = (char*...
Read more

node.js - NodeJS remote terminal to Dropbear OpenWRT-Server -

-
i wandering whether there valid solution have remote terminal openwrt-box out of nodejs-app? connecting terminal works: ssh -i ~/.mykeys/id_rsa root@192.168.178.39 busybox v1.23.2 (2015-04-22 23:25:48 utc) built-in shell (ash) root@openwrt:~# the only interactive ssh solution nodejs doesn't interactive part described in readme.md following: var client = require('ssh2').client; var conn = new client(); conn.on('ready', function() { console.log('client :: ready'); conn.shell(function(err, stream) { if (err) throw err; stream.on('close', function() { console.log('stream :: close'); conn.end(); }).on('data', function(data) { console.log('stdout: ' + data); }).stderr.on('data', function(data) { console.log('stderr: ' + data); }); stream.end('ls -l\nexit\n'); }); }).connect({ host: '192.168.100.100', port: 22, username...
Read more

node.js - On Gitbash - Bower : ENOGIT git is not installed or not in the PATH -

-
Image
i have project bower.json file , im trying load it's bower libraries on windows. turn on gitbash, cd project directory , type in bower install / bower update. receive error: bower enogit git not installed or not in path but there path git: $ git /bin/git so wierd thing works in cmd on windows, but doesnt work gitbash . value have in system path env variable regarding git: c:\program files (x86)\develop\vcs\git\cmd i tried re-install msysgit , chose option: run git windows command prompt so: it still doesnt seem work.. bower version: $ bower --version 1.4.1 git version: $ git --version git version 1.9.5.msysgit.1 bower installed globally using npm edit: found cause of issue: have file in profile home directory .bashrc use in order define general aliases , on , added line: export path="~/appdata/roaming/composer/vendor/bin":$path and somehow when line present receive error in gitbash, wierd though, add path global composer packag...
Read more