apache spark - Environment issue in moving from protobuf version 2.4 to 2.5 -

-

i have generated protobuf code using compiler 2.4. , have created application jar. works fine , can run spark job. jars in classpath of spark relevant protobuf 

 mesos-0.18.1-shaded-protobuf.jar,  protobuf-java-2.5.0-spark.jar

but when use same generated code in sbt unit testing failing 

  [info]   org.apache.spark.sparkexception: job aborted due stage           failure: task 0 in stage 2.0 failed 1 times, recent failure:    lost task 0.0 in stage 2.0 (tid 2, localhost):        java.lang.unsupportedoperationexception: supposed overridden subclasses.                                                            [info]  @ com.google.protobuf.generatedmessage.getunknownfields(generatedmessage.java:180)

from google search found need change protoc compiler version 2.5 , unit testing works fine . application not able run in spark . exception 

  java.lang.verifyerror: class xxx.xxx.xx..    overrides final method getunknownfields.()lcom/google/protobuf/unknownfieldset;

the machine application runs , sbt test runs different

class path in sbt contains

  protobuf-java-2.5.0.jar   protobuf-java-2.5.0-spark.jar

i had in pom file mesos-0.18.1-shaded-protobuf.jar shows contains google-protobuf version 2.5 .

the questions problem in environment causing issue ?

basically protocol buffers 2.5, several methods went being defined final in protocol buffers library code being in generated code. means code generated protoc 2.4 can not used protocol buffers 2.5 libraries , vice versa

as correctly identified

  java.lang.unsupportedoperationexception: supposed overridden classes.                                                              [info]  @   com.google.protobuf.generatedmessage.getunknownfields(generatedmessage.java:180)

is message when run code generated protoc 2.4 libraries protocol buffers 2.5

the message

java.lang.verifyerror: class xxx.xxx.xx..  overrides final method getunknownfields.()lcom/google/protobuf/unknownfieldset;

is message when run code generated protoc 2.5 libraries protocol buffers 2.4.

see: error serialization protobuf


Comments

Post a Comment

Popular posts from this blog

qt - Using float or double for own QML classes -

-
i've created components , helper methods using c++ , qt used in qml gui. of methods calculate gui elements (size, transformations, scene graph items creation). target arm 32 bit using opengl / eglfs render output. opengl using float , qml using real (defined double ). what should use in c++ do not lose precision? if use qreal ( double ) shouldn't lose precision. if git grep float in qtbase.git , can find out bit more: dist/changes-5.2.0-**************************************************************************** dist/changes-5.2.0-* important behavior changes * dist/changes-5.2.0-**************************************************************************** dist/changes-5.2.0- dist/changes-5.2.0- - qt compiled qreal typedef'ed double on dist/changes-5.2.0: platforms. qreal float on arm chipsets before. guarantees more dist/changes-5.2.0- consistent behavior between platforms qt supports, binary dist/chan...
Read more

Create Outlook appointment via C# .Net -

-
i need create outlook appointment using microsoft.office.interop.outlook , while can work locally on own workstation , works if run web application via server's browser, not work when connect server externally. hence, think might permission issue. i changed application pool identity " localsystem " don't access denied error. unfortunately, doesn't work. the app behaves if appointment created, appointment doesn't appear in outlook. here include file on top of aspx.cs page using outlook = microsoft.office.interop.outlook; here code using pop appointment. outlook.application apptapp = new outlook.application(); outlook.appointmentitem appt = apptapp.createitem(outlook.olitemtype.olappointmentitem) outlook.appointmentitem; appt.subject = txtfirstname.text + " " + txtlastname.text; appt.body = txtcomment.text; appt.alldayevent = false; appt.start = datetime.parse(txtreminderdate.text + " 8:00 am"); appt.end = datetime.p...
Read more

ios - Swift Array Resetting Itself -

-
i have 2 arrays: pointhistory , datehistory . have nstimer , , when timer runs out, action called. in action appending int pointhistory , , current date string datehistory . here timer action: func timeraction() { let steppervalue = int(stepper.value) employee.numberofpoints = steppervalue networking.saveemployee(employee, completion: { (error) -> void in if error != nil { let alert = uialertcontroller(title: "error", message: "there error updating \(self.employee.name)'s points", preferredstyle: .alert) let alertaction = uialertaction(title: "ok", style: .cancel, handler: nil) alert.addaction(alertaction) self.presentviewcontroller(alert, animated: true, completion: nil) } }) var dateformatter = nsdateformatter() dateformatter.dateformat = "mm-dd-yyyy" dateformatter.timezone = nstimezone.localtimezone() var date = nsdate() var ...
Read more