google app engine - Gmail API Python: RequestTooLargeError: The request to API call datastore_v3.Put() was too large -

-

i getting following error batch request gmail api on google app engine:

requesttoolargeerror: request api call datastore_v3.put() large.

from other questions on stackoverflow understand problem has memcache. nevertheless don't know how solve issue, since coming if run 1 request per batch , before can content of email (like compressing it).

my code looks follows:

          count = 0 #start new batch request after every 1000 requests           batch = batchhttprequest(callback=get_items)           in new_items:             batch.add(service.users().messages().get(userid=email, id=i), request_id=str(count))             count += 1             if count % 1000 == 0:               n in range(0, 5):                  try:                   batch.execute(http=http)                   break                 except exception e:                   if n < 4:                     time.sleep((2 ** n) + random.randint(0, 1000) / 1000)                   else:                     raise               batch = batchhttprequest(callback=get_items)            if count % 1000 != 0:             n in range(0, 5):                try:                 batch.execute(http=http)                 break               except exception e:                 if n < 4:                   time.sleep((2 ** n) + random.randint(0, 1000) / 1000)                 else:                   raise

what possible solution?

edit

adding callback function

def get_items(request_id, response, exception):   if exception not none:       print 'an error occurred: %s' % exception   else:       save_messages = request_id.split('/', 2)[1]       email = request_id.split('/', 2)[2]       in_reply_to = ''       m_id = ''       r in response['payload']['headers']:           if r['name'].lower() == 'message-id':               m_id = r.get('value')           elif r['name'].lower() == 'in-reply-to':               in_reply_to = r.get('value')           elif r['name'].lower() == 'from':               sender, t_t = stripemails(r.get('value'), none, none, true, email, false, false)       if m_id:         incoming = gmail(id=m_id) #skip if exists       else:         logging.info(response)         logging.exception('no message id detect')         return       incoming.email = email       incoming.response = json.dumps(response)       incoming.put()

by savings large text item jsonproperty compressed=true problem solved.


Comments

Post a Comment

Popular posts from this blog

qt - Using float or double for own QML classes -

-
i've created components , helper methods using c++ , qt used in qml gui. of methods calculate gui elements (size, transformations, scene graph items creation). target arm 32 bit using opengl / eglfs render output. opengl using float , qml using real (defined double ). what should use in c++ do not lose precision? if use qreal ( double ) shouldn't lose precision. if git grep float in qtbase.git , can find out bit more: dist/changes-5.2.0-**************************************************************************** dist/changes-5.2.0-* important behavior changes * dist/changes-5.2.0-**************************************************************************** dist/changes-5.2.0- dist/changes-5.2.0- - qt compiled qreal typedef'ed double on dist/changes-5.2.0: platforms. qreal float on arm chipsets before. guarantees more dist/changes-5.2.0- consistent behavior between platforms qt supports, binary dist/chan...
Read more

Create Outlook appointment via C# .Net -

-
i need create outlook appointment using microsoft.office.interop.outlook , while can work locally on own workstation , works if run web application via server's browser, not work when connect server externally. hence, think might permission issue. i changed application pool identity " localsystem " don't access denied error. unfortunately, doesn't work. the app behaves if appointment created, appointment doesn't appear in outlook. here include file on top of aspx.cs page using outlook = microsoft.office.interop.outlook; here code using pop appointment. outlook.application apptapp = new outlook.application(); outlook.appointmentitem appt = apptapp.createitem(outlook.olitemtype.olappointmentitem) outlook.appointmentitem; appt.subject = txtfirstname.text + " " + txtlastname.text; appt.body = txtcomment.text; appt.alldayevent = false; appt.start = datetime.parse(txtreminderdate.text + " 8:00 am"); appt.end = datetime.p...
Read more

ios - Swift Array Resetting Itself -

-
i have 2 arrays: pointhistory , datehistory . have nstimer , , when timer runs out, action called. in action appending int pointhistory , , current date string datehistory . here timer action: func timeraction() { let steppervalue = int(stepper.value) employee.numberofpoints = steppervalue networking.saveemployee(employee, completion: { (error) -> void in if error != nil { let alert = uialertcontroller(title: "error", message: "there error updating \(self.employee.name)'s points", preferredstyle: .alert) let alertaction = uialertaction(title: "ok", style: .cancel, handler: nil) alert.addaction(alertaction) self.presentviewcontroller(alert, animated: true, completion: nil) } }) var dateformatter = nsdateformatter() dateformatter.dateformat = "mm-dd-yyyy" dateformatter.timezone = nstimezone.localtimezone() var date = nsdate() var ...
Read more