sql - Avoiding lots of counters in Java -

-

in java project, need read file 1.6 million lines.

each line represents 1 action users have done in 1 day. there 83 different possible actions if i'm not wrong.

i need analyze file follows , store found statistics in csv files: generally: count how 1 action has occurred (numbers go high half million)

but there should separate files:

  • how has 1 action occurred per hour? (24 rows in csv file)

  • how has 1 action occurred per user? (about 20 different users - file each one)

  • how has 1 action occurred per user per hour? (separate file per user, 24 rows in it)

and on top, there 3 different channels (html, mobile, telephone) things can occur (also saved in log-file), need create 1 folder every channel , things mentioned above each one.

the question:

how can store/count efficiently? run-time not of problem (it shouldn't run day it's no problem it takes half hour) how count it?

i can't create many counters (amount huge), , int[] aren't convenient in opinion here have remember action has index etc.

is there better solution?

i thought using local database , sql scripts, program needs run on every pc , has executable command-line (and not in ide). using intellij 14 development.

an embedded database h2.

any packing mean have yourself.

you have count fields on several levels, maybe separate tables, speed. timestamp checking.

the advantage reports can done flexibly. backups made easily.

a custom refactoring can done later when functions.


Comments

Post a Comment

Popular posts from this blog

qt - Using float or double for own QML classes -

-
i've created components , helper methods using c++ , qt used in qml gui. of methods calculate gui elements (size, transformations, scene graph items creation). target arm 32 bit using opengl / eglfs render output. opengl using float , qml using real (defined double ). what should use in c++ do not lose precision? if use qreal ( double ) shouldn't lose precision. if git grep float in qtbase.git , can find out bit more: dist/changes-5.2.0-**************************************************************************** dist/changes-5.2.0-* important behavior changes * dist/changes-5.2.0-**************************************************************************** dist/changes-5.2.0- dist/changes-5.2.0- - qt compiled qreal typedef'ed double on dist/changes-5.2.0: platforms. qreal float on arm chipsets before. guarantees more dist/changes-5.2.0- consistent behavior between platforms qt supports, binary dist/chan...
Read more

Create Outlook appointment via C# .Net -

-
i need create outlook appointment using microsoft.office.interop.outlook , while can work locally on own workstation , works if run web application via server's browser, not work when connect server externally. hence, think might permission issue. i changed application pool identity " localsystem " don't access denied error. unfortunately, doesn't work. the app behaves if appointment created, appointment doesn't appear in outlook. here include file on top of aspx.cs page using outlook = microsoft.office.interop.outlook; here code using pop appointment. outlook.application apptapp = new outlook.application(); outlook.appointmentitem appt = apptapp.createitem(outlook.olitemtype.olappointmentitem) outlook.appointmentitem; appt.subject = txtfirstname.text + " " + txtlastname.text; appt.body = txtcomment.text; appt.alldayevent = false; appt.start = datetime.parse(txtreminderdate.text + " 8:00 am"); appt.end = datetime.p...
Read more

ios - Swift Array Resetting Itself -

-
i have 2 arrays: pointhistory , datehistory . have nstimer , , when timer runs out, action called. in action appending int pointhistory , , current date string datehistory . here timer action: func timeraction() { let steppervalue = int(stepper.value) employee.numberofpoints = steppervalue networking.saveemployee(employee, completion: { (error) -> void in if error != nil { let alert = uialertcontroller(title: "error", message: "there error updating \(self.employee.name)'s points", preferredstyle: .alert) let alertaction = uialertaction(title: "ok", style: .cancel, handler: nil) alert.addaction(alertaction) self.presentviewcontroller(alert, animated: true, completion: nil) } }) var dateformatter = nsdateformatter() dateformatter.dateformat = "mm-dd-yyyy" dateformatter.timezone = nstimezone.localtimezone() var date = nsdate() var ...
Read more