Mymory Evaluation

This wiki will be a scratch pad and contain a TODO list for people that will be involved in Mymory's context evaluation.

Software to be installed

• FirstSteps - By following the steps described there you will:
  • install UserObservationHub (please svn update if you already have an older version)
  • install ​Dragontalk: Observation plugins for Thunderbird and Firefox (please install the newest version)

• WindowsLoggerListener (Windows users only) - By following the steps described there you will:
  • install ​User Activity Logger
  • configure property file (./etc/userobservationhub.properties) to let UOH work with output of the User Activity Logger

• ScreenshotRecorder (optional) - By following the steps described there you will:
  • configure property file (./etc/userobservationhub.properties) to set the screenshot interval time or to deactivate the screenshot recorder

Part 1: Logging user actions --> create a log file with NOPs

The first important part of the evaluation is the logging part. We need a log of your actions for some period - at least for a day, better for one week or so. To create this log and (iteratively) accumulate observed user actions, you just start / kill / restart the UOH:

• Start the UOH (via the batch file for example) and just "do what you gotta do"! ;-)
• Disabling UOH is not yet implemented - just kill the UOH (with multiple CTRL+C for example) - this will not harm anything! feel free to kill that beast whenever you want or have to!
• Restart UOH again any time.

Restarting the UOH is no problem. Observed user actions are always appended to the log file (userobservationhub_nops.log).

Part 2: Import legacy data (gnowsis, context threads)

DFKI researchers can use the following team set to check out all projects needed for this concern: Save this file MymoryEval_PimoEditorBranch_TeamSet.psf and then use eclipse/File/import/Team/Team Project Set.

TODO: Upload runtime configuration here

Start runtime by launching MyContextEval.launch (TODO: runtime not yet uploaded here)

The easiest way to import the PIMO from ​gnowsis beta and to transform it to be conform with ​PIMOEditor is to launch the MyContext.launch (TODO: upload .launch) and use the button at the Context "Cidebar" called "Sync with gnowsis".

TODO: Write how to export and import a list of old context threads (JConsole -> ...)

Part 3: Assign contexts to NOPs --> create ground truth

The second important part is the manual assignment of the logged NOPs to the user's contexts.

To do so, Mymory created an "evaluation GUI", that eases this task.

Click on the button "ContextualizeObservedNopsGui" to open the evaluation GUI.

Part 4: Run evaluations on ground truth

TODO