How do I access Collector’s JSON store? - medullan/navocat-collector GitHub Wiki

Refer to the meda.yml file, it has an attribute called data_path which will have the location of the JSON store. The JSON store are text files that can be parsed and imported into any database system of your choice for querying.

Directory structure:

data_path / dataset name / hit type / date / filename

Example file path:

data_path/production/events/2014-04-23/2014-04-23-15:00:00-bc4e87...ffe8c.json

Example file contents:

{
  "id":"e81e8050cb1d11e3879544fb42fffe8c",
  "ht":"2014-04-23T15:31:46-04:00", 
  "hp":
        {
              "name":"test",
              "category":"test",
              "action":"test",
              "label":
              "took the test"
        },
  "pi":"2706b380cb1111e3acf044fb42fffe8c", 
  "pp":
        {
              "age":"45",
              "plan_type":"basic",
              "gender":"female",
              "consumer_segment":
              "movers_and_she_kers"
        }
  } 

Each event is stored in JSON format, one event per line. The data structure contains the following fields.

Field Name	Description	Example
id	unique hit id	e81e8050cb1d11e3879544fb42fffe8c
ht	hit time	2014-04-23T15:31:46-04:00
pi	user profile id	2706b380cb1111e3acf044fb42fffe8c
hp	hit properties	{ "name":"test","category":"test","action":"test","label":"took the test"}
pp	user profile properties	{"age":"45","plan_type":"basic","gender":"female","consumer_segment":"movers_and_she_kers"}