Getting Started with Javelin

Who is this article for?

 Coruson administrators or data scientists.

 Understanding of Coruson config is recommended.

This article is an introduction to Javelin. 

Javelin is a business intelligence process available for use with Coruson. Javelin operates by performing a daily export of all data changes into a CSV format. These CSVs are exported to an Amazon S3 bucket which can then be retrieved and can then be ingested into your own warehouse or data analysis tool.

To be clear, Javelin does not routinely include all data from the system and instead produces a daily delta of changes. A full export can be scheduled for the purpose of refreshing your data warehouse. 

This article is split into the following sections:

1. Javelin Structure
2. Entity Relationship Diagrams (ERDs)

1. Javelin Structure

A Javelin export is a series of folders, each one named after the module that the data relates to.

For Example: ReportAnalysisModel contains the report record header information, with FormFieldAnalysisModel containing the details of the fields added to forms. Each row will include an ID field which will be referenced as a foreign key on other models.

Each model will include the following files:

• Create: All new records that have been created since the last export.
• Update: All record changes that have occurred since the last export.
• Delete: All records that have been deleted since the last export.

Note: The export includes all models, however you only need to import the models that you are interested in analysing.

2. Entity Relationship Diagrams (ERDs)