Skip to content

dp3

Dynamic Profile Processing Platform (DP³)

Platform directory structure:

  • Worker - The main worker process.

  • API - The HTTP API implementation.

  • Binaries under dp3.bin - Executables for running the platform.

  • Common - Common modules which are used throughout the platform.

    • Config, EntitySpec and AttrSpec - Models for reading, validation and representing platform configuration of entities and their attributes. datatype is also used within this context.
    • Scheduler - Allows modules to run callbacks at specified times
    • Task - Model for a single task processed by the platform
    • Utils - Auxiliary utility functions

  • Database.EntityDatabase - A wrapper responsible for communication with the database server.

  • HistoryManagement.HistoryManager - Module responsible for managing history saved in database, currently to clean old data.

  • Snapshots - SnapShooter, a module responsible for snapshot creation and running configured data correlation and fusion hooks, and Snapshot Hooks, which manage the registered hooks and their dependencies on one another.

  • TaskProcessing - Module responsible for task distribution, processing and running configured hooks. Task distribution is possible due to the task queue.