Service - Notification Manager: Difference between revisions

From Izara Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(62 intermediate revisions by 2 users not shown)
Line 7: Line 7:
= Repository =
= Repository =


https://bitbucket.org/stb_working/notification-manager/src/master/
https://bitbucket.org/izara-core-shared/izara-core-shared-notification-manager


= DynamoDB tables =
= Object Schemas =


== [[Standard Config Table Per Service]] ==
; Additional Information: [[Per Service Schemas]]


=== Configuration tags ===
== objType ==
 
=== notificationGroup ===
 
* Groups many triggerGroups together


; configKey = ''receiver'', configTag = {receiverTag}
: configValue example
<syntaxhighlight lang="JavaScript">
<syntaxhighlight lang="JavaScript">
{
{
// .. other receiver level configuration options, eg max length of notification body
  objectType: "notificationGroup",
"endpoint": {
  canDelete: false,
"endpoint": {eg: Lambda function name}
  storageResources: {
"service_type": {eg: "Lambda"} //service type tag, at the moment only "Lambda"
    myGraph: {
}
      storageType: "graph",
      graphServerTag: "GraphHandler"
    },
    dynamoDB: {
      storageType: "dynamoDB",
      tableName: "NotificationGroupProcessing"
    }
  },
  addOnDataStructure: [
    {
      type: "versionedData",
      versionedDataLabel: "notificationGroupSettings",
      storageResourceTag: "myGraph",
      fieldNames: {
    "notificationGroupName": {
      type: "string",
      requiredOnCreate: true,
      canUpdate: true,
      validation: {
        pattern: pattern
      }
    },
    "consolidatedType": {
      type: "string",
      optionalOnCreate: true,
      requiredOnCreate: false,
      canUpdate: true,
      validation: {
        pattern: pattern
      }
    },
    "consolidatedFrequency": {
      type: "number",
      optionalOnCreate: true,
      requiredOnCreate: false,
      canUpdate: true,
      validation: {
        pattern: pattern
      }
    },
    "consolidatedSendIfEmpty": {
      type: "boolean",
      optionalOnCreate: true,
      requiredOnCreate: false,
      canUpdate: true,
      validation: {
        pattern: pattern
      }
    },
    "consolidatedMessageCount": {
      type: "number",
      optionalOnCreate: true,
      requiredOnCreate: false,
      canUpdate: true,
      validation: {
        pattern: pattern
      }
    },
    "consolidatedConfigs": {
      type: "array",
      optionalOnCreate: true,
      requiredOnCreate: false,
      canUpdate: true,
      validation: {
        pattern: pattern
      }
    }
      }
    }
  ],
  fieldNames: {
    notificationGroupId: {
      type: "string",
      randomOnCreate: true,
      canUpdate: false,
      validation: {
    pattern: pattern
      },
      storageResourceTags: ['myGraph', "dynamoDB"]
    },
    consolidatedLastTimeSent: {
      type: "number",
      optionalOnCreate: true,
      canUpdate: true,
      validation: {
    pattern: pattern
      },
      storageResourceTags: ["dynamoDB"]
    },
  },
  identifiers: [
    {
      type: "identifier",
      fieldName: "notificationGroupId"
    }
  ]
}
}
</syntaxhighlight>
</syntaxhighlight>


== NotificationGroup ==
==== fieldNames ====
 
* Groups many notificatons into groups
* Simplifies management of similar notifications
* Allows for consolidation of notifications at notification group level


=== Fields ===
; notificationGroupId (identifier)
 
: comes from: randomOnCreate
; notificationGroupId
; consolidatedLastTimeSent
: (partition key)
: start time for recurring or last time for send consolidated message
: comes from: {receiverTag}_{grouping id given be receiver service}
: eg receiverTag: userContactMgr
: eg grouping id: userId or userId+methodTag hash
; receiverSortKey
: (sort key)
: optional (? might have to set something) key that specifies a unique notification group within the receiver's grouping id
: eg: a uuid created by UserContactManager
; notificationGroupName
; notificationGroupName
: string name set by reciever service, optional
: string name set by user
; consolidated
: true|false
; consolidatedType
; consolidatedType
: overview|detailed
: none | recurring | messageCount
: overview sends a count of each type of notification, detailed lists each activity message
: ''none'' is not consolidated, process immediately
: ''recurring'' process at a specific frequency
: ''messageCount'' process when a specific number of messages have been received
; consolidatedFrequency
; consolidatedFrequency
: not sure, maybe use some sort of standard like cron
: for consolidatedType = recurring, number of milliseconds between each processing
; consolidatedNextSendDue
: timestamp for next due time to send notification
; consolidatedSendIfEmpty
; consolidatedSendIfEmpty
: true|false
: setting for if have no consolidated message
: true = send message out
: false = not send message out
; consolidatedMessageCount
: send a consolidated message when the number of messages reaches
; consolidatedConfigs
: pattern for message to send data in consolidated message


== Notifications ==
=== consolidated ===
 
<syntaxhighlight lang="JavaScript">
{
  objectType: "consolidated",
  canDelete: false,
  storageResources: {
    dynamoDB: {
      storageType: "dynamoDB",
      tableName: "PendingConsolidation"
    }
  },
  fieldNames: {
    notificationGroupId: {
      type: "string",
      canUpdate: false,
      storageResourceTags: ['dynamoDB'],
      fromObjType: {
    serviceTag: "NotificationManager",
    objectType: "notificationGroup"
      }
    },
    checkedTriggerTime: {
      type: "string",
      requiredOnCreate: true,
      canUpdate: false,
      validation: {
    pattern: pattern
      },
      storageResourceTags: ['dynamoDB']
    },
    activityMsg: {
      type: "object",
      requiredOnCreate: true,
      canUpdate: false,
      validation: {
    pattern: pattern
      },
      storageResourceTags: ['dynamoDB']
    },
    flowTag: {
      type: "string",
      requiredOnCreate: true,
      canUpdate: false,
      validation: {
    pattern: pattern
      },
      storageResourceTags: ['dynamoDB']
    },
    flowStep: {
      type: "string",
      requiredOnCreate: true,
      canUpdate: false,
      validation: {
    pattern: pattern
      },
      storageResourceTags: ['dynamoDB']
    }
  },
  identifiers: [
    {
      type: "partitionKey",
      fieldName: "notificationGroupId"
    },
    {
      type: "sortKey",
      fieldName: "checkedTriggerTime"
    }
  ]
}
</syntaxhighlight>


* no sort key
==== fieldNames ====


=== Fields ===
; notificationGroupId (partition key)
: comes from: randomOnCreate
; checkedTriggerTime (sort key)
: comes from {timestamp activity handled in Activity Switchboard}_{small random UUID}
: adding the UUID to ensure no clashing records with the same timestamp and notificationGroupId
; activityMsg
: the message delivered from Activity Switchboard
; flowTag
: defines the consolidated configuration for the notification group
; flowType
: defines the consolidated configuration for the notification group


; notificationId
== Object Relationships ==
: (partition key)
: random UUID
; notificationGroupId
; serviceName
; msgTag
; notificationName
: string name set by reciever service, optional
; triggers
: array/list of triggers that must match for this notification to happen, see [[#Triggers structure]]


== PendingConsolidation ==
=== ownsNotificationGroup ===
<syntaxhighlight lang="JavaScript">
{
  "ownsNotificationGroup": {
    fieldNames: {
      "originTimestamp": {
    type: "number",
    requiredOnCreate: true,  // default = false
    canUpdate: true,          // default = true
    validation: {}            // ajv syntax
      }
    },
    storageResources: {
      myGraph: {
    storageType: "graph",
    graphServerTag: "GraphHandler"
      }
    },
    links: [
      {
    storageResourceTags: ["myGraph"],
    from: {
      objType: {
        serviceTag: "UserAccount",
        objectType: "user"
      },
      linkType: "one",
    },
    to: {
      objType: {
        serviceTag: "NotificationManager",
        objectType: "notificationGroup"
      },
      requiredOnCreate: true,
      linkType: "many",
      handler: true
    }
      }
    ]
  }
}
</syntaxhighlight>
: links the user to their created notification group


=== Fields ===
=== hasTriggerGroup ===
<syntaxhighlight lang="JavaScript">
{
  "hasTriggerGroup": {
    canChangeToRelTypes: [
      {
    serviceTag: "NotificationManager",
    relationshipTag: "disabledTriggerGroup"
      }
    ],
    fieldNames: {
      "originTimestamp": {
    type: "number",            // "string" | "number" ...
    requiredOnCreate: true,  // default = false
    canUpdate: true,          // default = true
    validation: {}            // ajv syntax
      }
    },
    storageResources: {
      myGraph: {
    storageType: "graph",
    graphServerTag: "GraphHandler"
      }
    },
    links: [
      {
    storageResourceTags: ["myGraph"],
    from: {
      objType: {
        serviceTag: "NotificationManager",
        objectType: "notificationGroup"
      },
      linkType: "many",
      handler: true
    },
    to: {
      objType: {
        serviceTag: "ActivitySwitchboard",
        objectType: "triggerGroup"
      },
      linkType: "many"
    }
      }
    ]
  }
}
</syntaxhighlight>


; notificationGroupId
=== disabledTriggerGroup ===
: (partition key)
<syntaxhighlight lang="JavaScript">
; time
{
: comes from {timestamp activity handled in Activity Switchboard}_{small random UUID}
  "disabledTriggerGroup": {
: adding the UUID to ensure no clashing records with the same timestamp and notificationGroupId
    canChangeToRelTypes: [
; activityMessage
      {
: copy of the message delivered from Activity Switchboard
    serviceTag: "NotificationManager",
    relationshipTag: "hasTriggerGroup"
      }
    ],
    fieldNames: {
      "originTimestamp": {
    type: "number",            // "string" | "number" ...
    requiredOnCreate: true,  // default = false
    canUpdate: true,          // default = true
    validation: {}            // ajv syntax
      }
    },
    storageResources: {
      myGraph: {
    storageType: "graph",
    graphServerTag: "GraphHandler"
      }
    },
    links: [
      {
    storageResourceTags: ["myGraph"],
    from: {
      objType: {
        serviceTag: "NotificationManager",
        objectType: "notificationGroup"
      },
      linkType: "many",
      handler: true
    },
    to: {
      objType: {
        serviceTag: "ActivitySwitchboard",
        objectType: "triggerGroup"
      },
      linkType: "many"
    }
      }
    ]
  }
}
</syntaxhighlight>
 
= value or values array =
 
* Either 'value' or 'values' should be set, not both, if 'values' is used it means any of the elements in the 'values' array can match.


= Triggers structure =
* To achieve this on Activity Switchboard a new trigger group is created for each element, each activity group has the full list of other triggers, and one option from this trigger's ''values'' array. If a notification has multiple ''values'' type triggers than a new trigger group on Activity Switchboard is created for each combination.


Record of the triggers for a notification, saved in Notifications table
* "serviceName" and "topicName" valueTypes do not have propertyName


<syntaxhighlight lang="JavaScript">
= serviceName and topicName triggers =
[
{
"property": {can be a nested property, use dot notation}
"value": {string or number}
"values": {array/list of values}
"meta": true|false // default false, if true will search message attributes or other special cases like msgTag
},
..
]
</syntaxhighlight>


* either value or values is set, not both
* Notifications do not have to set their serviceName and/or topicName, if not set then any message that matches the properties will pass
* Can set only the serviceName, then any message that passess the properties and is from that serviceName passes
* Can set serviceName+topicName, then only messages in that topic will pass
* serviceName and topicName can both be submitted as "values" array, creating multiple trigger groups for each combination


= Consolidated notifications =
= Consolidated notifications =
Line 112: Line 398:
* maybe can use some sort of queue to store a list of NotificationGroup’s that are due to be sent (either because consolidatedSendIfEmpty == true or there are some activities waiting to be processed)
* maybe can use some sort of queue to store a list of NotificationGroup’s that are due to be sent (either because consolidatedSendIfEmpty == true or there are some activities waiting to be processed)


= Formating notifications =  
= Formating the notification body =  


* Initially the format will be hardwired and simple, but in the future we could create templates for formating the notification body
* Initially the format will be hardwired and simple, but in the future we could create templates for formating the notification body
* The notificationBody is currently sent to receiver as a JSON stringified object containing all activityMsgs


= Ideas =  
= Ideas =  

Latest revision as of 05:59, 11 September 2025

Overview

Consolidates and sends notifications to any number of receiver services. Will be used for user notifications but can have other types of receiver services added. Activities are received from Activity Switchboard service.

Notification groups set whether activities are considated (eg per day/per month/per x number of activities), if considated activities are stored here until sending is triggered, according to the considation rules. If not consolidated they are sent on immediately.

Repository

https://bitbucket.org/izara-core-shared/izara-core-shared-notification-manager

Object Schemas

Additional Information
Per Service Schemas

objType

notificationGroup

  • Groups many triggerGroups together
{
  objectType: "notificationGroup",
  canDelete: false,
  storageResources: {
    myGraph: {
      storageType: "graph",
      graphServerTag: "GraphHandler"
    },
    dynamoDB: {
      storageType: "dynamoDB",
      tableName: "NotificationGroupProcessing"
    }
  },
  addOnDataStructure: [
    {
      type: "versionedData",
      versionedDataLabel: "notificationGroupSettings",
      storageResourceTag: "myGraph",
      fieldNames: {
	    "notificationGroupName": {
	      type: "string",
	      requiredOnCreate: true,
	      canUpdate: true,
	      validation: {
	        pattern: pattern
	      }
	    },
	    "consolidatedType": {
	      type: "string",
	      optionalOnCreate: true,
	      requiredOnCreate: false,
	      canUpdate: true,
	      validation: {
	        pattern: pattern
	      }
	    },
	    "consolidatedFrequency": {
	      type: "number",
	      optionalOnCreate: true,
	      requiredOnCreate: false,
	      canUpdate: true,
	      validation: {
	        pattern: pattern
	      }
	    },
	    "consolidatedSendIfEmpty": {
	      type: "boolean",
	      optionalOnCreate: true,
	      requiredOnCreate: false,
	      canUpdate: true,
	      validation: {
	        pattern: pattern
	      }
	    },
	    "consolidatedMessageCount": {
	      type: "number",
	      optionalOnCreate: true,
	      requiredOnCreate: false,
	      canUpdate: true,
	      validation: {
	        pattern: pattern
	      }
    	},
	    "consolidatedConfigs": {
	      type: "array",
    	  optionalOnCreate: true,
    	  requiredOnCreate: false,
    	  canUpdate: true,
	      validation: {
	        pattern: pattern
	      }
    	}
      }
    }
  ],
  fieldNames: {
    notificationGroupId: {
      type: "string",
      randomOnCreate: true,
      canUpdate: false,
      validation: {
	    pattern: pattern
      },
      storageResourceTags: ['myGraph', "dynamoDB"]
    },
    consolidatedLastTimeSent: {
      type: "number",
      optionalOnCreate: true,
      canUpdate: true,
      validation: {
	    pattern: pattern
      },
      storageResourceTags: ["dynamoDB"]
    },
  },	
  identifiers: [
    {
      type: "identifier",
      fieldName: "notificationGroupId"
    }
  ]
}

fieldNames

notificationGroupId (identifier)
comes from: randomOnCreate
consolidatedLastTimeSent
start time for recurring or last time for send consolidated message
notificationGroupName
string name set by user
consolidatedType
none | recurring | messageCount
none is not consolidated, process immediately
recurring process at a specific frequency
messageCount process when a specific number of messages have been received
consolidatedFrequency
for consolidatedType = recurring, number of milliseconds between each processing
consolidatedSendIfEmpty
setting for if have no consolidated message
true = send message out
false = not send message out
consolidatedMessageCount
send a consolidated message when the number of messages reaches
consolidatedConfigs
pattern for message to send data in consolidated message

consolidated

					
{
  objectType: "consolidated",
  canDelete: false,
  storageResources: {
    dynamoDB: {
      storageType: "dynamoDB",
      tableName: "PendingConsolidation"
    }
  },
  fieldNames: {
    notificationGroupId: {
      type: "string",
      canUpdate: false,
      storageResourceTags: ['dynamoDB'],
      fromObjType: {
	    serviceTag: "NotificationManager",
	    objectType: "notificationGroup"
      }
    },
    checkedTriggerTime: {
      type: "string",
      requiredOnCreate: true,
      canUpdate: false,
      validation: {
	    pattern: pattern
      },
      storageResourceTags: ['dynamoDB']
    },
    activityMsg: {
      type: "object",
      requiredOnCreate: true,
      canUpdate: false,
      validation: {
	    pattern: pattern
      },
      storageResourceTags: ['dynamoDB']
    },
    flowTag: {
      type: "string",
      requiredOnCreate: true,
      canUpdate: false,
      validation: {
	    pattern: pattern
      },
      storageResourceTags: ['dynamoDB']
    },
    flowStep: {
      type: "string",
      requiredOnCreate: true,
      canUpdate: false,
      validation: {
	    pattern: pattern
      },
      storageResourceTags: ['dynamoDB']
    }
  },
  identifiers: [
    {
      type: "partitionKey",
      fieldName: "notificationGroupId"
    },
    {
      type: "sortKey",
      fieldName: "checkedTriggerTime"
    }
  ]
}

fieldNames

notificationGroupId (partition key)
comes from: randomOnCreate
checkedTriggerTime (sort key)
comes from {timestamp activity handled in Activity Switchboard}_{small random UUID}
adding the UUID to ensure no clashing records with the same timestamp and notificationGroupId
activityMsg
the message delivered from Activity Switchboard
flowTag
defines the consolidated configuration for the notification group
flowType
defines the consolidated configuration for the notification group

Object Relationships

ownsNotificationGroup

{
  "ownsNotificationGroup": {
     fieldNames: {
       "originTimestamp": {
	     type: "number",
	     requiredOnCreate: true,  	// default = false
	    canUpdate: true,          	// default = true
	    validation: {}            	// ajv syntax
      }
    },
    storageResources: {
      myGraph: {
	    storageType: "graph",
	    graphServerTag: "GraphHandler"
      }
    },
    links: [
      {
	    storageResourceTags: ["myGraph"],
	    from: {
	      objType: {
	        serviceTag: "UserAccount",
	        objectType: "user"
	      },
	      linkType: "one",
	    },
	    to: {
	      objType: {
	        serviceTag: "NotificationManager",
	        objectType: "notificationGroup"
	      },
	      requiredOnCreate: true,
	      linkType: "many",
	      handler: true
	    }
      }
    ]
  }
}
links the user to their created notification group

hasTriggerGroup

{
  "hasTriggerGroup": {
    canChangeToRelTypes: [
      {
	    serviceTag: "NotificationManager",
	    relationshipTag: "disabledTriggerGroup"
      }
    ],
    fieldNames: {
      "originTimestamp": {
	    type: "number",            	// "string" | "number" ...
	    requiredOnCreate: true,  	// default = false
	    canUpdate: true,          	// default = true
	    validation: {}            	// ajv syntax
      }
    },
    storageResources: {
      myGraph: {
	    storageType: "graph",
	    graphServerTag: "GraphHandler"
      }
    },
    links: [
      {
	    storageResourceTags: ["myGraph"],
	    from: {
	      objType: {
	        serviceTag: "NotificationManager",
	        objectType: "notificationGroup"
    	  },
	      linkType: "many",
	      handler: true
    	},
	    to: {
	      objType: {
	        serviceTag: "ActivitySwitchboard",
	        objectType: "triggerGroup"
	      },
	      linkType: "many"
    	}
      }
    ]
  }
}

disabledTriggerGroup

{
  "disabledTriggerGroup": {
    canChangeToRelTypes: [
      {
	    serviceTag: "NotificationManager",
	    relationshipTag: "hasTriggerGroup"
      }
    ],
    fieldNames: {
      "originTimestamp": {
	    type: "number",            	// "string" | "number" ...
	    requiredOnCreate: true,  	// default = false
	    canUpdate: true,          	// default = true
	    validation: {}            	// ajv syntax
      }
    },
    storageResources: {
      myGraph: {
	    storageType: "graph",
	    graphServerTag: "GraphHandler"
      }
    },
    links: [
      {
	    storageResourceTags: ["myGraph"],
	    from: {
	      objType: {
	        serviceTag: "NotificationManager",
	        objectType: "notificationGroup"
	      },
	      linkType: "many",
	      handler: true
	    },
	    to: {
	      objType: {
	        serviceTag: "ActivitySwitchboard",
	        objectType: "triggerGroup"
	      },
	      linkType: "many"
    	}
      }
    ]
  }
}

value or values array

  • Either 'value' or 'values' should be set, not both, if 'values' is used it means any of the elements in the 'values' array can match.
  • To achieve this on Activity Switchboard a new trigger group is created for each element, each activity group has the full list of other triggers, and one option from this trigger's values array. If a notification has multiple values type triggers than a new trigger group on Activity Switchboard is created for each combination.
  • "serviceName" and "topicName" valueTypes do not have propertyName

serviceName and topicName triggers

  • Notifications do not have to set their serviceName and/or topicName, if not set then any message that matches the properties will pass
  • Can set only the serviceName, then any message that passess the properties and is from that serviceName passes
  • Can set serviceName+topicName, then only messages in that topic will pass
  • serviceName and topicName can both be submitted as "values" array, creating multiple trigger groups for each combination

Consolidated notifications

How to trigger processing for time based consolidations

  • ....
  • maybe can use some sort of queue to store a list of NotificationGroup’s that are due to be sent (either because consolidatedSendIfEmpty == true or there are some activities waiting to be processed)

Formating the notification body

  • Initially the format will be hardwired and simple, but in the future we could create templates for formating the notification body
  • The notificationBody is currently sent to receiver as a JSON stringified object containing all activityMsgs

Ideas

  • overview notifications currently count per notification, but could be extended to do aggregates on a per notification, per field level
  • If set to overview maybe can store just aggregate/s needed for the consolidated notification, at the moment store entire messages, create the overview once when sending notification

Working documents

Working documents - Notification Manager