NPM module - izara-shared - Revision history

Sven the Barbarian: /* AwaitingMultipleSteps */

2023-11-29T15:09:27Z

AwaitingMultipleSteps

← Older revision		Revision as of 15:09, 29 November 2023
Line 48:		Line 48:
	* calling flow should always save AwaitingMultipleSteps records before sending requests to external flows to ensure no race conditions where an external flow completes before AwaitingMultipleSteps record saved		* calling flow should always save AwaitingMultipleSteps records before sending requests to external flows to ensure no race conditions where an external flow completes before AwaitingMultipleSteps record saved
	* combine this with callingFlow param in requests to cached external flows to ensure always get a trigger in calling flow for each external step		* combine this with callingFlow param in requests to cached external flows to ensure always get a trigger in calling flow for each external step
			* Checking if all AwaitingMultipleSteps complete should always return true and pass on one or more invocations to the next step, more than one is common when concorrent invocations check remaining, next step must be able to handle this, eg by adding a uniqueId step

	Two tables are maintained and must be updated together to ensure can query by awaitingStepId and pendingStepId, GSI does not work due to inconsistency [[2022-12-25 AwaitingMultipleSteps GSI issue\|see here]].		Two tables are maintained and must be updated together to ensure can query by awaitingStepId and pendingStepId, GSI does not work due to inconsistency [[2022-12-25 AwaitingMultipleSteps GSI issue\|see here]].

Sven the Barbarian at 07:07, 25 December 2022

2022-12-25T07:07:44Z

← Older revision		Revision as of 07:07, 25 December 2022
Line 45:		Line 45:
	* One awaitingStepId can have multiple pendingStepIds that are awaiting it		* One awaitingStepId can have multiple pendingStepIds that are awaiting it
	* One pendingStepId can have multiple awaitingStepIds it is awaiting		* One pendingStepId can have multiple awaitingStepIds it is awaiting
	* logic ~~can prepend any~~ prefix to awaitingStepId ~~if want to be share one table~~ and ~~differentiate different external step ids~~		* logic prepends a prefix to both awaitingStepId and pendingStepId so queries return only results for a specific task, in case other tasks use the same identifier/s
	* calling flow should always save AwaitingMultipleSteps records before sending requests to external ~~flow,s~~ to ensure no race conditions where an external flow completes before AwaitingMultipleSteps record saved		* calling flow should always save AwaitingMultipleSteps records before sending requests to external flows to ensure no race conditions where an external flow completes before AwaitingMultipleSteps record saved
	* combine this with callingFlow param in requests to cached external flows to ensure always get a trigger in calling flow for each external step		* combine this with callingFlow param in requests to cached external flows to ensure always get a trigger in calling flow for each external step

			Two tables are maintained and must be updated together to ensure can query by awaitingStepId and pendingStepId, GSI does not work due to inconsistency [[2022-12-25 AwaitingMultipleSteps GSI issue\|see here]].

	=== DynamoDB table: AwaitingMultipleSteps ===		=== DynamoDB table: AwaitingMultipleSteps ===
Line 63:		Line 65:
	* sort key: pendingStepId		* sort key: pendingStepId

	~~Global secondary index~~:		=== DynamoDB table: AwaitingMultipleSteps ===

			<syntaxhighlight lang="JavaScript">
			{
			awaitingStepId: "xx",
			pendingStepId: "xx",
			timestamp: "xx", //when record created
			uniqueRequestId: "xx", optional, used for idempotence when processing the awaitingStepId
			}
			</syntaxhighlight>

	* partition key: pendingStepId		* partition key: pendingStepId
	* sort key: awaitingStepId		* sort key: awaitingStepId
	* projected attributes: (none)
	* main primary key is used to find parent pendingStepId after a sorted awaitingStepId completes, GSI is used to check if any pending awaitingStepIds remain for parent pendingStepId

	= LambdaSharedLib =		= LambdaSharedLib =

Sven the Barbarian: /* AsyncFlowSharedLib */

2021-12-26T03:01:19Z

AsyncFlowSharedLib

← Older revision		Revision as of 03:01, 26 December 2021
Line 23:		Line 23:
	* One awaitingStepId can have multiple pendingStepIds that are awaiting it		* One awaitingStepId can have multiple pendingStepIds that are awaiting it
	* logic can prepend any prefix to awaitingStepId if want to be share one table and differentiate different external step ids		* logic can prepend any prefix to awaitingStepId if want to be share one table and differentiate different external step ids
			* calling flow should always save AwaitingStep record before sending request to external flow, to ensure no race condition where that external flow completes before AwaitingStep record saved
			* combine this with callingFlow param in request to cached external flows to ensure always get a trigger in calling flow for each external step

	=== DynamoDB table: AwaitingStep ===		=== DynamoDB table: AwaitingStep ===
Line 44:		Line 46:
	* One pendingStepId can have multiple awaitingStepIds it is awaiting		* One pendingStepId can have multiple awaitingStepIds it is awaiting
	* logic can prepend any prefix to awaitingStepId if want to be share one table and differentiate different external step ids		* logic can prepend any prefix to awaitingStepId if want to be share one table and differentiate different external step ids
			* calling flow should always save AwaitingMultipleSteps records before sending requests to external flow,s to ensure no race conditions where an external flow completes before AwaitingMultipleSteps record saved
			* combine this with callingFlow param in requests to cached external flows to ensure always get a trigger in calling flow for each external step

	=== DynamoDB table: AwaitingMultipleSteps ===		=== DynamoDB table: AwaitingMultipleSteps ===

Sven the Barbarian at 13:17, 25 December 2021

2021-12-25T13:17:46Z

@@ Line 37: / Line 37: @@
 * partition key: awaitingStepId
 * sort key: pendingStepId
 = LambdaSharedLib =

Sven the Barbarian: /* DynamoDB AwaitingStep tables */

2021-12-25T12:49:15Z

DynamoDB AwaitingStep tables

← Older revision		Revision as of 12:49, 25 December 2021
Line 24:		Line 24:
	* logic can prepend any prefix to awaitingStepId if want to be share one table and differentiate different external step ids		* logic can prepend any prefix to awaitingStepId if want to be share one table and differentiate different external step ids

	=== DynamoDB AwaitingStep ~~tables~~ ===		=== DynamoDB table: AwaitingStep ===

	<syntaxhighlight lang="JavaScript">		<syntaxhighlight lang="JavaScript">

Sven the Barbarian at 09:18, 25 December 2021

2021-12-25T09:18:22Z

@@ Line 13: / Line 13: @@
 * {string} systemTextGraphTag ("systemText")
 * {string} systemTextServiceNameGraphTag ("systemTextServiceName")
 = LambdaSharedLib =

Sven the Barbarian at 13:17, 18 October 2021

2021-10-18T13:17:47Z

← Older revision		Revision as of 13:17, 18 October 2021
Line 370:		Line 370:

	Generic functions and constants for Locations.		Generic functions and constants for Locations.

			== consts ==

			= AddressesSharedLib =

			Generic functions and constants for Addresses.

	== consts ==		== consts ==

Sven the Barbarian: /* LocationSharedLib */

2021-10-18T13:16:39Z

LocationSharedLib

← Older revision		Revision as of 13:16, 18 October 2021
Line 367:		Line 367:
	* currently only need arnElements.fullResourceName		* currently only need arnElements.fullResourceName

	= ~~LocationSharedLib~~ =		= LocationsSharedLib =

	Generic functions and constants for Locations.		Generic functions and constants for Locations.

	== consts ==		== consts ==




	= Working documents =		= Working documents =

	[[:Category:Working_documents - izara-shared\|Working_documents - NPM module - izara-shared]]		[[:Category:Working_documents - izara-shared\|Working_documents - NPM module - izara-shared]]

Sven the Barbarian at 02:00, 18 October 2021

2021-10-18T02:00:24Z

← Older revision		Revision as of 02:00, 18 October 2021
Line 366:		Line 366:
	* explodes the arn and returns the different elements		* explodes the arn and returns the different elements
	* currently only need arnElements.fullResourceName		* currently only need arnElements.fullResourceName

			= LocationSharedLib =

			Generic functions and constants for Locations.

			== consts ==

Sven the Barbarian: /* GraphSharedLib */

2021-05-30T13:36:28Z

GraphSharedLib

← Older revision		Revision as of 13:36, 30 May 2021
Line 210:		Line 210:
	= GraphSharedLib =		= GraphSharedLib =

	Helper functions for interacting with ~~Neptune~~ graph databases from any service.		Helper functions for interacting with graph databases from any service.

	== constants ==		== constants ==
Line 224:		Line 224:
	* {string} versionedDataToPropertyName ("to")		* {string} versionedDataToPropertyName ("to")
	* {string} originTimestamp ("originTimestamp")		* {string} originTimestamp ("originTimestamp")

			== graphSharedLib.getNode ==

			<syntaxhighlight lang="JavaScript">
			/**
			* @param {string[]} parentNodeIdentifierLabels - array of labels
			* @param {object} parentNodeUniqueIdProperties - node properties
			*
			* @returns {object} an object with ''labels'' and ''properties'' properties
			*/
			</syntaxhighlight>


	== graphSharedLib.createVersionedDataHasRelationshipType ==		== graphSharedLib.createVersionedDataHasRelationshipType ==