Developer guide for making Integration Tests

Overview

How to create folder and file in S3 bucket for prepare integrationTest

Integration Test Config for config of property in file resources.json, events.json and tests.json

Setup integrationtest

Create folder

• create folder in buckets s3

integrationtest-config-us-east-2/test_config/{your folder name}

• your folder name

1.Create name Developer for folder name inside test_config

2.Create folder service Names of Test

3.Create folder your test

integrationtest-config-us-east-2/test_config/{nameDeveloper}/{serviceNames}/{foldeTest}/

eg. integrationtest-config-us-east-2/test_config/mintDev/complexFilter/basicCase/

4.Can save file events, tests,resources inside

Note: can shared file events, tests,resources by bucket Prefix.

Create file

• files upload in s3'

-resources.json

-events.json

-tests.json

1.resources.json and events.json is json object

note :Can create these files in a SharedResource folder and share it with another test for collaborative usage

eg. integrationtest-config-us-east-2/test_config/jamesDev/SellOfferManager/SharedResource/resources.json

2.tests.json is json array of objects

• Detail of files

1.resources.json

• Syntax; resources Syntax

2.events.json

• Syntax; events Syntax
• If initeage stage snsSqsTrigger is true but not set snsServiceName or snsTopic

-sns

• set snsSqsTrigger is true, if not set or fase ---> direct invoke

-DirectSqs

• set BatchSqsMessages is true, if not set or fase ---> direct invoke

• forStageMatching Use in test important parameter
• testValueMatches is default true

testValueMatches use in case not test parameter random data eg. timeStamp or uuid , but function require paramiter.

3.tests.json

• Syntax; tests Syntax
• Case test dynamodb (optional test) use dynamodbOutputEventIdentifiers in stage of test

• Upload file to s3

1.batchscript

2.upload to S3 bucket directly

#!/bin/bash 
set -u 

localPath="/home/dogsrcute/Programming mint/Fixed_Integrationtest/PluemDev/paginate/2stages" 
bucketName=s3://integrationtest-config-us-east-2/test_config/mintDev/fixed/PluemDev/2stages/ 

aws s3 cp "$localPath" "$bucketName" --recursive

• localPath is part to files for upload
• bucketName is your bucket
• run interminal in folder uploadFileToS3.sh

bash uploadFileToS3.sh

Type of parameter

Parameter type for create property in events.json

object: { 
	forStageMatching: true, 
	properties: {} 
}, 
array: { 
	forStageMatching: true, 
	eventValue: [] 
}, 
number: { 
	forStageMatching: true, 
	value: 1111 
}, 
string: { 
	forStageMatching: true, 
	value: "hi" 
}, 
boolean: { 
	forStageMatching: true, 
	value: true 
} 

// Case empty 
EmptyString:{ 
	value: "" 
}, 
EmptyArray:{ 
	forStageMatching: true, 
	eventValue: [] 
}, 
EmptyObject:{ 
	forStageMatching: true, 
	value: {} 
}

Test

• results of test show in dynamodb table IntTestingTestTestRecord.
• How to test integrationtest

direct invoke or BashScript

1. direct invoke in console lambda function IntTestingTestInitiateIntegrationTestHdrInv

create params for invoke

{ 
	"serviceName": "ComplexFilter",  
	"resourceType": "Lambda",  
	"resourceName": "ProcessComplexFilterHdrSqs",  
	"integrationTestTags": [ 
		"test_S3_ByDev"  
	],  
	"bucketName": "integrationtest-config-us-east-2",  
	"bucketPrefix":[  
		"test_config/mintDev/basicCase/", 
		"test_config/mintDev/SharedResource/"  
	]  
}

2.BashScript integrationTest.sh

2.1 create file integrationTest.sh

#!/bin/bash
​set -u
stage="Test"
region="us-east-2"
aws configure set region ${region}

declare -a groupTests=(

'{
  "serviceName": "DelivMethodSTD",
  "resourceType": "Lambda",
  "resourceName": "MockDeliveryMethod2GetHdrInv",
  "integrationTestTags": [
    "integrationTest_DelivMethodSTD_Get_NomalCase"
  ],
  "bucketName": "integrationtest-config-us-east-2",
  "bucketPrefix": [
    "test_config/mintDev/DelivMethodSTD/getPassed/",
    "test_config/PluemDev/SharedResource/"
  ]
}'

)

functionName="IntTesting"

for test in "${groupTests[@]}"; do
	echo "start one set of tests"
	echo ${test}
	#... invoke InitateTests....
	aws lambda invoke \
	--function-name "${functionName}${stage}InitiateIntegrationTestHdrInv" \
	--payload "${test}" \
	--invocation-type RequestResponse \
	--cli-binary-format raw-in-base64-out \
	/dev/stdout

	echo "----------- Finish("${functionName}${stage}InitiateIntegrationTestHdrInv") ------------"
done

2.2 run bashscript

bash integrationTest.sh

Setup seedData

some case much have data before test.In case not own service can be put seedData in bucket s3 and run bashscript "refreshSeedData.sh" for delete old seedData and generate seedData in ownservcie and add on seedData(for use case test) in s3.

• dynamodb
• graphHandler
• bashscript

1.dynamodb

1.1 setting in service

1.1.1 app/__test__/initial_setup/src/ServiceConfig.js

in function tableConfigs

module.exports.tableConfigs = {
  Config: {
    clearDataWhenRefresh: true
  }
}

• clearDataWhenRefresh set true if want to refresh seed data

1.1.2 /app/sls_yaml/core-function.yml

in function name RemoveSeedDataDynamo

add role of table want to RemoveSeedData.

bashscript

1.create file bashScript "refreshSeedData.sh"

#!/bin/bash
set -u

declare -a refreshSeedServices=(
"testingMint"
# "DelivMethodSTD"
)

stage="Test"
region="us-east-2"

payload='{
	"bucketS3":{
		"bucketName":"integrationtest-config-us-east-2",
		"bucketPrefix":["seedData_integrationTest/MintDev/caseTestGenerateSeedData/IntTesting/dynamoDB/",
						"seedData_integrationTest/MintDev/caseTestGenerateSeedDataA/IntTesting/dynamoDB/"
		]
	}
}'

payload="${payload:-{}}"
# Check if the payload is still empty and warn the user
if [ "$payload" == "{}" ]; then
    echo "GenerateSeedData form ownservice"
fi
# # -------------------------------------------------------------------------------------------------------


for refreshSeedService in "${refreshSeedServices[@]}"; do
	echo "start refresh seed graph data for ${refreshSeedService}, function name: ${refreshSeedService}${stage}RemoveSeedDataDynamo"

	# refresh seed data dynamodb
	aws lambda invoke \
	--function-name "${refreshSeedService}${stage}RemoveSeedDataDynamo" out\
	--cli-binary-format raw-in-base64-out \
	--region=${region} || continue
done
echo "Finish run all RemoveSeedDataDynamo"

for refreshSeedService in "${refreshSeedServices[@]}"; do
    echo "start refresh seed dynamoDB data for ${refreshSeedService}, function name: ${refreshSeedService}${stage}GenerateSeedDataDynamoTestEnv"
    echo "payload:${payload}"

    aws lambda invoke \
    --function-name "${refreshSeedService}${stage}GenerateSeedDataDynamoTestEnv" out \
    --payload "${payload}" \
    --cli-binary-format raw-in-base64-out \
    --region=${region} || continue
done
echo "Finish run all GenerateSeedDataDynamoTestEnv"

2.run bashscript

bash refreshSeedData.sh

Working documents

Working_documents - Developer guide for making Integration Tests