CUMULUS-4241: Backport CUMULUS-4191 to v20.3.x (#4090)

* CUMULUS-4191: Update lambdas to filter rules based on provider in message (#4062)

* CUMULUS-4191: Update lambdas to filter rules based on provider in message

* add int test checking rule provider

* add unit tests

* add unit tests

* remove serial

* remove some comments

* convert messageConsumer handler to new style

* update changelog

* PR feedback

* CUMULUS-4252: Fix S3 unit test failures caused by stricter validation introduced in aws-sdk 3.896.0 (#4079)

* fix test-multipartCopyObject failures caused by stricter validation introduced in aws-sdk 3.896.0

* update related unit tests

* update changelog

* remove unused import

* Update lzards test client to use provider, add 'status' global to int… (#4080)

* Update lzards test client to use provider, add 'status' global to int tests

* Fix additional broken tests

* Update CHANGELOG

* Re-enable tests

* Update tests to use collection param over metadata collection query

* Fix unit tests

* CUMULUS-4254: Pin AWS-SDK version to circumvent circular JSON issue (#4081)

* CI fix

* changelog

* sns fix

* removing any type

* pinning version

* pinning all aws-sdk to 3.621 and also fixing lzards collection api issue

* changing types to 3.609 and removing status from lzards reqs

* fixing typo

* update errorify to remove circular reference

* unpinning versions

* updated changelog for errorify

* move errorify to errors package

* using errors/errorify instead of api/errorify

* re-adding status

* mv errorify test to errors

* fix lint additional errorify

* test:ci

* rename test file

---------

Co-authored-by: jennyhliu <[email protected]>

* backport 4191 + CI fixes to 20.3.x

* adding release-20-ci-tf stack vars

---------

Co-authored-by: jennyhliu <[email protected]>
Co-authored-by: Jonathan Kovarik <[email protected]>
Co-authored-by: jennyhliu <[email protected]>

Author: 3 people

CHANGELOG.md

@@ -4,6 +4,28 @@ All notable changes to this project will be documented in this file.
 
 The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 
+## [v20.3.1] 2025-10-14
+
+### Changed
+
+- **CUMULUS-4191**
+  - Updated `messageConsumer` and `sqsMessageConsumer` Lambdas to apply rule filtering
+    based on the provider from the record message.
+  - Updated `messageConsumer` lambda handler to async/await style
+
+- **CUMULUS-4242**
+  - Updated @cumulus/lizards-api-client to include configured provider via `lzards_provider` env var in all queries
+  - Updated LZARDS integration tests to work with updated API client query requirements for API version 1.5.25
+
+- **CUMULUS-4252**
+  - Fixed `@aws-client/S3` unit test failures caused by stricter validation introduced in
+    `@aws-sdk/[email protected]`
+
+- **CUMULUS-4254**
+  - Moved `@cumulus/api/lib/utils.errorify` function to `@cumulus/errors` and updated it to remove circular reference
+  - Used `errorify` instead of `JSON.stringify` for AWS errors
+  - Added required `collection` field to lzards api request in `LzardsBackupSpec` integration test to fix the bug in `CUMULUS-4242`
+
 ## [v20.3.0] 2025-08-18
 
 ### Notable Changes

example/cumulus-tf/lambdas.tf

@@ -198,6 +198,7 @@ resource "aws_lambda_function" "lzards_api_client_test" {
       launchpad_api                           = var.launchpad_api
       lzards_launchpad_certificate            = var.launchpad_certificate
       lzards_launchpad_passphrase_secret_name = length(var.launchpad_passphrase) == 0 ? null : aws_secretsmanager_secret.lzards_api_client_test_launchpad_passphrase.name
+      lzards_provider                         = var.lzards_provider
     }
   }
 

example/deployments/cumulus/release-20-ci-tf.tfvars

@@ -0,0 +1 @@
+prefix = "release-20-ci-tf"

example/deployments/data-persistence/release-20-ci-tf.tfvars

@@ -0,0 +1 @@
+prefix = "release-20-ci-tf"

example/deployments/db-migration/release-20-ci-tf.tfvars

@@ -0,0 +1 @@
+prefix = "release-20-ci-tf"

example/lambdas/asyncOperations/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@cumulus/test-async-operations",
-  "version": "20.3.0",
+  "version": "20.3.1",
   "description": "AsyncOperations Test Lambda",
   "main": "index.js",
   "private": true,

example/lambdas/ftpPopulateTestLambda/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@cumulus/ftp-populate-test-lambda",
-  "version": "20.3.0",
+  "version": "20.3.1",
   "description": "FTP Population Utility Lambda",
   "main": "index.js",
   "private": true,
@@ -19,12 +19,12 @@
     "access": "private"
   },
   "dependencies": {
-    "@cumulus/api": "20.3.0",
-    "@cumulus/api-client": "20.3.0",
-    "@cumulus/common": "20.3.0",
-    "@cumulus/integration-tests": "20.3.0",
-    "@cumulus/logger": "20.3.0",
-    "@cumulus/test-data": "20.3.0",
+    "@cumulus/api": "20.3.1",
+    "@cumulus/api-client": "20.3.1",
+    "@cumulus/common": "20.3.1",
+    "@cumulus/integration-tests": "20.3.1",
+    "@cumulus/logger": "20.3.1",
+    "@cumulus/test-data": "20.3.1",
     "fs-extra": "^9.0.0",
     "jsftp": "https://github.com/jkovarik/jsftp.git#add_288",
     "lodash": "^4.17.20"

example/lambdas/lzardsClientTest/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@cumulus/test-lzards-api-lambda",
-  "version": "20.3.0",
+  "version": "20.3.1",
   "description": "LZARDS API Client Test Lambda",
   "private": true,
   "engines": {
@@ -20,7 +20,7 @@
   "author": "Cumulus Authors",
   "license": "Apache-2.0",
   "dependencies": {
-    "@cumulus/logger": "20.3.0",
-    "@cumulus/lzards-api-client": "20.3.0"
+    "@cumulus/logger": "20.3.1",
+    "@cumulus/lzards-api-client": "20.3.1"
   }
 }

example/lambdas/python-processing/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@cumulus/python-process-activity",
   "private": true,
-  "version": "20.3.0",
+  "version": "20.3.1",
   "description": "Python reference activity",
   "homepage": "https://github.com/nasa/cumulus/tree/master/example/lambdas/python-reference-activity",
   "repository": {

example/lambdas/python-reference-activity/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@cumulus/python-reference-activity",
   "private": true,
-  "version": "20.3.0",
+  "version": "20.3.1",
   "description": "Python reference activity",
   "homepage": "https://github.com/nasa/cumulus/tree/master/example/lambdas/python-reference-activity",
   "repository": {