GitHub - udhos/sqspipe: continuously move messages between aws sqs queues in a r...
source link: https://github.com/udhos/sqspipe
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
sqspipe
sqspipe continuously moves messages between aws sqs queues in a rate limited manner.
Build
git clone https://github.com/udhos/sqspipe
cd sqspipe
go install ./sqspipe
export QUEUE_URL_SRC=https://sqs.us-east-1.amazonaws.com/111111111111/queue_src
export QUEUE_URL_DST=https://sqs.us-east-1.amazonaws.com/222222222222/queue_dst
sqspipe
Mandatory Env Vars
sqspipe will move messages from source queue defined in $QUEUE_URL_SRC to destination queue defined in $QUEUE_URL_DST.
These env vars are required.
export QUEUE_URL_SRC=https://sqs.us-east-1.amazonaws.com/111111111111/queue_src
export QUEUE_URL_DST=https://sqs.us-east-1.amazonaws.com/222222222222/queue_dst
Optional Env Vars
These env vars are optional.
export ROLE_ARN_SRC=arn:aws:iam::111111111111:role/sqs_consumer
export ROLE_ARN_DST=arn:aws:iam::222222222222:role/sqs_producer
export MAX_RATE=16 ;# max messages per second
Roles
You can use $ROLE_ARN_SRC to specify a role to access the source queue, and $ROLE_ARN_DST to specify a role to access the destination queue. The role in $ROLE_ARN_SRC must allow actions sqs:ReceiveMessage and sqs:DeleteMessage to source queue. The role in $ROLE_ARN_DST must allow action sqs:SendMessage to destination queue.
Max Rate
If $MAX_RATE isn't specified, it defaults to 16 messages per second.
Docker
Build recipe:
./docker/build.sh
Pull from Docker hub:
docker pull udhos/sqspipe:0.0.0
Docker hub: https://hub.docker.com/r/udhos/sqspipe
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK