Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Redis dlq support #1478

Merged
merged 3 commits into from
Oct 10, 2024
Merged

Redis dlq support #1478

merged 3 commits into from
Oct 10, 2024

Conversation

jaymell
Copy link
Contributor

@jaymell jaymell commented Oct 4, 2024

Add support for moving failed messages to deadletter queue in
Redis. The queue can be re-driven via an undocumented endpoint,
/api/v1/admin/redrive-dlq.

@jaymell jaymell force-pushed the redis-dlq-support branch 2 times, most recently from 8adfc31 to 8ae8326 Compare October 7, 2024 18:34
@jaymell jaymell marked this pull request as ready for review October 7, 2024 19:27
@jaymell jaymell requested a review from a team as a code owner October 7, 2024 19:27
@jaymell jaymell force-pushed the redis-dlq-support branch from bc06ac8 to d82b4c6 Compare October 7, 2024 19:36
svix-gabriel
svix-gabriel previously approved these changes Oct 7, 2024
Copy link
Contributor

@svix-gabriel svix-gabriel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I left a minor nit, but otherwise LGTM.

Will we have admin endpoints for viewing the DLQ too?

README.md Outdated Show resolved Hide resolved
@jaymell
Copy link
Contributor Author

jaymell commented Oct 7, 2024

Will we have admin endpoints for viewing the DLQ too?

Yeah we probably need it. Elsewhere we monitor the queue depth, so at a minimum I should probably just add that for now. Otherwise it's completely opaque what's going on w/ the queue since we create/manage it internally.

@jaymell jaymell force-pushed the redis-dlq-support branch 3 times, most recently from a2a0b68 to be6e7c2 Compare October 8, 2024 16:41
This matches downstream changes and should make the integration
of DLQ support seamless.
Add support for moving failed messages to deadletter queue in
Redis. The queue can be re-driven via an undocumented endpoint,
`/api/v1/admin/redrive-dlq`.
@jaymell jaymell force-pushed the redis-dlq-support branch from be6e7c2 to 75f243a Compare October 8, 2024 21:57
Bring in downstream changes to prevent flakes here.
@jaymell jaymell requested a review from svix-gabriel October 10, 2024 15:10
@jaymell
Copy link
Contributor Author

jaymell commented Oct 10, 2024

For now, I've added metrics to monitor the DLQ (and other queues) via metrics (#1479). We can consider adding additional admin endpoints later, but for now the metrics will prevent DLQ contents from being completely opaque to the user.

@svix-james svix-james merged commit d0443bd into svix:main Oct 10, 2024
7 checks passed
@jaymell jaymell deleted the redis-dlq-support branch October 10, 2024 20:43
@jaymell jaymell mentioned this pull request Nov 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants