DurableEmitter Optimizations

[DylanTinianov]

• Coalesce deletes instead of marking delivered + purge loop.
• Removes Fallback client (doesn't provide any value and adds complexity during outages).
• Added page cursor to cycle through DB start point in retransmit loop to be proactive against events that never deliver from blocking other events from being resent.
• Cleans up unnecessary DB calls and logs.

Tested on Reliability Env

[github-actions]

👋 DylanTinianov, thanks for creating this pull request!

To help reviewers, please consider creating future PRs as drafts first. This allows you to self-review and make any final changes before notifying the team.

Once you're ready, you can mark it as "Ready for review" to request feedback. Thanks!

[github-actions]

⚠️ API Diff Results - github.com/smartcontractkit/chainlink-common

⚠️ Breaking Changes (16)

pkg/durableemitter (1)

• NewDurableEmitter — Type changed:

func(
  DurableEventStore, 
  BatchEmitter, 
  - github.com/smartcontractkit/chainlink-common/pkg/chipingress.Client, 
  bool, 
  Config, 
  github.com/smartcontractkit/chainlink-common/pkg/logger.Logger, 
  go.opentelemetry.io/otel/metric.Meter
)
(*DurableEmitter, error)

pkg/durableemitter.(*PgDurableEventStore) (4)

• ListPending — Type changed:

func(
  context.Context, 
  time.Time, 
  + time.Time, 
  + int64, 
  int
)
([]DurableEvent, error)

• MarkDelivered — 🗑️ Removed

• MarkDeliveredBatch — 🗑️ Removed

• PurgeDelivered — 🗑️ Removed

pkg/durableemitter.Config (5)

• MarkBatchFlushInterval — 🗑️ Removed

• MarkBatchSize — 🗑️ Removed

• MarkBatchWorkers — 🗑️ Removed

• PurgeBatchSize — 🗑️ Removed

• PurgeInterval — 🗑️ Removed

pkg/durableemitter.DurableEventStore (5)

• BatchDelete — ➕ Added

• ListPending — Type changed:

func(
  context.Context, 
  time.Time, 
  + time.Time, 
  + int64, 
  int
)
([]DurableEvent, error)

• MarkDelivered — 🗑️ Removed

• MarkDeliveredBatch — 🗑️ Removed

• PurgeDelivered — 🗑️ Removed

pkg/durableemitter.Hooks (1)

• OnBatchMarkDelivered — 🗑️ Removed

✅ Compatible Changes (5)

pkg/durableemitter.(*PgDurableEventStore) (1)

• BatchDelete — ➕ Added

pkg/durableemitter.Config (3)

• DeleteBatchFlushInterval — ➕ Added

• DeleteBatchSize — ➕ Added

• DeleteBatchWorkers — ➕ Added

pkg/durableemitter.Hooks (1)

• OnBatchDelete — ➕ Added

---

📄 View full apidiff report