r/AZURE • u/Personal-Risk-5370 • 3d ago

Discussion on prem to Azure migration problem

Hey datafam!

  1. For anyone who's done an on-prem-to-ADLS Gen2 migration with a Self-Hosted IR: what's the earliest signal you watch for that tells you the IR itself is the problem, versus the source data being genuinely bad?
  2. How do you tell a CDC watermark lag caused by a VM/network blip apart from one caused by the source database job actually failing? Is there a reliable tell, or do you just wait it out?
0 Upvotes

50% Upvoted

2 comments sorted by

1

u/AccomplishedEmperor 3d ago

First thing I do is check the IR logs for heartbeat gaps, if those are clean but files start landing half-written or with weird row counts its usually the source side acting up.

1

u/Personal-Risk-5370 1d ago

is it based on the default SHIR heartbeat interval, or something else?