load progress in query-status sometimes become smaller

[GMHDBJD]

What did you do?

query-status when in load stage

What did you expect to see?

load progress become larger

What did you see instead?

sometimes become smaller

tiup dmctl:v2.0.7 --master-addr=172.16.6.1:8161 query-status test -s mysql-replica-01
Starting component `dmctl`: /home/gmhdbjd/.tiup/components/dmctl/v2.0.7/dmctl/dmctl --master-addr=172.16.6.1:8161 query-status test -s mysql-replica-01
{
    "result": true,
    "msg": "",
    "sources": [
        {
            "result": true,
            "msg": "",
            "sourceStatus": {
                "source": "mysql-replica-01",
                "worker": "dm-172.16.6.7-8363",
                "result": null,
                "relayStatus": null
            },
            "subTaskStatus": [
                {
                    "name": "test",
                    "stage": "Running",
                    "unit": "Load",
                    "result": null,
                    "unresolvedDDLLockID": "",
                    "load": {
                        "finishedBytes": "65011251",
                        "totalBytes": "3854328608",
                        "progress": "1.69 %",
                        "metaBinlog": "(mysql-bin.000005, 918368254)",
                        "metaBinlogGTID": "1e62060e-3c65-11ec-a30b-0242ac110002:1-5633"
                    }
                }
            ]
        }
    ]
}
tiup dmctl:v2.0.7 --master-addr=172.16.6.1:8161 query-status test -s mysql-replica-01
Starting component `dmctl`: /home/gmhdbjd/.tiup/components/dmctl/v2.0.7/dmctl/dmctl --master-addr=172.16.6.1:8161 query-status test -s mysql-replica-01
{
    "result": true,
    "msg": "",
    "sources": [
        {
            "result": true,
            "msg": "",
            "sourceStatus": {
                "source": "mysql-replica-01",
                "worker": "dm-172.16.6.7-8363",
                "result": null,
                "relayStatus": null
            },
            "subTaskStatus": [
                {
                    "name": "test",
                    "stage": "Running",
                    "unit": "Load",
                    "result": null,
                    "unresolvedDDLLockID": "",
                    "load": {
                        "finishedBytes": "67108866",
                        "totalBytes": "3854328608",
                        "progress": "1.74 %",
                        "metaBinlog": "(mysql-bin.000005, 918368254)",
                        "metaBinlogGTID": "1e62060e-3c65-11ec-a30b-0242ac110002:1-5633"
                    }
                }
            ]
        }
    ]
}
tiup dmctl:v2.0.7 --master-addr=172.16.6.1:8161 query-status test -s mysql-replica-01
Starting component `dmctl`: /home/gmhdbjd/.tiup/components/dmctl/v2.0.7/dmctl/dmctl --master-addr=172.16.6.1:8161 query-status test -s mysql-replica-01
{
    "result": true,
    "msg": "",
    "sources": [
        {
            "result": true,
            "msg": "",
            "sourceStatus": {
                "source": "mysql-replica-01",
                "worker": "dm-172.16.6.7-8363",
                "result": null,
                "relayStatus": null
            },
            "subTaskStatus": [
                {
                    "name": "test",
                    "stage": "Running",
                    "unit": "Load",
                    "result": null,
                    "unresolvedDDLLockID": "",
                    "load": {
                        "finishedBytes": "64011683",
                        "totalBytes": "3854328608",
                        "progress": "1.66 %",
                        "metaBinlog": "(mysql-bin.000005, 918368254)",
                        "metaBinlogGTID": "1e62060e-3c65-11ec-a30b-0242ac110002:1-5633"
                    }
                }
            ]
        }
    ]
}

Versions of the cluster

Upstream TiDB cluster version (execute SELECT tidb_version(); in a MySQL client):

(paste TiDB cluster version here)

TiCDC version (execute cdc version):

(paste TiCDC version here)

DM version (execute dmctl -V):

nightly

[lance6716]

caused by

tiflow/dm/loader/loader.go

Lines 224 to 225 in 528ca40

	// update finished offset after checkpoint updated
	w.loader.finishedDataSize.Store(job.offset)

introduced in pingcap/dm#1778

[lance6716]

/assign @Ehco1996

[Ehco1996]

/assign @Ehco1996

i am sorry but i not remeber why i do this change in that PR 😅
fixed in #4093