Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

unstable test TestParallelDDL #37186

Closed
Tracked by #41316
hawkingrei opened this issue Aug 17, 2022 · 4 comments
Closed
Tracked by #41316

unstable test TestParallelDDL #37186

hawkingrei opened this issue Aug 17, 2022 · 4 comments
Labels
component/ddl This issue is related to DDL of TiDB. component/test severity/moderate type/bug The issue is confirmed as a bug.

Comments

@hawkingrei
Copy link
Member

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

     ddl_worker_test.go:255: 
        	Error Trace:	/home/jenkins/.tidb/tmp/04446c229c5a73c16deb3edddcb4db34/sandbox/processwrapper-sandbox/5367/execroot/__main__/bazel-out/k8-fastbuild/bin/ddl/ddl_test_/ddl_test.runfiles/__main__/ddl/ddl_worker_test.go:255
        	Error:      	"41" is not less than "39"
        	Test:       	TestParallelDDL

https://prow.pingcap.net/view/gs/pingcapprow/logs/bazel_test_tidb/1559719363802566656#1:build-log.txt%3A5212

2. What did you expect to see? (Required)

3. What did you see instead (Required)

4. What is your TiDB version? (Required)
@hawkingrei hawkingrei added type/bug The issue is confirmed as a bug. component/test labels Aug 17, 2022
@ti-chi-bot ti-chi-bot added may-affects-4.0 This bug maybe affects 4.0.x versions. may-affects-5.0 This bug maybe affects 5.0.x versions. may-affects-5.1 This bug maybe affects 5.1.x versions. may-affects-5.2 This bug maybe affects 5.2.x versions. may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-6.0 may-affects-6.1 may-affects-6.2 labels Aug 18, 2022
@seiya-annie seiya-annie removed may-affects-4.0 This bug maybe affects 4.0.x versions. may-affects-5.1 This bug maybe affects 5.1.x versions. may-affects-5.2 This bug maybe affects 5.2.x versions. may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-5.0 This bug maybe affects 5.0.x versions. may-affects-6.0 may-affects-6.1 may-affects-6.2 labels Aug 18, 2022
@YangKeao
Copy link
Member

Get another backtrace by running this test repeatedly at local:

[2022/09/15 16:47:42.909 +08:00] [INFO] [db.go:625] ["Waiting for closer"]
--- FAIL: TestParallelDDL (2.02s)
    testkit.go:120: 
                Error Trace:    /home/yangkeao/Project/github.com/YangKeao/tidb/testkit.go:120
                                                        /home/yangkeao/Project/github.com/YangKeao/tidb/testkit.go:113
                                                        /home/yangkeao/Project/github.com/YangKeao/tidb/ddl_worker_test.go:226
                                                        /home/yangkeao/Project/github.com/YangKeao/tidb/wait_group_wrapper.go:33
                                                        /home/yangkeao/Project/github.com/YangKeao/tidb/asm_amd64.s:1571
                Error:          Received unexpected error:
                                [schema:1049]Unknown database '(Schema ID 70)'
                                github.com/pingcap/errors.AddStack
                                        /home/yangkeao/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20211224045212-9687c2b0f87c/errors.go:174
                                github.com/pingcap/errors.Trace
                                        /home/yangkeao/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20211224045212-9687c2b0f87c/juju_adaptor.go:15
                                github.com/pingcap/tidb/ddl.(*ddl).DoDDLJob
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/ddl/ddl.go:1055
                                github.com/pingcap/tidb/ddl.(*ddl).AlterTableAutoIDCache
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/ddl/ddl_api.go:4994
                                github.com/pingcap/tidb/ddl.(*ddl).AlterTable
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/ddl/ddl_api.go:3266
                                github.com/pingcap/tidb/executor.(*DDLExec).executeAlterTable
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/executor/ddl.go:370
                                github.com/pingcap/tidb/executor.(*DDLExec).Next
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/executor/ddl.go:148
                                github.com/pingcap/tidb/executor.Next
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/executor/executor.go:324
                                github.com/pingcap/tidb/executor.(*ExecStmt).next
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/executor/adapter.go:953
                                github.com/pingcap/tidb/executor.(*ExecStmt).handleNoDelayExecutor
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/executor/adapter.go:727
                                github.com/pingcap/tidb/executor.(*ExecStmt).handleNoDelay
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/executor/adapter.go:575
                                github.com/pingcap/tidb/executor.(*ExecStmt).Exec
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/executor/adapter.go:524
                                github.com/pingcap/tidb/session.runStmt
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/session/session.go:2187
                                github.com/pingcap/tidb/session.(*session).ExecuteStmt
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/session/session.go:2051
                                github.com/pingcap/tidb/testkit.(*TestKit).ExecWithContext
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/testkit/testkit.go:278
                                github.com/pingcap/tidb/testkit.(*TestKit).MustExecWithContext
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/testkit/testkit.go:118
                                github.com/pingcap/tidb/testkit.(*TestKit).MustExec
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/testkit/testkit.go:113
                                github.com/pingcap/tidb/ddl_test.TestParallelDDL.func10
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/ddl/ddl_worker_test.go:226
                                github.com/pingcap/tidb/util.(*WaitGroupWrapper).Run.func1
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/util/wait_group_wrapper.go:33
                                runtime.goexit
                                        /usr/lib/golang/src/runtime/asm_amd64.s:1571
                Test:           TestParallelDDL
                Messages:       sql:alter table test_parallel_ddl_2.t3 auto_id_cache 1024, [], error stack [schema:1049]Unknown database '(Schema ID 70)'
                                github.com/pingcap/errors.AddStack
                                        /home/yangkeao/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20211224045212-9687c2b0f87c/errors.go:174
                                github.com/pingcap/errors.Trace
                                        /home/yangkeao/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20211224045212-9687c2b0f87c/juju_adaptor.go:15
                                github.com/pingcap/tidb/ddl.(*ddl).DoDDLJob
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/ddl/ddl.go:1055
                                github.com/pingcap/tidb/ddl.(*ddl).AlterTableAutoIDCache
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/ddl/ddl_api.go:4994
                                github.com/pingcap/tidb/ddl.(*ddl).AlterTable
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/ddl/ddl_api.go:3266
                                github.com/pingcap/tidb/executor.(*DDLExec).executeAlterTable
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/executor/ddl.go:370
                                github.com/pingcap/tidb/executor.(*DDLExec).Next
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/executor/ddl.go:148
                                github.com/pingcap/tidb/executor.Next
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/executor/executor.go:324
                                github.com/pingcap/tidb/executor.(*ExecStmt).next
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/executor/adapter.go:953
                                github.com/pingcap/tidb/executor.(*ExecStmt).handleNoDelayExecutor
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/executor/adapter.go:727
                                github.com/pingcap/tidb/executor.(*ExecStmt).handleNoDelay
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/executor/adapter.go:575
                                github.com/pingcap/tidb/executor.(*ExecStmt).Exec
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/executor/adapter.go:524
                                github.com/pingcap/tidb/session.runStmt
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/session/session.go:2187
                                github.com/pingcap/tidb/session.(*session).ExecuteStmt
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/session/session.go:2051
                                github.com/pingcap/tidb/testkit.(*TestKit).ExecWithContext
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/testkit/testkit.go:278
                                github.com/pingcap/tidb/testkit.(*TestKit).MustExecWithContext
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/testkit/testkit.go:118
                                github.com/pingcap/tidb/testkit.(*TestKit).MustExec
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/testkit/testkit.go:113
                                github.com/pingcap/tidb/ddl_test.TestParallelDDL.func10
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/ddl/ddl_worker_test.go:226
                                github.com/pingcap/tidb/util.(*WaitGroupWrapper).Run.func1
                                        /home/yangkeao/Project/github.com/YangKeao/tidb/util/wait_group_wrapper.go:33
                                runtime.goexit
                                        /usr/lib/golang/src/runtime/asm_amd64.s:1571
    ddl_worker_test.go:264: 
                Error Trace:    /home/yangkeao/Project/github.com/YangKeao/tidb/ddl_worker_test.go:264
                Error:          "41" is not less than "0"
                Test:           TestParallelDDL
FAIL
[2022/09/15 16:47:42.955 +08:00] [INFO] [ddl_api.go:1006] ["Automatically convert BLOB(65535) to MEDIUMBLOB"]

@YangKeao
Copy link
Member

The drop could execute before alter. The execution order of these sqls cannot be predicted.

@Defined2014 Defined2014 mentioned this issue Feb 14, 2023
Open
@jebter jebter added the component/ddl This issue is related to DDL of TiDB. label Sep 11, 2023
@D3Hunter
Copy link
Contributor

seems a flaky case only, remove pick labels

@D3Hunter
Copy link
Contributor

open for too long without response, plz reopen it when needed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
component/ddl This issue is related to DDL of TiDB. component/test severity/moderate type/bug The issue is confirmed as a bug.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
7 participants
@D3Hunter @hawkingrei @jebter @YangKeao @VelocityLight @seiya-annie @ti-chi-bot