Skip to content

Performance regression for dbt test in 1.9 and later #1245

Description

@stegus64

I have noticed the same problem as reported in #1166 but now for dbt test. The fix for #1166 fixed the problem for dbt run, but the same problem remains for dbt test.

dbt test -s tests\test_iticket_multiple_tourcodes.sql
08:43:51 Running with dbt=1.10.13
08:43:52 Registered adapter: databricks=1.10.14
08:43:55 Found 305 models, 17 snapshots, 117 data tests, 10 seeds, 207 sources, 7 exposures, 900 macros
08:43:55
08:43:55 Concurrency: 8 threads (target='dev')
08:43:55
08:45:02 1 of 1 START test test_iticket_multiple_tourcodes .............................. [RUN]
08:45:05 1 of 1 PASS test_iticket_multiple_tourcodes .................................... [PASS in 2.94s]
08:45:05
08:45:05 Finished running 1 test in 0 hours 1 minutes and 10.07 seconds (70.07s).
08:45:05
08:45:05 Completed successfully
08:45:05
08:45:05 Done. PASS=1 WARN=0 ERROR=0 SKIP=0 NO-OP=0 TOTAL=1

Note the delay for over 60 seconds between 08:43:55 and 08:45:02

When running the same command on 1.8 everything works as expected:

dbt test -s tests\test_iticket_multiple_tourcodes.sql
08:39:23 Running with dbt=1.8.0
08:39:24 Registered adapter: databricks=1.8.0
08:39:25 Found 305 models, 17 snapshots, 117 data tests, 10 seeds, 207 sources, 7 exposures, 786 macros
08:39:25
08:39:45 Concurrency: 8 threads (target='dev')
08:39:45
08:39:45 1 of 1 START test test_iticket_multiple_tourcodes .............................. [RUN]
08:39:48 1 of 1 PASS test_iticket_multiple_tourcodes .................................... [PASS in 2.83s]
08:39:49
08:39:49 Finished running 1 test in 0 hours 0 minutes and 24.22 seconds (24.22s).
08:39:49
08:39:49 Completed successfully
08:39:49
08:39:49 Done. PASS=1 WARN=0 ERROR=0 SKIP=0 TOTAL=1

Metadata

Metadata

Assignees

No one assigned

    Labels

    StalebugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions