VSTest Azure task and MTP

[avivanoff]

According to documentation VSTest Azure task is not compatible with Microsoft Testing Platform. A couple of questions:

1. Our project has a mix of managed and native tests. Managed tests use MSTest.Sdk, native tests use Microsoft Unit Testing Framework for C++. In Azure pipelines we use a single VSTest task to run all tests, both managed and native. It should not work according to documentation, but it does.
2. If not VSTest task, what is the right approach to execute a mix of managed and native tests?

[Jakub Jareš (nohwnd)]

1. VSTest task will run vstest.console directly, which won't try to run the tests via MTP, instead it will run them via VSTest. This is part of our compatibility story, and is the same mechanisme that allows <UseVSTest>true</UseVSTest> to disable MTP even when used with MSTest.SDK.

2. There currently no single way to run c++ tests and MTP tests using the same command. The best way currently is to use dotnet test to run the managed tests, and keep using vstest to run c++ tests.

[Youssef Fahmy (Youssef1313)]

The documentation is correct. VSTest AzDO task doesn't support MTP.

Even if you managed to run both VSTest and MTP together with dotnet test, it's explicitly unsupported scenario, and it won't work with .NET 10 SDK + MTP v2.

The right action here is to separate this step to two steps:

1. Use dotnet test to run the managed tests with MTP.
2. Use VSTest task to run the native tests.

[avivanoff]

Youssef Fahmy (@Youssef1313), Just tried VSTest task with released today MSTest.Sdk 4.0.0. Still works. I thought this should not work.

[Amaury Levé (Evangelink)]

https://devblogs.microsoft.com/dotnet/microsoft-testing-platform-azure-retry/