Multi-card inference of Ovis2.5-9B

[casillas1111]

Simply adding 'device_map='auto'' during model loading will result in an error: "Expected all tensors to be on the same device, but at least two devices were found: cuda:1 and cuda:0!"

Are there any solutions? Thank you very much.