Title: [Annotation Error] Incorrect ground-truth label for MME-RealWorld-CN sample 000137.jpg
Description
I found an incorrect ground-truth annotation in the MME-RealWorld-CN dataset.
Sample information
- Dataset: MME-RealWorld-CN
- Image file:
ME_RealWorld_CN_images/000137.jpg
- Sample index:
137
- Sample UID:
mme-realworld-cn:index:137
- Dataset version/download date:
[add the version, commit hash, or download date]
Question
白色的车准备往哪里驾驶?
- (A) 直走
- (B) 左转
- (C) 右转
- (D) 后退
- (E) 图中没有对应特征
Current annotation
- Current ground-truth answer:
A
- Current answer text:
直走
Proposed correction
- Correct answer:
C
- Correct answer text:
右转
Evidence
The white vehicle is traveling in the right-turn lane.
The road markings and lane layout indicate that this lane is designated for vehicles turning right. Therefore, the vehicle is preparing to turn right rather than continue straight.
The ground-truth label should consequently be changed from:
to:
Evaluation impact
The current annotation incorrectly marks model predictions of C as wrong and predictions of A as correct. This may affect the reported benchmark accuracy for this sample.
Please verify and correct the annotation in MME_RealWorld_CN.json.
Title: [Annotation Error] Incorrect ground-truth label for MME-RealWorld-CN sample 000137.jpg
Description
I found an incorrect ground-truth annotation in the MME-RealWorld-CN dataset.
Sample information
ME_RealWorld_CN_images/000137.jpg137mme-realworld-cn:index:137[add the version, commit hash, or download date]Question
白色的车准备往哪里驾驶?
Current annotation
A直走Proposed correction
C右转Evidence
The white vehicle is traveling in the right-turn lane.
The road markings and lane layout indicate that this lane is designated for vehicles turning right. Therefore, the vehicle is preparing to turn right rather than continue straight.
The ground-truth label should consequently be changed from:
to:
Evaluation impact
The current annotation incorrectly marks model predictions of
Cas wrong and predictions ofAas correct. This may affect the reported benchmark accuracy for this sample.Please verify and correct the annotation in
MME_RealWorld_CN.json.