Skip to content

[Annotation Error] Possible incorrect ground-truth label for MME-RealWorld-CN sample 000137.jpg #16

Description

@miku722

Title: [Annotation Error] Incorrect ground-truth label for MME-RealWorld-CN sample 000137.jpg

Description

I found an incorrect ground-truth annotation in the MME-RealWorld-CN dataset.

Sample information

  • Dataset: MME-RealWorld-CN
  • Image file: ME_RealWorld_CN_images/000137.jpg
  • Sample index: 137
  • Sample UID: mme-realworld-cn:index:137
  • Dataset version/download date: [add the version, commit hash, or download date]

Question

白色的车准备往哪里驾驶?

  • (A) 直走
  • (B) 左转
  • (C) 右转
  • (D) 后退
  • (E) 图中没有对应特征

Current annotation

  • Current ground-truth answer: A
  • Current answer text: 直走

Proposed correction

  • Correct answer: C
  • Correct answer text: 右转

Evidence

The white vehicle is traveling in the right-turn lane.

The road markings and lane layout indicate that this lane is designated for vehicles turning right. Therefore, the vehicle is preparing to turn right rather than continue straight.

The ground-truth label should consequently be changed from:

A. 直走

to:

C. 右转

Evaluation impact

The current annotation incorrectly marks model predictions of C as wrong and predictions of A as correct. This may affect the reported benchmark accuracy for this sample.

Please verify and correct the annotation in MME_RealWorld_CN.json.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions