To review a viewpoint, simply adjust the slider for the image based on the following guidelines:
Top-down view (view from above)
-
The easiest way to mentally-visualize and decide on the correct viewpoint is by asking "Which way is the head pointing?" in relation to the camera. However, the pose of the animal will vary wildly based on physical characteristics of the species (long knecks, long legs, etc). In all cases, use the body position of the animal to decide the orientation instead of the position of the animal's face.
For example:
For this example, the camera is on the left side of the animal (looking from above), and the correct viewpoint that should be selected is .
For this example, again, the camera is on the left side of the animal (looking from above). However, even though the animal's face is pointed towards the camera, we use the body position to decide the correct orientation. The correct viewpoint that should be selected is .
This is a boarder-line example that is ultimately a left side view of the animal and not front-left. Therefore, the correct viewpoint that should be selected is .
Another boarder-line example that is also ultimately a left side view of the animal and not back-left. The correct viewpoint that should be selected is .
This example, however, is a back-left side of the animal (looking from above). The correct viewpoint that should be selected is .
For this example, the camera is on the front-right side of the animal (looking from above). The correct viewpoint that should be selected is .
- For faster viewpoint annotation, the number keys or a keypad can be used. The numbers 1 thru 8 are mapped to increments of 45°. We urge every reviewer to use the number pad to input the viewpoint, but you can further adjust the slider to get even closer accuracy, down to a precision of a single degree.
- If the viewpoint cannot be determined due to not enough information (e.g., the animal is obscured by some obstacle, the image is too blurry or there isn't enough light, there is only a small chunk of an animal in the image - like a leg or a piece of the head), you have two choices:
- edit the annotation by revisiting the image (link below the image)
- simply press the Delete button
- The Space key deletes the image and does not save any viewpoint information for that image. The Enter key submits the current quality of the slider as the image's viewpoint.
- Enter viewpoints as fast as you can while maintaining perfect accuracy.
- To bring up these instructions again, click on the button
To review a quality, simply adjust the slider for the image based on the following guidelines:
The "information" (keypoints) in the image that we want to classify
-
When deciding the quality of an image, it is important to keep in mind what information the underlying image analysis algorithms care about.
Looking at the image above, the white ellipsis on the body of the animal indicate what informaiton is the most important, whereas the red and orange
ellipsis indicate information that is less important.
-
The quality of the annotation is decided by 4 metrics (by order of importance):
-
Partially Visible - the entire animal is not visible due to visual obstruction by non-landscape objects (other animals, cars, buildings, the animal is off the side of the image, etc.)
-
Occlusion - the entire animal is not visible due to visual obstruction by natural landscape (brush, trees, grass, etc.)
-
Focus - the image of the animal is out of focus
-
Lighting and Shadow - the animal is under- or over-exposed, shadowed by another object, or its own pose is causing shadows on its body
-
The way you measure the image's quality will change for each viewpoint. If the viewpoint would not normally allow for one of the metrics above (e.g. a frontal image of a Plains Zebra would not normally
give a view of the rump) then that metric can be ignored. Judge the image on what an "ideal" image of that species given the viewpoint the animal is in.
For example:
Junk
- Severe occlusion
- Little to no parts visible
- Out of focus
- Lots of shadow
Poor
- Severe occlusion
- Head, shoulder, OR rump visible
- Mildly out of focus
- Lots of shadow
OK
- Little occlusion
- Head, shoulder, AND rump visible
- In focus
- Moderate shadow
Good
- Little occlusion
- Entire animal visible
- In focus
- Little shadow
Excellent
- No occlusion
- Entire animal visible
- In focus
- No shadow
- For faster quality annotation, the number keys or a keypad can be used. The letters Q (1), W (2), E (3), R (4), T (5) are mapped to their corresponding star ratings. We urge every reviewer to use the number pad to input the quality for speed purposes.
- If the quality cannot be determined due to not enough information (e.g., the animal is no animal in the image, the image is too blurry or there isn't enough light, there is only a small chunk of an animal in the image - like a leg or a piece of the head), you have two choices:
- edit the annotation by revisiting the image (link below the image)
- simply press the Delete button
- The Space key deletes the image and does not save any quality information for that image. The Enter key submits the current value of the slider as the image's quality.
- Enter qualities as fast as you can while maintaining perfect accuracy.
- To bring up these instructions again, click on the button