Skip to main content
​
Improvement
What's new

​
Improvements

​
Report extraction failures with job feedback

Submit job feedback (POST /v1/jobs/{jobUuid}/feedback) items now take an optional kind, so you can report a problem with the content a label was evaluated on rather than with the label’s outcome:
  • JOB_FEEDBACK_KIND_MISCLASSIFICATION: the label’s outcome was wrong. expectedOutcome is required. Omitting kind means the same thing, so existing integrations keep working unchanged.
  • JOB_FEEDBACK_KIND_MISSING_FRAME: a video frame that should have been extracted was missing.
  • JOB_FEEDBACK_KIND_MALFORMED_TRANSCRIPT: the video’s transcript was malformed.
expectedOutcome is now optional, and must be omitted for the two extraction kinds, since there is no label outcome to disagree with. Extraction feedback is also accepted on a label that did not reach a definite result. Get job feedback (GET /v1/jobs/{jobUuid}/feedback) returns each entry’s kind, with expectedOutcome and actualOutcome set to EVALUATION_RESULT_UNSPECIFIED where they don’t apply.