Docs Dashboard

Image Metadata

Visual Intent

Category of intents in the image

JSON Models

Example

Image JSON
{
  "imageInfo": {
    "recognitionModels": [
      {
        "modelName": "VisualIntentClsV2",
        "results": [
          {
            "categories": [
              {
                "name": "animal"
              },
              {
                "name": "artwork2D"
              }
            ],
            "featureType": "Categories",
            }
        ]
      }
    ]
  }
}

Annotations

Terms that describe the image content

JSON Models

Example

Image JSON
{
  "imageInfo": {
    "imageRequestInfo": {
      "blob": ""
    },
    "recognitionModels": [
      {
        "modelName": "ImageAnnotationV2",
        "results": [
          {
            "categories": [
              {
                "name": "rice"
              },
              {
                "name": "fried rice"
              },
              {
                "name": "chicken rice"
              },
              {
                "name": "vegetable recipes"
              },
              {
                "name": "vegetable stir fries"
              },
              {
                "name": "chicken"
              }
            ],
            "featureType": "Categories",
            }
        ]
      }
    ]
  }
}

Image

Binary image or URL

JSON Models

Example

Image JSON
{
  "imageInfo": {
    "imageRequestInfo": {
      "blob": "iVBORw0KGgoAAAANSUhEUgAAAKAAAABQCAYAAACeXX40AAAABGdBTUEAALGPC/xhBQAAQABJREFUeAFMvVmQ5Nl1n3dy3ytrX7q7eu+efcEMSGAIQADFRZRJSyGadpiSw5ZDCvlB4Qg/6VHBB+uFr36xXyzLYTvMsPVAyjLpsE2RImAQ2wAYzGC23qu7qmuvzMqs3DP9fTd7aFdPTlZl/pd7z/md/dz7zwQ// …"
    }
  }
}

Fashion-related objects

Clothing, shoes & accessories detected

JSON Models

Example

Image JSON
{
  "imageInfo": {
    "modelName": "ObjectDetection",
    "results": [
      {
        "hotspot": {
          "topLeft": {
            "x":0.61368835,
            "y":0.490951449
          },
          "topRight": {
            "x":0.61368835,
            "y":0.490951449
          },
          "bottomLeft": {
            "x":0.61368835,
            "y":0.490951449
          },
          "bottomRight": {
            "x":0.61368835,
            "y":0.490951449
          }
        },
        "featureType": "Object",
        "area": {
          "topLeft": {
            "x":0.021561414,
            "y":0.0277318656
          },
          "topRight": {
            "x":0.9689646,
            "y":0.0277318656
          },
          "bottomLeft": {
            "x":0.021561414,
            "y":0.954171062
          },
          "bottomRight": {
            "x":0.9689646,
            "y":0.954171062
          }
        }
      }
    ]
  }
}

Optical Character Recognition

Detected text and symbols

JSON Models

Example

Image JSON
{
  "imageInfo": {
    "recognitionModels": [
      {
        "modelName": "OCR",
        "results": [
          {
            "text": "Margie's Travel",
            "featureType": "MSOCR",
            "area": {
              "topLeft": {
                "x":0.0561904758,
                "y":0.413333327
              },
              "topRight": {
                "x":0.47714287,
                "y":0
              },
              "bottomLeft": {
                "x":0.0561904758,
                "y":0.534999967
              },
              "bottomRight": {
                "x":0.47714287,
                "y":0.534999967
              }
            }
          },
          {
            "text": "Phone: 716 555 0123",
            "featureType": "MSOCR",
            "area": {
              "topLeft": {
                "x":0.0542857125,
                "y":0.67
              },
              "topRight": {
                "x":0.342857122,
                "y":0
              },
              "bottomLeft": {
                "x":0.0542857125,
                "y":0.713333368
              },
              "bottomRight": {
                "x":0.342857122,
                "y":0.713333368
              }
            }
          },
          {
            "text": "4567 Main Street, Buffalo, NY 98052",
            "featureType": "MSOCR",
            "area": {
              "topLeft": {
                "x":0.05142857,
                "y":0.7366667
              },
              "topRight": {
                "x":0.553333342,
                "y":0
              },
              "bottomLeft": {
                "x":0.05142857,
                "y":0.785
              },
              "bottomRight": {
                "x":0.553333342,
                "y":0.785
              }
            }
          },
          {
            "text": "margie@margiestravel.com",
            "featureType": "MSOCR",
            "area": {
              "topLeft": {
                "x":0.0533333346,
                "y":0.803333342
              },
              "topRight": {
                "x":0.433333337,
                "y":0
              },
              "bottomLeft": {
                "x":0.0533333346,
                "y":0.858333349
              },
              "bottomRight": {
                "x":0.433333337,
                "y":0.858333349
              }
            }
          },
          {
            "text": "www.margiestravel.com",
            "featureType": "MSOCR",
            "area": {
              "topLeft": {
                "x":0.05142857,
                "y":0.87
              },
              "topRight": {
                "x":0.380952358,
                "y":0
              },
              "bottomLeft": {
                "x":0.05142857,
                "y":0.925
              },
              "bottomRight": {
                "x":0.380952358,
                "y":0.925
              }
            }
          }
        ]
      }
    ]
  }
}

Barcode (coming soon)

Decoded value of a barcode

Faces (coming soon)

Faces with bounding box coordinates

QR Code (coming soon)

Decoded value of a QR code