Tools Reference

identify_item

Identify items from photos without adding to inventory. Get product details, brand, model, and estimated value.

identify_item

Identify an item from a photo without adding it to inventory. Returns detailed product information using GPT-4 Vision.

Use Cases

  • Identify unknown items before deciding to add them
  • Get product details for items you're considering purchasing
  • Estimate value of items for insurance purposes
  • Find purchase links for replacement items
  • Identify items in photos others have shared with you

Parameters

ParameterTypeRequiredDescription
photo_urlstringNo*URL to the item photo
photo_base64stringNo*Base64 encoded photo
*You must provide either photo_url or photo_base64.

Example Request

Using Photo URL

{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "identify_item",
    "arguments": {
      "photo_url": "https://example.com/photos/unknown-appliance.jpg"
    }
  }
}

Using Base64 Photo

{
  "jsonrpc": "2.0",
  "id": 2,
  "method": "tools/call",
  "params": {
    "name": "identify_item",
    "arguments": {
      "photo_base64": "/9j/4AAQSkZJRgABAQEASABIAAD..."
    }
  }
}

Example Response

{
  "jsonrpc": "2.0",
  "id": 1,
  "result": {
    "content": [
      {
        "type": "text",
        "text": "{\"name\":\"Dyson V15 Detect Cordless Vacuum\",\"category\":\"Appliance\",\"brand\":\"Dyson\",\"model\":\"V15 Detect\",\"estimated_value\":\"$749\",\"description\":\"High-end cordless stick vacuum with laser dust detection, LCD screen showing particle counts, and up to 60 minutes of runtime. Features HEPA filtration and multiple cleaning heads.\",\"purchase_links\":[\"Dyson V15 Detect cordless vacuum\",\"Dyson V15 Detect best price\",\"Dyson V15 Detect Amazon\"],\"confidence\":0.85}"
      }
    ]
  }
}

Parsed Response

{
  "name": "Dyson V15 Detect Cordless Vacuum",
  "category": "Appliance",
  "brand": "Dyson",
  "model": "V15 Detect",
  "estimated_value": "$749",
  "description": "High-end cordless stick vacuum with laser dust detection, LCD screen showing particle counts, and up to 60 minutes of runtime. Features HEPA filtration and multiple cleaning heads.",
  "purchase_links": [
    "Dyson V15 Detect cordless vacuum",
    "Dyson V15 Detect best price",
    "Dyson V15 Detect Amazon"
  ],
  "confidence": 0.85
}

Response Fields

FieldTypeDescription
namestringIdentified product name
categorystring | nullItem category (Electronics, Appliance, Furniture, Tool, etc.)
brandstring | nullManufacturer or brand name
modelstring | nullSpecific model number or name
estimated_valuestring | nullApproximate retail price in USD
descriptionstring | nullDetailed product description
purchase_linksarraySuggested search terms for finding the item
confidencenumberIdentification confidence score (0-1)

Categories

Items are classified into categories such as:

  • Electronics - TVs, computers, phones, audio equipment
  • Appliance - Kitchen appliances, vacuums, HVAC
  • Furniture - Sofas, tables, chairs, beds
  • Tool - Power tools, hand tools, equipment
  • Decor - Art, lighting, decorative items
  • Outdoor - Patio furniture, grills, garden equipment

Tips for Best Results

Photo Quality

  • Good lighting - Avoid shadows and overexposure
  • Clear focus - Ensure the item is sharp and in focus
  • Full view - Show the entire item when possible

Helpful Details to Capture

  • Brand logos or labels
  • Model numbers on the item
  • Unique features or distinguishing characteristics
  • Scale reference (helps identify size)

What Works Well

  • Branded electronics with visible logos
  • Appliances with model labels
  • Furniture with distinctive designs
  • Tools from major manufacturers

What May Be Challenging

  • Generic or unbranded items
  • Heavily worn or damaged items
  • Items partially obscured
  • Very old or rare items

Error Handling

Missing Photo

{
  "content": [
    {
      "type": "text",
      "text": "{\"error\": \"Must provide either photo URL or base64 photo\"}"
    }
  ],
  "isError": true
}

Invalid URL

{
  "content": [
    {
      "type": "text",
      "text": "{\"error\": \"Invalid photo URL format\"}"
    }
  ],
  "isError": true
}

Identification Failed

{
  "content": [
    {
      "type": "text",
      "text": "{\"error\": \"Failed to identify item\"}"
    }
  ],
  "isError": true
}

AI Not Configured

{
  "content": [
    {
      "type": "text",
      "text": "{\"error\": \"AI identification not configured\"}"
    }
  ],
  "isError": true
}

Difference from add_item

Featureidentify_itemadd_item
Adds to inventoryNoYes
Requires property_idNoYes
Returns estimated valueYesNo
Returns purchase linksYesNo
Returns descriptionYesNo
AI model usedGPT-4oGPT-4o-mini

Use identify_item when you want detailed product information without saving. Use add_item when you want to add the item to your inventory.