visionvision.detect

Object Detect

Run an object detection model on the current screen.

Inputs

InputValue typeRequirementAccepted sources

modelIdstringRequiredliteral

classNamestringOptionalliteral

minScorenumberRequiredliteral

ROIroiDetection region. Value type: screen-ratio rect {x, y, width, height}; 0..1 maps to the device frame. Smaller ROI can reduce false positives and latency.rectRequiredliteral

Outputs

Output pathValue typeCoordinate space

data.bestobject—

data.best.scorenumber—

data.best.modelIdstring—

data.best.classNamestring—

data.best.centerpointscreenRatio

data.best.center.xnumberscreenRatio

data.best.center.ynumberscreenRatio

data.best.rectrectscreenRatio

data.itemsarray—

Runtime support

DesktopSupported

Android AgentSupported