likholat

This guide describes how to use OpenVINO custom layers

1. Install OpenVINO

Use this tutorial to install OpenVINO Runtime.

Configure OV environment with source <INSTALL_DIR>/setupvars.sh

2. Clone repository with extensions:

git clone https://github.com/dkurt/openvino_pytorch_layers.git

likholat

OV release DeformableConvolution support for DEKR

Pytorch layer documentation

OpenVINO layer documentation

To get OpenVINO IR:

To get OV model and compare the results of OV and Torch models run:

python3 tools/convert.py --cfg path/to/file.yaml TEST.MODEL_FILE path/to/file.yaml

likholat

OV DeformableConvolution support for DEKR

Pytorch layer documentation

OpenVINO layer documentation

Follow these steps to get OpenVINO IR:

• You can find all the changes needed to support the DeformableConvolution layer here.

1. Create .onnx model with python3 tools/convert.py --cfg path/to/file.yaml TEST.MODEL_FILE path/to/file.yaml:
2. Create OpenVINO IR with OpenVINO master branch:

likholat

Pytorch layer documentation: https://pytorch.org/vision/stable/ops.html#torchvision.ops.deform_conv2d

OpenVINO layer documentation: https://docs.openvinotoolkit.org/latest/openvino_docs_ops_convolution_DeformableConvolution_1.html

1. Create .onnx model with python3 export.py:

# export.py

import numpy as np
import torch

likholat

Pytorch layer documentation: https://pytorch.org/vision/stable/ops.html#torchvision.ops.deform_conv2d

OpenVINO layer documentation: https://docs.openvinotoolkit.org/latest/openvino_docs_ops_convolution_DeformableConvolution_1.html

1. Create .onnx model with python3 export.py:

# export.py

import numpy as np
import torch

likholat

<?xml version="1.0" encoding="utf-8"?>
<androidx.constraintlayout.widget.ConstraintLayout xmlns:android="http://schemas.android.com/apk/res/android"
    xmlns:app="http://schemas.android.com/apk/res-auto"
    xmlns:tools="http://schemas.android.com/tools"
    android:layout_width="match_parent"
    android:layout_height="match_parent"
    tools:context=".MainActivity">

    <org.opencv.android.JavaCameraView
        android:id="@+id/CameraView"

likholat

<?xml version="1.0" encoding="utf-8"?>
<manifest xmlns:android="http://schemas.android.com/apk/res/android"
    package="com.example.aslrecognitionapp">

    <application
        android:allowBackup="true"
        android:icon="@mipmap/ic_launcher"
        android:label="@string/app_name"
        android:roundIcon="@mipmap/ic_launcher_round"
        android:supportsRtl="true"

likholat

package com.example.aslrecognitiondemo;

import android.os.Bundle;
import android.util.Log;

import org.opencv.android.CameraActivity;
import org.opencv.android.CameraBridgeViewBase;
import org.opencv.android.CameraBridgeViewBase.CvCameraViewFrame;
import org.opencv.android.CameraBridgeViewBase.CvCameraViewListener2;
import org.opencv.core.Core;