Stack Overflow
Stack Overflow

Questions tagged [apache-tvm]

Use this tag for questions referring to Apache TVM Framework

Apache TVM is an open source machine learning compiler framework for CPUs, GPUs, and machine learning accelerators. It aims to enable machine learning engineers to optimize and run computations efficiently on any hardware backend.

9 questions
2
votes
0 answers

Integrating PyTorch models with TVM makes it worse from time perspective

I was recently told that integrating/compiling my PyTorch model with the help of Apache TVM should speed inference up, but am very confused about the usage of TVM as there seem to be multiple ways to use it. This blog on their website says Usage is…
ashenoy
  • 163
  • 1
  • 9
0
votes
0 answers

TVM compilation produces mismatched matrices

I have defined the following BERT-based model using PyTorch: class BERTGRUSentiment(nn.Module): 13 def __init__(self, 14 bert, 15 hidden_dim, 16 output_dim, 17 …
Someone
  • 800
  • 1
  • 7
  • 25
0
votes
0 answers

What is the difference between TVM and LLVM?

i cant visualize the full software stack ( pytorch + clang + TVM + LLVM + Hardware .... ) Do you have to have llvm if you use TVM ? do both make optimization ? is there a different functionality for wither one and they need each other or its just…
aghozzo
  • 13
  • 2
0
votes
0 answers

How can I cross-compile TVM for RISC-V on x86 Ubuntu 22.04.2 using LLVM and GCC toolchain?

How to cross compile TVM to RISCV on x86 Ubuntu 22.04.2? I want to cross-compile TVM for RISC-V on x86 Ubuntu 22.04.2. Environment: TVM version: 0.13.0-dev0 LLVM : sudo apt install llvm, version: 14.0.0 GNU toolchain for RISC-V : sudo apt-get…
Jerry
  • 1
  • 1
0
votes
0 answers

Is there a way to convert tvm.runtime.module.Module type to tvm.IRModule type?

I am new to TVM. I have an optimized TVM model as a tar file. I am trying to benchmark it by running inference on it. I referred to the benchmarking code and to this. Here is my code: import numpy as np import os import tvm from tvm import te from…
lelouch
  • 1
  • 1
0
votes
0 answers

Problems when following Integrate TVM and NVDLA

I meet a problem while I am following the project from Github https://github.com/shivmgg/tvm about integrating NVDLA and TVM. I run it on centos7. I think whether someone who has used this project might help me with my questions. Hello everyone. I…
Owenz
  • 1
  • 1
0
votes
0 answers

TVMError: Binary was created using cuda but a loader of that name is not registered

I'm generating tvm and istalling and using it in another docker container TVM wheel generation code: # install cmake RUN yum install -y wget RUN wget https://github.com/Kitware/CMake/releases/download/v3.20.2/cmake-3.20.2.tar.gz -O…
sb15
  • 313
  • 5
  • 18
0
votes
0 answers

Why are the output parameters of tvm.relay.optimize empty?

I am a beginner at using TVM. I have traced the resnet50. Now, I want to get the optimized modules using: model = ResNet50(10, 3) model.to(dtype) trace_input = torch.rand(1, 3, 224, 224) traced_model = torch.jit.trace(model, trace_input) for p in…
Maryam
  • 119
  • 1
  • 1
  • 6
0
votes
1 answer

No libtvm.so and libtvm_runtime.so found in TVM Docker Container

I am new to Apache TVM. I tried to build and launch a docker image named tvm.ci_cpu:latest as described in the tutorial https://tvm.apache.org/docs/install/docker.html#docker-source. I tried to use the python application tvmc inside docker container…
Ruyao Du
  • 11
  • 3