Stack Overflow
Stack Overflow

Questions tagged [android-vts]

Android-VTS (Vendor Test Suite) is an infrastructure that automates HAL and OS kernel testing. Android-VTS provides extensive functionality for Android testing and promotes a test-driven development process. Use this tag for questions referring to building, writing and using Android-VTS to test an Android native system implementation.

Usage:

• Systems Testing - To use VTS to test an Android native system implementation, set up a testing environment then test a patch using a VTS plan.

• Device Shell Commands - Instructions on how to use device shell commands to execute target-side test binaries, to get/set properties, environment variables, and system information, and to start/stop the Android framework.

• Test Templates - Details on configuring and using test templates for test modules that are not host-side Python subclass of VTS runner's BaseTest.

• Service Name Aware HAL Testing - Details on Android 9​ support for obtaining the service name of a given HAL instance based on the device on VTS is running.

• HAL Testability Check - Details on Android 9​ support for a runtime method that uses the device configuration to identify which VTS tests should be skipped for that device target.

• Multi-Device Testing - Instructions for configuring tests that require interaction between multiple Android devices.

• VTS Dashboard - Web-based user interface for viewing VTS results. Includes details on:

  • Setup: Instructions for setting up and configuring the VTS Dashboard. Database. A scalable back-end to support the continuous integration dashboard.

  • Database - A scalable back-end to support the continuous integration dashboard.

  • User Interface - A cohesive user interface that uses material design to effectively display information about test results, profiling, and coverage.

  • Lab Infrastructure - Describes the architecture of an automated testing infrastructure for running VTS, CTS, or other tests on partner devices running the AOSP Generic System Image (GSI), requires a Host Controller.

  • Binder and HWBinder Performance Tests - Tools for measuring throughput and latency.

More information can be found here. Additional details can be found at the Android VTS Codelab.

19 questions
2
votes
1 answer

How to run VtsHalWifiSupplicantV1_0Target test case

When I ran "run vts -m VtsHalWifiSupplicantV1_0Target", I get 0 result from it. vts-tf > run vts -m VtsHalWifiSupplicantV1_0Target ... 10-15 09:56:06 I/ResultReporter: Invocation finished in 48s. PASSED: 0, FAILED: 0, MODULES: 2 of 2 Do I need to…
Louis Lee
  • 21
  • 2
2
votes
1 answer

What are the correct commands to run the CTS and VTS test plans?

I am about to setup the VTS and CTS tests for our AOSP. Both of the test suites are using the Trade Federation test framework. What is confusing me is how to run the different test plans. According to the documentation…
Lokinin
  • 71
  • 1
  • 1
  • 8
2
votes
1 answer

Why VTS fails with inaccurate adb error?

I run VTS test suite and my tests fail 100% with this consistent error: AdbError: Error executing adb cmd 'adb -s 10.1.1.5:5555 reverse tcp:5010 tcp:1489'. ret: 1, stdout: , stderr: error: more than one device/emulator AdbError: Error executing adb…
Eduard Florinescu
  • 16,747
  • 28
  • 113
  • 179
1
vote
0 answers

vts error on androdroiP: TestInvocation: Unexpected exception when running invocation: java.lang.RuntimeException: Failed to get device information

Here I build a vts test environment both on ubuntu 16.04 and windows 10. I have installed the python's packages and build vts source in the AOSP according to the website "https://codelabs.developers.google.com/codelabs/android-vts/#1". My adb…
flyingpig007
  • 11
  • 1
1
vote
1 answer

How to use enum from Python3 and not enum from PyPI -- issue during the Android VTS setup on Windows?

I am trying to setup AOSP VTS test on Windows. When installing, there is a pip_requirements.txt which tries to download the enum package which later will be installed during the test execution. When the test case is being run, there is an enum…
AnkT
  • 11
  • 3
0
votes
0 answers

error: static data member 'gtest_registering_dummy_' not allowed in local class 'RadioHidlTest_v1_5_startNetworkScan_InvalidArgument_Test'

I want to make VtsHalRadioV1_5TargetTest of vts , when I cd hardware/interfaces/radio/1.5/vts/functional and execute the mm command to compile the current module，the results show as below error: static data member 'gtest_registering_dummy_' not…
Xiangjun Liu
  • 1
0
votes
0 answers

Add extra file to android VTS test

I am wondering how I can add an arbitrary file into a VTS test module for android? My test binary would need to access that file when running on the target device. Looking at many cc_test tests in the android repo, I can find many tests, but the…
Blindleistung
  • 672
  • 8
  • 21
0
votes
0 answers

What is VTS Hal Thermal TargetTest?

I've tested VTS test module "VtsHalThermalV1_0TargetTest" and getting the following error run vts -m VtsHalThermalV1_0TargetTest hardware/interfaces/thermal/1.0/vts/functional/VtsHalThermalV1_0TargetTest.cpp:76: Failure Expected equality of these…
I K
  • 1
  • 1
0
votes
2 answers

syntax error: unexpected 'newline' in .config file in android vts

Currently, I am running one VTS module VtsHalGnssExtV1_0TargetTest. But I am getting an error syntax error: unexpected 'newline'. But the tests ran correctly. ======================================================= =============== Summary…
Manjunath N
  • 1,365
  • 11
  • 22
0
votes
1 answer

VTS few test cases give syntax error unexpected 'newline' and module gets reported as incomplete (inspite of test cases pass)

/data/local/tmp/VtsHalBiometricsFaceV1_0TargetTest/VtsHalBiometricsFaceV1_0TargetTest.config[1]: syntax error: unexpected 'newline' Total Tests : 1 PASSED : 1 FAILED : 0 IMPORTANT: Some modules failed to run to…
DPKGRG
  • 65
  • 1
  • 5
0
votes
0 answers

Ask questions about Android VTS

I ask questions about Android VTS. I am currently working on ubuntu 18.04, and target device is working on AVD. First of all, the environment I set is as follows. $ sudo apt-get install git-core gnupg flex bison build-essential zip curl zlib1g-dev…
chacha
  • 1
  • 1
0
votes
1 answer

Google STS TradeFed fails with error: Failed to run command: com.android.tradefed.config.ConfigurationException: Can not find local config sts

This is related to Google STS. Similar to CTS and VTS, Google Trade Federation harness is used to run these test. However, unlike CTS and VTS, the STS suite fails whenrun sts command is invoked: sts-tf > run sts Failed to run command:…
Alsina
  • 387
  • 1
  • 2
  • 15
0
votes
2 answers

Android Q - VTS environment setup on ubuntu16.04

I have ubuntu 16.04 with Python2.7 and Python3.5 installed, but when I try to run VTS on a Android Q device, I got below error: 01-16 11:42:33 E/FormattedGeneratorReporter: Failed to install pip module enum…
lucky1928
  • 8,708
  • 10
  • 43
  • 92
0
votes
1 answer

Is there a way to define C language macro in Android.bp file?

I want to know if I can define C language macro in Android.bp file ? I am wrapping unit tests of some modules (which are written in C++) into VTS framework. There are certain changes which needs to be protected under macro.
Vaibhav Kulkarni
  • 29
  • 2
0
votes
1 answer

How to run vts for specific device when multiple devices are connected

I am having a AOSP VTS (version 9) setup which works fine on Linux when one device is connected. However, when two devices are connected to the computer, is there an option that let us choose the device on which the VTS should be run? I notice that…
AnkT
  • 11
  • 3
1
2