Questions tagged [fuzz-testing]

27 questions
16
votes
1 answer

Difference between "fuzz testing" and "monkey test"

I have recently been thinking of the difference between fuzz testing and monkey test. According to wiki, it seems monkey test is "only" a unit test and fuzz test isn't. Android has UI/Application Exerciser monkey and it doesn't seems like unit…
Matt
  • 8,195
  • 31
  • 115
  • 225
10
votes
7 answers

Tools to test softwares against any attacks for programmers?

in these days, i'm interested in software security. As i'm reading papers i see that there are many attacks and researchers are trying to invent new methods for softwares to get more secure systems. this question can be a general including all types…
berkay
  • 3,907
  • 4
  • 36
  • 51
7
votes
3 answers

Is it unwise to fuzz-test with a cryptographically weak pseudorandom generator?

When working on a large software project I often use fuzz-testing as part of my test cases to help smoke out bugs that may only show up when the input reaches a certain size or shape. I've done this most commonly by just using the standard random…
templatetypedef
  • 362,284
  • 104
  • 897
  • 1,065
6
votes
2 answers

Any good tools or tips for fuzz testing Windows forms applications?

I'm maintaining a ~300K LOC C# legacy thick-client application with a Windows.Forms interface. The app is full of little bugs and quirks. For example, I recently discovered a bug where if a users edits and tabs (not clicks) through cells on a…
Ogre Psalm33
  • 21,366
  • 16
  • 74
  • 92
5
votes
1 answer

relation between random testing and fuzz testing

I am wondering what the relation between random and fuzz testing is. I understand that random testing has been there for a longer time, but I cannot see any differences between them. They both seem to make use of random input to see if the program…
3
votes
1 answer

do these tcl error indicate insecure code?

I am doing a security test on a system having an embedded TCL interpreter. The system receives input from the Internet (HTTP), parses it and passes to customisable TCL scripts. During a fuzzing test (sending binary garbage in HTTP headers) I have…
abb
  • 684
  • 6
  • 15
3
votes
1 answer

Negative Property-Based Tests

Property-based testing is good when you can express simple and well-defined properties. I've also had luck with "negative properties" in the case of testing parsers, e.g. by generating invalid identifiers or mismatching indentation for…
sshine
  • 15,635
  • 1
  • 41
  • 66
3
votes
2 answers

Randomly flipping bits in a python binary string

I'm creating some fuzz tests in python and it would be invaluable for me to be able to, given a binary string, randomly flip some bits and ensure that exceptions are correctly raised, or results are correctly displayed for slight alterations on…
Slater Victoroff
  • 21,376
  • 21
  • 85
  • 144
2
votes
1 answer

How to write fuzz tests for List.partition function in ELM?

I don't have much experience with elm and I am trying to understand how fuzz tests work. For example how can I write a fuzz test for the List.partition function? It is defined like: partition : comparable -> List comparable -> (List comparable, List…
2
votes
1 answer

Does a Fuzz Testing Tool use the TCP/IP Stack of the Operating System?

Fuzz testing tools generate malformed packets of protocols. Do they use their own TCP/IP stack to generate these malformed packets? Does the operating system's TCP/IP stack play any role in Fuzz testing? I am working on a MPLS Fuzz testing tool…
Jay
  • 99
  • 2
  • 18
1
vote
1 answer

Microsoft REST-ler fuzzer - unable to use Proxy and Authentication token when doing fuzzy testing

Trying to fuzz test my node.js project with Microsoft's REST-ler fuzzer by pointing to a swagger json. I am trying to use https://github.com/microsoft/restler-fuzzer and running into issues with proxy. Getting outside our proxy allows me to start…
Vijay
  • 595
  • 1
  • 13
  • 27
1
vote
0 answers

How to effectively write a custom gremlin while using gremlins.js with Cypress?

I am using Gremlins.JS with Cypress to fuzz an application. In order to create a custom gremlin, I am trying to use this code block function customGremlin() { return function attack() { …
1
vote
1 answer

When the crosshair command succeeds, has my contract been proven correct?

When crosshair finds no counterexamples, has it used the Z3 solver to prove that my contract holds? The docs indicate that the absence of a counterexample doesn't guarantee that the property holds, but is that just because the translation or…
pschanely
  • 144
  • 1
  • 8
1
vote
1 answer

Can clang's libFuzzer test more than 1 API in the same binary?

libFuzzer's documentation gives an example of how you would fuzz an API: #include #include extern "C" int LLVMFuzzerTestOneInput(const uint8_t *data, size_t size) { if (size > 0 && data[0] == 'H') if (size > 1 && data[1]…
Trevor Hickey
  • 36,288
  • 32
  • 162
  • 271
1
vote
4 answers

Test code coverage without source code?

What tools are out there that can perform code coverage analysis at the machine code level rather than the source code level? I'm looking for a possible solution to perform fuzz testing on software that I do not have source code access.
1
2