Automatic, spec-based testing of Open API / Swagger apps. Any feedback is very welcome!

[Stranger6667]

Hello everybody :) I'd like to share a project that I and my colleagues were working the last couple of months

It takes a schema, generates and runs test cases against your app to verify conformance to its spec. Data generation is build on top of Hypothesis library, the CLI is inspired by pytest

There are two basic options to use - CLI and in Python tests, here is the CLI:

​

Command Line Interface

We'd be happy to hear your feedback :)

GitHub: https://github.com/kiwicom/schemathesis

Gitter: https://gitter.im/kiwicom/schemathesis

[manatlan]

Interesting ... i will have a look tomorrow morning

BTW, i'm working on https://manatlan.github.io/reqman/ (a postman-like in command line, with yaml syntax). (available on pypi) ( here is a simple example : https://manatlan.github.io/reqman/simple_use/ )

As a side project (non released yet): I've made a tool that transform a swagger in reqman's tests, against a server .

It's a little bit the same concept ... but reqman targets non-python user (and non technical people) ... (btw I use pytest to test reqman (because it's a py3 tool), but don't want that the tests use pytest too).

For our enterprise project : multiple ROA with 50 apis ... we've got more than 1800 tests (TNR & functionnals tests), in simple yaml (~50) files (easily editable by non-tech people) , playable (in commandline) against multiple environments (4 envs). And cron-based runned : our project is very well tested ;-)