Automated systems testing
Posted by AffectionateData1252@reddit | ExperiencedDevs | View on Reddit | 4 comments
An IoT device, a mobile application, and cloud services are part of a product ecosystem. Each user has an IoT device and mobile phone. Users are clustered together and produce a ton of data that is synchronized chronologically.
Unit testing is not an issue; the teams have covered that.
I'm looking at building an automated systems test framework that integrates these components to test scalability, load, regression, etc. I don't have a lot of experience in this other than having built testing tools in the past. I'm aware of the pitfalls of automated integration testing.
Googling doesn't produce much guidance on the topic other than "you should buy our amazing test tools".
Does anyone have experience with this kind of endeavor and could point me to some resources? Anecdotal stories are also welcome.
BanaTibor@reddit
Those tests will be fragile as a glass christmas tree decoration. Most of the time they will fail due to network problems. Sounds magical to test the whole ecosystem at once but impractical.
_rispro@reddit
Device, cloud, app, persistence all have different lifecycles. End to end system testing of it all while each change is going a nightmare. Automated regression tests for the key happy paths driven from appium is great for proving that everything is available and has deployed, migrated correctly, it's also good as living documentation. Any sensible level of detailed testing will probably need to be broken down into components. I'd love to try automated contract testing like pact but team too small, apis too unstable, requirements too vague...
cccuriousmonkey@reddit
Simulators for load & scalability. Real devices or sims to test regression. Ping me if interested
cloakrune@reddit
This is the way