I think their lack of actual answers here to these questions speaks volumes.
Your choice is to create a cloud account, upload everything you use to test your API to their servers, and then run all your tests, pulling your data out of their servers, for each test you want to run, every time you want to run them, with all the network overhead that brings with it.
I created a cloud account a couple years ago and when I moved just a small portion of my collection of API tests into their cloud, the Postman UI choked so bad and became unresponsive because it was constantly pulling my data out of their cloud.
I had to scrap that usage very quickly and was thankful they left the original functionality in the Scratch Pad for offline use. Now apparently that is no longer an option. It seems they are not even going to allow you to use the current version with the Scratch Pad in it and just not upgrade the software.
For our team, and I’m sure a lot of other teams as well, using Postman offline with Newman in the CI process was clean and fast because our large body of API tests could be run locally on our development PC’s or on the build server.
The alternative is to now pull all that data from the cloud, so forget running tests locally offline on a laptop. Watch your API tests in your CI process take significantly longer because you have to pull data out of their cloud to run your tests, instead of having those tests included in a folder in your code repository.
I am not even sure how their cloud offering handles versioning tests. We version our tests along with each version of our code and it’s all saved in the git repo. So, if I have to pull an old version of the application down and fix something, I have the tests that version was tested with included with that version of the code. No way you can do that with Postman cloud offering I am sure.
It’s really sad in my opinion that Postman is trying to force everyone to move to the cloud offering. My company would gladly pay for the offline version of postman for a reasonable annual subscription service like we do with other tools we use.
So really, our option is move to the cloud or find a different tool to test our API’s with.
Even if my company would be okay with storing internal API test requests in someone else’s cloud (which our security team is not), I am pretty confident that their online version will continue to choke up with the large volume of tests we currently have in our offline Postman collections.
RIP Postman… now to find a different product to test with…