Newman seems un-consistent while executing multiple scripts

We’ve encountered a situation where running a set of scripts through the Postman app returns the correct output, but running the same collection using Newman produces inconsistent and varying results. We’re unable to identify the cause of this issue.

Please get back to me if any of the members are getting such issues.

Hey @geniussingare :waving_hand:t3:

Without more contextual information about the inconsistencies you’re a seeing - if difficult to know what you’re referring to here.

Hey @danny-dainton, The inconsistency I’m referring to is in the test results. For example, I have a set of APIs and have written test scripts for data validation and schema validation. In some cases, we are matching the executed response with a hardcoded expected response. This works consistently in the Postman application. However, sometimes the same tests fail randomly when run with Newman, even though they work most of the time.

You still haven’t provided any visual examples of this problem.

What scripts have been written? What does this error look like? What version of Newman are you using? Have you tried running this using the Postman CLI?

Unfortunately, no one can see what you have in front of you so without providing a lot more information, this is very one sided.

I haven’t used postman cli, will try to use that and ill get back to with some visual examples