Sorry, yes I should’ve added also the pure Java test, not using a PWA. I was trying to answer the OPs question to show in which direction we did finally go for bigger projects and did skip showing a test step.
So but for your comparision (framework 1) I can give you the results with Java (you can compare this with the numbers from Xojo in the previous post). As this first test was not not satisfying enough for us (Xojo 10x slower and errors), we did not proceed into testing the second framework (Xojo - PWA) so I can not give you any numbers about that one.
Java (no PWA, comparable with wath Xojo with UI does):
Test Duration: 05:12
Bots: 50
Iterations: 78
Hits: 42871
Errors: 0
Avg Response Time: 1.25s
Max Response Time: 4.87s
Errors reported:
- Average response times were low and no errors were detected. Nice! The site can probably handle more load next time.
The reason we investigated Xojo was because of the RAD claim for the browsers side. If we had to write the HTML/CSS/JavaScript anyway to write the PWA, it did make little sense for us to go with the slower/more error prone one instead of the battle-proven Java.
I’m going to refrain now from this topic as I feel I’m in dangerous waters of being banned from the forum, what is not my wish. I’ve given our results and interprete them as you want. Other type Web Apps may produce different results, I do no know that. The main objective of posting these results was to assist the OP by showing him our findings and the process we went through to make our decision.
Note that this is only the essence from the final report we received, which gives you further detailed information and some nice graphs ;-). It defintely is worth going through such a process if you are planning a big Web App. Surprises further down the road are no fun.
It is a question almost everyone has (independant of the tool they use), and is one of the hardest to answer.
I wish the OP the best of luck with his project, no matter what his decision will be!