Glad to see the response this has gotten, thanks for the comments / feedback!
I definitely appreciate you thinking about this! Just in case it wasn't clear / for others who might be reading, I will restate one of the main points I was trying to make for newer users interested in testing: I think you can go as hard as you want on developing & using large-sample sim testing methods for DDSPF21, and I don't think it will have very much negative impact on the league!
Obviously there are personal burn-out risks for dedicating so much of your time to it (see my response to infinite later), and making it an expectation for others may have negative consequences. But as long as you personally are enjoying it and not forcing it on others, I see no real reason to be worried about the impacts on the league environment.
This is something I didn't incorporate into the article, so thank you for bringing it up. A significant issue with an environment where people "have to" sim test is that the outcome of each game is still very random and a lot of people feel their hard work is "wasted". Since sim testing for individual games on DDSPF21 is much less of an advantage, I am hopeful that fewer people who find that aspect extremely frustrating will burn themselves out (e.g., focusing on things aside from single game win probabilities to gain an edge).
(05-01-2023, 11:24 PM)aeonsjenni Wrote: It's definitely making me reconsider the approach I want to take when it comes to sim-testing in the future. I had never considered how detrimental a league environment that demanded constant testing could be, and it's something I'm very glad to be warned about.
I definitely appreciate you thinking about this! Just in case it wasn't clear / for others who might be reading, I will restate one of the main points I was trying to make for newer users interested in testing: I think you can go as hard as you want on developing & using large-sample sim testing methods for DDSPF21, and I don't think it will have very much negative impact on the league!
Obviously there are personal burn-out risks for dedicating so much of your time to it (see my response to infinite later), and making it an expectation for others may have negative consequences. But as long as you personally are enjoying it and not forcing it on others, I see no real reason to be worried about the impacts on the league environment.
(05-02-2023, 06:49 AM)infinitempg Wrote: S22 Yeti tested at 20% (or 30% for half of us, for some weird reason) against OCO in the Ultimus. We won.
S24 and S25 Yeti tested over 80% against SJS in both games. We lost both games.
I used to be huge on sim testing (especially since you actually could get statistically significant results), but I think those games broke me lol
This is something I didn't incorporate into the article, so thank you for bringing it up. A significant issue with an environment where people "have to" sim test is that the outcome of each game is still very random and a lot of people feel their hard work is "wasted". Since sim testing for individual games on DDSPF21 is much less of an advantage, I am hopeful that fewer people who find that aspect extremely frustrating will burn themselves out (e.g., focusing on things aside from single game win probabilities to gain an edge).