[Fix] #1242 bug report broken tests for connect four in ci #1126

Job	Run time
agilerl-tutorial-test (3.9, AgileRL)	14m 2s
tutorial-test (3.8, Tianshou)	3m 32s
agilerl-tutorial-test (3.10, AgileRL)	14m 41s
tutorial-test (3.8, CustomEnvironment)	27s
tutorial-test (3.8, CleanRL)	5m 42s
agilerl-tutorial-test (3.11, AgileRL)	14m 29s
tutorial-test (3.8, SB3/kaz)	4m 26s
tutorial-test (3.8, SB3/waterworld)	8m 48s
tutorial-test (3.8, SB3/test)	2m 44s
tutorial-test (3.9, Tianshou)	3m 25s
tutorial-test (3.9, CustomEnvironment)	1m 8s
tutorial-test (3.9, CleanRL)	5m 26s
tutorial-test (3.9, SB3/kaz)	4m 39s
tutorial-test (3.9, SB3/waterworld)	8m 27s
tutorial-test (3.9, SB3/test)	2m 15s
tutorial-test (3.10, Tianshou)	3m 15s
tutorial-test (3.10, CustomEnvironment)	1m 8s
tutorial-test (3.10, CleanRL)	7m 20s
tutorial-test (3.10, SB3/kaz)	4m 49s
tutorial-test (3.10, SB3/waterworld)	7m 50s
tutorial-test (3.10, SB3/test)	2m 12s
tutorial-test (3.11, Tianshou)	7m 33s
tutorial-test (3.11, CustomEnvironment)	39s
tutorial-test (3.11, CleanRL)	6m 56s
tutorial-test (3.11, SB3/kaz)	5m 47s
tutorial-test (3.11, SB3/waterworld)	8m 13s
tutorial-test (3.11, SB3/test)	2m 49s
	2h 32m 42s

Provide feedback