[Fix] #1242 bug report broken tests for connect four in ci #1129

Job	Run time
agilerl-tutorial-test (3.9, AgileRL)	14m 45s
agilerl-tutorial-test (3.10, AgileRL)	16m 39s
agilerl-tutorial-test (3.11, AgileRL)	16m 14s
tutorial-test (3.8, Tianshou)	3m 18s
tutorial-test (3.8, CustomEnvironment)	58s
tutorial-test (3.8, CleanRL)	5m 14s
tutorial-test (3.8, SB3/kaz)	4m 28s
tutorial-test (3.8, SB3/waterworld)	8m 8s
tutorial-test (3.8, SB3/test)	1m 57s
tutorial-test (3.9, Tianshou)	3m 27s
tutorial-test (3.9, CustomEnvironment)	30s
tutorial-test (3.9, CleanRL)	5m 25s
tutorial-test (3.9, SB3/kaz)	4m 41s
tutorial-test (3.9, SB3/waterworld)	7m 44s
tutorial-test (3.9, SB3/test)	2m 21s
tutorial-test (3.10, Tianshou)	3m 21s
tutorial-test (3.10, CustomEnvironment)	44s
tutorial-test (3.10, CleanRL)	7m 36s
tutorial-test (3.10, SB3/kaz)	4m 42s
tutorial-test (3.10, SB3/waterworld)	7m 51s
tutorial-test (3.10, SB3/test)	2m 7s
tutorial-test (3.11, Tianshou)	3m 25s
tutorial-test (3.11, CustomEnvironment)	29s
tutorial-test (3.11, CleanRL)	7m 20s
tutorial-test (3.11, SB3/kaz)	4m 45s
tutorial-test (3.11, SB3/waterworld)	7m 44s
tutorial-test (3.11, SB3/test)	2m 4s
	2h 27m 57s

Provide feedback