[Backport 1.1 latest] Avoid packaging for semver #31890

Job	Run time
code-quality	1m 4s
integration test / python 3.7 / ubuntu-20.04	7m 18s
build packages	37s
integration test / python 3.8 / ubuntu-20.04	7m 50s
unit test / python 3.7	1m 4s
integration test / python 3.9 / ubuntu-20.04	7m 50s
unit test / python 3.8	59s
integration test / python 3.10 / ubuntu-20.04	7m 59s
unit test / python 3.9	59s
integration test / python 3.8 / windows-latest	10m 55s
integration test / python 3.8 / macos-12	8m 12s
unit test / python 3.10	1m 7s
	55m 54s

Provide feedback