[LU-15887] add always_except() to test-framework

• Type: Bug
• Resolution: Unresolved
• Priority: Minor
• Severity: 3
• Assignee: John Hammond
• Reporter: John Hammond

Description

The way we add and remove tests from ALWAYS_EXCEPT is really senseless and encourages merge conflicts and porting mistakes. Instead of always just adding the next test to be excepted to the end of the list it would be better if we excepted groups of tests one issue per line and kept things sorted by test number.

Using a function to manage ALWAYS_EXCEPT will also help avoid problems like LU-15876.

So instead of a miniature IQ test like:

-# bug number:    LU-8411 LU-9054 LU-14921  EX-4334
-ALWAYS_EXCEPT+=" 407     312     101f 101k 428"
+# bug number:    LU-8411 LU-9054 LU-14921  ATM-2415 EX-4334
+ALWAYS_EXCEPT+=" 407     312     101f 101k 400a     428"

We could just do:

+always_except ATM-2415 400a