Test failures

Allowlist
Test Reason
SemaCXX/source_location.cpp The new interpreter is correct.
SemaCXX/constexpr-vector-access-elements.cpp The new interpreter is correct.
Sema/builtin-memcpy.c The new interpreter is correct.
SemaTemplate/temp_arg_nontype_cxx20.cpp The new interpreter is correct.
CodeGenObjC/encode-test-4.m Comparison against @encode is unspecified.
SemaCXX/new-delete.cpp Diagnostic differences are okay.
SemaCXX/builtin-std-move.cpp Diagnostic differences are okay.
SemaTemplate/temp_arg_nontype_cxx2c.cpp Diagnostic differences are okay.

Source Code

Date Failures Errors Diff Regressions Fixed
2025-05-05 104 701 -3
  • Sema/integer-overflow.c [Explicit Test]
  • Sema/builtins.c [builtin_constant_p]
  • SemaCXX/constexpr-frame-describe.cpp
2025-04-25 107 863 -7
  • AST/ast-dump-APValue-lvalue.cpp
  • SemaCXX/ptrauth-qualifier.cpp
  • CodeGen/p0963r3.cpp [Explicit Test]
  • CodeGen/ms_mangler_templatearg_opte.cpp
  • SemaTemplate/temp_arg_nontype_cxx2c.cpp
  • SemaCXX/builtin-is-constant-evaluated.cpp [builtin_constant_p]
  • C/C2y/n3254.c
  • CXX/expr/expr.const/p5-26.cpp
  • SemaTemplate/temp_arg_nontype_cxx20.cpp [builtin_bit_cast]
  • PCH/builtin-is-constant-evaluated.cpp [builtin_constant_p]
  • Sema/builtin-object-size.c
2025-04-16 114 1010 -7
  • std/algorithms/alg.sorting/alg.merge/inplace_merge_comp.pass.cpp
  • std/utilities/utility/mem.res/mem.res/mem.res.eq/not_equal.pass.cpp
  • std/algorithms/alg.sorting/alg.merge/inplace_merge.pass.cpp
  • std/utilities/utility/mem.res/mem.poly.allocator.class/mem.poly.allocator.eq/not_equal.pass.cpp
  • std/algorithms/alg.nonmodifying/mismatch/ranges_mismatch.pass.cpp
  • std/utilities/utility/mem.res/mem.res/mem.res.eq/equal.pass.cpp
  • std/utilities/utility/mem.res/mem.poly.allocator.class/mem.poly.allocator.eq/equal.pass.cpp
2025-04-13 121 1011 -22
  • CodeGen/ptrauth-function-init-fail.c
  • SemaCXX/builtin-dump-struct.cpp
  • std/ranges/range.adaptors/range.join/adaptor.pass.cpp
  • std/language.support/support.rtti/type.info/type_info.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.const/type_ctor.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.invoke/robust_against_adl.pass.cpp
  • std/containers/sequences/vector/vector.modifiers/append_range.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.invoke/invoke_void_0.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.access/conversion.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.invoke/invoke_int_0.pass.cpp
  • std/ranges/range.adaptors/range.join/range.join.iterator/star.pass.cpp
  • std/ranges/range.adaptors/range.join/range.join.iterator/arrow.pass.cpp
  • std/language.support/support.rtti/type.info/type_info.equal.pass.cpp
  • std/ranges/range.adaptors/range.join/range.join.iterator/decrement.pass.cpp
  • std/ranges/range.adaptors/range.join/range.join.iterator/increment.pass.cpp
  • std/ranges/range.adaptors/range.join/range.join.iterator/iter.swap.pass.cpp
  • std/containers/sequences/vector/vector.modifiers/insert_range.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.invoke/invoke.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.assign/copy_assign.pass.cpp
  • std/utilities/memory/specialized.algorithms/specialized.addressof/addressof.pass.cpp
  • std/algorithms/alg.sorting/alg.min.max/ranges.minmax.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.const/copy_ctor.pass.cpp
2025-04-01 143 1002 -77
  • std/strings/basic.string/string.modifiers/string_replace/size_size_pointer_size.pass.cpp
  • std/strings/basic.string/string.nonmembers/string_op+/char_string.pass.cpp
  • std/containers/sequences/vector.bool/assign_copy.pass.cpp
  • std/atomics/atomics.types.generic/atomics.types.float/ctor.pass.cpp
  • std/algorithms/alg.sorting/alg.sort/stable.sort/stable_sort.pass.cpp
  • std/algorithms/alg.sorting/alg.set.operations/set.union/ranges_set_union.pass.cpp
  • std/strings/char.traits/char.traits.specializations/char.traits.specializations.char32_t/move.pass.cpp
  • std/strings/char.traits/char.traits.specializations/char.traits.specializations.wchar_t/move.pass.cpp
  • std/algorithms/alg.sorting/alg.merge/ranges_merge.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/iter_iter_iter_iter.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/size_pointer_size.pass.cpp
  • std/strings/basic.string/string.modifiers/string_append/push_back.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/iter_iter_string_view.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/replace_with_range.pass.cpp
  • std/strings/char.traits/char.traits.specializations/char.traits.specializations.char8_t/move.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.copy/ranges.copy_backward.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/size_size_string_view.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/iter_iter_size_char.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/iter_iter_string.pass.cpp
  • std/strings/basic.string/string.nonmembers/string_op+/string.string_view.pass.cpp
  • std/containers/sequences/vector/vector.modifiers/destroy_elements.pass.cpp
  • std/containers/sequences/vector.bool/shrink_to_fit.pass.cpp
  • std/utilities/utility/pairs/pairs.pair/assign.pair_like_rv_const.pass.cpp
  • std/strings/basic.string/string.modifiers/string_assign/string.pass.cpp
  • std/strings/char.traits/char.traits.specializations/char.traits.specializations.char/move.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/size_size_string.pass.cpp
  • std/algorithms/alg.nonmodifying/alg.find/find.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.move/ranges.move_backward.segmented.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/string_view.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/iter_iter_pointer.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/insert_range.pass.cpp
  • std/containers/sequences/vector/vector.modifiers/assign_range.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/iter_iter_pointer_size.pass.cpp
  • std/utilities/utility/pairs/pairs.pair/assign_const_copy_convert.pass.cpp
  • std/strings/basic.string/string.nonmembers/string_op+/pointer_string.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.assign/const_pair_copy.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/size_string_size_size.pass.cpp
  • std/strings/basic.string/string.cons/from_range.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/iter_char.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/size_size_string_size_size.pass.cpp
  • std/utilities/utility/pairs/pairs.pair/assign_const_move_pair.pass.cpp
  • std/strings/basic.string/string.modifiers/string_append/initializer_list.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.swap/member_swap_const.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.shift/shift_right.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/iter_iter_iter.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/size_size_char.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/size_size_size_char.pass.cpp
  • std/utilities/utility/pairs/pairs.spec/non_member_const_swap.pass.cpp
  • libcxx/algorithms/alg.modifying.operations/copy_move_unwrap_reverse.pass.cpp
  • std/algorithms/alg.sorting/alg.set.operations/set.difference/ranges_set_difference.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.rotate/ranges_rotate.pass.cpp
  • std/algorithms/robust_against_adl.compile.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/size_T_size_size.pass.cpp
  • std/containers/sequences/vector.bool/assign_iter_iter.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.move/move_backward.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/size_size_T_size_size.pass.cpp
  • std/utilities/utility/pairs/pairs.pair/assign_const_move_convert.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.assign/const_pair_move.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.assign/const_convert_move.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/size_string.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.assign/const_copy.pass.cpp
  • std/algorithms/alg.sorting/alg.set.operations/set.symmetric.difference/ranges_set_symmetric_difference.pass.cpp
  • std/utilities/utility/pairs/pairs.pair/assign_const_copy_pair.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/size_pointer.pass.cpp
  • std/utilities/utility/pairs/pairs.pair/swap_member_const.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.assign/const_move.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.rotate/rotate.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/iter_size_char.pass.cpp
  • std/strings/char.traits/char.traits.specializations/char.traits.specializations.char16_t/move.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.move/ranges.move_backward.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.copy/ranges.copy_backward.segmented.pass.cpp
  • std/utilities/smartptr/unique.ptr/unique.ptr.special/cmp.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.copy/copy_backward.pass.cpp
  • std/strings/basic.string/string.nonmembers/string_op+/string_string.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.helper/tuple_size_structured_bindings.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.assign/const_convert_copy.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/size_size_pointer.pass.cpp
Showing only 5 datasets of 43 total