Test failures

Allowlist
Test Reason
SemaCXX/source_location.cpp The new interpreter is correct.
SemaCXX/constexpr-vector-access-elements.cpp The new interpreter is correct.
Sema/builtin-memcpy.c The new interpreter is correct.
SemaTemplate/temp_arg_nontype_cxx20.cpp The new interpreter is correct.
CodeGenObjC/encode-test-4.m Comparison against @encode is unspecified.
SemaCXX/new-delete.cpp Diagnostic differences are okay.
SemaCXX/builtin-std-move.cpp Diagnostic differences are okay.
SemaTemplate/temp_arg_nontype_cxx2c.cpp Diagnostic differences are okay.

Source Code

Date Failures Errors Diff Regressions Fixed
2025-04-25 107 863 -7
  • AST/ast-dump-APValue-lvalue.cpp
  • SemaCXX/ptrauth-qualifier.cpp
  • CodeGen/p0963r3.cpp [Explicit Test]
  • CodeGen/ms_mangler_templatearg_opte.cpp
  • SemaTemplate/temp_arg_nontype_cxx2c.cpp
  • SemaCXX/builtin-is-constant-evaluated.cpp [builtin_constant_p]
  • C/C2y/n3254.c
  • CXX/expr/expr.const/p5-26.cpp
  • SemaTemplate/temp_arg_nontype_cxx20.cpp [builtin_bit_cast]
  • PCH/builtin-is-constant-evaluated.cpp [builtin_constant_p]
  • Sema/builtin-object-size.c
2025-04-16 114 1010 -7
  • std/algorithms/alg.sorting/alg.merge/inplace_merge_comp.pass.cpp
  • std/utilities/utility/mem.res/mem.res/mem.res.eq/not_equal.pass.cpp
  • std/algorithms/alg.sorting/alg.merge/inplace_merge.pass.cpp
  • std/utilities/utility/mem.res/mem.poly.allocator.class/mem.poly.allocator.eq/not_equal.pass.cpp
  • std/algorithms/alg.nonmodifying/mismatch/ranges_mismatch.pass.cpp
  • std/utilities/utility/mem.res/mem.res/mem.res.eq/equal.pass.cpp
  • std/utilities/utility/mem.res/mem.poly.allocator.class/mem.poly.allocator.eq/equal.pass.cpp
2025-04-13 121 1011 -22
  • CodeGen/ptrauth-function-init-fail.c
  • SemaCXX/builtin-dump-struct.cpp
  • std/ranges/range.adaptors/range.join/adaptor.pass.cpp
  • std/language.support/support.rtti/type.info/type_info.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.const/type_ctor.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.invoke/robust_against_adl.pass.cpp
  • std/containers/sequences/vector/vector.modifiers/append_range.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.invoke/invoke_void_0.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.access/conversion.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.invoke/invoke_int_0.pass.cpp
  • std/ranges/range.adaptors/range.join/range.join.iterator/star.pass.cpp
  • std/ranges/range.adaptors/range.join/range.join.iterator/arrow.pass.cpp
  • std/language.support/support.rtti/type.info/type_info.equal.pass.cpp
  • std/ranges/range.adaptors/range.join/range.join.iterator/decrement.pass.cpp
  • std/ranges/range.adaptors/range.join/range.join.iterator/increment.pass.cpp
  • std/ranges/range.adaptors/range.join/range.join.iterator/iter.swap.pass.cpp
  • std/containers/sequences/vector/vector.modifiers/insert_range.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.invoke/invoke.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.assign/copy_assign.pass.cpp
  • std/utilities/memory/specialized.algorithms/specialized.addressof/addressof.pass.cpp
  • std/algorithms/alg.sorting/alg.min.max/ranges.minmax.pass.cpp
  • std/utilities/function.objects/refwrap/refwrap.const/copy_ctor.pass.cpp
2025-04-01 143 1002 -77
  • std/strings/basic.string/string.modifiers/string_replace/size_size_pointer_size.pass.cpp
  • std/strings/basic.string/string.nonmembers/string_op+/char_string.pass.cpp
  • std/containers/sequences/vector.bool/assign_copy.pass.cpp
  • std/atomics/atomics.types.generic/atomics.types.float/ctor.pass.cpp
  • std/algorithms/alg.sorting/alg.sort/stable.sort/stable_sort.pass.cpp
  • std/algorithms/alg.sorting/alg.set.operations/set.union/ranges_set_union.pass.cpp
  • std/strings/char.traits/char.traits.specializations/char.traits.specializations.char32_t/move.pass.cpp
  • std/strings/char.traits/char.traits.specializations/char.traits.specializations.wchar_t/move.pass.cpp
  • std/algorithms/alg.sorting/alg.merge/ranges_merge.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/iter_iter_iter_iter.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/size_pointer_size.pass.cpp
  • std/strings/basic.string/string.modifiers/string_append/push_back.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/iter_iter_string_view.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/replace_with_range.pass.cpp
  • std/strings/char.traits/char.traits.specializations/char.traits.specializations.char8_t/move.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.copy/ranges.copy_backward.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/size_size_string_view.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/iter_iter_size_char.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/iter_iter_string.pass.cpp
  • std/strings/basic.string/string.nonmembers/string_op+/string.string_view.pass.cpp
  • std/containers/sequences/vector/vector.modifiers/destroy_elements.pass.cpp
  • std/containers/sequences/vector.bool/shrink_to_fit.pass.cpp
  • std/utilities/utility/pairs/pairs.pair/assign.pair_like_rv_const.pass.cpp
  • std/strings/basic.string/string.modifiers/string_assign/string.pass.cpp
  • std/strings/char.traits/char.traits.specializations/char.traits.specializations.char/move.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/size_size_string.pass.cpp
  • std/algorithms/alg.nonmodifying/alg.find/find.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.move/ranges.move_backward.segmented.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/string_view.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/iter_iter_pointer.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/insert_range.pass.cpp
  • std/containers/sequences/vector/vector.modifiers/assign_range.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/iter_iter_pointer_size.pass.cpp
  • std/utilities/utility/pairs/pairs.pair/assign_const_copy_convert.pass.cpp
  • std/strings/basic.string/string.nonmembers/string_op+/pointer_string.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.assign/const_pair_copy.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/size_string_size_size.pass.cpp
  • std/strings/basic.string/string.cons/from_range.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/iter_char.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/size_size_string_size_size.pass.cpp
  • std/utilities/utility/pairs/pairs.pair/assign_const_move_pair.pass.cpp
  • std/strings/basic.string/string.modifiers/string_append/initializer_list.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.swap/member_swap_const.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.shift/shift_right.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/iter_iter_iter.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/size_size_char.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/size_size_size_char.pass.cpp
  • std/utilities/utility/pairs/pairs.spec/non_member_const_swap.pass.cpp
  • libcxx/algorithms/alg.modifying.operations/copy_move_unwrap_reverse.pass.cpp
  • std/algorithms/alg.sorting/alg.set.operations/set.difference/ranges_set_difference.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.rotate/ranges_rotate.pass.cpp
  • std/algorithms/robust_against_adl.compile.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/size_T_size_size.pass.cpp
  • std/containers/sequences/vector.bool/assign_iter_iter.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.move/move_backward.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/size_size_T_size_size.pass.cpp
  • std/utilities/utility/pairs/pairs.pair/assign_const_move_convert.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.assign/const_pair_move.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.assign/const_convert_move.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/size_string.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.assign/const_copy.pass.cpp
  • std/algorithms/alg.sorting/alg.set.operations/set.symmetric.difference/ranges_set_symmetric_difference.pass.cpp
  • std/utilities/utility/pairs/pairs.pair/assign_const_copy_pair.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/size_pointer.pass.cpp
  • std/utilities/utility/pairs/pairs.pair/swap_member_const.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.assign/const_move.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.rotate/rotate.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/iter_size_char.pass.cpp
  • std/strings/char.traits/char.traits.specializations/char.traits.specializations.char16_t/move.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.move/ranges.move_backward.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.copy/ranges.copy_backward.segmented.pass.cpp
  • std/utilities/smartptr/unique.ptr/unique.ptr.special/cmp.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.copy/copy_backward.pass.cpp
  • std/strings/basic.string/string.nonmembers/string_op+/string_string.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.helper/tuple_size_structured_bindings.pass.cpp
  • std/utilities/tuple/tuple.tuple/tuple.assign/const_convert_copy.pass.cpp
  • std/strings/basic.string/string.modifiers/string_replace/size_size_pointer.pass.cpp
2025-03-21 220 1046 -89
  • CodeGen/p0963r3.cpp [Explicit Test]
  • SemaCXX/constant-expression-p2280r4.cpp [Explicit Test]
  • std/algorithms/alg.sorting/alg.merge/inplace_merge.pass.cpp
  • std/algorithms/alg.sorting/alg.merge/inplace_merge_comp.pass.cpp
  • std/strings/basic.string/string.modifiers/string_op_plus_equal/string.pass.cpp
  • std/algorithms/alg.nonmodifying/alg.find/ranges.find.pass.cpp
  • std/strings/basic.string/string.capacity/reserve_size.pass.cpp
  • std/strings/basic.string/string.capacity/resize_size_char.pass.cpp
  • std/strings/basic.string/string.modifiers/string_assign/pointer_size.pass.cpp
  • std/strings/basic.string/string.ops/string_find/string_view_size.pass.cpp
  • std/strings/basic.string/string.ops/string_substr/substr_rvalue.pass.cpp
  • std/strings/basic.string/string.capacity/resize_size.pass.cpp
  • std/strings/basic.string/string.modifiers/string_append/iterator.pass.cpp
  • std/strings/basic.string/string.cons/string_view_size_size_deduction.pass.cpp
  • std/strings/basic.string/string.capacity/size.pass.cpp
  • std/strings/basic.string/string.cons/copy_alloc.pass.cpp
  • std/strings/basic.string/string.cons/T_size_size.pass.cpp
  • std/strings/basic.string/string.ops/string_find/string_size.pass.cpp
  • std/strings/basic.string/string.cons/move.pass.cpp
  • std/strings/basic.string/string.capacity/clear.pass.cpp
  • std/ranges/range.adaptors/range.lazy.split/general.pass.cpp
  • std/strings/basic.string/string.cons/move_assignment.pass.cpp
  • std/strings/string.view/string.view.comparison/greater.pass.cpp
  • std/strings/basic.string/string.capacity/shrink_to_fit.pass.cpp
  • libcxx/strings/c.strings/constexpr.cwchar.compile.pass.cpp
  • std/strings/basic.string/string.access/index.pass.cpp
  • std/strings/basic.string/string.modifiers/string_append/pointer.pass.cpp
  • std/strings/basic.string/string.cons/substr.pass.cpp
  • std/strings/basic.string/string.modifiers/string_assign/initializer_list.pass.cpp
  • std/strings/basic.string/string.capacity/max_size.pass.cpp
  • std/strings/string.view/string.view.comparison/less.pass.cpp
  • std/strings/basic.string/string.cons/string_view_assignment.pass.cpp
  • std/strings/basic.string/string.cons/initializer_list.pass.cpp
  • std/strings/basic.string/string.modifiers/string_op_plus_equal/pointer.pass.cpp
  • std/strings/basic.string/string.modifiers/string_append/size_char.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.fill/ranges.fill.pass.cpp
  • std/strings/basic.string/string.cons/string_view.pass.cpp
  • std/strings/basic.string/string.ops/string_find/char_size.pass.cpp
  • std/strings/basic.string/string.modifiers/string_assign/iterator.pass.cpp
  • std/strings/basic.string/string.modifiers/string_copy/copy.pass.cpp
  • std/strings/basic.string/string.access/front.pass.cpp
  • std/strings/basic.string/string.modifiers/string_swap/swap.pass.cpp
  • std/strings/basic.string/string.modifiers/string_append/append_range.pass.cpp
  • std/strings/basic.string/string.ops/string_substr/substr.pass.cpp
  • std/strings/basic.string/string.modifiers/string_insert/iter_initializer_list.pass.cpp
  • std/strings/basic.string/string.capacity/resize_and_overwrite.pass.cpp
  • std/strings/basic.string/string.cons/iter_alloc_deduction.pass.cpp
  • std/strings/string.view/string.view.template/contains.ptr.pass.cpp
  • std/strings/basic.string/string.modifiers/string_assign/T_size_size.pass.cpp
  • std/strings/basic.string/string.nonmembers/string.cmp/comparison.pass.cpp
  • std/strings/string.view/string.view.comparison/less_equal.pass.cpp
  • SemaCXX/cxx2b-consteval-propagate.cpp
  • std/strings/basic.string/string.cons/implicit_deduction_guides.pass.cpp
  • std/strings/basic.string/string.contains/contains.ptr.pass.cpp
  • std/strings/basic.string/string.modifiers/string_append/string_view.pass.cpp
  • std/strings/basic.string/string.capacity/length.pass.cpp
  • std/strings/basic.string/string.cons/substr_rvalue.pass.cpp
  • std/strings/basic.string/string.modifiers/string_erase/pop_back.pass.cpp
  • std/strings/basic.string/string.modifiers/string_op_plus_equal/initializer_list.pass.cpp
  • std/strings/basic.string/string.cons/pointer_size_alloc.pass.cpp
  • std/strings/basic.string/string.modifiers/string_append/pointer_size.pass.cpp
  • std/strings/basic.string/string.cons/brace_assignment.pass.cpp
  • std/strings/basic.string/string.cons/char_assignment.pass.cpp
  • std/strings/basic.string/string.modifiers/string_append/string_size_size.pass.cpp
  • std/strings/basic.string/string.modifiers/string_assign/size_char.pass.cpp
  • std/strings/basic.string/string.capacity/empty.pass.cpp
  • std/strings/basic.string/string.ops/string_find/pointer_size.pass.cpp
  • std/strings/basic.string/string.modifiers/string_append/T_size_size.pass.cpp
  • std/strings/basic.string/string.nonmembers/string_op+/string_pointer.pass.cpp
  • std/strings/char.traits/char.traits.specializations/char.traits.specializations.wchar_t/find.pass.cpp
  • std/strings/basic.string/string.cons/pointer_alloc.pass.cpp
  • std/strings/string.view/string.view.comparison/not_equal.pass.cpp
  • std/strings/string.view/string.view.comparison/greater_equal.pass.cpp
  • std/strings/basic.string/string.modifiers/string_assign/assign_range.pass.cpp
  • std/strings/basic.string/string.require/contiguous.pass.cpp
  • std/algorithms/alg.nonmodifying/alg.fold/left_folds.pass.cpp
  • std/strings/basic.string/string.modifiers/string_op_plus_equal/char.pass.cpp
  • std/strings/string.view/string.view.template/contains.string_view.pass.cpp
  • std/strings/basic.string/string.cons/pointer_assignment.pass.cpp
  • std/strings/basic.string/string.cons/size_char_alloc.pass.cpp
  • std/strings/basic.string/string.modifiers/string_assign/pointer.pass.cpp
  • libcxx/strings/basic.string/string.cons/copy_shrunk_long.pass.cpp
  • std/strings/basic.string/string.ops/string_find.first.of/char_size.pass.cpp
  • std/strings/basic.string/string.cons/copy_assignment.pass.cpp
  • std/strings/basic.string/string.cons/initializer_list_assignment.pass.cpp
  • std/strings/basic.string/string.ops/string_find/pointer_size_size.pass.cpp
  • std/strings/basic.string/string.cons/copy.pass.cpp
  • std/strings/basic.string/string.cons/iter_alloc.pass.cpp
  • std/strings/basic.string/string.cons/string_view_deduction.pass.cpp
  • std/strings/string.view/string.view.comparison/equal.pass.cpp
  • std/strings/basic.string/string.access/back.pass.cpp
  • std/strings/string.view/string.view.comparison/comparison.pass.cpp
  • std/strings/basic.string/string.cons/move_alloc.pass.cpp
  • std/strings/basic.string/string.nonmembers/string.special/swap.pass.cpp
  • std/algorithms/alg.modifying.operations/alg.fill/ranges.fill_n.pass.cpp
  • std/strings/basic.string/string.contains/contains.string_view.pass.cpp
  • std/strings/basic.string/string.modifiers/string_append/string.pass.cpp
Showing only 5 datasets of 42 total