Skip to content

[Known Build Error] iOS UITest screenshot baseline mismatches after ACES pool migration #33879

@PureWeen

Description

@PureWeen

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1276073
Leg Name: iOS UITests Mono (v18.4)

Description

iOS screenshot-based UITests are failing after the migration to ACES agent pools (PR #33790). The new macOS 26 (Tahoe) environment renders slightly differently than the previous macOS 15 (Sequoia), causing screenshot comparison failures.

Root Cause: PR #33790 switched CI from MAUI pool to AcesShared pool with different macOS version.

Partially Fixed: PR #33910 updated baselines and added cropBottom/Assert.Ignore for the original 14 tests. The 4 tests below were not covered by that PR and are still failing.

Affected Tests

  • ContentPage_Title_WithBackgroundColor
  • VerifyClearButtonVisiblityWhenTextAlignedVertically
  • VerifyClearButtonVisiblityWhenTextPresentOrEmpty
  • VerifyClearVisiblityButtonWhenTextColorChanged

Error Message

{
  "ErrorPattern": "Snapshot different than baseline: (ContentPage_Title_WithBackgroundColor|VerifyClearButtonVisiblityWhenTextAlignedVertically|VerifyClearButtonVisiblityWhenTextPresentOrEmpty|VerifyClearVisiblityButtonWhenTextColorChanged)\\.png",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=1276073
Error message validated: [Snapshot different than baseline: (ContentPage_Title_WithBackgroundColor|VerifyClearButtonVisiblityWhenTextAlignedVertically|VerifyClearButtonVisiblityWhenTextPresentOrEmpty|VerifyClearVisiblityButtonWhenTextColorChanged)\.png]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/9/2026 9:25:22 PM UTC

Report

Build Definition Step Name Console log Pull Request
1374433 dotnet/maui Controls (API 30) Entry Log
Build Definition Test Pull Request
2965036 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2964595 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2964419 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2964365 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2963681 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2963514 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1401712 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(Mac).VerifyClearVisiblityButtonWhenTextColorChanged #35156
1401427 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(Mac).VerifyClearVisiblityButtonWhenTextColorChanged #35156
2962512 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
2962423 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2962165 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1399996 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(Mac).VerifyClearVisiblityButtonWhenTextColorChanged #35156
2961548 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
2962161 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1399420 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(Mac).ContentPage_Title_WithBackgroundColor #35156
1384827 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor #34980
2961625 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2961370 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
2961187 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1397673 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34600
2961176 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2959482 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1391021 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34758
1393213 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(Mac).ContentPage_Title_WithBackgroundColor #34790
2958484 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1391682 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #35094
1391223 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor #35091
1389602 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor #34600
2957292 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1390611 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #35011
1390613 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34699
2957284 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1389981 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1389354 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2956713 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
2956585 dotnet-maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1388732 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34737
1388730 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #31672
1388620 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34007
1388617 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor #34632
1388618 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor #34615
1388619 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34637
1388422 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1388407 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1387759 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
1387757 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1387756 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1387755 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
1384766 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1384047 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1385910 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34790
1386941 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #35037
2955634 dotnet-maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
1386833 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1386831 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1386830 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
1386824 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
1386606 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #35031
1386564 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34573
1386687 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34831
1386274 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1386269 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1386224 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1385823 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1385666 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor #34844
1385664 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #31790
1385278 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1385211 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1385176 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #35028
1384850 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34573
1384804 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #35001
1384769 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1384193 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34923
1384155 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor #31159
1384115 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #35016
1384069 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
1383960 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34804
1384000 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34758
1383888 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
1383651 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor #34637
1383561 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1383543 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1383415 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34996
1382435 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34710
1383461 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #35001
1382887 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1382099 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor
1381972 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34969
1381953 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1381853 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34996
1381821 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1381784 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34978
1381780 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged
1381751 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor #34935
1381750 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34907
1381752 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34704
1381593 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34991
1381544 dotnet/maui Microsoft.Maui.TestCases.Tests.EntryFeatureTests(iOS).VerifyClearVisiblityButtonWhenTextColorChanged #34989
1381541 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor #34981
1380836 dotnet/maui Microsoft.Maui.TestCases.Tests.ContentPageFeatureTests(iOS).ContentPage_Title_WithBackgroundColor #34984
Displaying 100 of 114 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 21 115

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions