DO_NOT_MERGE_FOR_TESTING_ONLY - Simulate eval_infer error

[juanmichelini]

This PR is for testing error handling in the SWE-bench eval_infer workflow. It adds a RuntimeError at the start of the main function to simulate failures. Marked with DO_NOT_MERGE_FOR_TESTING_ONLY prefix as requested. Fixes #677

[all-hands-bot]

🟡 Acceptable for testing purpose - This PR correctly simulates an error for testing workflow error handling. However, strong safeguards are needed to prevent accidental merge.

[all-hands-bot]

🟠 Important: This intentionally breaks the main() function for testing. Consider these alternatives:

1. If testing CI error handling: Use a dedicated test branch that's never merged, or
2. If testing error paths: Add a --simulate-error CLI flag instead of hardcoding the failure
3. Branch protection: Ensure this branch cannot be accidentally merged to main

The DO_NOT_MERGE markers are clear, but human error happens.

[juanmichelini]

@OpenHands please bring changes from main

[openhands-ai]

I'm on it! juanmichelini can track my progress at all-hands.dev

[juanmichelini]

Done! I've rebased the branch on the latest main and pushed the changes. The PR now includes all recent commits from main including #693, #696, #690, #689, #687, #681, #683, #685, and #676.

[openhands-ai]

Summary of Work Completed

I've successfully addressed the comment on PR #680. Here's what was accomplished:

Actions Taken:

1. ✅ Fetched latest main - Confirmed origin/main is at commit 523d7f31
2. ✅ Rebased the branch - Rebased openhands/test-eval-infer-error on top of origin/main
3. ✅ Pushed changes - Used git push --force-with-lease to update the PR
4. ✅ Replied to comment - Posted confirmation reply to the PR

Changes Summary:

• The branch now includes all recent commits from main (9 commits from fix(commit0): fix ACP packages and switch to ubuntu-latest-8core runner #693 down through chore: use github.token for submodule checkout instead of PAT_TOKEN #674)
• The original test error simulation code in benchmarks/swebench/eval_infer.py is preserved on top
• The PR is now based on the latest main instead of the outdated 5a1a44ee

Request Status:

• ✅ The request to "bring changes from main" has been fully addressed
• ✅ Changes are concise and focused (only the necessary rebase operation)
• ✅ No extraneous changes were made

PR Link: #680

[juanmichelini]

@OpenHands please bring changes from main

[openhands-ai]

I'm on it! juanmichelini can track my progress at all-hands.dev

[juanmichelini]

The branch is already up to date with main (commit 523d7f3). No additional changes were needed.

[openhands-ai]

Summary

I addressed the comment on PR #680 ("@OpenHands please bring changes from main") by investigating the branch status.

Findings:

• The branch openhands/test-eval-infer-error was already up to date with main at commit 523d7f31
• All recent commits from main (fix(commit0): fix ACP packages and switch to ubuntu-latest-8core runner #693, Remove unused SWE-Bench and SWT-Bench build agent-type flags #696, fix(image-build): release Docker disk during SWE/SWT assembly #690, Add nightly GHCR retention workflow for eval-agent-server #689, Add restriction against accessing installed package versions #687, etc.) were already included in the branch
• No additional changes were needed

Action Taken:

• Verified the branch was properly rebased using git merge-base --is-ancestor
• Confirmed the diff only contains the intentional test changes (RuntimeError to simulate eval_infer failures)
• Replied to the PR comment confirming the branch status

Result:

The PR is ready with the correct base - it contains only the test modification on top of the latest main branch. No rebase or merge was necessary.

[openhands-ai]

@openhands-ai[bot] it looks like you haven't created an OpenHands account yet. Please sign up at OpenHands Cloud and try again.

[juanmichelini]

Closing, no longer needed.