guettli/sharedinbox
1
0
Fork 0
Code Issues 21 Pull Requests 6 Actions Packages Projects Releases Wiki Activity

CI: fail if "error occurred" #145

New Issue
Closed
opened 2026-05-22 10:28:36 +00:00 by guettli · 0 comments
guettli commented 2026-05-22 10:28:36 +00:00 (Migrated from codeberg.org)
Copy Link
Copy Source

Look at:

Test results will be streamed to [ https://console.firebase.google.com/project/sharedinbox-496103/testlab/histories/bh.e2f77c58eca6e2ca/matrices/8057574493482132177 ].
10:08:17 Test is Pending
10:09:07 Starting attempt 1.
10:09:07 Test is Running
10:13:14 A non-retryable error occurred.
10:13:14 Done. Test time = 183 (secs)
10:13:14 Starting results processing. Attempt: 1
10:13:14 Completed results processing. Time taken = 6 (secs)
10:13:14 Test is Finished
Instrumentation testing complete.
More details are available at [ https://console.firebase.google.com/project/sharedinbox-496103/testlab/histories/bh.e2f77c58eca6e2ca/matrices/8057574493482132177 ].
┌─────────┬───────────────────────┬──────────────┐
│ OUTCOME │    TEST_AXIS_VALUE    │ TEST_DETAILS │
├─────────┼───────────────────────┼──────────────┤
│ Passed  │ oriole-33-en-portrait │ --           │
└─────────┴───────────────────────┴──────────────┘
ERROR: Firebase error detected in output
Stderr:
Activated service account credentials for: [firebase-test-lab-ci@sharedinbox-496103.iam.gserviceaccount.com]
Updated property [core/project].
task: Failed to run task "test-android-firebase": exit status 1
::error title=Task 'test-android-firebase' failed::exit status 1

source: https://codeberg.org/guettli/sharedinbox/actions/runs/479/jobs/0/attempt/1#jobstep-4-362

It does not fail because of "error occurred", but because of

Stderr:
Activated service account credentials for: [firebase-test-lab-ci@sharedinbox-496103.iam.gserviceaccount.com]
Updated property [core/project].

Update that:

Ignore these stderr lines. But keep "fail if unknown stderr".

Additionally: fail if there is "error" in the output.

And: fail if the number of executed tests do not match.

Look at: ``` Test results will be streamed to [ https://console.firebase.google.com/project/sharedinbox-496103/testlab/histories/bh.e2f77c58eca6e2ca/matrices/8057574493482132177 ]. 10:08:17 Test is Pending 10:09:07 Starting attempt 1. 10:09:07 Test is Running 10:13:14 A non-retryable error occurred. 10:13:14 Done. Test time = 183 (secs) 10:13:14 Starting results processing. Attempt: 1 10:13:14 Completed results processing. Time taken = 6 (secs) 10:13:14 Test is Finished Instrumentation testing complete. More details are available at [ https://console.firebase.google.com/project/sharedinbox-496103/testlab/histories/bh.e2f77c58eca6e2ca/matrices/8057574493482132177 ]. ┌─────────┬───────────────────────┬──────────────┐ │ OUTCOME │ TEST_AXIS_VALUE │ TEST_DETAILS │ ├─────────┼───────────────────────┼──────────────┤ │ Passed │ oriole-33-en-portrait │ -- │ └─────────┴───────────────────────┴──────────────┘ ERROR: Firebase error detected in output Stderr: Activated service account credentials for: [firebase-test-lab-ci@sharedinbox-496103.iam.gserviceaccount.com] Updated property [core/project]. task: Failed to run task "test-android-firebase": exit status 1 ::error title=Task 'test-android-firebase' failed::exit status 1 ``` source: https://codeberg.org/guettli/sharedinbox/actions/runs/479/jobs/0/attempt/1#jobstep-4-362 --- It does not fail because of "error occurred", but because of > Stderr: Activated service account credentials for: [firebase-test-lab-ci@sharedinbox-496103.iam.gserviceaccount.com] Updated property [core/project]. --- Update that: Ignore these stderr lines. But keep "fail if unknown stderr". Additionally: fail if there is "error" in the output. And: fail if the number of executed tests do not match.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
NeedSupervisor
Issue escalated to a human supervisor; agentloop will skip it until cleared.
 State/InProgress
State/Later
State/Planned
automerge
Eligible for automatic merge by CI
 ci-failure
Issue opened by agentloop to track a failing CI workflow; used for deduplication.
 do-not-merge
Plan PR — review only, do not merge.
 loop/code
Add to run the built-in "code" prompt; override at prompts/code.md.
 loop/code-ci-pending
Prompt "code" finished; waiting for the PR's CI to pass before advancing.
 loop/code-done
Prompt "code" finished successfully.
 loop/code-in-process
Agent for the "code" prompt is currently running on this issue.
 loop/merge
Managed by agentloop
 loop/merge-done
Managed by agentloop
 loop/merge-in-process
Managed by agentloop
 loop/plan
Add to run the built-in "plan" prompt; override at prompts/plan.md.
 loop/plan-done
Prompt "plan" finished successfully.
 loop/plan-in-process
Agent for the "plan" prompt is currently running on this issue.
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
guettlibot guettli
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: guettli/sharedinbox#145