# Build "Successful" even though most steps "skipped" **URL:** \ **Category:** Drone Support\ **Created:** [August 19, 2020, 2:15pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980 "2020-08-19T14:15:43Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![captncraig](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/captncraig/32/5888_2.png) [@captncraig](https://drone.discourse.group/u/captncraig)\ **Post date:** [August 19, 2020, 2:15pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/1 "2020-08-19T14:15:44Z")
We have a build (should be publicly accessible [here](https://drone.grafana.net/grafana/grafana/1500/1/4) that show success on github, even though most of the steps are actually skipped. This has happened at least twice now. I can’t find anything in logs to indicate why it chose to skip those steps. Restarting the build has resulted in a successful run, so I don’t think it is anything wrong with the config. The only reason I can guess things are being skipped is that a step dependency is not being met, but in this case all of the steps that ran were successful. The “identify-runner” step is a little off here, because it shows success, even though the ui shows no logs. That seems a little unusual. This is pretty bad, since we usually trust the checkmark on a PR to mean all of the tests have passed and so forth, but in this case we got the checkmark without running any of the tests. Are there any steps I can take to debug why this is happening and figure out how to fix it? We are running drone 1.9. The exact drone.yml for this build is [here](https://github.com/grafana/grafana/blob/3b248fccc8dc112d712cbe216b6b64f6c2bc165e/.drone.yml) ---
**Author:** ![bradrydzewski](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/bradrydzewski/32/3513_2.png) [@bradrydzewski](https://drone.discourse.group/u/bradrydzewski)\ **Post date:** [August 19, 2020, 2:22pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/2 "2020-08-19T14:22:04Z")
I ran through `drone lint` and I can see the problem is caused by an invalid dependency that is defined your dependency graph. It looks like defining an invalid dependency causes the pipeline to short circuit and exit. ```auto $ drone lint linter: invalid or unknown step dependency ``` which version of the runner are you using? I think we may have patched this recently, but if not, we can work on a patch. ---
**Author:** ![aknudsen](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/aknudsen/32/5067_2.png) [@aknudsen](https://drone.discourse.group/u/aknudsen)\ **Post date:** [August 19, 2020, 2:25pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/3 "2020-08-19T14:25:03Z")
@bradrydzewski How can you tell the invalid dependency? The linter doesn’t output it. The strange thing though, is that this issue happens only rarely? Shouldn’t Drone always skip steps due to the missing dependency? ---
**Author:** ![captncraig](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/captncraig/32/5888_2.png) [@captncraig](https://drone.discourse.group/u/captncraig)\ **Post date:** [August 19, 2020, 2:26pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/4 "2020-08-19T14:26:56Z")
Using `drone/drone-runner-docker:1.3` ---
**Author:** ![captncraig](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/captncraig/32/5888_2.png) [@captncraig](https://drone.discourse.group/u/captncraig)\ **Post date:** [August 19, 2020, 2:27pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/5 "2020-08-19T14:27:31Z")
I should definitely update that to 1.5. ---
**Author:** ![aknudsen](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/aknudsen/32/5067_2.png) [@aknudsen](https://drone.discourse.group/u/aknudsen)\ **Post date:** [August 19, 2020, 2:34pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/6 "2020-08-19T14:34:28Z")
@bradrydzewski Can you see which dependency is missing?? I’ve read through .drone.yml now and can’t see any missing dependencies at all. I mean, there might be one, but I can’t spot it (disclaimer: I’m the author of the Grafana Drone config). ---
**Author:** ![bradrydzewski](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/bradrydzewski/32/3513_2.png) [@bradrydzewski](https://drone.discourse.group/u/bradrydzewski)\ **Post date:** [August 19, 2020, 2:45pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/7 "2020-08-19T14:45:06Z")
@aknudsen I just pushed an update that provides a better error message: > linter: unknown step dependency detected: build-backend references test-backend the directed graph library that we use would require that test-backend is defined before build-backend in the pipeline. ---
**Author:** ![aknudsen](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/aknudsen/32/5067_2.png) [@aknudsen](https://drone.discourse.group/u/aknudsen)\ **Post date:** [August 19, 2020, 2:45pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/8 "2020-08-19T14:45:46Z")
@bradrydzewski Ah…, thanks on both accounts! ---
**Author:** ![captncraig](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/captncraig/32/5888_2.png) [@captncraig](https://drone.discourse.group/u/captncraig)\ **Post date:** [August 20, 2020, 5:36pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/9 "2020-08-20T17:36:29Z")
We have updated our runners to all use the latest docker runner (1.5). We have also triple-checked our dependency graphs and made sure they all pass lint. We are continuing to see unexplained skipped steps, primarily on private repos. Restarting the build usually fixes it, but it is happening with some frequency. The common symptom seems to be skipped steps, and at least one “successful” step that has no logs at all. ---
**Author:** ![aknudsen](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/aknudsen/32/5067_2.png) [@aknudsen](https://drone.discourse.group/u/aknudsen)\ **Post date:** [August 20, 2020, 5:45pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/10 "2020-08-20T17:45:23Z")
I can confirm @captncraig’s account, we have experienced several builds of a private repo today to skip (most) steps and be marked as successful by Drone. I’ve run `drone lint` on the repo .drone.yml in question, and it finds no issues. Could there please be a Drone configuration parameter to make it fail hard (with an explanation) when unable to resolve dependencies, instead of skipping and marking the build successful? I think this behaviour is really bad, as it’s _never_ something I want to happen and I’m also super confused as to _why_ it’s happening. ---
**Author:** ![bradrydzewski](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/bradrydzewski/32/3513_2.png) [@bradrydzewski](https://drone.discourse.group/u/bradrydzewski)\ **Post date:** [August 20, 2020, 9:27pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/11 "2020-08-20T21:27:08Z")
> I want to happen and I’m also super confused as to _why_ it’s happening I published a patch yesterday that is available in `drone/drone-runner-docker:latest`, however, if you upgraded to version 1.5 you would not have the fix yet. I recommend using the latest image to see if this solves the issue. I am not aware of any other root cause for the behavior described, however, if the issue persists we would kindly ask that you enabled debug logging on the runner and provide the logs, as well as a yaml that we can use to try and reproduce (also if the repository is open source, a link to the build is also helpful). _edit: just noticed you mentioned this was for a private repository. once you upgrade, feel free to email me the requested info if you don’t want to share publicly_ ---
**Author:** ![aknudsen](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/aknudsen/32/5067_2.png) [@aknudsen](https://drone.discourse.group/u/aknudsen)\ **Post date:** [August 21, 2020, 7:17am UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/12 "2020-08-21T07:17:09Z")
Thanks for making that change @bradrydzewski! It’ll be a great help if Drone catches and reports these errors, instead of just skipping steps 🙂 I will see with @captncraig if we can try the `latest` image revision. I’ll email you the Drone config in question (to the standard [drone.io](http://drone.io) address). ---
**Author:** ![captncraig](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/captncraig/32/5888_2.png) [@captncraig](https://drone.discourse.group/u/captncraig)\ **Post date:** [August 21, 2020, 2:33pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/13 "2020-08-21T14:33:10Z")
I deployed runners from latest. The linter error does stop one edge case that looks a little like ours, and I much prefer the new behaviour, so thank you. Time will tell if that gives any improvement or insight to the problematic builds. ---
**Author:** ![aknudsen](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/aknudsen/32/5067_2.png) [@aknudsen](https://drone.discourse.group/u/aknudsen)\ **Post date:** [September 9, 2020, 8:40am UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/14 "2020-09-09T08:40:54Z")
@bradrydzewski This problem is happening again for us now (although randomly, as before) ☹ See f.ex. [this build](https://drone.grafana.net/grafana/grafana/2426). @captncraig We’re sure we’re on a version with the fix? ---
**Author:** ![aknudsen](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/aknudsen/32/5067_2.png) [@aknudsen](https://drone.discourse.group/u/aknudsen)\ **Post date:** [September 21, 2020, 2:02pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/15 "2020-09-21T14:02:36Z")
@bradrydzewski Got [another](https://drone.grafana.net/grafana/grafana/2942) aborted, but successful, build just now 😕 I thought you made a patch to stop this from happening? ---
**Author:** ![bradrydzewski](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/bradrydzewski/32/3513_2.png) [@bradrydzewski](https://drone.discourse.group/u/bradrydzewski)\ **Post date:** [September 21, 2020, 11:02pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/16 "2020-09-21T23:02:07Z")
we made numerous patches to both prevent this issue and provide additional trace logging so that we could help diagnose the issue if it happens again. In order to take advantage of all patches and improved logging you need version 1.5.2 of the runner or higher. If this happens again, enable trace logging on the runner and provide a log dump and we can analyze. ---
**Author:** ![aknudsen](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/aknudsen/32/5067_2.png) [@aknudsen](https://drone.discourse.group/u/aknudsen)\ **Post date:** [September 22, 2020, 6:55am UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/17 "2020-09-22T06:55:55Z")
Thanks, will check,. ---
**Author:** ![aknudsen](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/aknudsen/32/5067_2.png) [@aknudsen](https://drone.discourse.group/u/aknudsen)\ **Post date:** [September 23, 2020, 7:27am UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/18 "2020-09-23T07:27:03Z")
I think we might have been on an older version of the runners after all, from what I hear we’ve rolled out v1.5.2 now. Fingers crossed it smooths out the bumps! ---
**Author:** ![captncraig](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/captncraig/32/5888_2.png) [@captncraig](https://drone.discourse.group/u/captncraig)\ **Post date:** [October 5, 2020, 4:09pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/19 "2020-10-05T16:09:18Z")
It happened again on 1.5.2 runners, sadly. But maybe there are some leads here: > **[Drone | Continuous Integration](https://drone.grafana.net/grafana/grafana-enterprise/623/1/1)** Specifically the FIXME lines are a little concerning. ```auto {"log":"time=\"2020-10-04T18:22:03Z\" level=debug msg=\"stage details fetched\" build.id=13512 build.number=623 repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 thread=1\n","stream":"stderr","time":"2020-10-04T18:22:03.459465436Z"} {"log":"time=\"2020-10-04T18:22:03Z\" level=debug msg=\"updated stage to running\" build.id=13512 build.number=623 repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 thread=1\n","stream":"stderr","time":"2020-10-04T18:22:03.923214325Z"} {"log":"time=\"2020-10-04T18:22:05Z\" level=debug msg=\"received exit code 0\" build.id=13512 build.number=623 repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 step.name=identify-runner thread=1\n","stream":"stderr","time":"2020-10-04T18:22:05.116809089Z"} {"log":"time=\"2020-10-04T18:22:08Z\" level=debug msg=\"received exit code 0\" build.id=13512 build.number=623 repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 step.name=clone thread=1\n","stream":"stderr","time":"2020-10-04T18:22:08.587163022Z"} {"log":"time=\"2020-10-04T18:23:43Z\" level=debug msg=\"received exit code 0\" build.id=13512 build.number=623 repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 step.name=initialize thread=1\n","stream":"stderr","time":"2020-10-04T18:23:43.515627302Z"} {"log":"time=\"2020-10-04T18:23:46Z\" level=debug msg=\"received exit code 0\" build.id=13512 build.number=623 repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 step.name=shellcheck thread=1\n","stream":"stderr","time":"2020-10-04T18:23:46.374465501Z"} {"log":"time=\"2020-10-04T18:23:46Z\" level=debug msg=\"received exit code 0\" build.id=13512 build.number=623 repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 step.name=codespell thread=1\n","stream":"stderr","time":"2020-10-04T18:23:46.52527782Z"} {"log":"time=\"2020-10-04T18:23:58Z\" level=debug msg=\"received exit code 0\" build.id=13512 build.number=623 repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 step.name=build-docs-website thread=1\n","stream":"stderr","time":"2020-10-04T18:23:58.408606694Z"} {"log":"time=\"2020-10-04T18:24:05Z\" level=debug msg=\"received exit code 0\" build.id=13512 build.number=623 repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 step.name=lint-backend thread=1\n","stream":"stderr","time":"2020-10-04T18:24:05.424525511Z"} {"log":"time=\"2020-10-04T18:24:35Z\" level=debug msg=\"received exit code 0\" build.id=13512 build.number=623 repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 step.name=build-plugins thread=1\n","stream":"stderr","time":"2020-10-04T18:24:35.292970565Z"} {"log":"time=\"2020-10-04T18:26:42Z\" level=debug msg=\"received exit code 0\" build.id=13512 build.number=623 repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 step.name=test-frontend thread=1\n","stream":"stderr","time":"2020-10-04T18:26:42.100059521Z"} {"log":"time=\"2020-10-04T18:26:42Z\" level=debug msg=\"destroying the pipeline environment\" build.id=13512 build.number=623 repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 thread=1\n","stream":"stderr","time":"2020-10-04T18:26:42.209616062Z"} {"log":"time=\"2020-10-04T18:26:42Z\" level=debug msg=\"FIXME: Got an status-code for which error does not match any expected type!!!: -1\" module=api status_code=-1\n","stream":"stderr","time":"2020-10-04T18:26:42.209628951Z"} {"log":"time=\"2020-10-04T18:26:42Z\" level=debug msg=\"FIXME: Got an status-code for which error does not match any expected type!!!: -1\" module=api status_code=-1\n","stream":"stderr","time":"2020-10-04T18:26:42.209632549Z"} {"log":"time=\"2020-10-04T18:26:42Z\" level=debug msg=\"FIXME: Got an status-code for which error does not match any expected type!!!: -1\" module=api status_code=-1\n","stream":"stderr","time":"2020-10-04T18:26:42.209650361Z"} {"log":"time=\"2020-10-04T18:26:48Z\" level=debug msg=\"successfully destroyed the pipeline environment\" build.id=13512 build.number=623 repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 thread=1\n","stream":"stderr","time":"2020-10-04T18:26:48.603660405Z"} {"log":"time=\"2020-10-04T18:26:48Z\" level=debug msg=\"stage failed\" build.id=13512 build.number=623 duration=279 error=\"1 error occurred:\\n\\t* \u003chtml\u003e\\r\\n\u003chead\u003e\u003ctitle\u003e400 Bad Request\u003c/title\u003e\u003c/head\u003e\\r\\n\u003cbody\u003e\\r\\n\u003ccenter\u003e\u003ch1\u003e400 Bad Request\u003c/h1\u003e\u003c/center\u003e\\r\\n\u003chr\u003e\u003ccenter\u003enginx/1.15.10\u003c/center\u003e\\r\\n\u003c/body\u003e\\r\\n\u003c/html\u003e\\r\\n\\n\\n\" repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 thread=1\n","stream":"stderr","time":"2020-10-04T18:26:48.603685414Z"} {"log":"time=\"2020-10-04T18:26:48Z\" level=debug msg=\"poller: request stage from remote server\" thread=1\n","stream":"stderr","time":"2020-10-04T18:26:48.603691545Z"} {"log":"time=\"2020-10-04T18:26:48Z\" level=debug msg=\"done listening for cancellations\" build.id=13512 build.number=623 repo.id=61 repo.name=grafana-enterprise repo.namespace=grafana stage.id=30779 stage.name=build-master-downstream stage.number=1 thread=1\n","stream":"stderr","time":"2020-10-04T18:26:48.60381219Z"} ``` ---
**Author:** ![bradrydzewski](https://yyz1.discourse-cdn.com/flex003/user_avatar/drone.discourse.group/bradrydzewski/32/3513_2.png) [@bradrydzewski](https://drone.discourse.group/u/bradrydzewski)\ **Post date:** [October 5, 2020, 4:27pm UTC](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980/20 "2020-10-05T16:27:55Z")
I am unable to access the link. Also can you enable trace logging on the runner? We added a bunch of new trace log entries to help debug this issue. > Specifically the FIXME lines are a little concerning. the FIXME lines come from the Docker Client and should be ignored. The error is both annoying and misleading, but unfortunately nothing we can do about it until there is an upstream Docker fix. [Next page](https://drone.discourse.group/t/build-successful-even-though-most-steps-skipped/10980.md?page=2)