Raw log | Switch to full mode | Login

python -u /b/c/goma_client/goma_ctl.py stat in dir /b/c/b/mac/src: allow_subannotations: False base_name: goma_stat cmd: ['python', '-u', '/b/c/goma_client/goma_ctl.py', 'stat'] cwd: /b/c/b/mac/src env: {'GOMA_SERVICE_ACCOUNT_JSON_FILE': '/creds/service_accounts/service-account-goma-client.json', 'GOMACTL_CRASH_REPORT_ID_FILE': '/b/rr/tmpTUmdZ6/crash_report_id_file', 'GOMA_DUMP_STATS_FILE': '/b/rr/tmpTUmdZ6/goma_stats_proto'} infra_step: False name: postprocess_for_goma.goma_stat nest_level: 1 ok_ret: frozenset([0]) trigger_specs: [] full environment: AWS_CREDENTIAL_FILE: /b/build/site_config/.boto BOTO_CONFIG: /b/build/site_config/.boto BUILDBOT_BLAMELIST: [u'kojii@chromium.org'] BUILDBOT_BRANCH: BUILDBOT_BUILDBOTURL: http://build.chromium.org/p/tryserver.chromium.mac/ BUILDBOT_BUILDERNAME: mac_chromium_compile_dbg_ng BUILDBOT_BUILDNUMBER: 398903 BUILDBOT_CLOBBER: BUILDBOT_GOT_REVISION: None BUILDBOT_MASTERNAME: tryserver.chromium.mac BUILDBOT_REVISION: BUILDBOT_SCHEDULER: None BUILDBOT_SLAVENAME: vm706-m4 CHROME_HEADLESS: 1 CIPD_CACHE_DIR: /b/c/cipd GIT_USER_AGENT: darwin git/2.7.4 vm706-m4.golo.chromium.org GOMACTL_CRASH_REPORT_ID_FILE: /b/rr/tmpTUmdZ6/crash_report_id_file GOMA_DUMP_STATS_FILE: /b/rr/tmpTUmdZ6/goma_stats_proto GOMA_SERVICE_ACCOUNT_JSON_FILE: /creds/service_accounts/service-account-goma-client.json HOME: /Users/chrome-bot INFRA_BUILDBOT_MASTER_CLASS_NAME: TryServerChromiumMac INFRA_BUILDBOT_SLAVE_ACTIVE_SUBDIR: INFRA_BUILDBOT_SLAVE_NAME: vm706-m4 LOGDOG_COORDINATOR_HOST: luci-logdog.appspot.com LOGDOG_STREAM_PREFIX: bb/tryserver.chromium.mac/mac_chromium_compile_dbg_ng/398903 LOGDOG_STREAM_PROJECT: chromium LOGDOG_STREAM_SERVER_PATH: unix:/b/build/rr/tmpdEiMFm/butler.sock LOGNAME: chrome-bot PAGER: cat PATH: /b/cipd_path_tools:/b/cipd_client:/Users/chrome-bot/slavebin:/b/depot_tools:/usr/local/git/bin:/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin PWD: /b/build/slave/remote_run/build PYTHONIOENCODING: UTF-8 PYTHONPATH: /b/build/site_config:/b/build/scripts:/b/build/scripts/release:/b/build/third_party:/b/build/third_party/google_api_python_client:/b/build/third_party/httplib2/python2:/b/build/third_party/infra_libs:/b/build/third_party/oauth2client:/b/build/third_party/pyasn1:/b/build/third_party/pyasn1-modules:/b/build/third_party/python-rsa:/b/build/third_party/requests_2_10_0:/b/build/third_party/setuptools-0.6c11:/b/build/third_party/site-packages:/b/build/third_party/uritemplate:/b/build_internal/site_config:/b/build_internal/symsrc:/b/build/slave:/b/build/third_party/buildbot_slave_8_4:/b/build/third_party/twisted_10_2: PYTHONUNBUFFERED: 1 SHELL: /bin/bash SSH_AUTH_SOCK: /tmp/launch-LMtlMc/Listeners TMPDIR: /var/folders/9x/6c6sv3cj4j53wzpzthbp4ksm0000gm/T/ USER: chrome-bot VERSIONER_PYTHON_PREFER_32_BIT: no VERSIONER_PYTHON_VERSION: 2.7 __CF_USER_TEXT_ENCODING: 0x1F4:0:0 using /var/folders/9x/6c6sv3cj4j53wzpzthbp4ksm0000gm/T/goma_chrome-bot as tmpdir request: total=2950 success=2869 failure=55 compiler_proxy: fail=0 compiler_info: stores=0 store_dups=0 miss=0 fail=0 goma: finished=2907 cache_hit=1573 local_cachehit=0 aborted=8 retry=104 fail=81 fallback_in_setup: parse_fail=0 no_remote=0 http_disabled=0 compiler_info_fail=0 compiler_disabled=0 requested_by_user=0 local: run=69 killed=0 finished=35 local run reason: fail goma, local run started in CALL_EXEC=2 fail in call exec=26 local idle=5 should not run while delaying subproc=3 slow goma, local run started in FILE_REQ=1 slow goma, local run started in FILE_RESP=32 error: user: E:1 compiler_proxy:12602ms: reached max number of active fail fallbacks E:1 compiler_proxy:13382ms: reached max number of active fail fallbacks E:1 compiler_proxy:11064ms: reached max number of active fail fallbacks E:1 compiler_proxy:14196ms: reached max number of active fail fallbacks E:1 compiler_proxy:8238ms: reached max number of active fail fallbacks E:1 compiler_proxy:14142ms: reached max number of active fail fallbacks E:1 compiler_proxy:11105ms: reached max number of active fail fallbacks E:1 compiler_proxy:14178ms: reached max number of active fail fallbacks E:1 compiler_proxy:8143ms: reached max number of active fail fallbacks E:1 compiler_proxy:8059ms: reached max number of active fail fallbacks E:1 compiler_proxy:13373ms: reached max number of active fail fallbacks E:1 compiler_proxy:8088ms: reached max number of active fail fallbacks E:1 compiler_proxy:14101ms: reached max number of active fail fallbacks E:1 compiler_proxy:8028ms: reached max number of active fail fallbacks E:1 compiler_proxy:8528ms: reached max number of active fail fallbacks E:1 compiler_proxy:8131ms: reached max number of active fail fallbacks E:1 compiler_proxy:8151ms: reached max number of active fail fallbacks E:1 compiler_proxy:6651ms: reached max number of active fail fallbacks E:1 compiler_proxy:11071ms: reached max number of active fail fallbacks E:1 compiler_proxy:11057ms: reached max number of active fail fallbacks E:1 compiler_proxy:11449ms: reached max number of active fail fallbacks E:1 compiler_proxy:12210ms: reached max number of active fail fallbacks E:1 compiler_proxy:12325ms: reached max number of active fail fallbacks E:1 compiler_proxy:14110ms: reached max number of active fail fallbacks E:1 compiler_proxy:8118ms: reached max number of active fail fallbacks E:1 compiler_proxy:9711ms: reached max number of active fail fallbacks E:1 compiler_proxy:8064ms: reached max number of active fail fallbacks E:1 compiler_proxy:10994ms: reached max number of active fail fallbacks E:1 compiler_proxy:8123ms: reached max number of active fail fallbacks E:1 compiler_proxy:9567ms: reached max number of active fail fallbacks E:1 compiler_proxy:6515ms: reached max number of active fail fallbacks E:1 compiler_proxy:9595ms: reached max number of active fail fallbacks E:1 compiler_proxy:6907ms: reached max number of active fail fallbacks E:1 compiler_proxy:11075ms: reached max number of active fail fallbacks E:1 compiler_proxy:9137ms: reached max number of active fail fallbacks E:1 compiler_proxy:6162ms: reached max number of active fail fallbacks E:1 compiler_proxy:6897ms: reached max number of active fail fallbacks E:1 compiler_proxy:6137ms: reached max number of active fail fallbacks E:1 compiler_proxy:9042ms: reached max number of active fail fallbacks E:1 compiler_proxy:8955ms: reached max number of active fail fallbacks E:1 compiler_proxy:9003ms: reached max number of active fail fallbacks E:1 compiler_proxy:12624ms: reached max number of active fail fallbacks E:1 compiler_proxy:8612ms: reached max number of active fail fallbacks E:1 compiler_proxy:5001ms: reached max number of active fail fallbacks E:1 compiler_proxy:8160ms: reached max number of active fail fallbacks E:1 compiler_proxy:3129ms: reached max number of active fail fallbacks E:1 compiler_proxy:7486ms: reached max number of active fail fallbacks E:1 compiler_proxy:14307ms: reached max number of active fail fallbacks E:1 compiler_proxy:6152ms: reached max number of active fail fallbacks E:1 compiler_proxy:17253ms: reached max number of active fail fallbacks E:1 compiler_proxy:9491ms: reached max number of active fail fallbacks E:1 compiler_proxy:8065ms: reached max number of active fail fallbacks E:1 compiler_proxy:11218ms: reached max number of active fail fallbacks E:1 compiler_proxy:11609ms: reached max number of active fail fallbacks E:1 compiler_proxy:8547ms: reached max number of active fail fallbacks files: requested=2641897 uploaded=40458 missed=0 outputs: files=5652 rename=0 buf=5652 peak_req=4994479 memory: consuming=1789816832 time: uptime=377 include_processor: total=402271 skipped=291321 total_wait_time=16561 total_run_time=12541 includecache: entries=2983 cache_size=2776651 hit=109248 missed=1695 updated=721 evicted=0 orig_total=27698421 orig_max=658123 orig_ave=9285 filter_total=2776651 filter_max=582022 filter_ave=930 depscache: table_size=20880 max=2800 total=15062610 average=721 idtable=46684 hit=2789 updated=154 missed=7 incdircache: instances=16 memory=4956492 created=58 reused=103 http_rpc: query=2991 retry=0 timeout=11 error=83