profile
viewpoint
If you are wondering where the data of this site comes from, please visit https://api.github.com/users/simonjohansson/events. GitMemory does not store any data, but only uses NGINX to cache data for a period of time. The idea behind GitMemory is simply to give users a better reading experience.
Simon Johansson simonjohansson @springernature Berlin, DE

simonjohansson/B2G-build 2

Docker image to build B2G.

project-tenjin/backend 1

Java Spring backend for project Tenjin

simonjohansson/cf-concourse-vault 1

Deploy CF, Concourse and Vault in Bosh Lite. Yay

robwhitby/concourse 0

Concourse CI

simonjohansson/anyconnect 0

Connect to anyconnect using a docker container

simonjohansson/archive-resource 0

downloads and extracts an archive (currently tgz) from a uri

simonjohansson/archiver 0

Easily create and extract .zip, .tar, .tar.gz, .tar.bz2, .tar.xz, .tar.lz4, .tar.sz, and .rar (extract-only) files with Go

push eventspringernature/halfpipe

Simon Johansson

commit sha 6f921a528a96a48848f643fc8fa5ab9c8f4b7533

Bump atc packages

view details

push time in 6 days

create barnchspringernature/halfpipe

branch : automatic-cdc

created branch time in 6 days

release springernature/halfpipe

3.73.1

released time in 12 days

push eventspringernature/halfpipe

Simon Johansson

commit sha cae02fa3696d8ae02f46305371a34364da2fe570

Remove rogue cd command

view details

push time in 12 days

release springernature/halfpipe

3.73.0

released time in 13 days

release springernature/halfpipe

3.72.0

released time in 13 days

release springernature/halfpipe

3.71.0

released time in 18 days

release springernature/halfpipe

3.70.0

released time in 20 days

release springernature/halfpipe

3.69.3

released time in a month

push eventspringernature/halfpipe

Simon Johansson

commit sha e1e6fb9797001d7e7c694760c41a5b71ddd157cb

Remove weird workflow created by e2e

view details

push time in a month

release springernature/halfpipe

3.69.2

released time in a month

push eventspringernature/halfpipe

Simon Johansson

commit sha f55d3b669e6870c57851f95b0846a7704a731b92

Rob forgot to run the tests

view details

push time in a month

push eventspringernature/halfpipe

Simon Johansson

commit sha 5e5411337b5e2e8ff7d68ed5c215aa697c833ed5

cf7 default to snpaas

view details

push time in a month

push eventspringernature/halfpipe-deploy-resource

Simon Johansson

commit sha bb54e067c91f384e3173925ad7fa1c9c8d0bb59d

Make it work with the aggregator gateway. It seems it doesnt merge groups and job with the metric so we have to merge it ourselves.

view details

push time in a month

push eventspringernature/halfpipe-deploy-resource

Simon Johansson

commit sha f62ae451a5ef4fecaf2598c1b6b7f8fdc2654b47

Use text as transport instead of gbuffer to the aggregationgateway

view details

push time in a month

push eventspringernature/halfpipe-deploy-resource

Simon Johansson

commit sha 4e06b6d400fbff54cf9cc2ba52583d938e88cfb8

Update push gateway to aggregation gateway

view details

push time in a month

push eventspringernature/halfpipe-deploy-resource

Simon Johansson

commit sha 70f7bdfd9b6ec0f8064c6ea0afe0af6dad0110cf

Tag as latest

view details

push time in a month

release springernature/halfpipe

3.69.1

released time in a month

push eventspringernature/halfpipe

Simon Johansson

commit sha 1c1fcb8a7a9559ce97fed42d521124b3f61bc7ad

Dont use a tag when using the cf-resource, just use the latest since that has been tested to work

view details

push time in a month

push eventspringernature/halfpipe-deploy-resource

Simon Johansson

commit sha f2942b62e02f02781ca5b38e70130531e2302e2f

Update pipeline so we push the test resource to a different docker image.

view details

push time in a month

push eventspringernature/halfpipe-deploy-resource

Simon Johansson

commit sha 03c1eec4a6e46dfc00a0f800f00127abab3bada6

Update the buckets for the prometheus buckets, also remove a bunch of tags that we dont really need

view details

push time in a month

issue commentspringernature/halfpipe

README link requires auth

Hey @drahnr, sorry for the late reply!

Currently the Halfpipe docs are merged with our other super secret internal docs, but if your still curious I could see if I can desensitize it and share it?

drahnr

comment created time in a month

issue commentconcourse/concourse

Database pinned to 100% CPU after a few hours of running

Maybe run the inspection queries again?

Show foreign keys without an index

               conrelid               |                             conname                             | reltuples
--------------------------------------+-----------------------------------------------------------------+-----------
 volumes                              | volumes_worker_artifact_id_fkey                                 |        95
 volumes                              | worker_resource_certs_id_fkey                                   |        95
 volumes                              | volumes_parent_id_fkey                                          |        95
 build_image_resource_caches          | build_image_resource_caches_job_id_fkey                         |        57
 resource_config_versions             | resource_config_versions_resource_config_scope_id_fkey          |        42
 resources                            | resources_resource_config_scope_id_fkey                         |        33
 worker_resource_caches               | worker_resource_caches_worker_name_fkey                         |        30
 resource_config_scopes               | resource_config_scopes_resource_id_fkey                         |        30
 next_build_inputs                    | next_build_inputs_resource_id_fkey                              |        26
 build_resource_config_version_inputs | build_resource_config_version_inputs_resource_id_fkey           |        18
 build_resource_config_version_inputs | build_resource_config_version_inputs_build_id_fkey              |        18
 resource_config_check_sessions       | resource_config_check_sessions_worker_base_resource_type_id_fke |        11
 next_build_pipes                     | next_build_pipes_from_build_id_fkey                             |         1
 worker_resource_certs                | worker_resource_certs_worker_name_fkey                          |         0
 resource_disabled_versions           | resource_disabled_versions_resource_id_fkey                     |         0
 build_pipes                          | build_pipes_from_build_id_fkey                                  |         0
 worker_artifacts                     | worker_artifacts_build_id_fkey                                  |         0

Show the size and number of hits for each index

               tablename               |                            indexname                            | num_rows | table_size | index_size | unique | number_of_scans | tuples_read | tuples_fetched 
---------------------------------------+-----------------------------------------------------------------+----------+------------+------------+--------+-----------------+-------------+----------------
 access_tokens                         | access_tokens_pkey                                              |       35 | 32 kB      | 16 kB      | Y      |              90 |          83 |             83
 auth_code                             | auth_code_pkey                                                  |        0 | 8192 bytes | 16 kB      | Y      |               8 |           8 |              8
 auth_request                          | auth_request_pkey                                               |        0 | 8192 bytes | 16 kB      | Y      |              32 |          32 |             32
 base_resource_types                   | base_resource_types_name_key                                    |        0 | 8192 bytes | 16 kB      | Y      |          204217 |      204189 |         204189
 base_resource_types                   | base_resource_types_pkey                                        |        0 | 8192 bytes | 16 kB      | Y      |            1332 |        1332 |           1332
 build_events                          | build_events_build_id_event_id                                  |        0 | 0 bytes    | 8192 bytes | Y      |               0 |           0 |              0
 build_events                          | build_events_build_id_old_event_id                              |        0 | 0 bytes    | 8192 bytes | Y      |               0 |           0 |              0
 build_image_resource_caches           | build_image_resource_caches_build_id                            |       57 | 8192 bytes | 16 kB      | N      |           54258 |       54293 |          53746
 build_image_resource_caches           | build_image_resource_caches_job_build_idx                       |       57 | 8192 bytes | 16 kB      | N      |             497 |          71 |             36
 build_image_resource_caches           | build_image_resource_caches_resource_cache_id                   |       57 | 8192 bytes | 16 kB      | N      |              74 |          15 |              0
 build_pipes                           | build_pipes_from_build_id_to_build_id_uniq                      |        0 | 8192 bytes | 16 kB      | Y      |          113386 |          64 |              0
 build_pipes                           | build_pipes_to_build_id_idx                                     |        0 | 8192 bytes | 16 kB      | N      |          113366 |          64 |              0
 build_resource_config_version_inputs  | build_inputs_resource_versions_idx                              |       18 | 8192 bytes | 16 kB      | N      |             250 |         268 |            196
 build_resource_config_version_inputs  | build_resource_config_version_inputs_uniq                       |       18 | 8192 bytes | 16 kB      | Y      |            4611 |        3940 |           3646
 build_resource_config_version_outputs | build_resource_config_version_outputs_build_id_idx              |        1 | 8192 bytes | 16 kB      | N      |            9363 |         180 |             80
 build_resource_config_version_outputs | build_resource_config_version_outputs_resource_id_idx           |        1 | 8192 bytes | 16 kB      | N      |             506 |         113 |              9
 build_resource_config_version_outputs | build_resource_config_version_outputs_uniq                      |        1 | 8192 bytes | 16 kB      | Y      |             457 |           3 |              3
 builds                                | build_names_uniq_idx                                            |       56 | 176 kB     | 16 kB      | Y      |             277 |         576 |             72
 builds                                | builds_interceptible_completed                                  |       56 | 176 kB     | 16 kB      | N      |           47780 |     1039015 |          15249
 builds                                | builds_ordered_by_job_id_idx                                    |       56 | 176 kB     | 16 kB      | N      |         1529520 |     1530024 |        1437211
 builds                                | builds_pipeline_id                                              |       56 | 176 kB     | 16 kB      | N      |            2557 |        2798 |           2524
 builds                                | builds_pkey                                                     |       56 | 176 kB     | 16 kB      | Y      |         1478464 |     1169353 |        1033016
 builds                                | builds_resource_id_idx                                          |       56 | 176 kB     | 16 kB      | N      |         5510400 |     5519515 |        4990930
 builds                                | builds_resource_type_id_idx                                     |       56 | 176 kB     | 16 kB      | N      |         4646217 |     4699604 |        4160171
 builds                                | builds_running_builds_by_serial_groups_idx                      |       56 | 176 kB     | 16 kB      | N      |             445 |        1400 |            693
 builds                                | builds_status                                                   |       56 | 176 kB     | 16 kB      | N      |          118379 |      479765 |         319119
 builds                                | builds_team_id                                                  |       56 | 176 kB     | 16 kB      | N      |               0 |           0 |              0
 builds                                | needs_v6_migration_idx                                          |       56 | 176 kB     | 8192 bytes | N      |              98 |           0 |              0
 builds                                | next_build_id_idx                                               |       56 | 176 kB     | 16 kB      | N      |            1614 |       12319 |           4454
 builds                                | order_builds_by_rerun_of_or_id_idx                              |       56 | 176 kB     | 16 kB      | N      |             462 |         508 |            461
 builds                                | order_job_builds_by_rerun_of_or_id_idx                          |       56 | 176 kB     | 16 kB      | N      |          492033 |      165368 |         164610
 builds                                | pending_builds_idx                                              |       56 | 176 kB     | 16 kB      | N      |             398 |        1455 |            381
 builds                                | rerun_of_builds_idx                                             |       56 | 176 kB     | 16 kB      | N      |           34846 |         772 |            716
 builds                                | succeeded_builds_ordering_with_rerun_builds_idx                 |       56 | 176 kB     | 16 kB      | N      |             154 |          90 |             79
 builds                                | unencrypted_private_plans_build_idx                             |       56 | 176 kB     | 16 kB      | N      |               0 |           0 |              0
 cert_cache                            | cert_cache_pkey                                                 |        0 | 0 bytes    | 8192 bytes | Y      |               0 |           0 |              0
 check_build_events                    | check_build_events_build_id_event_id                            |     1782 | 336 kB     | 272 kB     | Y      |            2429 |       21658 |              5
 client                                | client_pkey                                                     |        3 | 8192 bytes | 16 kB      | Y      |              39 |          39 |             39
 components                            | components_name_key                                             |       16 | 8192 bytes | 16 kB      | Y      |             448 |         432 |            432
 components                            | components_pkey                                                 |       16 | 8192 bytes | 16 kB      | Y      |             191 |         191 |            191
 connector                             | connector_pkey                                                  |        2 | 8192 bytes | 16 kB      | Y      |              35 |          35 |             35
 containers                            | containers_build_id                                             |       17 | 24 kB      | 16 kB      | N      |          445838 |      468950 |         417791
 containers                            | containers_build_id_not_null                                    |       17 | 24 kB      | 16 kB      | N      |             589 |        3977 |           2762
 containers                            | containers_handle_key                                           |       17 | 24 kB      | 16 kB      | Y      |               8 |           8 |              8
 containers                            | containers_image_check_container_id                             |       17 | 24 kB      | 16 kB      | N      |             154 |           0 |              0
 containers                            | containers_image_get_container_id                               |       17 | 24 kB      | 16 kB      | N      |             157 |          22 |              3
 containers                            | containers_pkey                                                 |       17 | 24 kB      | 16 kB      | Y      |          401282 |      348140 |         332234
 containers                            | containers_plan_id                                              |       17 | 24 kB      | 16 kB      | N      |             124 |           0 |              0
 containers                            | containers_resource_config_check_session_id                     |       17 | 24 kB      | 16 kB      | N      |             267 |         267 |            267
 containers                            | containers_team_id                                              |       17 | 24 kB      | 16 kB      | N      |               0 |           0 |              0
 containers                            | containers_worker_name                                          |       17 | 24 kB      | 16 kB      | N      |            1576 |        1928 |           1844
 deleted_pipelines                     |                                                                 |        0 | 8192 bytes |            | N      |                 |             |               
 device_request                        | device_request_pkey                                             |        0 | 0 bytes    | 8192 bytes | Y      |               0 |           0 |              0
 device_token                          | device_token_pkey                                               |        0 | 0 bytes    | 8192 bytes | Y      |               0 |           0 |              0
 job_inputs                            | job_inputs_job_id_idx                                           |       27 | 8192 bytes | 16 kB      | N      |            2204 |        2344 |           1884
 job_inputs                            | job_inputs_passed_job_id_idx                                    |       27 | 8192 bytes | 16 kB      | N      |            1010 |        1485 |            874
 job_inputs                            | job_inputs_resource_id_idx                                      |       27 | 8192 bytes | 16 kB      | N      |            1236 |        1355 |           1170
 job_outputs                           | job_outputs_job_id_idx                                          |       31 | 8192 bytes | 16 kB      | N      |            2607 |        1526 |           1070
 job_outputs                           | job_outputs_resource_id_idx                                     |       31 | 8192 bytes | 16 kB      | N      |            1164 |         602 |            462
 jobs                                  | jobs_latest_completed_build_id                                  |       26 | 184 kB     | 16 kB      | N      |          147586 |      167255 |          74873
 jobs                                  | jobs_next_build_id                                              |       26 | 184 kB     | 16 kB      | N      |          140248 |         732 |            324
 jobs                                  | jobs_pipeline_id                                                |       26 | 184 kB     | 16 kB      | N      |          829410 |     2345969 |         376481
 jobs                                  | jobs_pkey                                                       |       26 | 184 kB     | 16 kB      | Y      |         4028663 |     3034004 |        2446444
 jobs                                  | jobs_transition_build_id                                        |       26 | 184 kB     | 16 kB      | N      |          140579 |        1396 |            608
 jobs                                  | jobs_unique_pipeline_id_name                                    |       26 | 184 kB     | 16 kB      | Y      |             730 |         772 |            510
 jobs_serial_groups                    | jobs_serial_groups_job_id_idx                                   |       24 | 8192 bytes | 16 kB      | N      |            2955 |        3093 |           2808
 jobs_serial_groups                    | jobs_serial_groups_pkey                                         |       24 | 8192 bytes | 16 kB      | Y      |               0 |           0 |              0
 keys                                  | keys_pkey                                                       |        0 | 8192 bytes | 16 kB      | Y      |              30 |          28 |             28
 migrations                            |                                                                 |        0 | 8192 bytes |            | N      |                 |             |               
 migrations_history                    |                                                                 |      126 | 8192 bytes |            | N      |                 |             |               
 next_build_inputs                     | next_build_inputs_job_id                                        |       26 | 8192 bytes | 16 kB      | N      |          106492 |      106793 |          91508
 next_build_inputs                     | next_build_inputs_unique_job_id_input_name                      |       26 | 8192 bytes | 16 kB      | Y      |               0 |           0 |              0
 next_build_pipes                      | next_build_pipes_from_build_id_to_job_id_uniq                   |        1 | 8192 bytes | 16 kB      | Y      |             571 |          19 |              0
 next_build_pipes                      | next_build_pipes_job_id_idx                                     |        1 | 8192 bytes | 16 kB      | N      |             213 |          52 |              0
 offline_session                       | offline_session_pkey                                            |        0 | 8192 bytes | 16 kB      | Y      |               8 |           6 |              6
 password                              | password_pkey                                                   |        2 | 8192 bytes | 16 kB      | Y      |              32 |          32 |             32
 pipeline_build_events_100             | pipeline_build_events_100_build_id_event_id                     |       87 | 96 kB      | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_100             | pipeline_build_events_100_build_id_old_event_id                 |       87 | 96 kB      | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_90              | pipeline_build_events_90_build_id_event_id                      |      485 | 552 kB     | 32 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_90              | pipeline_build_events_90_build_id_old_event_id                  |      485 | 552 kB     | 40 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_91              | pipeline_build_events_91_build_id_event_id                      |      104 | 168 kB     | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_91              | pipeline_build_events_91_build_id_old_event_id                  |      104 | 168 kB     | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_92              | pipeline_build_events_92_build_id_event_id                      |       52 | 48 kB      | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_92              | pipeline_build_events_92_build_id_old_event_id                  |       52 | 48 kB      | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_93              | pipeline_build_events_93_build_id_event_id                      |      153 | 168 kB     | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_93              | pipeline_build_events_93_build_id_old_event_id                  |      153 | 168 kB     | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_94              | pipeline_build_events_94_build_id_event_id                      |      120 | 240 kB     | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_94              | pipeline_build_events_94_build_id_old_event_id                  |      120 | 240 kB     | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_95              | pipeline_build_events_95_build_id_event_id                      |      636 | 304 kB     | 40 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_95              | pipeline_build_events_95_build_id_old_event_id                  |      636 | 304 kB     | 40 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_96              | pipeline_build_events_96_build_id_event_id                      |      226 | 264 kB     | 32 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_96              | pipeline_build_events_96_build_id_old_event_id                  |      226 | 264 kB     | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_97              | pipeline_build_events_97_build_id_event_id                      |      283 | 264 kB     | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_97              | pipeline_build_events_97_build_id_old_event_id                  |      283 | 264 kB     | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_98              | pipeline_build_events_98_build_id_event_id                      |      339 | 264 kB     | 32 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_98              | pipeline_build_events_98_build_id_old_event_id                  |      339 | 264 kB     | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_99              | pipeline_build_events_99_build_id_event_id                      |       66 | 88 kB      | 16 kB      | Y      |               0 |           0 |              0
 pipeline_build_events_99              | pipeline_build_events_99_build_id_old_event_id                  |       66 | 88 kB      | 16 kB      | Y      |               0 |           0 |              0
 pipelines                             | parent_job_id                                                   |        9 | 8192 bytes | 16 kB      | N      |              30 |           0 |              0
 pipelines                             | pipelines_name_team_id                                          |        9 | 8192 bytes | 16 kB      | Y      |             323 |         274 |            266
 pipelines                             | pipelines_name_team_id_instance_vars                            |        9 | 8192 bytes | 8192 bytes | Y      |               0 |           0 |              0
 pipelines                             | pipelines_pkey                                                  |        9 | 8192 bytes | 16 kB      | Y      |         5393060 |     5391770 |        5390766
 pipelines                             | pipelines_team_id                                               |        9 | 8192 bytes | 16 kB      | N      |              21 |         182 |              0
 refresh_token                         | refresh_token_pkey                                              |        0 | 0 bytes    | 8192 bytes | Y      |               0 |           0 |              0
 resource_cache_uses                   | resource_cache_uses_build_id                                    |       11 | 8192 bytes | 16 kB      | N      |             337 |         542 |            132
 resource_cache_uses                   | resource_cache_uses_container_id                                |       11 | 8192 bytes | 16 kB      | N      |              50 |           0 |              0
 resource_cache_uses                   | resource_cache_uses_resource_cache_id                           |       11 | 8192 bytes | 16 kB      | N      |              67 |         148 |              0
 resource_caches                       | resource_caches_pkey                                            |       20 | 48 kB      | 16 kB      | Y      |            1131 |        1134 |           1131
 resource_caches                       | resource_caches_resource_config_id                              |       20 | 48 kB      | 16 kB      | N      |               0 |           0 |              0
 resource_caches                       | resource_caches_resource_config_id_version_md5_params_hash_uniq |       20 | 48 kB      | 16 kB      | Y      |          118523 |      127981 |         127774
 resource_config_check_sessions        | resource_config_check_sessions_pkey                             |       11 | 8192 bytes | 16 kB      | Y      |              42 |          42 |             42
 resource_config_check_sessions        | resource_config_check_sessions_resource_config_id               |       11 | 8192 bytes | 16 kB      | N      |               0 |           0 |              0
 resource_config_check_sessions        | resource_config_check_sessions_uniq                             |       11 | 8192 bytes | 16 kB      | Y      |          404710 |      401856 |         395820
 resource_config_scopes                | resource_config_scopes_pkey                                     |       30 | 8192 bytes | 16 kB      | Y      |          106090 |      106065 |         102655
 resource_config_scopes                | resource_config_scopes_resource_config_id_uniq                  |       30 | 8192 bytes | 16 kB      | Y      |             207 |          21 |             21
 resource_config_scopes                | resource_config_scopes_resource_id_resource_config_id_uniq      |       30 | 8192 bytes | 8192 bytes | Y      |               0 |           0 |              0
 resource_config_versions              | resource_config_scope_id_and_version_md5_unique                 |       42 | 40 kB      | 16 kB      | Y      |          145446 |      146849 |         146313
 resource_config_versions              | resource_config_versions_check_order_idx                        |       42 | 40 kB      | 16 kB      | N      |          738600 |      738934 |         732272
 resource_config_versions              | resource_config_versions_pkey                                   |       42 | 40 kB      | 16 kB      | Y      |               0 |           0 |              0
 resource_config_versions              | resource_config_versions_version                                |       42 | 40 kB      | 16 kB      | N      |               0 |           0 |              0
 resource_configs                      | resource_configs_base_resource_type_id                          |       30 | 8192 bytes | 16 kB      | N      |               0 |           0 |              0
 resource_configs                      | resource_configs_base_resource_type_id_so_key                   |       30 | 8192 bytes | 16 kB      | Y      |             198 |         106 |             76
 resource_configs                      | resource_configs_pkey                                           |       30 | 8192 bytes | 16 kB      | Y      |          969515 |      970966 |         967388
 resource_configs                      | resource_configs_resource_cache_id                              |       30 | 8192 bytes | 16 kB      | N      |               0 |           0 |              0
 resource_configs                      | resource_configs_resource_cache_id_so_key                       |       30 | 8192 bytes | 16 kB      | Y      |              74 |           6 |              6
 resource_disabled_versions            | resource_disabled_versions_resource_id_version_md5_uniq         |        0 | 0 bytes    | 8192 bytes | Y      |            1927 |           0 |              0
 resource_pins                         | resource_pins_pkey                                              |        0 | 8192 bytes | 16 kB      | Y      |           77528 |       29903 |          29902
 resource_types                        | resource_types_pipeline_id                                      |       19 | 8192 bytes | 16 kB      | N      |          339812 |      228155 |         153837
 resource_types                        | resource_types_pipeline_id_name_key                             |       19 | 8192 bytes | 16 kB      | Y      |            1456 |         428 |            395
 resource_types                        | resource_types_pkey                                             |       19 | 8192 bytes | 16 kB      | Y      |         5502882 |     5496615 |        4234573
 resource_types                        | resource_types_resource_config_id                               |       19 | 8192 bytes | 16 kB      | N      |           15963 |         114 |             76
 resources                             | resources_build_id_idx                                          |       33 | 24 kB      | 16 kB      | N      |          222965 |      237780 |         213793
 resources                             | resources_pipeline_id                                           |       33 | 24 kB      | 16 kB      | N      |            5016 |      120090 |         119085
 resources                             | resources_pkey                                                  |       33 | 24 kB      | 16 kB      | Y      |         2847766 |     2854564 |        2751070
 resources                             | resources_resource_config_id                                    |       33 | 24 kB      | 16 kB      | N      |          238081 |      243842 |         230239
 resources                             | unique_pipeline_id_name                                         |       33 | 24 kB      | 16 kB      | Y      |             617 |         464 |            341
 successful_build_outputs              | successful_build_outputs_build_id_idx                           |       26 | 8192 bytes | 16 kB      | Y      |             712 |         126 |            126
 successful_build_outputs              | successful_build_outputs_job_id_idx                             |       26 | 8192 bytes | 16 kB      | N      |               1 |           6 |              0
 successful_build_outputs              | successful_build_outputs_ordering_with_rerun_builds_idx         |       26 | 8192 bytes | 16 kB      | N      |              31 |          46 |              0
 successful_build_outputs              | successful_build_outputs_outputs_idx                            |       26 | 8192 bytes | 16 kB      | N      |               0 |           0 |              0
 successful_build_outputs              | successful_build_outputs_rerun_of_idx                           |       26 | 8192 bytes | 16 kB      | N      |             693 |           0 |              0
 task_caches                           | task_caches_job_id                                              |        4 | 8192 bytes | 16 kB      | N      |            1180 |        1860 |           1820
 task_caches                           | task_caches_job_id_step_name_path_uniq                          |        4 | 8192 bytes | 16 kB      | Y      |             505 |          21 |             20
 task_caches                           | task_caches_pkey                                                |        4 | 8192 bytes | 16 kB      | Y      |             200 |         200 |            200
 team_build_events_1                   | team_build_events_1_build_id_event_id                           |        0 | 0 bytes    | 8192 bytes | Y      |              15 |           0 |              0
 team_build_events_2                   | team_build_events_2_build_id_event_id                           |        0 | 0 bytes    | 8192 bytes | Y      |              15 |           0 |              0
 team_build_events_3                   | team_build_events_3_build_id_event_id                           |        0 | 0 bytes    | 8192 bytes | Y      |              15 |           0 |              0
 team_build_events_4                   | team_build_events_4_build_id_event_id                           |        0 | 0 bytes    | 8192 bytes | Y      |              15 |           0 |              0
 teams                                 | index_teams_name_unique_case_insensitive                        |        4 | 8192 bytes | 16 kB      | Y      |            4048 |        4043 |           4043
 teams                                 | teams_pkey                                                      |        4 | 8192 bytes | 16 kB      | Y      |         3547954 |     3535735 |        3535735
 users                                 | user_unique                                                     |        5 | 8192 bytes | 16 kB      | Y      |              53 |          48 |             48
 users                                 | users_pkey                                                      |        5 | 8192 bytes | 16 kB      | Y      |               0 |           0 |              0
 volumes                               | missing_volumes_idx                                             |       95 | 80 kB      | 16 kB      | N      |          132649 |       50464 |             60
 volumes                               | volumes_container_id                                            |       95 | 80 kB      | 16 kB      | N      |          125781 |      232471 |         109266
 volumes                               | volumes_handle                                                  |       95 | 80 kB      | 72 kB      | Y      |           90867 |      149082 |          86768
 volumes                               | volumes_id_state_key                                            |       95 | 80 kB      | 80 kB      | Y      |           40858 |       51197 |            248
 volumes                               | volumes_parent_id                                               |       95 | 80 kB      | 32 kB      | N      |          291333 |      136618 |          88065
 volumes                               | volumes_pkey                                                    |       95 | 80 kB      | 64 kB      | Y      |         1056284 |     1462850 |        1196720
 volumes                               | volumes_team_id                                                 |       95 | 80 kB      | 16 kB      | N      |               0 |           0 |              0
 volumes                               | volumes_worker_base_resource_type_id                            |       95 | 80 kB      | 16 kB      | N      |           25792 |       28140 |          25546
 volumes                               | volumes_worker_name                                             |       95 | 80 kB      | 16 kB      | N      |             438 |        5374 |           4996
 volumes                               | volumes_worker_name_handle_key                                  |       95 | 80 kB      | 136 kB     | Y      |              26 |         819 |            480
 volumes                               | volumes_worker_resource_cache_id                                |       95 | 80 kB      | 16 kB      | N      |             105 |         113 |            105
 volumes                               | volumes_worker_resource_cache_unique                            |       95 | 80 kB      | 32 kB      | Y      |          494705 |      494166 |         405634
 volumes                               | volumes_worker_task_cache_id                                    |       95 | 80 kB      | 16 kB      | N      |            1293 |        2057 |           1102
 volumes                               | worker_resource_cert_volumes_idx                                |       95 | 80 kB      | 16 kB      | N      |           29352 |      253036 |          29766
 wall                                  |                                                                 |        0 | 0 bytes    |            | N      |                 |             |               
 worker_artifacts                      | worker_artifacts_pkey                                           |        0 | 0 bytes    | 8192 bytes | Y      |               0 |           0 |              0
 worker_base_resource_types            | worker_base_resource_types_base_resource_type_id                |       42 | 16 kB      | 16 kB      | N      |               0 |           0 |              0
 worker_base_resource_types            | worker_base_resource_types_pkey                                 |       42 | 16 kB      | 16 kB      | Y      |             113 |         113 |            113
 worker_base_resource_types            | worker_base_resource_types_worker_name                          |       42 | 16 kB      | 16 kB      | N      |             464 |        6496 |              0
 worker_base_resource_types            | worker_base_resource_types_worker_name_base_resource_type_i_key |       42 | 16 kB      | 16 kB      | Y      |             337 |          99 |             85
 worker_resource_caches                | worker_resource_caches_pkey                                     |       30 | 8192 bytes | 16 kB      | Y      |          673762 |      601379 |         596388
 worker_resource_caches                | worker_resource_caches_resource_cache_id                        |       30 | 8192 bytes | 16 kB      | N      |             382 |         442 |            431
 worker_resource_caches                | worker_resource_caches_uniq                                     |       30 | 8192 bytes | 16 kB      | Y      |             792 |         409 |            408
 worker_resource_caches                | worker_resource_caches_worker_base_resource_type_id             |       30 | 8192 bytes | 16 kB      | N      |             112 |          17 |              0
 worker_resource_certs                 | worker_resource_certs_pkey                                      |        0 | 8192 bytes | 16 kB      | Y      |              11 |          11 |             11
 worker_task_caches                    | worker_task_caches_pkey                                         |        4 | 8192 bytes | 16 kB      | Y      |             610 |         610 |            610
 worker_task_caches                    | worker_task_caches_task_cache_id                                |        4 | 8192 bytes | 16 kB      | N      |              70 |          88 |             80
 worker_task_caches                    | worker_task_caches_worker_name                                  |        4 | 8192 bytes | 16 kB      | N      |              81 |         362 |            362
 worker_task_caches                    | worker_task_caches_worker_name_task_cache_id_uniq               |        4 | 8192 bytes | 16 kB      | Y      |            1406 |         854 |            828
 workers                               | constraint_workers_name_unique                                  |        2 | 8192 bytes | 16 kB      | Y      |            1070 |        1897 |           1058
 workers                               | workers_addr_key                                                |        2 | 8192 bytes | 16 kB      | Y      |               0 |           0 |              0
 workers                               | workers_pkey                                                    |        2 | 8192 bytes | 16 kB      | Y      |         1418662 |     1419633 |        1418314
 workers                               | workers_team_id                                                 |        2 | 8192 bytes | 16 kB      | N      |               0 |           0 |              0
kurtmc

comment created time in 2 months

release springernature/halfpipe

3.69.0

released time in 2 months

issue commentconcourse/concourse

Database pinned to 100% CPU after a few hours of running

That would reduce writes from one per minute (per resource) to one per half hour or so (per resource).

Every bit helps :)

Do you know what else might have caused the spike and volatility of the load between 7.2 and 7.3.1?

Screenshot 2021-06-07 at 14 44 03

7.2 was stable around 40% CPU for us and 7.3.1 is a bit all over the place

kurtmc

comment created time in 2 months

issue commentconcourse/concourse

Database pinned to 100% CPU after a few hours of running

How'd you come across it? I guess just sorting that load by total time column? By default the query inspector sorts queries by Load by total time, thats how we found it. Orange colour means Lock Wait, green is CPU and CPU Wait.

Would you mind running this query and sharing the results? Could help us get an idea of the scale we're comparing to.

 base_resource_type_id | count
-----------------------+-------
                     6 |   316
                     7 |  1608
                     8 |     3
                    12 |  1340
                    13 |     2
                    15 |   414
                       |  1920
kurtmc

comment created time in 2 months

issue commentconcourse/concourse

Database pinned to 100% CPU after a few hours of running

A new challenger appears after upgrading to 7.3.1

UPDATE
  resource_configs
SET
  last_referenced = now()
WHERE
  base_resource_type_id = $1
  AND source_hash = $2 RETURNING id,
  last_referenced

Screenshot 2021-05-31 at 21 55 32

kurtmc

comment created time in 2 months

push eventspringernature/halfpipe-deploy-resource

Simon Johansson

commit sha c36fb0dabc4614b841932cb4551ebe50e01b009f

Revert "Remove the metrics stuff" This reverts commit 7f3ba53f9f59cd286413f6c35bb9b5f945b11153.

view details

Simon Johansson

commit sha 409476aeff8460ea9b60409d4d6e5da26fc6525a

Send some stats to prometheus

view details

push time in 2 months

issue commentconcourse/concourse

Database pinned to 100% CPU after a few hours of running

This is the only place on the entire web I have found so far that mentions this weird "query". If anyone has the slightest idea of what it is, please, share - it's affecting us too.

Whats the breakdown for you? Currently for us Screenshot 2021-05-28 at 16 55 44

kurtmc

comment created time in 2 months

release springernature/halfpipe

3.68.0

released time in 2 months