Aditya Maru
2331ad873b
src: add sync before umount
11 months ago
Aditya Maru
f440133b20
wip
12 months ago
Aditya Maru
34ea2f79e5
src: change warning to debug
12 months ago
Aayush Shah
4ed3ba5c73
src: ignore unset sentinel value for tailscale token ( #89 )
12 months ago
Aditya Maru
aa6b213b0b
src: join and leave tailnet on start and cleanup of builder
12 months ago
Aditya Maru
9fdeb57c53
src: disable automatic buildkit GC
...
We have reason to believe that automatic GC is affecting
daemon startup times. In this patch we disable automatic GC
and instead rely on manual pruning of the buildkit cache.
Once the daemon is ready we spawn an async task to run prune
on any objects older than 14 days. We are already manaing the
ceph volume approaching its size limit ourselves in the VM
Agent.
Patch also adds some alerting when inode usage is high on a mountpoint.
1 year ago
Aditya Maru
def1585067
*: report metrics to the VM agent
1 year ago
Aditya Maru
4723a2a346
src: stop spurious warnings on buildkit shutdown
1 year ago
Aditya Maru
1672d6fbad
src: fix shutdown retry behavior
1 year ago
Aditya Maru
9302d2aea9
src: stop running process as nohup to avoid missing logs
1 year ago
Aditya Maru
ac42783fa9
src: cleanup flakiness in different parts of the action
1 year ago
Aditya Maru
54bc4e0788
src: refactor cleanup logic to expose buildkitd.log
...
Previosuly, we only killed the buildkitd process and unmounted
if builderInfo was non null. This was wrong cause we could have setup
builkdkitd, but failed after that step. This would then rely on the last
ditch effort by the post action to cleanup. We now change the proc kill
and unmount to happen on any build error.
1 year ago
Aditya Maru
53000f0f59
ignore error when nothing is mounted
1 year ago
Aditya Maru
1df1b3c361
src: ignore error when theres nothing mounted
1 year ago
Aditya Maru
de0451e517
src: make post unmount even if buildkitd is no longer present
...
Also increase retries when trying to unmount the buildkit directory.
Retry up to 3 seconds now, previously we were only retrying 3 times
with a 100ms backoff.
1 year ago
Aditya Maru
f06a558c36
src: alert if an exception is thrown on cleanup
1 year ago
Aayush
f9d1e150a9
*: unify error handling and add more unit tests
1 year ago
Aditya Maru
c71ad2dbef
*: refactor methods to support mocking
...
Additionally, write some tests to ensure the driver method
`startBlacksmithBuilder` handles all exceptions correctly in
both nofallback=true and nofallback=false configurations.
1 year ago
Aditya Maru
5ab78173d3
backend: default to /dev/vdb when ExposeVolume response is empty
1 year ago
Aditya Maru
edc01b36df
backend: use device returned in ExposeVolume response
1 year ago
Aditya Maru
72c7e93db9
src: send stickydisk key with commit
1 year ago
Aditya Maru
6d7db93fa2
src: bump socket creation timeout to 5s from 3s
1 year ago
Aditya Maru
c308f14958
src: report the correct sticky disk key
1 year ago
Aditya Maru
17d922af1a
src: shuttle a expose ID between expose and commit
1 year ago
Aditya Maru
a55bae5255
src: prevent top-level ref variable from being shadowed
1 year ago
Aditya Maru
9841eabab1
src: only resolve buildref on success
1 year ago
Aditya Maru
4938a7e10a
src: change arch to use BLACKSMITH_ENV
1 year ago
Aditya Maru
9336122050
src: add some idempotent cleanup safeguard in post action
1 year ago
Aditya Maru
bdf7f0bb37
src: wrap all steps after blacksmith builder in try catch
...
This ensures we always run cleanup if any step after creating the Blacksmith
builder errors out.
1 year ago
Aditya Maru
9b63433194
src: make blacksmith builder name unique
1 year ago
Aditya Maru
bda6587832
src: change sticky disk key to repo name
1 year ago
Aditya Maru
c33190b3c9
src: add local mirror to buildkit toml
1 year ago
Aditya Maru
1dee25cffd
src: fix the movement of cleanup to the main step
1 year ago
Aditya Maru
f16c36e819
src: add resize2fs call if the block device is formatted
1 year ago
Aditya Maru
e1da38ff9d
src: add petname and vmID to notification
1 year ago
Aditya Maru
ac4af6279b
src: move shutdown, cleanup, commit from post to after build
1 year ago
Aditya Maru
138e3a2a14
dist: cat buildkit log file if build fails
1 year ago
Aayush Shah
bdd6696880
Only use buildRef if it exists ( #42 )
1 year ago
Aayush Shah
03e2c54ea5
report cache hit ratio and build size back to backend ( #40 )
1 year ago
Aditya Maru
3cdd1d81fc
*: blkid returns non-zero code if no fs found
1 year ago
Aditya Maru
88ab597dfe
*: move formatting of the block device to the client
...
Previously, we were incorrectly formatting the block device
on the ceph server. This could cause corruption. As a mitigation
we now conditionally format the block device on the client. This
should only kick in if a previous parent clone has not already been
formatted.
1 year ago
Aditya Maru
b83388c4ca
*: inline headers
1 year ago
Aayush Shah
a6005ce994
record and report docker build duration seconds ( #33 )
1 year ago
Aayush Shah
7d2e9e7288
log the full request URL ( #32 )
1 year ago
Aayush Shah
4e686a61f2
log the status code in the build reporting warning ( #30 )
1 year ago
Aayush Shah
fc356a7e65
inline some logic ( #29 )
1 year ago
Aayush Shah
5dc5ef6baa
stop messing up API client headers in requests to backend ( #28 )
1 year ago
Aayush Shah
562ddafb4b
rename a method and add some debug logging ( #27 )
1 year ago
Aayush Shah
c50dbd0552
dont fail the build if we fail to contact backend ( #26 )
1 year ago
Aayush Shah
51601ec916
report builds to the backend ( #25 )
1 year ago