Just like that, BazelCon 2024 came and went. So... it’s obviously time to summarize the two events of last week: BazelCon 2024 and the adjacent Build Meetup. There is A LOT to cover, but everything is here in just one article!
It’s basically what BuildBarn offers, except scalable, independently maintained, and written in Rust. It’s Apache-licensed, though a member of the Linux Foundation.
> It’s basically what BuildBarn offers, except scalable
What makes you assume Buildbarn is not scalable? On the Buildbarn Slack channel there are multiple users who have been able to successfully scale their setup up >100k cores.
> independently maintained
Likewise, I’d like to know what makes NativeLink more “independently maintained” than Buildbarn. I think I’ve done a lot of work to listen to whatever the community wants and engage. For various components I’ve delegated ownership to others. I’m even inviting any individual/business to put their name in the README in case they want to offer consulting/commercial support. Earlier this year I got asked what my opinions were on handing over the project to the Linux Foundation, and I indicated I’d be fine with that.
Note that I’m a big fan of having choice. Kudos to the NativeLink team for what they’ve achieved. But I’m saddened that you’ve chosen to promote their product to the detriment of Buildbarn.
You’re right. I have not spun up Buildbarn in a while. I should revisit it should a need arise. I turned to NativeLink because the other company-maintained projects were too expensive and/or offered licenses that were incompatible with procurement guidelines for me.
I’m sure Buildbarn is great now. We do not need 100k cores. We need tens of thousands of cores running on a variety of workers, and many of those workers do not run Java. In my opinion, more choices is good for the ecosystem not bad as you alluded to.
wow what a bloated post regarding a bloated, slow and fundamentally broken useless piece of crap. thanks for making everyone's life slower and more difficult
No mention of the sole Gold Sponsor in this post so I will mention it here, which some of us had never heard of prior to the event.
NativeLink: https://nativelink.com
It’s basically what BuildBarn offers, except scalable, independently maintained, and written in Rust. It’s Apache-licensed, though a member of the Linux Foundation.
> It’s basically what BuildBarn offers, except scalable
What makes you assume Buildbarn is not scalable? On the Buildbarn Slack channel there are multiple users who have been able to successfully scale their setup up >100k cores.
> independently maintained
Likewise, I’d like to know what makes NativeLink more “independently maintained” than Buildbarn. I think I’ve done a lot of work to listen to whatever the community wants and engage. For various components I’ve delegated ownership to others. I’m even inviting any individual/business to put their name in the README in case they want to offer consulting/commercial support. Earlier this year I got asked what my opinions were on handing over the project to the Linux Foundation, and I indicated I’d be fine with that.
Note that I’m a big fan of having choice. Kudos to the NativeLink team for what they’ve achieved. But I’m saddened that you’ve chosen to promote their product to the detriment of Buildbarn.
You’re right. I have not spun up Buildbarn in a while. I should revisit it should a need arise. I turned to NativeLink because the other company-maintained projects were too expensive and/or offered licenses that were incompatible with procurement guidelines for me.
I’m sure Buildbarn is great now. We do not need 100k cores. We need tens of thousands of cores running on a variety of workers, and many of those workers do not run Java. In my opinion, more choices is good for the ecosystem not bad as you alluded to.
> Prebuilding git-archives periodically and using those to build the initial state of a Git clone can significantly improve performance.
There is a better solution for this called git-bundles. Which can be created incrementally as well.
https://github.com/git-ecosystem/git-bundle-server is a POC from github for distributing these bundles.
wow what a bloated post regarding a bloated, slow and fundamentally broken useless piece of crap. thanks for making everyone's life slower and more difficult
git-archive doesn't help speed up fetches. You need something that uses the packfile URI feature (https://git-scm.com/docs/packfile-uri).
Good point.
FYI This has since evolved into Bundle URI https://git-scm.com/docs/bundle-uri with an example server implementation I linked in the comment above.