Offering my servers to build FreeCAD, realthunder's fork and PRs

Have some feature requests, feedback, cool stuff to share, or want to know where FreeCAD is going? This is the place.
Forum rules
Be nice to others! Read the FreeCAD code of conduct!
Cyclonit
Posts: 57
Joined: Sat Sep 26, 2020 11:19 am
Location: Germany

Re: Offering my servers to build FreeCAD, realthunder's fork and PRs

Post by Cyclonit »

It depends on how the builds are done. The servers currently run fedora minimal. Realthunder uses docker for his builds, so no issues there. I do not have licenses for Windows server or OSX though.

I am not familiar with the current setup, but I would go for a Jenkins or GitLab setup to support different repositories, branches etc.
User avatar
mnesarco
Posts: 475
Joined: Thu Mar 26, 2020 8:52 pm

Re: Offering my servers to build FreeCAD, realthunder's fork and PRs

Post by mnesarco »

Hi @Cyclonit your offer sounds very generous, one question: How stable is it? what happens if you decided to unplug the servers in few months? Changing infrastruture is very costly and time consuming, I think that if FreeCAD decided to move some infrastructure somewhere, the espectations are to maintan it for many years to come.

It will be very valuable to run transient tasks, builds, tests, store backups, mirrors, etc... but not to host critical assets.

It is just my oppinion.
Cyclonit
Posts: 57
Joined: Sat Sep 26, 2020 11:19 am
Location: Germany

Re: Offering my servers to build FreeCAD, realthunder's fork and PRs

Post by Cyclonit »

mnesarco wrote: Sat Oct 03, 2020 6:41 pmHi @Cyclonit your offer sounds very generous, one question: How stable is it? what happens if you decided to unplug the servers in few months?
I do understand your concerns. To put it simply, as long as they are being put to good use, I have zero intention to shut them down. I have continuously rented servers for the past 7 years and either used them myself or hosted game servers for friends and family. Supporting FreeCAD would be a step up for sure, but I am fully comitted to my offer.

mnesarco wrote: Sat Oct 03, 2020 6:41 pmChanging infrastruture is very costly and time consuming, I think that if FreeCAD decided to move some infrastructure somewhere, the espectations are to maintan it for many years to come.
Regardless of my previous statement regarding my comitment, I suggest that any CI/CD pipeline should be built in such a way that it can easily be moved to other servers. Both for recovery and to allow reproducing results on other systems.
Cyclonit
Posts: 57
Joined: Sat Sep 26, 2020 11:19 am
Location: Germany

Re: Offering my servers to build FreeCAD, realthunder's fork and PRs

Post by Cyclonit »

kkremitzki wrote:ping
loo wrote:ping
Sorry for the ping, could you comment on this? Afaik you are the persons responsible for building FreeCAD and I'd like to know if you're interested in my offer or if it is not needed.

Kind regards
Cyclonit
User avatar
sgrogan
Veteran
Posts: 6499
Joined: Wed Oct 22, 2014 5:02 pm

Re: Offering my servers to build FreeCAD, realthunder's fork and PRs

Post by sgrogan »

kkremitzki wrote: pinged by pinger macro
looo wrote: pinged by pinger macro
What do you think?

I can think of some things we could do, linux only;
Build source documentation, need script
Build offline documentation and Merge with master (.qhh), need script
commit translations (.ts) to master

We wouldn't need to host anything, everything could be deployed elsewhere.
"fight the good fight"
User avatar
looo
Veteran
Posts: 3941
Joined: Mon Nov 11, 2013 5:29 pm

Re: Offering my servers to build FreeCAD, realthunder's fork and PRs

Post by looo »

sgrogan wrote: Fri Oct 09, 2020 12:40 am What do you think?
Cyclonit wrote: Wed Oct 07, 2020 7:37 am Sorry for the ping, could you comment on this?
We are using azure for the conda-builds. To add builds of any branch we only have to create a fork of the feedstock (I tested this already). So actually azure doesn't have a lot of limitations.
Other things we talked about in the past:

- daily appimage:
build freecad + creating the appimage in one step (But in my eyes the weekly builds are a good compromise. If one wants faster updates, simple use the ppa or build freecad for yourself. If you want more stable freecad use the stable version (currently a problem as 0.19 is not yet released)

- storing old builds/appimages:
currently we have ~10gb of storage on anaconda.org. So we have to delete older builds. (For me this is not really an issue, as there is not much need for builds older than 3 months)
User avatar
Kunda1
Veteran
Posts: 13434
Joined: Thu Jan 05, 2017 9:03 pm

Re: Offering my servers to build FreeCAD, realthunder's fork and PRs

Post by Kunda1 »

looo wrote: Fri Oct 09, 2020 8:59 am Other things we talked about in the past:

- daily appimage:
build freecad + creating the appimage in one step (But in my eyes the weekly builds are a good compromise. If one wants faster updates, simple use the ppa or build freecad for yourself. If you want more stable freecad use the stable version (currently a problem as 0.19 is not yet released)

- storing old builds/appimages:
currently we have ~10gb of storage on anaconda.org. So we have to delete older builds. (For me this is not really an issue, as there is not much need for builds older than 3 months)
Daily AppImages would be very very helpful for the 'compiling shy' power users which most likely would be the silent majority. If we could automate thi, it would be pretty awesome.
Alone you go faster. Together we go farther
Please mark thread [Solved]
Want to contribute back to FC? Checkout:
'good first issues' | Open TODOs and FIXMEs | How to Help FreeCAD | How to report Bugs
jmaustpc
Veteran
Posts: 11207
Joined: Tue Jul 26, 2011 6:28 am
Location: Australia

Re: Offering my servers to build FreeCAD, realthunder's fork and PRs

Post by jmaustpc »

Kunda1 wrote: Fri Oct 09, 2020 2:12 pm
looo wrote: Fri Oct 09, 2020 8:59 am Other things we talked about in the past:

- daily appimage:
build freecad + creating the appimage in one step (But in my eyes the weekly builds are a good compromise. If one wants faster updates, simple use the ppa or build freecad for yourself. If you want more stable freecad use the stable version (currently a problem as 0.19 is not yet released)

- storing old builds/appimages:
currently we have ~10gb of storage on anaconda.org. So we have to delete older builds. (For me this is not really an issue, as there is not much need for builds older than 3 months)
Daily AppImages would be very very helpful for the 'compiling shy' power users which most likely would be the silent majority. If we could automate thi, it would be pretty awesome.
Cyclonit wrote: Fri Oct 02, 2020 11:38 am I've been in contact with realthunder regarding building his fork more regularly.
I am not diminishing the generosity of this offer. It is likely very useful, is certainly generous and very much appreciated by me and no doubt many others. :)

However just to be clear as I have no doubt the OP would agree, this should only be used for transient data or possibly as a secondary/alternative/temporary back up of data that is also backed up elsewhere. Important, core, irreplaceable, project, confidential, data etc. should be run/stored on services in professional data centres and the like, where we can have confidence that hardware/software maintenance and reliability in general are appropriate. Where we are not vulnerable to the effects of one point of failure.


As we saw with Roland, even the best most well meaning can still be killed in a car accident. :cry:
User avatar
kkremitzki
Veteran
Posts: 2518
Joined: Thu Mar 03, 2016 9:52 pm
Location: Illinois

Re: Offering my servers to build FreeCAD, realthunder's fork and PRs

Post by kkremitzki »

Cyclonit wrote: Wed Oct 07, 2020 7:37 am
Sorry for the ping, could you comment on this? Afaik you are the persons responsible for building FreeCAD and I'd like to know if you're interested in my offer or if it is not needed.

Kind regards
Cyclonit
Hello, and firstly, thank you for the kind offer. Sorry for the delay in a response; there has been so much activity and people wanting to help after the F360 announcement, it's been great, but at the same time I feel bad in a sense because although I want to fully take advantage of all these offers, I'm not always able to.

Anyway, to get to the response, yes, that would be very useful indeed! From your restrictions, it seems like the servers would be fine to be used as non-public build machines and an archival site, and any build artifacts it produces would just need to be transferred elsewhere; this would be no problem.

I'll PM you a public key after I post this. I guess the only question I have, is there anything available in terms of out-of-band access? For example, previously someone offered us something like this, but it was inaccessible in a data center (the contributor had moved away from that continent) and at one point I broke it and never had it come back up after reboot.
Like my FreeCAD work? I'd appreciate any level of support via Patreon, Liberapay, or PayPal! Read more about what I do at my blog.
Cyclonit
Posts: 57
Joined: Sat Sep 26, 2020 11:19 am
Location: Germany

Re: Offering my servers to build FreeCAD, realthunder's fork and PRs

Post by Cyclonit »

jmaustpc wrote: Sat Oct 10, 2020 7:14 am However just to be clear as I have no doubt the OP would agree, this should only be used for transient data or possibly as a secondary/alternative/temporary back up of data that is also backed up elsewhere. Important, core, irreplaceable, project, confidential, data etc. should be run/stored on services in professional data centres and the like, where we can have confidence that hardware/software maintenance and reliability in general are appropriate. Where we are not vulnerable to the effects of one point of failure.
Hi, thank you for the kind words and yes, you are correct. I consider these servers to be best suited for transient tasks or secondary backup for critical data. The servers are located in a professional datacenters, but they are not storage optimized.

kkremitzki wrote: Sat Oct 10, 2020 8:57 am Hello, and firstly, thank you for the kind offer. Sorry for the delay in a response; there has been so much activity and people wanting to help after the F360 announcement, it's been great, but at the same time I feel bad in a sense because although I want to fully take advantage of all these offers, I'm not always able to.
No worries :D you're doing a great job and good work. This matter is not time critical.

kkremitzki wrote: Sat Oct 10, 2020 8:57 amAnyway, to get to the response, yes, that would be very useful indeed! From your restrictions, it seems like the servers would be fine to be used as non-public build machines and an archival site, and any build artifacts it produces would just need to be transferred elsewhere; this would be no problem.
Correct.
kkremitzki wrote: Sat Oct 10, 2020 8:57 amI'll PM you a public key after I post this. I guess the only question I have, is there anything available in terms of out-of-band access? For example, previously someone offered us something like this, but it was inaccessible in a data center (the contributor had moved away from that continent) and at one point I broke it and never had it come back up after reboot.
There is out of band acces but I'll have to check if I can give you access to it. The servers are rented and I do not have physical access myself, but there is a management website for creating/reverting to snapshots and the likes. I am fine with exchanging contact data with you and/or other veterans of the project so you can reach me directly.

I'll set up your account tomorrow so you can check out the servers. What kind of a setup do you have in mind from a technical perspective?
Post Reply