DevHeads.net

Ceph-14.x.x, dropping 32-bit archs

Ceph 14.x.x (Nautilus) will no longer be built on i686 and armv7hl archs
starting in fedora-30/rawhide.

The upstream project doesn't support it. The armv7hl builders don't have
enough memory (or address space) to build some components.

And the other active maintainer (branto) and I don't have cycles to
devote to keeping it building on 32-bit archs.

(FWIW, currently ceph-12.2.9 (luminous) is in rawhide, f29, and f28 and
it has packages for i686 and armv7hl for people who want to run ceph on
32-bit archs.)

Comments

Re: Ceph-14.x.x, dropping 32-bit archs

By Marcin Juszkiewicz at 12/05/2018 - 08:23

W dniu 05.12.2018 o 14:14, Kaleb S. KEITHLEY pisze:

BTW - how much memory is needed to build Ceph 14?

Re: Ceph-14.x.x, dropping 32-bit archs

By Dan =?ISO-8859-... at 12/05/2018 - 08:34

On Wed, 5 Dec 2018 14:23:49 +0100

have you tried building with reduced debuginfo, eg. -g1 or even -g0?

I wonder how much broken deps it will cause.

Dan

Re: Ceph-14.x.x, dropping 32-bit archs

By Kaleb S. KEITHLEY at 12/05/2018 - 08:45

On 12/5/18 8:34 AM, Dan Horák wrote:
More — apparently — than the armv7hl builders have. :-) branto may know.

branto told me that he has tried all the different optimization levels.

Don't know. Hence this heads up warning.

Re: Ceph-14.x.x, dropping 32-bit archs

By Daniel P. Berrange at 12/05/2018 - 09:31

On Wed, Dec 05, 2018 at 08:45:19AM -0500, Kaleb S. KEITHLEY wrote:
Is there any consideration given to only building the ceph client
pieces on 32-bit ? Presumably those parts are simpler and thus
not likely to hit the address/memory limits, and be more tractable
for supporting ?

I very much doubt people would run ceph server parts on 32-bit,
so any usage of ceph on 32-bit is likely to be limited to the
client pieces

repoquery can report on direct dependancies that would be broken by
any ceph packages being removed. There could be transitive ripples
out from there. From my own POV this would impact qemu & libvirt,
which would need to conditionally turn off their rbd support for
those archs.

Regards,
Daniel

Re: Ceph-14.x.x, dropping 32-bit archs

By Marcin Juszkiewicz at 12/05/2018 - 09:02

W dniu 05.12.2018 o 14:45, Kaleb S. KEITHLEY pisze:
Random Fedora armhf builder hardware info:

Memory:
total used free shared buff/cache available
Mem: 24929616 103092 24375448 348 451076 24524500
Swap: 18869244 21348 18847896

Storage:
Filesystem Size Used Avail Use% Mounted on
/dev/vda2 135G 5.7G 122G 5% /
Seriously 24 GB of ram + 18 GB of swap is not enough to build ceph? That's
more real memory than x86-64 builder have (15 387 432 ram + 134 216 700 swap).

I understand "we drop because upstream does not care about 32bit" reason.

Re: Ceph-14.x.x, dropping 32-bit archs

By Dan =?ISO-8859-... at 12/05/2018 - 09:08

On Wed, 5 Dec 2018 15:02:41 +0100

The problem is usually in the 4GB address space on 32-bit platforms
(much less is available for user data), when it builds large C++
codebase. Either the compiler OOMs or the linker OOMs. That's why
reducing the generated debuginfos often helps.

Dan