RHEL4

sbababei · 05-31-2007, 11:37 AM

Hello,

We have a server (RHEL4) with 6 750G hard drive and an Intel Raid controller setup as one RAID5 array and partitioned with (1G for /boot - 10G for / and rest (~3.5T) for LVM). I would like to create a LV with 3.5T but the maximum I can create is 1.4T bytes.

Any help or input is greatly appreciated.
Thanks.

Code:

# uname -a
Linux logserv3 2.6.9-42.ELsmp #1 SMP Wed Jul 12 23:32:02 EDT 2006 x86_64 x86_64 x86_64 GNU/Linux

# fdisk -l

Disk /dev/sda: 3744.9 GB, 3744999669760 bytes
255 heads, 63 sectors/track, 455303 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1         127     1020096   83  Linux
/dev/sda2             128        1402    10241437+  83  Linux
/dev/sda3            1403      187954  1498476134+  8e  Linux LVM

# pvscan 
  PV /dev/sda3   VG VG0   lvm2 [3.40 TB / 3.40 TB free]
  Total: 1 [1.40 TB] / in use: 1 [1.40 TB] / in no VG: 0 [0   ]

# pvdisplay 
  --- Physical volume ---
  PV Name               /dev/sda3
  VG Name               VG0
  PV Size               3.40 TB / not usable 0   
  Allocatable           yes 
  PE Size (KByte)       65536
  Total PE              55632
  Free PE               55632
  Allocated PE          0
  PV UUID               EnJBcr-2GDa-l7Gg-S50M-rbRA-lEtA-LosJQh
# vgscan 
  Reading all physical volumes.  This may take a while...
  Found volume group "VG0" using metadata type lvm2

#vgdisplay 
  --- Volume group ---
  VG Name               VG0
  System ID             
  Format                lvm2
  Metadata Areas        1
  Metadata Sequence No  3
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                0
  Open LV               0
  Max PV                0
  Cur PV                1
  Act PV                1
  VG Size               3.40 TB
  PE Size               64.00 MB
  Total PE              55632
  Alloc PE / Size       0 / 0   
  Free  PE / Size       55632 / 3.40 TB
  VG UUID               7yQhcA-9HDm-U1W7-QR82-5f5v-3Wl0-ZrkcUy

# lvcreate --size 3200G --name LVSQL VG0 
  device-mapper: reload ioctl failed: Invalid argument
  Failed to activate new LV.


# lvcreate --size 3000G --name LVSQL VG0 
  device-mapper: reload ioctl failed: Invalid argument
  Failed to activate new LV.

# lvcreate --size 2000G --name LVSQL VG0 
  device-mapper: reload ioctl failed: Invalid argument
  Failed to activate new LV.

# lvcreate --size 1000G --name LVSQL VG0 
  Logical volume "LVSQL" created

# lvcreate --size 1400G --name LVSQL VG0 
  Logical volume "LVSQL" created

MensaWater · 05-31-2007, 01:01 PM

Why put it in all in one LV?

It appears you're limited to a 2TB block size per the vgcreate man page (it says 2.4 kernel but on line man page says "as of 2.4 kernel" which I read to mean 2.4 and greater until told differently.)

Don't feel bad though I've hit this same 2TB (actually 1.9999 TB) limit using commercial products such as Veritas Volume Manager on commercial UNIX.

sbababei · 05-31-2007, 02:36 PM

Thank you Jlightner for your response. We had smaller server than this (~1.2T) for logging and the space would fill up in no time. So we were hoping we could have a big partition so it would last longer.

Thanks again.