Multiple Promise Ultra 100 TX2 controllers...

John Burton j.c.burton at gats-inc.com
Thu Nov 8 07:39:19 PST 2001 

Greetings!

Over the past month, I've been trying to build a 500GB  ATA/100 RAID 5
array and have encountered multiple problems along the way.  My system
consists of:

   * SuperMicro 370DL3 motherboard w/ Adaptec Ultra 160 SCSI and 100mbit
     nic (eepro100) onboard.
   * 2 1GHz PIII processors w/ 512MB memory.
   * 9GB Quantum Atlas Ultra 160 SCSI system disk.
   * 100GB Seagate AIT tape Autoloader.
   * Seagate DDS-3 4mm tape drive.
   * 6 x 100GB Western Digital ATA/100 disks
   * 2 x 3Ware hotswap chassis - fits 3 ATA/100 1" disks in a 2 bay area
   * RedHat 7.2

The latest problem I've been having is with multiple Promise Ultra 100
tx2 controllers - with 6 disks, I need 6 IDE channels which means 3
Ultra 100 controllers.  I had purchased one tx2 earlier this year (early
spring) and just this past week purchased 2 more.  I installed them and
connected them to the 6 disks.

When I booted the machine, I got the Promise Ultra BIOS screen detecting
the drives, and then it displays a list of 8 possible drives (D0 - D7).
D0, D2, D4, & D6 have disks listed next to them and D1, D3, D5, & D7 do
not have any disks listed (this is expected since I'm only using 1
master drive per channel). What is not expected is that there are only 8
possible drives listed. With 3 controllers, there should be 12 possible
drives with 6 drives detected.

When Linux started booting, I noticed that all 3 controllers and 6 disks
were detected. So far so good.  When the kernel started checking for
partitions on the disks, it ran into trouble (last two disks giving DMA
errors). Below is the appropriate log entries showing what happened.
According to the logs it looks like there is a problem with either the
3rd controller or the last 2 disks.  I rearranged the order of the
controllers (i.e. swapped which cards were installed in which slots) and
left the order of the disks the same (first two disks attached to the
controller in the first PCI slot, etc).  And got the same results (last
two disks showing DMA errors). I then changed the order of the disks
relative to the PCI slots and still got the same results (last two disks
giving DMA errors). I then removed one controller at a time (leaving 2
installed at any one time) and connected various combinations of 4 disks
from the available 6. Everything worked fine, with no errors.  At this
point I'm kinda stuck with the conclusion that only 2 Promise Ultra100
TX2 cards will work in that system at one time.

Does anyone have any suggestions? thoughts? help?

Hopefully waiting,

John


SYSLOG Entries:

Nov  7 13:49:48 oracle kernel: PDC20268: IDE controller on PCI bus 00
dev 20
Nov  7 13:49:48 oracle kernel: PDC20268: chipset revision 1
Nov  7 13:49:48 oracle kernel: PDC20268: not 100%% native mode: will
probe irqs later
Nov  7 13:49:48 oracle kernel: PDC20268: ROM enabled at 0xfeaf8000
Nov  7 13:49:48 oracle kernel: PDC20268: (U)DMA Burst Bit DISABLED
Primary PCI Mode Secondary MASTER Mode.
Nov  7 13:49:48 oracle kernel:     ide2: BM-DMA at 0xdf90-0xdf97, BIOS
settings: hde:pio, hdf:pio
Nov  7 13:49:48 oracle kernel:     ide3: BM-DMA at 0xdf98-0xdf9f, BIOS
settings: hdg:pio, hdh:pio
Nov  7 13:49:48 oracle kernel: PDC20268: IDE controller on PCI bus 00
dev 18
Nov  7 13:49:48 oracle kernel: PDC20268: chipset revision 1
Nov  7 13:49:48 oracle kernel: PDC20268: not 100%% native mode: will
probe irqs later
Nov  7 13:49:48 oracle kernel: PDC20268: ROM enabled at 0xfeaec000
Nov  7 13:49:48 oracle kernel: PDC20268: (U)DMA Burst Bit ENABLED
Primary MASTER Mode Secondary MASTER Mode.
Nov  7 13:49:48 oracle kernel:     ide4: BM-DMA at 0xdf60-0xdf67, BIOS
settings: hdi:pio, hdj:pio
Nov  7 13:49:48 oracle kernel:     ide5: BM-DMA at 0xdf68-0xdf6f, BIOS
settings: hdk:pio, hdl:pio
Nov  7 13:49:49 oracle kernel: PDC20268: IDE controller on PCI bus 00
dev 10
Nov  7 13:49:49 oracle kernel: PDC20268: chipset revision 1
Nov  7 13:49:49 oracle kernel: PDC20268: not 100%% native mode: will
probe irqs later
Nov  7 13:49:49 oracle kernel: PDC20268: ROM enabled at 0xfeae4000
Nov  7 13:49:49 oracle kernel: PDC20268: (U)DMA Burst Bit ENABLED
Primary MASTER Mode Secondary MASTER Mode.
Nov  7 13:49:49 oracle kernel:     ide6: BM-DMA at 0xdf30-0xdf37, BIOS
settings: hdm:pio, hdn:pio
Nov  7 13:49:49 oracle kernel:     ide7: BM-DMA at 0xdf38-0xdf3f, BIOS
settings: hdo:pio, hdp:pio
Nov  7 13:49:49 oracle kernel: ServerWorks OSB4: IDE controller on PCI
bus 00 dev 79
Nov  7 13:49:49 oracle kernel: ServerWorks OSB4: chipset revision 0
Nov  7 13:49:49 oracle kernel: ServerWorks OSB4: not 100%% native mode:
will probe irqs later
Nov  7 13:49:49 oracle kernel:     ide0: BM-DMA at 0xffa0-0xffa7, BIOS
settings: hda:pio, hdb:pio
Nov  7 13:49:49 oracle kernel:     ide1: BM-DMA at 0xffa8-0xffaf, BIOS
settings: hdc:DMA, hdd:pio
Nov  7 13:49:49 oracle kernel: hdc: CD-ROM CDU311, ATAPI CD/DVD-ROM
drive
Nov  7 13:49:49 oracle kernel: hde: WDC WD1000BB-00CCB0, ATA DISK drive
Nov  7 13:49:49 oracle kernel: hdg: WDC WD1000BB-00CCB0, ATA DISK drive
Nov  7 13:49:49 oracle kernel: hdi: WDC WD1000BB-00CCB0, ATA DISK drive
Nov  7 13:49:49 oracle kernel: hdk: WDC WD1000BB-00CCB0, ATA DISK drive
Nov  7 13:49:49 oracle kernel: hdm: WDC WD1000BB-00CCB0, ATA DISK drive
Nov  7 13:49:49 oracle kernel: hdo: WDC WD1000BB-00CCB0, ATA DISK drive
Nov  7 13:49:49 oracle kernel: ide1 at 0x170-0x177,0x376 on irq 15
Nov  7 13:49:49 oracle kernel: ide2 at 0xdff0-0xdff7,0xdfe6 on irq 22
Nov  7 13:49:49 oracle kernel: ide3 at 0xdfa8-0xdfaf,0xdfe2 on irq 22
Nov  7 13:49:49 oracle kernel: ide4 at 0xdfa0-0xdfa7,0xdf8e on irq 20
Nov  7 13:49:49 oracle kernel: ide5 at 0xdf80-0xdf87,0xdf8a on irq 20
Nov  7 13:49:49 oracle kernel: ide6 at 0xdf58-0xdf5f,0xdf7e on irq 18
Nov  7 13:49:49 oracle kernel: ide7 at 0xdf50-0xdf57,0xdf4e on irq 18
Nov  7 13:49:49 oracle kernel: blk: queue c0435808, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:49 oracle kernel: blk: queue c0435808, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:49 oracle kernel: hde: 195371568 sectors (100030 MB)
w/2048KiB Cache, CHS=193821/16/63, (U)DMA
Nov  7 13:49:49 oracle kernel: blk: queue c0435b4c, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:49 oracle kernel: blk: queue c0435b4c, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:49 oracle kernel: hdg: 195371568 sectors (100030 MB)
w/2048KiB Cache, CHS=193821/16/63, (U)DMA
Nov  7 13:49:49 oracle kernel: blk: queue c0435e90, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:49 oracle kernel: blk: queue c0435e90, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:49 oracle kernel: hdi: 195371568 sectors (100030 MB)
w/2048KiB Cache, CHS=193821/16/63, UDMA(100)
Nov  7 13:49:49 oracle kernel: blk: queue c04361d4, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:49 oracle kernel: blk: queue c04361d4, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:49 oracle kernel: hdk: 195371568 sectors (100030 MB)
w/2048KiB Cache, CHS=193821/16/63, UDMA(100)
Nov  7 13:49:50 oracle kernel: blk: queue c0436518, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:50 oracle kernel: blk: queue c0436518, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:50 oracle kernel: hdm: 195371568 sectors (100030 MB)
w/2048KiB Cache, CHS=193821/16/63, UDMA(100)
Nov  7 13:49:50 oracle kernel: blk: queue c043685c, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:50 oracle kernel: blk: queue c043685c, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:50 oracle kernel: hdo: 195371568 sectors (100030 MB)
w/2048KiB Cache, CHS=193821/16/63, UDMA(100)
Nov  7 13:49:50 oracle kernel: ide-floppy driver 0.97.sv
Nov  7 13:49:50 oracle kernel: Partition check:
Nov  7 13:49:50 oracle kernel:  hde: [PTBL] [12161/255/63] hde1
Nov  7 13:49:50 oracle kernel:  hdg: [PTBL] [12161/255/63] hdg1
Nov  7 13:49:50 oracle kernel:  hdi: [PTBL] [12161/255/63] hdi1
Nov  7 13:49:50 oracle kernel:  hdk: [PTBL] [12161/255/63] hdk1
Nov  7 13:49:50 oracle kernel:  hdm:hdm: dma_intr: status=0x51 {
DriveReady SeekComplete Error }
Nov  7 13:49:50 oracle kernel: hdm: dma_intr: error=0x84 {
DriveStatusError BadCRC }
Nov  7 13:49:50 oracle kernel: hdm: dma_intr: status=0x51 { DriveReady
SeekComplete Error }
Nov  7 13:49:50 oracle kernel: hdm: dma_intr: error=0x84 {
DriveStatusError BadCRC }
Nov  7 13:49:50 oracle kernel: hdm: timeout waiting for DMA
Nov  7 13:49:50 oracle kernel: ide_dmaproc: chipset supported
ide_dma_timeout func only: 14
Nov  7 13:49:50 oracle kernel: blk: queue c0436518, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:50 oracle kernel: blk: queue c0436518, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:50 oracle kernel:  [PTBL] [12161/255/63] hdm1
Nov  7 13:49:50 oracle kernel:  hdo:hdo: timeout waiting for DMA
Nov  7 13:49:50 oracle kernel: ide_dmaproc: chipset supported
ide_dma_timeout func only: 14
Nov  7 13:49:50 oracle kernel: blk: queue c043685c, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:50 oracle kernel: blk: queue c043685c, I/O limit 4095Mb
(mask 0xffffffff)
Nov  7 13:49:50 oracle kernel:  [PTBL] [12161/255/63] hdo1

More information about the Beowulf mailing list