iSCSI target returns "Device type is not supported by server", discovery fails.

Bug #1034015 reported by RoyK
10
This bug affects 1 person
Affects Status Importance Assigned to Milestone
linux (Ubuntu)
Expired
Medium
Unassigned
open-iscsi (Ubuntu)
Expired
Undecided
Unassigned

Bug Description

Connecting from an Ubuntu 12.04LTS server to a
SANRAD (http://www.sanrad.com) switch offering iSCSI connectivity, fails.
First, look for targets

root@media2:~# iscsiadm -m discovery -t st -p 172.31.1.15
172.31.1.15:3260,65535 bigmedia1
172.31.1.14:3260,65535 bigmedia1
172.31.1.16:3260,65535 bigmedia1
172.31.1.15:3260,65535 media1target
172.31.1.14:3260,65535 media1target
172.31.1.16:3260,65535 media1target
172.31.1.15:3260,65535 bigmedia2
172.31.1.14:3260,65535 bigmedia2
172.31.1.16:3260,65535 bigmedia2

Lots of nice targets - now connect to one

root@media2:~# iscsiadm -m node -T bigmedia1 -p 172.31.1.15 -l
Logging in to [iface: default, target: bigmedia1, portal: 172.31.1.15,3260]
Login to [iface: default, target: bigmedia1, portal: 172.31.1.15,3260]: successful
root@media2:~# echo $?
0

Apparently connected - it says successful, and returns zero. Now, check partitions

root@media2:~# cat /proc/partitions
major minor #blocks name

  11 0 1048575 sr0
   8 0 731445248 sda
   8 1 1048576 sda1
   8 2 730395648 sda2
 252 0 20971520 dm-0
 252 1 8388608 dm-1

Nothing new - sda is my root drive, the new one should be in there as sdb. Checking dmesg, it has two new lines

[ 358.391438] scsi6 : iSCSI Initiator over TCP/IP
[ 358.645490] scsi scan: INQUIRY result too short (5), using 36

Please see http://karlsbakk.net/tmp/iscsi-debug.txt for a login attempt with -d 200 and http://karlsbakk.net/tmp/iscsi-fail.pcap for a traffic dump between the two machines during login attempt.

Please note that with open-iscsi on a CentOS 5.8 machine of the same make, this works perfectly.

roy

Revision history for this message
RoyK (roysk) wrote :
Revision history for this message
Howard Chan (smartboyhw) wrote :

Status: New -> Confirmed
Importance: Undecided -> Low.

This bug affects, but then it isn't that important to affect. So low.

Changed in ubuntu:
status: New → Confirmed
Revision history for this message
Ubuntu Foundations Team Bug Bot (crichton) wrote :

Thank you for taking the time to report this bug and helping to make Ubuntu better. It seems that your bug report is not filed about a specific source package though, rather it is just filed against Ubuntu in general. It is important that bug reports be filed about source packages so that people interested in the package can find the bugs about it. You can find some hints about determining what package your bug might be about at https://wiki.ubuntu.com/Bugs/FindRightPackage. You might also ask for help in the #ubuntu-bugs irc channel on Freenode.

To change the source package that this bug is filed about visit https://bugs.launchpad.net/ubuntu/+bug/1034015/+editstatus and add the package name in the text box next to the word Package.

[This is an automated message. I apologize if it reached you inappropriately; please just reply to this message indicating so.]

tags: added: bot-comment
Revision history for this message
RoyK (roysk) wrote : Re: Fails to connect to iSCSI target

on amd64

affects: ubuntu → linux (Ubuntu)
Revision history for this message
RoyK (roysk) wrote :

Low affection for whom?

Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

Would it be possible for you to test the latest upstream kernel? Refer to https://wiki.ubuntu.com/KernelMainlineBuilds . Please test the latest v3.5kernel[0] (Not a kernel in the daily directory) and install both the linux-image and linux-image-extra .deb packages.

Once you've tested the upstream kernel, please remove the 'needs-upstream-testing' tag. Please only remove that one tag and leave the other tags. This can be done by clicking on the yellow pencil icon next to the tag located at the bottom of the bug description and deleting the 'needs-upstream-testing' text.

If this bug is fixed in the mainline kernel, please add the following tag 'kernel-fixed-upstream'.

If the mainline kernel does not fix this bug, please add the tag: 'kernel-bug-exists-upstream'.

If you are unable to test the mainline kernel, for example it will not boot, please add the tag: 'kernel-unable-to-test-upstream'.
Once testing of the upstream kernel is complete, please mark this bug as "Confirmed".

Thanks in advance.

[0] http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.6-rc1-quantal/

Changed in linux (Ubuntu):
importance: Undecided → Medium
tags: added: kernel-da-key precise
tags: added: needs-upstream-testing
Changed in linux (Ubuntu):
status: Confirmed → Incomplete
Revision history for this message
RoyK (roysk) wrote :

Just tested 3.5.0-030500-generic - same behaviour

Revision history for this message
RoyK (roysk) wrote :

Could this be an open-iscsi bug and not a kernel issue?

tags: added: kernel-bug-exists-upstream
removed: needs-upstream-testing
Changed in linux (Ubuntu):
status: Incomplete → Confirmed
Revision history for this message
RoyK (roysk) wrote :

It may be of help that this problem is persistent also on Scientific Linux 6.3 with kernel 2.6.32-279.el6.x86_64 and iscsiadm 2.0-872.41.el6

Changed in linux (Ubuntu):
status: Confirmed → Triaged
Revision history for this message
Peter Petrakis (peter-petrakis) wrote :

@roysk

The thing about inquiry data is that it's incumbent on the target to provide
what the initiator has asked of it. What is open-iscsi connecting to, another SAN,
if so which make and model? If it's not a HW SAN could you setup an software
iSCSI target server and connect with the existing open-iscsi tool set to see
if the short inquiry phenomenon follows the SAN or the the client?

In my experience, these sort of faults usually are the result of a SCSI target
that's not quite ready. Sure it may be fully provisioned, but if the SAN is busy
serving other requests, *it's operating system* can starve out the target and
cause unpredictable results. It's an equal opportunity offender, affecting
software iSCSI targets and inefficient HW SAN firmware (also software :).

Getting 36 bytes of inquiry data is trivial, something is really wrong if we can't
get even that from the target.

https://en.wikipedia.org/wiki/SCSI_Inquiry_Command

If you are using a software target to begin with, consider adding cgroups to
ensure it has a minimum of CPU time to perform it's tasks in a timely manner;
or simply decreasing the net workload on the system and see if that improves
reliability.

Changed in open-iscsi (Ubuntu):
status: New → Incomplete
Revision history for this message
Peter Petrakis (peter-petrakis) wrote :

So here's your problem, which I identified by running wireshark on the pcap
(very helpful, thanks for providing), typing 'iscsi' to filter on that only
and identified the inquiry exchange.

The inquiry cmd open-iscsi send looks fine. The response from the target
however...

0060 00 00 00 00 00 00 7f 00 05 00 00 00 00 00 00 00 ........ ........
0070 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ........ ........
0080 00 00 00 00 00 00 00 00 00 00 ........ ..

Definitely no make and model information there...

Wireshark was so kind as to translate it for me.

Peripheral: 0x7f, Qualifier: Device type is not supported by server, Device Type: Unknown or no device type
011. .... = Qualifier: Device type is not supported by server (0x03)
...1 1111 = Device Type: Unknown or no device type (0x1f)

So sure it's advertising a lun, but when we reach out in touch it we get garbage.

This is decidedly SAN side. That Centos "works" at all is simply a race condition *or*
it has a quirk allowance for your SAN, which you have yet to articulate.

Contact your SAN vendor to determine why it's responding this way.

summary: - Fails to connect to iSCSI target
+ iSCSI target returns "Device type is not supported by server", discovery
+ fails.
Revision history for this message
Peter Petrakis (peter-petrakis) wrote :

My bad, it's a SANRAD (never heard of it, I though you were using some slang)

http://www.sanrad.com/

Let us know what they think of that pcap you provided, that was very helpful.

description: updated
Revision history for this message
penalvch (penalvch) wrote :
tags: added: regression-potential
Changed in linux (Ubuntu):
status: Triaged → Incomplete
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for linux (Ubuntu) because there has been no activity for 60 days.]

Changed in linux (Ubuntu):
status: Incomplete → Expired
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for open-iscsi (Ubuntu) because there has been no activity for 60 days.]

Changed in open-iscsi (Ubuntu):
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.