ANSI-INCITS-365-2002-R2007.pdf

ANSI INCITS 365-2002 for Information Technology SCSI RDMA Protocol (SRP) ANSI INCITS 365-2002 Copyright American National Standards Institute Provided by IHS under license with ANSI Licensee=IHS Employees/1111111001, User=listmgr, listmgr Not for Resale, 04/29/2007 19:58:15 MDTNo reproduction or networking permitted without license from IHS -,-,- ANSI INCITS 365-2002 American National Standard for Information Technology SCSI RDMA Protocol (SRP) Secretariat Information Technology Industry Council (ITI) Approved November 21, 2002 American National Standards Institute, Inc. Abstract This standard describes the message format and protocol definitions required to transfer commands and data between a SCSI (Small Computer System Interface) initiator port and a SCSI target port using an RDMA communication service. ® Copyright American National Standards Institute Provided by IHS under license with ANSI Licensee=IHS Employees/1111111001, User=listmgr, listmgr Not for Resale, 04/29/2007 19:58:15 MDTNo reproduction or networking permitted without license from IHS -,-,- Approval of an American National Standard requires review by ANSI that the requirements for due process, consensus, and other criteria for approval have been met by the standards developer. Consensus is established when, in the judgement of the ANSI Board of Standards Review, substantial agreement has been reached by directly and materially affected interests. Substantial agreement means much more than a simple majority, but not necessarily unanimity. Consensus requires that all views and objections be considered, and that a concerted effort be made towards their resolution. The use of American National Standards is completely voluntary; their existence does not in any respect preclude anyone, whether he has approved the standards or not, from manufacturing, marketing, purchasing, or using products, processes, or procedures not conforming to the standards. The American National Standards Institute does not develop standards and will in no circumstances give an interpretation of any American National Standard. Moreover, no person shall have the right or authority to issue an interpretation of an American National Standard in the name of the American National Standards Institute. Requests for interpretations should be addressed to the secretariat or sponsor whose name appears on the title page of this standard. CAUTION NOTICE: This American National Standard may be revised or withdrawn at any time. The procedures of the American National Standards Institute require that action be taken periodically to reaffirm, revise, or withdraw this standard. Purchasers of American National Standards may receive current information on all standards by calling or writing the American National Standards Institute. American National Standard Published by American National Standards Institute, Inc. 25 West 43rd Street, New York, NY 10036 Copyright © 2002 by Information Technology Industry Council (ITI) All rights reserved. No part of this publication may be reproduced in any form, in an electronic retrieval system or otherwise, without prior written permission of ITI, 1250 Eye Street NW, Washington, DC 20005. Printed in the United States of America CAUTION: The developers of this standard have requested that holders of patents that may be required for the implementation of the standard disclose such patents to the publisher. However, neither the developers nor the publisher have undertaken a patent search in order to identify which, if any, patents may apply to this standard. As of the date of publication of this standard and following calls for the identification of patents that may be required for the implementation of the standard, no such claims have been made. No further patent search is conducted by the de- veloper or publisher in respect to any standard it processes. No representation is made or implied that licenses are not required to avoid infringement in the use of this standard. Copyright American National Standards Institute Provided by IHS under license with ANSI Licensee=IHS Employees/1111111001, User=listmgr, listmgr Not for Resale, 04/29/2007 19:58:15 MDTNo reproduction or networking permitted without license from IHS -,-,- i Contents Page Foreword. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .v Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii 1Scope. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 2Normative references . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2 2.1Normative references . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2 2.2Approved references. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2 2.3References under development . . . . . . . . . . . . . . . . . . . . . . . . . . . .2 3Definitions, symbols, abbreviations and conventions . . . . . . . . . . . . . . . . . . .3 3.1Definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3 3.2Acronyms. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4 3.3Keywords. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4 3.4Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .5 3.5Notation for procedures and functions. . . . . . . . . . . . . . . . . . . . . . . .6 4RDMA communication service model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 4.1Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 4.2RDMA Channels . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 4.2.1Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 4.2.2Establishment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8 4.2.3Disestablishment. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10 4.3Messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10 4.4RDMA operations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10 4.4.1Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10 4.4.2RDMA Write. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11 4.4.3RDMA Read . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11 4.5Ordering and Reliability. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11 4.5.1Ordering and reliability overview . . . . . . . . . . . . . . . . . . . . . . . . . . .11 4.5.2Reliability. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11 4.5.3Ordering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12 5Structure and concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13 5.1Overview of SRP operation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13 5.1.1RDMA channel establishment and login . . . . . . . . . . . . . . . . . . . . .13 5.1.2Single RDMA channel operation . . . . . . . . . . . . . . . . . . . . . . . . . . .13 5.1.3Multiple independent RDMA channel operation . . . . . . . . . . . . . . .13 5.1.4RDMA channel disconnection . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14 5.2Identifiers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15 5.3Alias associations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15 5.4Information unit classes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15 5.5SRP target port buffer management . . . . . . . . . . . . . . . . . . . . . . . .15 5.5.1Buffer management overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15 5.5.2SRP requests issued by target port. . . . . . . . . . . . . . . . . . . . . . . . .15 5.5.3Requests issued by initiator port . . . . . . . . . . . . . . . . . . . . . . . . . . .15 5.6Data buffers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17 5.6.1Memory descriptors. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17 5.6.2Data buffer descriptors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18 6SRP Information Units . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23 6.1Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23 Copyright American National Standards Institute Provided by IHS under license with ANSI Licensee=IHS Employees/1111111001, User=listmgr, listmgr Not for Resale, 04/29/2007 19:58:15 MDTNo reproduction or networking permitted without license from IHS -,-,- ii Page 7SCSI mode parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48 7.1SCSI mode parameter overview and codes. . . . . . . . . . . . . . . . . . 48 7.2Disconnect-reconnect mode page . . . . . . . . . . . . . . . . . . . . . . . . . 48 7.2.1Valid fields . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 7.2.2Invalid fields . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 7.3Protocol specific LUN page . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 7.4Protocol specific port page . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 Annexes ASRP interface protocol and services. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 BSRP for the InfiniBandTM Architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 Copyright American National Standards Institute Provided by IHS under license with ANSI Licensee=IHS Employees/1111111001, User=listmgr, listmgr Not for Resale, 04/29/2007 19:58:15 MDTNo reproduction or networking permitted without license from IHS -,-,- iii Page Tables 1Memory descriptor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17 2Data buffer descriptor formats . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18 3Supported data buffer descriptor formats. . . . . . . . . . . . . . . . . . . . . . . . . . .19 4Indirect data buffer descriptor. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20 5SRP requests sent from SRP initiator ports to SRP target ports . . . . . . . . .23 6SRP responses sent from SRP target ports to SRP initiator ports . . . . . . . .23 7SRP requests sent from SRP target ports to SRP initiator ports . . . . . . . . .23 8SRP responses sent from SRP initiator ports to SRP target ports . . . . . . . .23 9SRP_LOGIN_REQ request . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25 10MULTI-CHANNEL ACTION code values . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 11 SRP_LOGIN_RSP response . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27 12MULTI-CHANNEL RESULT code values . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28 13 SRP_LOGIN_REJ response. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29 14 SRP_LOGIN_REJ response reason codes . . . . . . . . . . . . . . . . . . . . . . . . .30 15 SRP_I_LOGOUT request. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31 16 SRP_T_LOGOUT request . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .32 17 SRP_T_LOGOUT request reason codes . . . . . . . . . . . . . . . . . . . . . . . . . . .33 18 SRP_TSK_MGMT request . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34 19TASK MANAGEMENT FUNCTION CODES. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35 20 SRP_CMD request. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36 21TASK ATTRIBUTE. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37 22 SRP_RSP response . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .39 23RESPONSE DATA field . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42 24RSP_CODE values . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42 25 SRP_CRED_REQ request . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43 26 SRP_CRED_RSP response. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44 27 SRP_AER_REQ request . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45 28 SRP_AER_RSP response . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47 29 SRP mode page codes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48 30 Disconnect-reconnect mode page . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48 Copyright American National Standards Institute Provided by IHS under license with ANSI Licensee=IHS Employees/1111111001, User=listmgr, listmgr Not for Resale, 04/29/2007 19:58:15 MDTNo reproduction or networking permitted without license from IHS -,-,- iv Figures 1SCSI document relationships . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 2RDMA communication service example . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 3Example RDMA channel establishment . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 4Memory descriptor mapping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 5Example indirect data buffer descriptor with no PARTIAL MEMORY DESCRIPTOR LIST field. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 6Example indirect data buffer descriptor with a PARTIAL MEMORY DESCRIPTOR LIST field. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 Copyright American National Standards Institute Provided by IHS under license with ANSI Licensee=IHS Employees/1111111001, User=listmgr, listmgr Not for Resale, 04/29/2007 19:58:15 MDTNo reproduction or networking permitted without license from IHS -,-,- vi Foreword (This foreword is not part of ANSI INCITS 365-2002.) The purpose of this standard is to define a SCSI transport protocol based on Remote Direct Memory