2 Copyright(c) 2016-2017 Intel Corporation. All rights reserved.
4 Redistribution and use in source and binary forms, with or without
5 modification, are permitted provided that the following conditions
8 * Redistributions of source code must retain the above copyright
9 notice, this list of conditions and the following disclaimer.
10 * Redistributions in binary form must reproduce the above copyright
11 notice, this list of conditions and the following disclaimer in
12 the documentation and/or other materials provided with the
14 * Neither the name of Intel Corporation nor the names of its
15 contributors may be used to endorse or promote products derived
16 from this software without specific prior written permission.
18 THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
19 "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
20 LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
21 A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
22 OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
23 SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
24 LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
25 DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
26 THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
27 (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
28 OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
31 Cryptography Device Library
32 ===========================
34 The cryptodev library provides a Crypto device framework for management and
35 provisioning of hardware and software Crypto poll mode drivers, defining generic
36 APIs which support a number of different Crypto operations. The framework
37 currently only supports cipher, authentication, chained cipher/authentication
38 and AEAD symmetric Crypto operations.
44 The cryptodev library follows the same basic principles as those used in DPDKs
45 Ethernet Device framework. The Crypto framework provides a generic Crypto device
46 framework which supports both physical (hardware) and virtual (software) Crypto
47 devices as well as a generic Crypto API which allows Crypto devices to be
48 managed and configured and supports Crypto operations to be provisioned on
49 Crypto poll mode driver.
58 Physical Crypto devices are discovered during the PCI probe/enumeration of the
59 EAL function which is executed at DPDK initialization, based on
60 their PCI device identifier, each unique PCI BDF (bus/bridge, device,
61 function). Specific physical Crypto devices, like other physical devices in DPDK
62 can be white-listed or black-listed using the EAL command line options.
64 Virtual devices can be created by two mechanisms, either using the EAL command
65 line options or from within the application using an EAL API directly.
67 From the command line using the --vdev EAL option
69 .. code-block:: console
71 --vdev 'cryptodev_aesni_mb_pmd0,max_nb_queue_pairs=2,max_nb_sessions=1024,socket_id=0'
73 Our using the rte_vdev_init API within the application code.
77 rte_vdev_init("cryptodev_aesni_mb_pmd",
78 "max_nb_queue_pairs=2,max_nb_sessions=1024,socket_id=0")
80 All virtual Crypto devices support the following initialization parameters:
82 * ``max_nb_queue_pairs`` - maximum number of queue pairs supported by the device.
83 * ``max_nb_sessions`` - maximum number of sessions supported by the device
84 * ``socket_id`` - socket on which to allocate the device resources on.
90 Each device, whether virtual or physical is uniquely designated by two
93 - A unique device index used to designate the Crypto device in all functions
94 exported by the cryptodev API.
96 - A device name used to designate the Crypto device in console messages, for
97 administration or debugging purposes. For ease of use, the port name includes
104 The configuration of each Crypto device includes the following operations:
106 - Allocation of resources, including hardware resources if a physical device.
107 - Resetting the device into a well-known default state.
108 - Initialization of statistics counters.
110 The rte_cryptodev_configure API is used to configure a Crypto device.
114 int rte_cryptodev_configure(uint8_t dev_id,
115 struct rte_cryptodev_config *config)
117 The ``rte_cryptodev_config`` structure is used to pass the configuration parameters.
118 In contains parameter for socket selection, number of queue pairs and the
119 session mempool configuration.
123 struct rte_cryptodev_config {
125 /**< Socket to allocate resources on */
126 uint16_t nb_queue_pairs;
127 /**< Number of queue pairs to configure on device */
133 /**< Session mempool configuration */
137 Configuration of Queue Pairs
138 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~
140 Each Crypto devices queue pair is individually configured through the
141 ``rte_cryptodev_queue_pair_setup`` API.
142 Each queue pairs resources may be allocated on a specified socket.
146 int rte_cryptodev_queue_pair_setup(uint8_t dev_id, uint16_t queue_pair_id,
147 const struct rte_cryptodev_qp_conf *qp_conf,
150 struct rte_cryptodev_qp_conf {
151 uint32_t nb_descriptors; /**< Number of descriptors per queue pair */
155 Logical Cores, Memory and Queues Pair Relationships
156 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
158 The Crypto device Library as the Poll Mode Driver library support NUMA for when
159 a processor’s logical cores and interfaces utilize its local memory. Therefore
160 Crypto operations, and in the case of symmetric Crypto operations, the session
161 and the mbuf being operated on, should be allocated from memory pools created
162 in the local memory. The buffers should, if possible, remain on the local
163 processor to obtain the best performance results and buffer descriptors should
164 be populated with mbufs allocated from a mempool allocated from local memory.
166 The run-to-completion model also performs better, especially in the case of
167 virtual Crypto devices, if the Crypto operation and session and data buffer is
168 in local memory instead of a remote processor's memory. This is also true for
169 the pipe-line model provided all logical cores used are located on the same
172 Multiple logical cores should never share the same queue pair for enqueuing
173 operations or dequeuing operations on the same Crypto device since this would
174 require global locks and hinder performance. It is however possible to use a
175 different logical core to dequeue an operation on a queue pair from the logical
176 core which it was enqueued on. This means that a crypto burst enqueue/dequeue
177 APIs are a logical place to transition from one logical core to another in a
178 packet processing pipeline.
181 Device Features and Capabilities
182 ---------------------------------
184 Crypto devices define their functionality through two mechanisms, global device
185 features and algorithm capabilities. Global devices features identify device
186 wide level features which are applicable to the whole device such as
187 the device having hardware acceleration or supporting symmetric Crypto
190 The capabilities mechanism defines the individual algorithms/functions which
191 the device supports, such as a specific symmetric Crypto cipher,
192 authentication operation or Authenticated Encryption with Associated Data
199 Currently the following Crypto device features are defined:
201 * Symmetric Crypto operations
202 * Asymmetric Crypto operations
203 * Chaining of symmetric Crypto operations
204 * SSE accelerated SIMD vector operations
205 * AVX accelerated SIMD vector operations
206 * AVX2 accelerated SIMD vector operations
207 * AESNI accelerated instructions
208 * Hardware off-load processing
211 Device Operation Capabilities
212 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
214 Crypto capabilities which identify particular algorithm which the Crypto PMD
215 supports are defined by the operation type, the operation transform, the
216 transform identifier and then the particulars of the transform. For the full
217 scope of the Crypto capability see the definition of the structure in the
218 *DPDK API Reference*.
222 struct rte_cryptodev_capabilities;
224 Each Crypto poll mode driver defines its own private array of capabilities
225 for the operations it supports. Below is an example of the capabilities for a
226 PMD which supports the authentication algorithm SHA1_HMAC and the cipher
231 static const struct rte_cryptodev_capabilities pmd_capabilities[] = {
233 .op = RTE_CRYPTO_OP_TYPE_SYMMETRIC,
235 .xform_type = RTE_CRYPTO_SYM_XFORM_AUTH,
237 .algo = RTE_CRYPTO_AUTH_SHA1_HMAC,
255 .op = RTE_CRYPTO_OP_TYPE_SYMMETRIC,
257 .xform_type = RTE_CRYPTO_SYM_XFORM_CIPHER,
259 .algo = RTE_CRYPTO_CIPHER_AES_CBC,
277 Capabilities Discovery
278 ~~~~~~~~~~~~~~~~~~~~~~
280 Discovering the features and capabilities of a Crypto device poll mode driver
281 is achieved through the ``rte_cryptodev_info_get`` function.
285 void rte_cryptodev_info_get(uint8_t dev_id,
286 struct rte_cryptodev_info *dev_info);
288 This allows the user to query a specific Crypto PMD and get all the device
289 features and capabilities. The ``rte_cryptodev_info`` structure contains all the
290 relevant information for the device.
294 struct rte_cryptodev_info {
295 const char *driver_name;
296 enum rte_cryptodev_type dev_type;
297 struct rte_pci_device *pci_dev;
299 uint64_t feature_flags;
301 const struct rte_cryptodev_capabilities *capabilities;
303 unsigned max_nb_queue_pairs;
306 unsigned max_nb_sessions;
314 Scheduling of Crypto operations on DPDK's application data path is
315 performed using a burst oriented asynchronous API set. A queue pair on a Crypto
316 device accepts a burst of Crypto operations using enqueue burst API. On physical
317 Crypto devices the enqueue burst API will place the operations to be processed
318 on the devices hardware input queue, for virtual devices the processing of the
319 Crypto operations is usually completed during the enqueue call to the Crypto
320 device. The dequeue burst API will retrieve any processed operations available
321 from the queue pair on the Crypto device, from physical devices this is usually
322 directly from the devices processed queue, and for virtual device's from a
323 ``rte_ring`` where processed operations are place after being processed on the
327 Enqueue / Dequeue Burst APIs
328 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~
330 The burst enqueue API uses a Crypto device identifier and a queue pair
331 identifier to specify the Crypto device queue pair to schedule the processing on.
332 The ``nb_ops`` parameter is the number of operations to process which are
333 supplied in the ``ops`` array of ``rte_crypto_op`` structures.
334 The enqueue function returns the number of operations it actually enqueued for
335 processing, a return value equal to ``nb_ops`` means that all packets have been
340 uint16_t rte_cryptodev_enqueue_burst(uint8_t dev_id, uint16_t qp_id,
341 struct rte_crypto_op **ops, uint16_t nb_ops)
343 The dequeue API uses the same format as the enqueue API of processed but
344 the ``nb_ops`` and ``ops`` parameters are now used to specify the max processed
345 operations the user wishes to retrieve and the location in which to store them.
346 The API call returns the actual number of processed operations returned, this
347 can never be larger than ``nb_ops``.
351 uint16_t rte_cryptodev_dequeue_burst(uint8_t dev_id, uint16_t qp_id,
352 struct rte_crypto_op **ops, uint16_t nb_ops)
355 Operation Representation
356 ~~~~~~~~~~~~~~~~~~~~~~~~
358 An Crypto operation is represented by an rte_crypto_op structure, which is a
359 generic metadata container for all necessary information required for the
360 Crypto operation to be processed on a particular Crypto device poll mode driver.
362 .. figure:: img/crypto_op.*
364 The operation structure includes the operation type, the operation status
365 and the session type (session-based/less), a reference to the operation
366 specific data, which can vary in size and content depending on the operation
367 being provisioned. It also contains the source mempool for the operation,
368 if it allocated from a mempool.
370 If Crypto operations are allocated from a Crypto operation mempool, see next
371 section, there is also the ability to allocate private memory with the
372 operation for applications purposes.
374 Application software is responsible for specifying all the operation specific
375 fields in the ``rte_crypto_op`` structure which are then used by the Crypto PMD
376 to process the requested operation.
379 Operation Management and Allocation
380 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
382 The cryptodev library provides an API set for managing Crypto operations which
383 utilize the Mempool Library to allocate operation buffers. Therefore, it ensures
384 that the crytpo operation is interleaved optimally across the channels and
385 ranks for optimal processing.
386 A ``rte_crypto_op`` contains a field indicating the pool that it originated from.
387 When calling ``rte_crypto_op_free(op)``, the operation returns to its original pool.
391 extern struct rte_mempool *
392 rte_crypto_op_pool_create(const char *name, enum rte_crypto_op_type type,
393 unsigned nb_elts, unsigned cache_size, uint16_t priv_size,
396 During pool creation ``rte_crypto_op_init()`` is called as a constructor to
397 initialize each Crypto operation which subsequently calls
398 ``__rte_crypto_op_reset()`` to configure any operation type specific fields based
399 on the type parameter.
402 ``rte_crypto_op_alloc()`` and ``rte_crypto_op_bulk_alloc()`` are used to allocate
403 Crypto operations of a specific type from a given Crypto operation mempool.
404 ``__rte_crypto_op_reset()`` is called on each operation before being returned to
405 allocate to a user so the operation is always in a good known state before use
410 struct rte_crypto_op *rte_crypto_op_alloc(struct rte_mempool *mempool,
411 enum rte_crypto_op_type type)
413 unsigned rte_crypto_op_bulk_alloc(struct rte_mempool *mempool,
414 enum rte_crypto_op_type type,
415 struct rte_crypto_op **ops, uint16_t nb_ops)
417 ``rte_crypto_op_free()`` is called by the application to return an operation to
422 void rte_crypto_op_free(struct rte_crypto_op *op)
425 Symmetric Cryptography Support
426 ------------------------------
428 The cryptodev library currently provides support for the following symmetric
429 Crypto operations; cipher, authentication, including chaining of these
430 operations, as well as also supporting AEAD operations.
433 Session and Session Management
434 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
436 Session are used in symmetric cryptographic processing to store the immutable
437 data defined in a cryptographic transform which is used in the operation
438 processing of a packet flow. Sessions are used to manage information such as
439 expand cipher keys and HMAC IPADs and OPADs, which need to be calculated for a
440 particular Crypto operation, but are immutable on a packet to packet basis for
441 a flow. Crypto sessions cache this immutable data in a optimal way for the
442 underlying PMD and this allows further acceleration of the offload of
445 .. figure:: img/cryptodev_sym_sess.*
447 The Crypto device framework provides a set of session pool management APIs for
448 the creation and freeing of the sessions, utilizing the Mempool Library.
450 The framework also provides hooks so the PMDs can pass the amount of memory
451 required for that PMDs private session parameters, as well as initialization
452 functions for the configuration of the session parameters and freeing function
453 so the PMD can managed the memory on destruction of a session.
455 **Note**: Sessions created on a particular device can only be used on Crypto
456 devices of the same type, and if you try to use a session on a device different
457 to that on which it was created then the Crypto operation will fail.
459 ``rte_cryptodev_sym_session_create()`` is used to create a symmetric session on
460 Crypto device. A symmetric transform chain is used to specify the particular
461 operation and its parameters. See the section below for details on transforms.
465 struct rte_cryptodev_sym_session * rte_cryptodev_sym_session_create(
466 uint8_t dev_id, struct rte_crypto_sym_xform *xform);
468 **Note**: For AEAD operations the algorithm selected for authentication and
469 ciphering must aligned, eg AES_GCM.
472 Transforms and Transform Chaining
473 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
475 Symmetric Crypto transforms (``rte_crypto_sym_xform``) are the mechanism used
476 to specify the details of the Crypto operation. For chaining of symmetric
477 operations such as cipher encrypt and authentication generate, the next pointer
478 allows transform to be chained together. Crypto devices which support chaining
479 must publish the chaining of symmetric Crypto operations feature flag.
481 Currently there are three transforms types cipher, authentication and AEAD.
482 Also it is important to note that the order in which the
483 transforms are passed indicates the order of the chaining.
487 struct rte_crypto_sym_xform {
488 struct rte_crypto_sym_xform *next;
489 /**< next xform in chain */
490 enum rte_crypto_sym_xform_type type;
493 struct rte_crypto_auth_xform auth;
494 /**< Authentication / hash xform */
495 struct rte_crypto_cipher_xform cipher;
497 struct rte_crypto_aead_xform aead;
502 The API does not place a limit on the number of transforms that can be chained
503 together but this will be limited by the underlying Crypto device poll mode
504 driver which is processing the operation.
506 .. figure:: img/crypto_xform_chain.*
512 The symmetric Crypto operation structure contains all the mutable data relating
513 to performing symmetric cryptographic processing on a referenced mbuf data
514 buffer. It is used for either cipher, authentication, AEAD and chained
517 As a minimum the symmetric operation must have a source data buffer (``m_src``),
518 a valid session (or transform chain if in session-less mode) and the minimum
519 authentication/ cipher/ AEAD parameters required depending on the type of operation
520 specified in the session or the transform
525 struct rte_crypto_sym_op {
526 struct rte_mbuf *m_src;
527 struct rte_mbuf *m_dst;
530 struct rte_cryptodev_sym_session *session;
531 /**< Handle for the initialised session context */
532 struct rte_crypto_sym_xform *xform;
533 /**< Session-less API Crypto operation parameters */
540 } data; /**< Data offsets and length for ciphering */
547 } data; /**< Data offsets and length for authentication */
551 phys_addr_t phys_addr;
552 } digest; /**< Digest parameters */
556 phys_addr_t phys_addr;
557 } aad; /**< Additional authentication parameters */
562 Asymmetric Cryptography
563 -----------------------
565 Asymmetric functionality is currently not supported by the cryptodev API.
571 The cryptodev Library API is described in the *DPDK API Reference* document.