Application User Guide

• 1. Conntrack-Based Applications
  • 1.1. Conntrack Functional Test
  • 1.2. Conntrack Core Scalability Test
  • 1.3. Conntrack Connection Per Second (CPS) Test
• 2. OVS Offload
  • 2.1. Introduction
  • 2.2. Architecture
    • 2.2.1. Packet Flow - Wire-VM Communication and vice versa
  • 2.3. Getting the sources and compile
  • 2.4. Setting up the Environment
    • 2.4.1. Binding required devices
  • 2.5. Launching the application
    • 2.5.1. Understanding the output
    • 2.5.2. Understanding different nodes
  • 2.6. Various Packet Flow Scenarios (with demo)
    • 2.6.1. Wire-VM Communication
• 3. DAO Crypto Agent App
  • 3.1. Overview
  • 3.2. Architecture Summary
  • 3.3. Lifecycle
  • 3.4. Host Interaction
  • 3.5. Validation
  • 3.6. Build & Run
  • 3.7. References
• 4. VirtIO-crypto
  • 4.1. Setting up EP environment
    • 4.1.1. Setup SDP PF/VF count in EBF menu
    • 4.1.2. Setup huge pages for DPDK application
    • 4.1.3. Bind required DMA devices to vfio-pci
    • 4.1.4. Bind required CPT VF’s to vfio-pci
    • 4.1.5. Bind PEM BAR4 and DPI BAR0 platform devices to vfio-platform
    • 4.1.6. Bind required SDP RVU devices to vfio-pci
  • 4.2. Running the EP firmware application
    • 4.2.1. EAL Options
    • 4.2.2. Application Options
    • 4.2.3. Example EP firmware command
  • 4.3. Setting up Host environment
  • 4.4. Running DPDK crypto-perf on host virtio device
• 5. VirtIO-l2fwd
  • 5.1. Setting up EP environment
    • 5.1.1. Setup SDP PF/VF count in EBF menu
    • 5.1.2. Setup huge pages for DPDK application
    • 5.1.3. Bind required DMA devices to vfio-pci
    • 5.1.4. Bind required RPM VF’s to vfio-pci
    • 5.1.5. Bind PEM BAR4 and DPI BAR0 platform devices to vfio-platform
    • 5.1.6. Bind required SDP RVU devices to vfio-pci
  • 5.2. Running the EP firmware application
    • 5.2.1. EAL Options
    • 5.2.2. Application Options
    • 5.2.3. Example EP firmware command
  • 5.3. Setting up Host environment
• 6. VirtIO-blkIO
  • 6.1. Architecture
  • 6.2. Application Workflow
    • 6.2.1. Initialization
    • 6.2.2. Main Processing Loop
    • 6.2.3. Request Processing
    • 6.2.4. Completion Handling
    • 6.2.5. Teardown
  • 6.3. Setting up EP environment
    • 6.3.1. Setup SDP PF/VF count in EBF menu
    • 6.3.2. Setup huge pages for DPDK application
    • 6.3.3. Bind required DMA devices to vfio-pci
    • 6.3.4. Bind required NPA PF to vfio-pci
    • 6.3.5. Bind required SDP RVU devices to vfio-pci
    • 6.3.6. Running the EP firmware application
  • 6.4. Setting up Host environment
  • 6.5. Using block device on host
• 7. Secgw-graph
  • 7.1. Features
  • 7.2. Setting up environment
    • 7.2.1. Setup of SDP and RPM devices
    • 7.2.2. Setup huge pages for DPDK application
    • 7.2.3. Bind required RPM VF’s to vfio-pci
    • 7.2.4. Bind required SDP VF’s to vfio-pci
    • 7.2.5. Bind required CPT VF to vfio-pci
    • 7.2.6. Bind required Inline device PF to vfio-pci
    • 7.2.7. Setting up Host environment
  • 7.3. Running secgw-graph
    • 7.3.1. EAL Options
    • 7.3.2. Application Options
    • 7.3.3. secgw.cli
    • 7.3.4. Application bootup logs
    • 7.3.5. CLI terminal
  • 7.4. CLI commands
  • 7.5. Running as IPv4 router
    • 7.5.1. Configuration
    • 7.5.2. ping host2 IP from host1
    • 7.5.3. How it works
    • 7.5.4. Resolving Partial Routes
  • 7.6. Running as IPsec gateway
    • 7.6.1. Configuration
    • 7.6.2. Check IPsec configuration
    • 7.6.3. ping host2 IP from host1
  • 7.7. Planned Features
  • 7.8. Known Issues
• 8. Universal SmartNIC Turnkey App
  • 8.1. Introduction
    • 8.1.1. Feature List
  • 8.2. Getting the sources and compile
    • 8.2.1. Binding required devices
  • 8.3. Launching the application
    • 8.3.1. Application Options
    • 8.3.2. Example Commands
    • 8.3.3. Supported CLI commands
    • 8.3.4. Runtime configuration
    • 8.3.5. Application running demo
• 9. FD.io Vector Packet Processing (VPP)
  • 9.1. What is VPP?
  • 9.2. VPP Accelerations
  • 9.3. Marvell’s High-Performance VPP for OCTEON
    • 9.3.1. Installing and Running VPP for Packet I/O Acceleration Demo
    • 9.3.2. Running VPP for Crypto offload Demo
    • 9.3.3. VPP FD.io Documentation
  • 9.4. VPP Usage and Integrations
  • 9.5. Compiling VPP from sources
  • 9.6. Enhancing VPP IPsec offload with Strongswan Integration
    • 9.6.1. Strongswan Integration
    • 9.6.2. Configuring VPP IPsec route mode or policy mode
    • 9.6.3. VPP startup.conf configuration and CLI commands
    • 9.6.4. Strongswan configuration on DPU
    • 9.6.5. Strongswan configuration on remote DPU/Host:
    • 9.6.6. Ipsec Linux commands
  • 9.7. Host Offload to OCTEON DPU Via Virtio Interface over PCIe
    • 9.7.1. Configuring OCTEON DPU
  • 9.8. Host offload to OCTEON DPU via SDP interface over PCIe
    • 9.8.1. Configuring OCTEON DPU
    • 9.8.2. Configuring Host
• 10. TLS Proxy with NGINX
  • 10.1. Introduction
  • 10.2. NGINX Brief
  • 10.3. NGINX as TLS termination proxy
    • 10.3.1. Usage/deployment Model
    • 10.3.2. NGINX Architecture Diagram
    • 10.3.3. NGINX acceleration on OCTEON
  • 10.4. Steps to Install
    • 10.4.1. Ubuntu Debian package
    • 10.4.2. Compiling from Sources
  • 10.5. Environment Setup
    • 10.5.1. Run the below script (once after every reboot) to create CPT VFs and bind to vfio-pci:
    • 10.5.2. NGINX configuration
    • 10.5.3. OpenSSL configuration
  • 10.6. Launching the application
    • 10.6.1. Running the Proxy Application
    • 10.6.2. Functional Testing of the Proxy
    • 10.6.3. Performance Testing of the Proxy
• 11. Machine Learning
  • 11.1. Introduction
  • 11.2. Setting Up The TVM Compiler Framework
    • 11.2.1. Prerequisites
    • 11.2.2. Cloning and Building TVM Sources
    • 11.2.3. Setting MMLC Binaries
  • 11.3. Model Compilation
    • 11.3.1. Model Layers and Operators
    • 11.3.2. Compiler Options
    • 11.3.3. FP16 Compilation Flow
    • 11.3.4. Compilation Flow for CPU Execution
    • 11.3.5. Pre-processing and Post-processing Steps
  • 11.4. Running Inference
    • 11.4.1. Simulator Mode
    • 11.4.2. DPDK ML Test Application Mode
    • 11.4.3. Output Validation
  • 11.5. Example Models/Usecases
    • 11.5.1. Resnet50 Model Compilation using Jupyter Notebook
    • 11.5.2. LUCID
    • 11.5.3. Mnist-12
    • 11.5.4. GoogLeNet
    • 11.5.5. MobileNetv2-12
    • 11.5.6. VGG11
    • 11.5.7. References
• 12. Snort with VectorScan
  • 12.1. What is Snort?
  • 12.2. What is VectorScan?
  • 12.3. Accelerations
  • 12.4. Installing Snort
    • 12.4.1. Ubuntu Debian package
    • 12.4.2. Install the Snort package and verify
  • 12.5. VectorScan Benchmarking
    • 12.5.1. Pattern Sets
    • 12.5.2. Performance measurements
  • 12.6. Snort Benchmarking
• 13. Kubernetes CNI Offload
  • 13.1. Introduction
  • 13.2. Architecture of CNI-Offload Solution
    • 13.2.1. Host Components
    • 13.2.2. DPU Components
    • 13.2.3. Solution Software and Firmware Matrix
  • 13.3. Installation Steps
    • 13.3.1. System Requirements:
    • 13.3.2. Add nodes to k8s Cluster
    • 13.3.3. Build and Deploy CNI-Offload Solution
    • 13.3.4. Verify CNI-Offload Solution is Deployed
  • 13.4. Test Star Wars Demo with CNI-Offload
    • 13.4.1. Testbed Diagram:
    • 13.4.2. Deploy Services
    • 13.4.3. Service Offload Validation
    • 13.4.4. Policy Offload Validation
    • 13.4.5. Star Wars Demo Video with CNI-Offload
  • 13.5. Test IPsec Transparent Encryption with CNI-Offload
    • 13.5.1. IPSec Demo Video with CNI-Offload
• 14. Envoy Acceleration on OCTEON
  • 14.1. Overview
  • 14.2. Architecture
  • 14.3. Accelerating Envoy on Marvell OCTEON Platform
  • 14.4. Accelerating TLS handshake
  • 14.5. Private Key Provider Extension
  • 14.6. DPDK Crypto API Integration
  • 14.7. Benefits
  • 14.8. Deployment
• 15. RDMA Solution
  • 15.1. RDMA Overview
  • 15.2. Octeon RDMA Firmware
    • 15.2.1. Features
    • 15.2.2. Setting up Environment
    • 15.2.3. Launching RDMA Application on OCTEON
  • 15.3. Host Software Architecture
    • 15.3.1. a. User Space
    • 15.3.2. b. Kernel Space
    • 15.3.3. Setting up Environment
    • 15.3.4. UD Ping-Pong Test
    • 15.3.5. Multi-Queue UD Test (ibv_ud_mq_trf)
    • 15.3.6. Multi-Device RDMA Steps
    • 15.3.7. Troubleshooting
    • 15.3.8. Command-Line Scenarios (Multi-QP Application)
    • 15.3.9. Planned Enhancements
    • 15.3.10. Known Issues
    • 15.3.11. References
    • 15.3.12. Performance Testing (Perftest Suite)
    • 15.3.13. Latency Tests (UD / RC):
    • 15.3.14. Bandwidth Tests (UD / RC SEND, WRITE, READ):