Difference between revisions of "RFNoC (UHD 3.0)"
MartinBraun (Talk | contribs) m (MartinBraun moved page RFNoC to RFNoC (UHD 3.0)) |
|||
(41 intermediate revisions by 4 users not shown) | |||
Line 1: | Line 1: | ||
− | == | + | ==Overview== |
{| | {| | ||
− | |style="vertical-align:top;"| | + | |style="vertical-align:top; width: 60%;"|RFNoC is a network-distributed heterogeneous processing tool with a focus on enabling FPGA processing in USRP devices. It allows you to move data on and off of an FPGA in a transparent way, thus enabling seamless use of both host-based and FPGA-based processing in an application. It provides a way to leverage FPGA processing capabilities and IP in your application which can scale across multiple FPGAs and devices across a network. |
− | ||[[File: | + | |
+ | Signal processing algorithms are contained modules known as "Computation Engines" or "RFNoC Blocks", and an interface wrapper is provided to encapsulate existing or external IP to use with RFNoC. This allows you to import Xilinx™ CoreGen™ IP blocks, for example, and use them immediately in your RFNoC application. The internals of a RFNoC block are wholly independent from any other block, and can be designed with any tool that supports AXI stream interfaces, including VHDL, Verilog, and Xilinx™ Vivado™ HLS. | ||
+ | |||
+ | We are quickly building out the library of ready-to-use RFNoC blocks and already have many available, including the blocks necessary for an OFDM stack (e.g., detection, synchronization, equalizer, packet demodulator). | ||
+ | |||
+ | RFNoC is integrated with the UHD™ software, and all USRP devices from the third-generation on (X300 Series, E300 Series) are supported by RFNoC out-of-the-box. Like UHD, RFNoC is also Free and Open Source Software (LGPL), and the full source code can be found in our public code repositories. | ||
+ | ||[[File:rfnoc.png|250px]] | ||
|} | |} | ||
+ | |||
+ | ==Framework and Data Flow Example== | ||
+ | Below is a figure of the RFNoC stack. | ||
+ | |||
+ | [[File:rfnoc_stack.png|650px]] | ||
+ | |||
+ | The example below shows basic data flow of an RFNoC application. While this shows one possible data flow, there are many possible combinations from Host block to FPGA block, FPGA block to Host block, Host to Host, FPGA to FPGA, etc. | ||
+ | |||
+ | [[File:gr_rfnoc_ex1.png|650px]] | ||
==Supported Devices== | ==Supported Devices== | ||
* E310/E312 | * E310/E312 | ||
+ | * E320 | ||
* X300/X310 | * X300/X310 | ||
+ | * N300/N310/N320/N321 | ||
− | == | + | ==Sample of Available Blocks== |
− | + | ||
− | + | ||
− | + | ||
*FIFO | *FIFO | ||
*FFT | *FFT | ||
Line 23: | Line 37: | ||
*Window multiplier (for FFT) | *Window multiplier (for FFT) | ||
*OFDM: Burst detection + synchronization, equalizer, packet demodulator | *OFDM: Burst detection + synchronization, equalizer, packet demodulator | ||
+ | *and [https://github.com/EttusResearch/fpga/tree/maint/usrp3/lib/rfnoc more...] | ||
− | ==RFNoC | + | ==RFNoC FAQs== |
− | + | ===FPGA=== | |
+ | ====What is the purpose of the rb_stb signal on NoC Shell?==== | ||
+ | When writing or reading a settings register in a RFNoC block, the block receives a command packet (with the register address / value to write as the payload) and sends out a response packet. The response packet acknowledges the command packet and includes readback data as the payload. In the write case, the readback data is usually discarded. In the read case, the readback data payload will be the value of the register read in the block. | ||
− | + | The signal <code>rb_stb</code>, called readback strobe, is used to control the the output of the response packet. After receiving a command packet, Noc Shell’s command packet processor will not output a response packet unless <code>rb_stb</code> is asserted. This functionality can be used to throttle the reception of command packets / settings register read/writes. | |
− | + | Most blocks should keep <code>rb_stb</code> asserted. Note, the <code>rb_stb</code> bit width is as wide as the number of block ports in use. For example, a two block port RFNoC block should set <code>rb_stb</code> to <code>2’b11</code>, otherwise a command packet timeout will occur. | |
− | + | ===UHD=== | |
+ | ====Why do I have a command timeout error?==== | ||
+ | Error message example: | ||
− | + | <pre>RuntimeError: EnvironmentError: IOError: 0/FIR_0 user_reg_read64() failed: EnvironmentError: IOError: [0/FIR_0] sr_read64() failed: EnvironmentError: IOError: Block ctrl (CE_04_Port_70) no response packet - AssertionError: bool(buff) | |
+ | in uint64_t ctrl_iface_impl::wait_for_ack(bool) | ||
+ | at /home/ettus/src/uhd/host/lib/rfnoc/ctrl_iface.cpp:205</pre> | ||
− | + | <ul> | |
+ | <li>Check <code>ce_clk</code> / <code>ce_rst</code> are correctly connected in <code>rfnoc_ce_auto_inst_<device>.v</code> file where <code><device></code> is <code>x300</code>, <code>x310</code>, or <code>e310</code>.</li> | ||
+ | <li>Check block is correctly connected to the crossbar. Generally this is only an issue if manually connecting RFNoC block’s signals to the crossbar.</li> | ||
+ | <li>Check if Noc Shell’s <code>rb_stb</code> signal is properly asserted. Note, <code>rb_stb</code> bit width must be as wide as the number of block ports in use, i.e. if using 2 block ports, <code>rb_stb</code> must be <code>2’b11</code>.</li> | ||
+ | <li>RFNoC block is using timed commands (<code>USE_TIMED_CMDS</code>) with Noc Shell and the command FIFO depth parameter (<code>CMD_FIFO_SIZE</code>) on Noc Shell is too small. UHD will issue up to 64 commands at once, so set <code>CMD_FIFO_SIZE</code> to at least <code>8</code>.</li> | ||
+ | </ul> | ||
− | == | + | |
− | + | ===GNU Radio=== | |
+ | ====When do I use an RFNoC FIFO in my flowgraph and which kind if any?==== | ||
+ | |||
+ | An '''RFNoC FIFO''' is needed in your flowgraph in the following 2 conditions: | ||
+ | |||
+ | First, if you are running a GNU Radio flowgraph that is structured as follows: | ||
+ | |||
+ | <code>Host block -> RFNoC block -> Host block</code> | ||
+ | |||
+ | In this case, you need to do either: | ||
+ | |||
+ | <code>Host block -> RFNoC FIFO -> RFNoC Block -> Host block</code> | ||
+ | |||
+ | -OR- | ||
+ | |||
+ | <code>Host block -> RFNoC Block -> RFNoC FIFO -> Host block</code> | ||
+ | |||
+ | The order doesn't matter. This structure also benefits from having the [http://gnuradio.org/redmine/projects/gnuradio/wiki/Guided_Tutorial_GRC#243-A-Note-on-the-Throttle-Block GNU Radio Throttle block] in the sequence. The reason behind the need to add the FIFO is because of performance inside of GNU Radio, so that the RX/TX work functions in the GNU Radio RFNoC block implementations run in separate threads. | ||
+ | |||
+ | Use <code>RFNoC: FIFO</code> (<code>AXI_FIFO_LOOPBACK</code>) in this case. See the following figure as an example. | ||
+ | |||
+ | [[File:fifo_v01.png|650px]] | ||
+ | |||
+ | Second, in the case where you are transmitting out to the antenna on the X3xx series devices, i.e. | ||
+ | |||
+ | <code>Host -> DmaFIFO -> Radio</code> | ||
+ | |||
+ | -OR- | ||
+ | |||
+ | <code>Host -> DmaFIFO -> DUC -> Radio</code> | ||
+ | |||
+ | Ethernet introduces a latency in flow control from the X3x0 back to the host. The latency will cause underruns unless a large buffer, i.e. <code>DMA_FIFO</code>, is added to the flowgraph. | ||
+ | |||
+ | Use <code>RFNoC: DmaFIFO</code> (<code>AXI_DMA_FIFO</code>) in this case. See the following figures as examples. | ||
+ | |||
+ | [[File:dma_fifo_v01.png|650px]] | ||
+ | |||
+ | -OR- | ||
+ | |||
+ | [[File:dma_fifo_v02.png|650px]] | ||
+ | |||
+ | ====Splitting an RFNoC Data Stream in GNU Radio==== | ||
+ | |||
+ | '''Copy Block:''' In the RFNoC domain, streams of data can not be split as easily as they are in the GNU Radio domain. The <code>Copy</code> block depicted in the screenshot below serves the function as a stream splitter at the FPGA-Host boundary. It’s main purpose, when <code>Enabled</code>, is to copy the samples it is getting at its input and putting then into the output, but here it is also serving as a boundary between a RFNoC-domain and a GNURadio-domain. In the flowgraph above. after this boundary is passed, the data stream can easily be split into the two sinks to have them run simultaneously (standard GNU Radio functionality). It is possible to connect the GNU Radio blocks directly to RFNoC blocks without a <code>Copy</code> block, but only one would work at a time (the other ones would have to be disabled). Another way to split data streams from the RFNoC-domain is to use the <code>RFNoC: Split Stream</code> block, which would split the streams in the RFNoC domain, but this is not very useful here as we are moving into the GNURadio-domain. | ||
+ | |||
+ | [[File:rfnoc_ddc.grc_v02.png|650px]] | ||
+ | |||
+ | ====What is the difference between USRP Sink/Source blocks and the RFNoC:Radio block?==== | ||
+ | |||
+ | The USRP Source and Sink blocks use the <code>multi_usrp</code> API, whereas the <code>RFNoC:Radio</code> block uses the RFNoC API. In general, unless RFNoC features are desired, there is no need to use the <code>RFNoC:Radio</code> block. The <code>RFNoC:Radio</code> block is most useful when its output is connected directly to another RFNoC block. Below is a list of differences as well as a GRC screenshot to help differentiate between the two blocks. | ||
+ | |||
+ | Distinctions: | ||
+ | * The USRP Source/Sink blocks work with any version of UHD, and does not require <code>gr-ettus</code>. The <code>gr-ettus</code> Out-Of-Tree GNU Radio module is currently needed to use any RFNoC Blocks. This requirement will be removed as more RFNoC components are migrated into UHD. | ||
+ | * The USRP Source/Sink blocks include a superset of the not only the components of an <code>RFNoC:Radio</code>, but also <code>DDC/DUC</code> chains, and the <code>DRAM FIFO</code> (specific to X3xx series). When using the <code>RFNoC:Radio</code> block, the <code>DDC/DUC</code> blocks need to be added explicitly. See the figure below. | ||
+ | * When using the USRP Source/Sink blocks, it is not possible to connect to any RFNoC blocks. | ||
+ | * USRP Source/Sink blocks can only be used when using a <code>multi_usrp</code> API FPGA image (when looking in the USRP FPGA images directory they are the images without the term “RFNOC” in them), or an FPGA image that includes <code>RFNoC:Radio</code> and <code>RFNoC:DDC/DUC</code> blocks. | ||
+ | |||
+ | |||
+ | '''NOTE:''' The RFNOC:DmaFIFO block is only needed for the X3xx series devices. | ||
+ | [[File:rfnocRadio_uhdSinkSource_grc_v07.png|650px]] | ||
+ | |||
+ | ===Tools=== | ||
+ | ====Xilinx License: Xilinx’s License manager looks for an Ethernet adapter with the name eth0...==== | ||
+ | |||
+ | '''Problem:''' The Xilinx Vivado License Manager looks for an Ethernet adapter with the name <code>eth0</code>, but Ubuntu 16.04 and later now use a persistent naming scheme, with interface names such as (e.g. <code>np6s0, enp4s0, enp2s0f0, enp2s0f1, enx00ef5c620935</code>). | ||
+ | |||
+ | '''Solution:''' Rename the ethernet adapter to <code>eth0</code>. | ||
+ | |||
+ | Create this file: | ||
+ | <code>70-persistent-net.rules</code> in this <code>/etc/udev/rules.d/</code> directory | ||
+ | And adding the following line to the file (substitute <code>xx:xx:xx:xx:xx:xx</code> for the MAC address of the Ethernet adapter): | ||
+ | |||
+ | SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="xx:xx:xx:xx:xx:xx", ATTR{dev_id}=="0x0", ATTR{type}=="1", NAME="eth0" | ||
+ | |||
+ | Ubuntu information: | ||
+ | |||
+ | http://askubuntu.com/questions/767786/changing-network-interfaces-name-ubuntu-16-04 | ||
+ | |||
+ | Xilinx information: | ||
+ | |||
+ | https://www.xilinx.com/support/answers/60510.html | ||
+ | |||
+ | ==Licensing== | ||
+ | * [[Licensing FAQ]] | ||
+ | |||
+ | ==RFNoC Resources== | ||
+ | *[[Getting_Started_with_RFNoC_Development|Getting Started with RFNoC Development]] | ||
+ | *[https://drive.google.com/file/d/0B6ccrJyAZaq3MTRDbmVUR0gwVU0/view GNU Radio 2016 Conference Presentation] | ||
+ | *[https://www.youtube.com/watch?v=8cPd3t88djE Virginia Tech Video Presentation] | ||
+ | *[https://kb.ettus.com/images/e/eb/RFNoC_Wireless_at_VirginiaTech_2014_Intro.pdf Virginia Tech Presentation - Introduction to RFNoC] | ||
+ | *[https://kb.ettus.com/images/1/1e/RFNoC_Wireless_at_VirginiaTech_2014_Host.pdf Virginia Tech Presentation - RFNoC Deep Dive: Host Side] | ||
+ | *[https://kb.ettus.com/images/7/78/RFNoC_Wireless_at_VirginiaTech_2014_FPGA.pdf Virginia Tech Presentation - RFNoC Deep Dive: FPGA] | ||
+ | *[https://conferences.sigcomm.org/sigcomm/2013/papers/srif/p45.pdf sigcom 2013 Paper] | ||
[[Category:Software Resources]] | [[Category:Software Resources]] |
Latest revision as of 09:27, 7 February 2022
Contents
Overview
Framework and Data Flow Example
Below is a figure of the RFNoC stack.
The example below shows basic data flow of an RFNoC application. While this shows one possible data flow, there are many possible combinations from Host block to FPGA block, FPGA block to Host block, Host to Host, FPGA to FPGA, etc.
Supported Devices
- E310/E312
- E320
- X300/X310
- N300/N310/N320/N321
Sample of Available Blocks
- FIFO
- FFT
- FIR
- fosphor (real-time spectrum analyzer)
- Decimator (Keep 1 in N)
- Log Power Calculator
- Radio Interface
- Vector IIR (moving average)
- Window multiplier (for FFT)
- OFDM: Burst detection + synchronization, equalizer, packet demodulator
- and more...
RFNoC FAQs
FPGA
What is the purpose of the rb_stb signal on NoC Shell?
When writing or reading a settings register in a RFNoC block, the block receives a command packet (with the register address / value to write as the payload) and sends out a response packet. The response packet acknowledges the command packet and includes readback data as the payload. In the write case, the readback data is usually discarded. In the read case, the readback data payload will be the value of the register read in the block.
The signal rb_stb
, called readback strobe, is used to control the the output of the response packet. After receiving a command packet, Noc Shell’s command packet processor will not output a response packet unless rb_stb
is asserted. This functionality can be used to throttle the reception of command packets / settings register read/writes.
Most blocks should keep rb_stb
asserted. Note, the rb_stb
bit width is as wide as the number of block ports in use. For example, a two block port RFNoC block should set rb_stb
to 2’b11
, otherwise a command packet timeout will occur.
UHD
Why do I have a command timeout error?
Error message example:
RuntimeError: EnvironmentError: IOError: 0/FIR_0 user_reg_read64() failed: EnvironmentError: IOError: [0/FIR_0] sr_read64() failed: EnvironmentError: IOError: Block ctrl (CE_04_Port_70) no response packet - AssertionError: bool(buff) in uint64_t ctrl_iface_impl::wait_for_ack(bool) at /home/ettus/src/uhd/host/lib/rfnoc/ctrl_iface.cpp:205
- Check
ce_clk
/ce_rst
are correctly connected inrfnoc_ce_auto_inst_<device>.v
file where<device>
isx300
,x310
, ore310
. - Check block is correctly connected to the crossbar. Generally this is only an issue if manually connecting RFNoC block’s signals to the crossbar.
- Check if Noc Shell’s
rb_stb
signal is properly asserted. Note,rb_stb
bit width must be as wide as the number of block ports in use, i.e. if using 2 block ports,rb_stb
must be2’b11
. - RFNoC block is using timed commands (
USE_TIMED_CMDS
) with Noc Shell and the command FIFO depth parameter (CMD_FIFO_SIZE
) on Noc Shell is too small. UHD will issue up to 64 commands at once, so setCMD_FIFO_SIZE
to at least8
.
GNU Radio
When do I use an RFNoC FIFO in my flowgraph and which kind if any?
An RFNoC FIFO is needed in your flowgraph in the following 2 conditions:
First, if you are running a GNU Radio flowgraph that is structured as follows:
Host block -> RFNoC block -> Host block
In this case, you need to do either:
Host block -> RFNoC FIFO -> RFNoC Block -> Host block
-OR-
Host block -> RFNoC Block -> RFNoC FIFO -> Host block
The order doesn't matter. This structure also benefits from having the GNU Radio Throttle block in the sequence. The reason behind the need to add the FIFO is because of performance inside of GNU Radio, so that the RX/TX work functions in the GNU Radio RFNoC block implementations run in separate threads.
Use RFNoC: FIFO
(AXI_FIFO_LOOPBACK
) in this case. See the following figure as an example.
Second, in the case where you are transmitting out to the antenna on the X3xx series devices, i.e.
Host -> DmaFIFO -> Radio
-OR-
Host -> DmaFIFO -> DUC -> Radio
Ethernet introduces a latency in flow control from the X3x0 back to the host. The latency will cause underruns unless a large buffer, i.e. DMA_FIFO
, is added to the flowgraph.
Use RFNoC: DmaFIFO
(AXI_DMA_FIFO
) in this case. See the following figures as examples.
-OR-
Splitting an RFNoC Data Stream in GNU Radio
Copy Block: In the RFNoC domain, streams of data can not be split as easily as they are in the GNU Radio domain. The Copy
block depicted in the screenshot below serves the function as a stream splitter at the FPGA-Host boundary. It’s main purpose, when Enabled
, is to copy the samples it is getting at its input and putting then into the output, but here it is also serving as a boundary between a RFNoC-domain and a GNURadio-domain. In the flowgraph above. after this boundary is passed, the data stream can easily be split into the two sinks to have them run simultaneously (standard GNU Radio functionality). It is possible to connect the GNU Radio blocks directly to RFNoC blocks without a Copy
block, but only one would work at a time (the other ones would have to be disabled). Another way to split data streams from the RFNoC-domain is to use the RFNoC: Split Stream
block, which would split the streams in the RFNoC domain, but this is not very useful here as we are moving into the GNURadio-domain.
What is the difference between USRP Sink/Source blocks and the RFNoC:Radio block?
The USRP Source and Sink blocks use the multi_usrp
API, whereas the RFNoC:Radio
block uses the RFNoC API. In general, unless RFNoC features are desired, there is no need to use the RFNoC:Radio
block. The RFNoC:Radio
block is most useful when its output is connected directly to another RFNoC block. Below is a list of differences as well as a GRC screenshot to help differentiate between the two blocks.
Distinctions:
- The USRP Source/Sink blocks work with any version of UHD, and does not require
gr-ettus
. Thegr-ettus
Out-Of-Tree GNU Radio module is currently needed to use any RFNoC Blocks. This requirement will be removed as more RFNoC components are migrated into UHD. - The USRP Source/Sink blocks include a superset of the not only the components of an
RFNoC:Radio
, but alsoDDC/DUC
chains, and theDRAM FIFO
(specific to X3xx series). When using theRFNoC:Radio
block, theDDC/DUC
blocks need to be added explicitly. See the figure below. - When using the USRP Source/Sink blocks, it is not possible to connect to any RFNoC blocks.
- USRP Source/Sink blocks can only be used when using a
multi_usrp
API FPGA image (when looking in the USRP FPGA images directory they are the images without the term “RFNOC” in them), or an FPGA image that includesRFNoC:Radio
andRFNoC:DDC/DUC
blocks.
NOTE: The RFNOC:DmaFIFO block is only needed for the X3xx series devices.
Tools
Xilinx License: Xilinx’s License manager looks for an Ethernet adapter with the name eth0...
Problem: The Xilinx Vivado License Manager looks for an Ethernet adapter with the name eth0
, but Ubuntu 16.04 and later now use a persistent naming scheme, with interface names such as (e.g. np6s0, enp4s0, enp2s0f0, enp2s0f1, enx00ef5c620935
).
Solution: Rename the ethernet adapter to eth0
.
Create this file:
70-persistent-net.rules
in this /etc/udev/rules.d/
directory
And adding the following line to the file (substitute xx:xx:xx:xx:xx:xx
for the MAC address of the Ethernet adapter):
SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="xx:xx:xx:xx:xx:xx", ATTR{dev_id}=="0x0", ATTR{type}=="1", NAME="eth0"
Ubuntu information:
http://askubuntu.com/questions/767786/changing-network-interfaces-name-ubuntu-16-04
Xilinx information:
https://www.xilinx.com/support/answers/60510.html