Menu
What's new
By:
Filters Better Search

RT-AX86U - Jumbo frames for 2.5GbE port.

  • SNBForums Code of Conduct

    SNBForums is a community for everyone, no matter what their level of experience.

    Please be tolerant and patient of others, especially newcomers. We are all here to share and learn!

    The rules are simple: Be patient, be nice, be helpful or be gone!

Spc

Spc

Regular Contributor
Hey everyone,
I am testing out new 2.5Gbit/s links.

I am using RT-AX86U with latest merlin and jumbo frames are enabled, however firmware does not specify how big are jumbo frames, are they 9k ? or 16k ?
USB dongle from ASUS i am using is ASUS usb-c2500, which supports 16k jumbo frames:

1662217103251.png


Asus USB-C2500 also supports 16k jumbo frames in linux:
1662218503701.png


ASUS usb-c2500:
Chip1Realtek RTL8156B

RT-AX86U uses:
ETH chip3Realtek RTL8226B

If i check with ifconfig all interfaces are 1500 bytes, no sign of 9000 bytes:
Code: 
bond0     Link encap:Ethernet  HWaddr FC:34:97:8B:5E:C8
          UP BROADCAST RUNNING ALLMULTI MASTER MULTICAST  MTU:1500  Metric:1
          RX packets:10175872 errors:0 dropped:2729 overruns:0 frame:0
          TX packets:2754910 errors:0 dropped:461 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:13013747984 (12.1 GiB)  TX bytes:497796580 (474.7 MiB)

br0       Link encap:Ethernet  HWaddr FC:34:97:8B:5E:C8
          inet addr:192.168.0.35  Bcast:192.168.0.255  Mask:255.255.255.0
          UP BROADCAST RUNNING ALLMULTI MULTICAST  MTU:1500  Metric:1
          RX packets:647988 errors:0 dropped:32530 overruns:0 frame:0
          TX packets:4290 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:50536958 (48.1 MiB)  TX bytes:1018450 (994.5 KiB)

eth0      Link encap:Ethernet  HWaddr FC:34:97:8B:5E:C8
          UP BROADCAST ALLMULTI MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

eth1      Link encap:Ethernet  HWaddr FC:34:97:8B:5E:C8
          UP BROADCAST ALLMULTI MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

eth2      Link encap:Ethernet  HWaddr FC:34:97:8B:5E:C8
          UP BROADCAST ALLMULTI MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

eth3      Link encap:Ethernet  HWaddr FC:34:97:8B:5E:C8
          UP BROADCAST RUNNING ALLMULTI SLAVE MULTICAST  MTU:1500  Metric:1
          RX packets:6498690 errors:0 dropped:24 overruns:0 frame:0
          TX packets:2618277 errors:0 dropped:457 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:8161966918 (7.6 GiB)  TX bytes:473784848 (451.8 MiB)

eth4      Link encap:Ethernet  HWaddr FC:34:97:8B:5E:C8
          UP BROADCAST RUNNING ALLMULTI SLAVE MULTICAST  MTU:1500  Metric:1
          RX packets:3677182 errors:0 dropped:58 overruns:0 frame:0
          TX packets:136633 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:4851781066 (4.5 GiB)  TX bytes:24011732 (22.8 MiB)

eth5      Link encap:Ethernet  HWaddr FC:34:97:8B:5E:C8
          UP BROADCAST RUNNING ALLMULTI MULTICAST  MTU:1500  Metric:1
          RX packets:2046568 errors:0 dropped:0 overruns:0 frame:0
          TX packets:7991081 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:190780625 (181.9 MiB)  TX bytes:10145018265 (9.4 GiB)

eth6      Link encap:Ethernet  HWaddr FC:34:97:8B:5E:C8
          UP BROADCAST RUNNING ALLMULTI MULTICAST  MTU:1500  Metric:1
          RX packets:6666 errors:0 dropped:0 overruns:0 frame:332272
          TX packets:584446 errors:48 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:1369515 (1.3 MiB)  TX bytes:64432145 (61.4 MiB)
          Interrupt:48

eth7      Link encap:Ethernet  HWaddr FC:34:97:8B:5E:CC
          UP BROADCAST RUNNING ALLMULTI MULTICAST  MTU:1500  Metric:1
          RX packets:193668 errors:0 dropped:21 overruns:0 frame:0
          TX packets:916936 errors:0 dropped:17574 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:36115988 (34.4 MiB)  TX bytes:443933244 (423.3 MiB)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          UP LOOPBACK RUNNING MULTICAST  MTU:65536  Metric:1
          RX packets:122205 errors:0 dropped:0 overruns:0 frame:0
          TX packets:122205 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:27457103 (26.1 MiB)  TX bytes:27457103 (26.1 MiB)

lo:0      Link encap:Local Loopback
          inet addr:127.0.1.1  Mask:255.0.0.0
          UP LOOPBACK RUNNING MULTICAST  MTU:65536  Metric:1

spu_ds_dummy Link encap:UNSPEC  HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
          UP RUNNING NOARP  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:100
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

spu_us_dummy Link encap:UNSPEC  HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
          UP RUNNING NOARP  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:100
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)


I have enabled jumbo frames in UI:
1662216850932.png


Does anyone know if merlin caps jumbo frames to max 9k or can we get more than 9k ?


Thanks.
 
Last edited:
You may want to reconsider using jumbo frames. While working well on your LAN, packets going to the internet will be broken up to satisfy the MTU of your provider hardware. With jumbo frames enabled this is done by the router. Even with the standard Ethernet packet the frames can still be broken up.
Do you want to add extra load to your router?
 
bbunge said:
You may want to reconsider using jumbo frames. While working well on your LAN, packets going to the internet will be broken up to satisfy the MTU of your provider hardware. With jumbo frames enabled this is done by the router. Even with the standard Ethernet packet the frames can still be broken up.
Do you want to add extra load to your router?
Click to expand...
My router is Windows server 2022 on Intel® Core™ i5-6400 with 20 GB RAM and Intel Ethernet Server Adapter I350 - T4 v2.
I have 2Gbit LACP to internet and 2Gbit/s LACP to local switch connection on this router.

I am using RT-AX86U only as access point / switch.
I also tested jumbo frames to internet, because i am using direct connection to dual channel fiber (FTTH), i can use up to 9k MTU, it goes through without fragmentation.
I can ping with 9k MTU without any problems and it doesn't fragment.
 
Last edited:
It's my (possibly mistaken) understanding that for pure end-to-end IPv6 connections, each end of the link will negotiate frame size...so unless you're only communicating with v6 servers, jumbo frames will be a burden on your router, and bottleneck your network to an extent as @bbunge suggested.

Maybe this will help: https://www.smallnetbuilder.com/arc...o-know-jumbo-frames-in-small-networks?start=0
think about how much more capable your router is today vs 15 yrs ago when that article was written
 
Last edited:
Yea i think ipv6 has static MTU, ipv4 on other hand can be changed.

Example:
20 LAN IPv4 16114 20 Enabled Connected ActiveStore
20 LAN IPv6 1452 20 Enabled Connected ActiveStore

Only IPv4 is affected by driver mtu change.
IPv6 always stays at 1452 as shown.

You can test this example.

1. Set MTU to 9000 in windows driver.
2. Disable your network NIC in windows.
3. Enable your NIC in windows
4. As soon as you enable your NIC, type: Get-NetIPInterface in Windows powershell.

IPv6 and IPv4 will be 9000 MTU.
After a minute or so windows will adjust MTU of IPv6 to 1452 automatically.


All my switches have support for 10240 MTU.
10240 is enabled on all ports in my local network on switches.
 
Last edited:
In IP V4, the end points should negotiate the MTU. If your local LAN works best with an MTU of say 9k, then use that. Communications to hosts on the internet with the default MTU will negotiate with your hosts and the will chose the smaller MTU. I don't recall the meninism when hosts at both end support jumbo frames and ones in the middle don't yet both hosts will still be able to communicate.

Morris
 
Spc said:
I found this on internet:
View attachment 44057

https://www.jeffgeerling.com/blog/2020/testing-25-gbps-ethernet-on-raspberry-pi-cm4

So jumbo frames should get us improvement in speed.
I am talking about direct LAN connection between computers, not WAN port.
Click to expand...

First off, the graphs appear to be for a Rasberry PI. If you or more of your hosts is a PI and you are using the same adapter he is then you have valid info. That is if you application behaves as his test one did.

Jumbo frames were critical in the early days of high speed networking. Today with controller stack offload and/or very fast CPUs it's not necessarily the case. As most modern CPUs and NICs are both capable of keeping the rotate window stuffed, even with small packets, the difference in performance is limited to the delay for the inter record gab and there tiny. Now if you are using Jumbo Frames and for any reason a transmission is needed, that's going to take a lot longer than 10 inter record gaps and this is just for the one frame, never mind an entire rotate window or on average 1/2 the rotate window. If line quality is not perfect and/or one of the hosts experiences buffer overruns or underruns, then a jumbo frame will slow throughput significantly. Only large file transfers and emulations such as ISCSI will benniffit and as I pointed out at the beginning not as much as it used to help.

Morirs
 
Spc said:
So jumbo frames should get us improvement in speed.
I am talking about direct LAN connection between computers, not WAN port.
Click to expand...
Bear in mind that most of his efforts were in overcoming the problems with his setup and the CPU limitations of the Pi. Once he did that he ended up with roughly the numbers you would expect for non-jumbo vs. jumbo frames, i.e. 2330 Mbps vs. 2480 Mbps. So about a 6% increase in throughput. Measurable but not exactly game changing.
 
ColinTaylor said:
Bear in mind that most of his efforts were in overcoming the problems with his setup and the CPU limitations of the Pi. Once he did that he ended up with roughly the numbers you would expect for non-jumbo vs. jumbo frames, i.e. 2330 Mbps vs. 2480 Mbps. So about a 6% increase in throughput. Measurable but not exactly game changing.
Click to expand...
I've seen even less with data center gear. It's not cut and dry
 
Depends on device and cpu, low speed cpus should see increase with jumbo frames.
Also if you are rendering video, cpu is at 100% and you're copying files while rendering jumbo frames should help out.
 
I just tested both versions:
- RT-AX86U (Original)
- RX-AX86U Pro

Original supports jumbo frames on local switch LAN1,2,3,4 + 2.5GbE port, if i enable option in switch settings, i can ping my server with MTU of 9K.
On Pro version i do the same but packets just get discarded.

Example:
RT-AX86U (Original):


Code: 
ping 192.168.0.1 -l 8000 -f -t


Pinging 192.168.0.1 with 8000 bytes of data:
Reply from 192.168.0.1: bytes=8000 time<1ms TTL=255
Reply from 192.168.0.1: bytes=8000 time<1ms TTL=255
Reply from 192.168.0.1: bytes=8000 time<1ms TTL=255


Ping statistics for 192.168.0.1:
    Packets: Sent = 3, Received = 3, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 0ms, Maximum = 0ms, Average = 0ms

Example:
RT-AX86U PRO:
Code: 
ping 192.168.0.1 -l 8000 -f -t


Pinging 192.168.0.1 with 8000 bytes of data:
Packet needs to be fragmented but DF set.
Packet needs to be fragmented but DF set.
Packet needs to be fragmented but DF set.


Ping statistics for 192.168.0.1:
Ping statistics for 192.168.0.1:
Packets: Sent = 3, Received = 0, Lost = 3 (100% loss)

PRO version uses this broacom SOC:
www.broadcom.com

Quad-core ARM v8 compliant 64 bit processor for residential access point applications BCM4912

The BCM4912 is a quad-core ARM v8 compliant 64-bit processor for residential access point (AP) applications.
www.broadcom.com www.broadcom.com

Question is, does BCM4912 support jumbo frames and ASUS didn't implement them so currently PRO version has broken firmware and option to enable jumbo frames is missing ?
Or BCM4912 doesn't support more than 1500 MTU across all 5 ports.

and yes, BCM4912 has all 5 ports including 2.5GbE intergrated into itself.
 
Spc said:
On Pro version i do the same but packets just get discarded.
Click to expand...
I thought the Pro didn't have an option in the GUI to enable Jumbo frames? So it's not that surprising that pinging the router's LAN bridge doesn't work. A more valid test would be to enable Jumbo frames on two ethernet connected clients and seeing what the largest packet is that you can send between them.
 
Last edited:
ColinTaylor said:
I thought the Pro didn't have an option in the GUI to enable Jumbo frames? So it's not that surprising that pinging the router's LAN bridge doesn't work. A more valid test would be to enable Jumbo frames on two ethernet connected clients and seeing what the largest packet is that you can send between them.
Click to expand...
I am not pinging the router, but my local server (192.168.0.1) with intel nic set to 9000 MTU.
So the switch inside pro version is not even passing MTU bigger than 1492 bytes to other clients connected to switch in pro version.
 
Spc said:
I just tested both versions:
- RT-AX86U (Original)
- RX-AX86U Pro

Original supports jumbo frames on local switch LAN1,2,3,4 + 2.5GbE port, if i enable option in switch settings, i can ping my server with MTU of 9K.
On Pro version i do the same but packets just get discarded.

Example:
RT-AX86U (Original):


Code: 
ping 192.168.0.1 -l 8000 -f -t


Pinging 192.168.0.1 with 8000 bytes of data:
Reply from 192.168.0.1: bytes=8000 time<1ms TTL=255
Reply from 192.168.0.1: bytes=8000 time<1ms TTL=255
Reply from 192.168.0.1: bytes=8000 time<1ms TTL=255


Ping statistics for 192.168.0.1:
    Packets: Sent = 3, Received = 3, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 0ms, Maximum = 0ms, Average = 0ms

Example:
RT-AX86U PRO:
Code: 
ping 192.168.0.1 -l 8000 -f -t


Pinging 192.168.0.1 with 8000 bytes of data:
Packet needs to be fragmented but DF set.
Packet needs to be fragmented but DF set.
Packet needs to be fragmented but DF set.


Ping statistics for 192.168.0.1:
Ping statistics for 192.168.0.1:
Packets: Sent = 3, Received = 0, Lost = 3 (100% loss)

PRO version uses this broacom SOC:
www.broadcom.com

Quad-core ARM v8 compliant 64 bit processor for residential access point applications BCM4912

The BCM4912 is a quad-core ARM v8 compliant 64-bit processor for residential access point (AP) applications.
www.broadcom.com www.broadcom.com

Question is, does BCM4912 support jumbo frames and ASUS didn't implement them so currently PRO version has broken firmware and option to enable jumbo frames is missing ?
Or BCM4912 doesn't support more than 1500 MTU across all 5 ports.

and yes, BCM4912 has all 5 ports including 2.5GbE intergrated into itself.
Click to expand...
You have done a good job testing. What application are you running that might benefit from jumbo frames? With the high bandwidth demand of this application it may be wise to keep this traffic in the core of your network and off of an access switch such as the ones on our Asus routers.
 
Morris said:
You have done a good job testing. What application are you running that might benefit from jumbo frames? With the high bandwidth demand of this application it may be wise to keep this traffic in the core of your network and off of an access switch such as the ones on our Asus routers.
Click to expand...
Usual stuff, mostly file sharing (samba) and some other protocols, and yes enabling jumbo frames speeds increase when copying files from one file server to client, i have already tested this and confirmed this.
So example using samba (windows file sharing) will use MTU bigger than 1500, and enabling faster speeds on jumbo frames enabled.
 
Spc said:
Usual stuff, mostly file sharing (samba) and some other protocols, and yes enabling jumbo frames speeds increase when copying files from one file server to client, i have already tested this and confirmed this.
So example using samba (windows file sharing) will use MTU bigger than 1500, and enabling faster speeds on jumbo frames enabled.
Click to expand...
Are there other switches close to your router? Possibly you can move the hosts that do the larger file transfers off of the router. If you can get them all on the same switch that will work best.
 
You must log in or register to reply here.

Similar threads

K
Double NAT?
Replies
1
Views
860
krl69
K
A
ASUS Dual WAN Failover, Then Failback, Leaves Secondary LAN in "Hot Standby"
Replies
4
Views
2K
Kingp1n
K
K
Dropouts on ASUS RT-AX86U
Replies
5
Views
343
kram66
K
B
ASUS 89X - Slow WiFi
Replies
7
Views
1K
ben29
B
janico82
sbnMerlin 1.2.6 - Network Isolation Tool based on Guest Networks, June 26 2024
6 7 8
Replies
149
Views
18K
Underskore
U
Similar threads
Thread starter Title Forum Replies Date
Zakalwe Solved RT-AX86U Pro - Using as PPPoE modem with BT Full Fibter internet Asuswrt-Merlin 8
M RT-AX86U Pro - Merlin: can't get p2p cameras available to wan. Asuswrt-Merlin 4
M 802.1q VLAN tagging menu missing for WAN interface (Asus RT-AX86U Pro) Asuswrt-Merlin 4
R RT-AX86U 3.0.0.4.388_24243 hacked Asuswrt-Merlin 14
E Question about DDNS forced update interval RT-AX86U Asuswrt-Merlin 3
T 5G Frequency issue on RT-AX86U after update 3004.388.8_2 Asuswrt-Merlin 2
R RT-AX86U Pro LAN Port on Guest Network Asuswrt-Merlin 9
staralfur12 I have an old Brother HL-2300D, and an Asus AX86U. How do I achieve AirPrint? Asuswrt-Merlin 20
N RT-AX86U-Pro, WAN disconnect every 36 hours Asuswrt-Merlin 25
M RT-AX86U and DNS Privacy over USB WAN Asuswrt-Merlin 0

Similar threads

Latest threads

Support SNBForums w/ Amazon

If you'd like to support SNBForums, just use this link and buy anything on Amazon. Thanks!

Sign Up For SNBForums Daily Digest

Get an update of what's new every day delivered to your mailbox. Sign up here!

Staff online

Members online

Total: 583 (members: 19, guests: 564)
Top