ER8411 units drop off controller

This thread has been locked for further replies. You can start a new thread to share your ideas or ask questions.

ER8411 units drop off controller

This thread has been locked for further replies. You can start a new thread to share your ideas or ask questions.
ER8411 units drop off controller
ER8411 units drop off controller
2024-04-17 00:47:10
Model: ER8411  
Hardware Version: V1
Firmware Version: 1.2.1, 1.2.X,

Solid facts:
I'm hosting my controller.

I have many sites, with mostly 6XX and 7XX routers, but I have 2 8411 units too.

 

Issue:

 

8411 shows disconnected in the OMADA system. The 8411 units are functional and up, even though in OMADA reports them disconnected. This seems to have been going on for about 3 months. The issue existed on 2 firmware changes, and over 3 OMADA upgrades.

 

(SIDE issue, both units have totally frozen at times too. This tends to happen X HR after "viewing"  any settings for the 8411 in OMADA. only fix is to power cycle)

 

Fixes:

 

Seems the only way to fix is to factory reset the 8411, log in locally, then have it join my OMADA. It then needs to sync and reboot a few times before its stable again.

 

Sadly, 13hr, 2 days, 9 days, 4 days, 37days, or even 320hours or some other random time, the 8411 will again drop off OMADA.

 

I have two of these units in two different sites / states. They BOTH do this. They do not do this at the same time. No changes are made with in OMADA or physically at the sites. It is random, it is random per device. 

 

The issue is we can not have downtime like this, even going down for 12 min as the units re config is 15 min too long. We are ordering 2 more 8411 units, and will run 2 units per site as fail over. And thats sad, because we bought these units for the uptime, for the dual power, for the multi WAN, and so on.

 

Solution:

 

Only solution we can do right now is buy 2 more 8411 units and setup fail over. ( Might use a 7XX unit at one site as they would only be used when the 8411 freeze or fail to connect to OMADA.

 

I'm hopeful others are having this exact issue, and TPLINK/OMADA is working on a solution.

 

  0      
  0      
#1
Options
2 Reply
Re:ER8411 units drop off controller
2024-04-17 03:03:06 - last edited 2024-04-17 03:05:58

Hi @DaKings 

Thanks for posting in our business forum.

Are you hosting the controller over the cloud? If yes, you have to worry about the connection stability.

I experience the same thing in the lab as well when the Internet becomes unstable and I have an over-cloud adoption.

But if my controller resides in the LAN, my topology next to my office desk works perfectly for months.

 

The key is when the tunnel or port forwarding adoption is not stable, which will interfere with the transmission of the "keepalive" packets. It would eventually lead to a problem like "Heartbeat Missed" > "Disconnected".

 

I would say from the first day when Omada was introduced, there were reports about this. It was never a fix from us. I remembered that back in 2021 when SDNC V4 was released and the cloud was available for it, it had reported. The guides about the adoption over the Internet were first released during that period, too.

 

You might ask this on the controller page where people discuss the controller. But I would assume that this is mostly a network connectivity issue.

 

If you'd like to discuss this with me, let me know how you adopt and manage them. Diagram, please. 

Best Regards! If you are new to the forum, please read: Howto - A Guide to Use Forum Effectively. Read Before You Post. Look for a model? Search your model NOW Official and Beta firmware. NEW features! Subscribe for the latest update!Download Beta Here☚ ☛ ★ Configuration Guide ★ ☚ ☛ ★ Knowledge Base ★ ☚ ☛ ★ Troubleshooting ★ ☚ ● Be kind and nice. ● Stay on the topic. ● Post details. ● Search first. ● Please don't take it for granted. ● No email confidentiality should be violated. ● S/N, MAC, and your true public IP should be mosaiced.
  2  
  2  
#2
Options
Re:ER8411 units drop off controller
2024-04-18 23:07:07

  @Clive_A 

Thanks for taking the time to reply

 

"Are you hosting the controller over the cloud? If yes, you have to worry about the connection stability.

I experience the same thing in the lab as well when the Internet becomes unstable and I have an over-cloud adoption.

But if my controller resides in the LAN, my topology next to my office desk works perfectly for months."

 

I'm hosting my own software based controller with static IP and full domain name ( Omada.Mydomain.com ).

I have ~7 other sites / routers that never have dropped off my OMADA controller, ONLY the 8411 units drop.

One of the 8411 units is on the very same LAN as the controller, and it drops off the controller.

 

" The key is when the tunnel or port forwarding adoption is not stable, which will interfere with the transmission of the "keepalive" packets. It would eventually lead to a problem like "Heartbeat Missed" > "Disconnected"."

 

The Omada controller is at my datacenter sitting behind a 8411 with dual 10G internet connections. I host many services behind that 8411, and none of those have issues. I run a national off-site backup service, and software hates small / random drops. So if there are network issues, that backup software (running on 3 servers behind one of the 8411s) would let me know.  ( I do agree a faulty network can cause this, but if that was the case, I'd see more devices going off-line. I have about 60 or so OMADA devices, it is ONLY the 8411 units that drop, no other OMADA device has dropped)

 

" I would say from the first day when Omada was introduced, there were reports about this. It was never a fix from us. I remembered that back in 2021 when SDNC V4 was released and the cloud was available for it, it had reported. The guides about the adoption over the Internet were first released during that period, too. "

i've seen this when using a Proxy, like NGNIX. The "default" settings in the proxy don't support constant connection OR constant sending of data. Example, by default, if one tries to upload ~500MB to a server behind Ngnix proxy, it would fail. The Proxy would drop. Need to increase the MAX data and increase WAIT times. My stuff is behind a proxy, but I have configured it to allow constant connections, extended the waits and increased max data rates per proxy cfg. But I doubt its PROXY in my case, as out of ~60+ OMADA devices, ONLY my 2 8411 units keep dropping. Again, could be 1hr, could be 1 month, or something in between.

" You might ask this on the controller page where people discuss the controller. But I would assume that this is mostly a network connectivity issue. "

I was debating where to post this. I thought about doing it on the controller support, but the controller is fine, as all my other devices never drop, it's only the 8411 units that drop.

 

"If you'd like to discuss this with me, let me know how you adopt and manage them. Diagram, please. "

Yea, that would be cool if I could pick your brain a little on this. I think it might be a setting I made in the 8411's config. I have a few point 2 point VPNs going between my sites. I've noticed once an 8411 drops. I'll use the controller to disable the VPNs, factory reset the 8411, base config it so it can see controller, re join to controller and it'll work. If I leave the VPN's enabled, then rejoin the 8411, it'll work. But at some point after the last reboot to apply configs, it'll drop ( 5 to 30 min). I've enabled one VPN every day till it locks or not. Sometimes, I can get them all up and good for a week or so. Maybe a routing / loop issue?  I'd really hate to delete them from OMADA and start fresh, but that is my next option.

Let me draft a layout. I look forward to your input!

 

Thanks

  1  
  1  
#3
Options