cancel
Showing results for 
Search instead for 
Did you mean: 

CODA-4582 - Open Issues for Investigation

RogersDave
Retired Support
Retired Support

*** This post was last edited May 2, 2017 ***

 

Good morning Community,

 

As I mentioned in a post two days ago, we have received the next firmware 2.0.10.20 from Hitron. We are currently running initial testing on this version and will push it out to participants in the firmware trial program as soon as it passes initial testing.

 

However, while running these tests, we discovered abnormal behavior with ICMP and are awaiting feedback from Hitron today to asses how this will be addressed. As soon as I this is confirmed, I’ll update the change log with the correct version information and start pushing it out.

 

In parallel, we are still working on the following high priority items. In some cases below, I requested affected customers to reach out to me via private message. If you do so, please include your modem MAC address in the subject line (even if we exchange messages daily) as there are a lot of you reaching out to me daily 🙂

 

UDP Packet Loss

The investigation for what has been reported as UDP packet loss is still ongoing. We have deployed a probe at one fellow forum member on both a CODA-4582 and a CGNM-3552 to collect additional data. We are actively working with Hitron and Intel on the results observed.

 

Based on what we know so far, in most instances UDP packet loss is coupled with higher uplink usage in the area. Although the impact is noticeable in specific logs (League of Legends), the root cause for the perceivable impact (while playing) is likely related to bufferbloat (see next issue).

 

 

Bufferbloat

When comparing the performance of a CODA-4582 to a CGNM-3552 in the same network conditions, the CODA-4582 consistently reports higher bufferbloat when tested on DSLReports.

 

Update April 12: The solution for this problem will come in two folds. It will require a change in software which will possibly be included in 2.0.10.27 but more likely in 2.0.10.28 and a change in network configuration.

 

The network configuration change is not compatible with the current firmware so this change will only come after a vast majority of the modems are running the new code. We are however looking at a way to make the change only for specific modems to support testing in the community.

 

Update April 22: This problem seems resolved in firmware 2.0.10.27

 

 

5 GHz WiFi Low range for channels 36 to 48

Lower WiFi channels on the modem have a much smaller range. This is due in part to the limit imposed by Industry Canada to maximum transmit power.

 

Furthermore, the current automatic channel selection (auto mode) tends to select the lower channels when in similar load conditions.

 

Workaround: manually select higher channels (149-153-157-161)

 

Update April 22: The channel selection algorithm has been improved in firmware 2.0.10.27

 

 

Loss of OFDM Channel Lock

Under some RF conditions, the modem fails to lock properly on the OFDM channel. This typically result in variable performance.

 

Update April 12: This problem is resolved in 2.0.10.26T2

 

 

List of connected device does not get fully populated

This is a known issue that has been tracked since firmware 2.0.10.13. We are making improvements at every firmware but it is not a perfect system.

 

The situation is worst after a reboot or firmware upgrade as the list gets reset and must be repopulated as devices renew their DHCP lease.

 

 

NAT Loopback not working for wired clients

When setting up port forwarding to an internal server, it is possible for a client on WiFi to reach the server using the external IP/port. If the client is on a wired interface, it doesn't work.

 

Update April 12: This problem is resolved in 2.0.10.26T2 (not confirmed)

 

 

LAN Counters not working

Some customers reported that LAN counters (especially in bridge mode) are reporting inaccurate values.

 

This problem has been reported to Hitron for investigation.

 

 

Unexpected modem reboot

Some customers reported their modem reboots unexpectedly. We have also seen this behavior in our lab.

 

Update April 12: This problem is resolved in 2.0.10.26T2

 

 

Missing SC-QAM Channels

After a reboot, some modems are missing SC-QAM channels. A fix has been implemented in 2.0.10.26T2 to address this behavior but it has not corrected all scenarios.

 

Investigation continues with Hitron.

 

 

WiFi Survey

The WiFi Survey functionality in firmware 2.0.10.26T2 (and possibly before) reports incorrect SSID names.

 

 

Guest Network

When connecting to the Guest Network, an error message is displayed "only allow DHCP client to use this wireless".  This has been reported in firmware 2.0.10.26T2.

 

Update April 22: This issue has been resolved in firmware 2.0.10.27

Update May 2: It seems this issue is not fully resolved and still experienced by some users


 

Future Planned Improvements

The following are items that we are working on in parallel of the above.

  • Improvement in WiFi speeds
  • Improvement in latency / bufferbloat

 

 

Dave

 

*Edited Labels*

2,620 REPLIES 2,620

Re: CODA-4582 - Open Issues for Investigation


@lethalsniper wrote:

@RogersDave look at these amazing speeds on the coda modem firmware .24 with 2 black dots and when i call rogersthey tell me everything looks good realy ?  test done hardwired with cat 6 cable

 


lethalsniper,

 

If I'm not mistaken, you are on a 250/20 Mbps plan. Your downlink speed is therefore within an acceptable range but your uplink speed is too low. However, as I have previously stated to you, the upstream utilization in your area tends to be on the hot side and will require node rework.

 

This will unfortunately not happen before the Spring for sure as it usually involves getting various construction permits and a lot of digging.

 

Dave

Re: CODA-4582 - Open Issues for Investigation


@Triple_Helix wrote:

@RogersDave Hold on there is a newer CODA with 2 Black Dots? Are they any better and should we change our single Black Dot Modems?


There are indeed CODAs with 2 black dots but they are not better than CODAs with a single black dot. It is simply a logistic marker for us for a specific shipment during the transition from "no dot" to "single dot".

 

We rechecked a batch of modem to ensure they were ok and added a second dot.

Re: CODA-4582 - Open Issues for Investigation

Okay fair enough but @RogersDave what's causing the high ping and jitter as you see in that image

Re: CODA-4582 - Open Issues for Investigation

RyzenFX
I'm a reliable contributor

Ping and jitter is caused by the low upload you're seeing. So basically the node congestion on the upload side is causing this high jitter and ping.

Re: CODA-4582 - Open Issues for Investigation

Triple_Helix
I plan to stick around

@RogersDave wrote:

@Triple_Helix wrote:

@RogersDave Hold on there is a newer CODA with 2 Black Dots? Are they any better and should we change our single Black Dot Modems?


There are indeed CODAs with 2 black dots but they are not better than CODAs with a single black dot. It is simply a logistic marker for us for a specific shipment during the transition from "no dot" to "single dot".

 

We rechecked a batch of modem to ensure they were ok and added a second dot.


@RogersDave Sorry I couldn't wait as the store closes in about 15 Minutes so I went an got a 2 Black Dot Modem as I never did take back my first Black Dot that never went back for QA so I sent you a PM to update my new Modem info!

 

TIA,

 

Daniel Smiley Wink

Re: CODA-4582 - Open Issues for Investigation

But how long does it take to fix a node issue its been since December 2016 going to be almost 4 months of this issue and from my understanding @RogersDave im not the only one who has called in regarding this issue in my area

Re: CODA-4582 - Open Issues for Investigation

RyzenFX
I'm a reliable contributor

@lethalsniper As he mentioned, it will start during spring b/c it will require permits and a lot of digging in order to split the node. You can't really do much other than wait for it to be fixed.

Re: CODA-4582 - Open Issues for Investigation

Alex4161
I'm a senior contributor

@RogersDave

 

Has there been a fix to the issue where I keep losing the OFDM Downstream channel rendering my modem as being offline from the Rogers network?  I have this happening 2 to 3x a day and the only fix is to unplug, wait a few minutes and replug the modem to reboot it.  This is really annoying and has started from last week.

 

I called support and they eluded to the fact that I may have a signal problem and I have a Sr. Tech coming to check things out tomorrow morning.

 

Here is my current signal levels and I power cycled the modem aroung 7 pm.

 

Downstream Overview

Port IDFrequency (MHz)ModulationSignal strength (dBmV)Channel IDSignal noise ratio (dB)
1615000000256QAM-2.9001136.610
2561000000256QAM-3.500235.780
3567000000256QAM-3.900335.780
4573000000256QAM-2.700435.595
5579000000256QAM-1.700535.780
6585000000256QAM-1.100636.610
7591000000256QAM0.400737.356
8597000000256QAM0.700837.636
9603000000256QAM0.300937.636
10609000000256QAM-1.1001037.356
11555000000256QAM-2.700136.387
12621000000256QAM-4.0001235.780
13633000000256QAM-3.2001336.387
14639000000256QAM-2.5001436.610
15645000000256QAM-1.8001536.610
16651000000256QAM-3.0001636.610
17657000000256QAM-3.5001736.610
18663000000256QAM-2.8001836.387
19669000000256QAM-2.5001936.387
20675000000256QAM-2.6002036.610
21681000000256QAM-2.1002136.387
22687000000256QAM-2.1002236.610
23693000000256QAM-2.9002336.610
24699000000256QAM-2.9002436.387
25705000000256QAM-4.0002536.610
26711000000256QAM-5.3002635.780
27717000000256QAM-6.2002735.084
28723000000256QAM-7.4002834.484
29825000000256QAM-5.1002935.780
30831000000256QAM-5.4003035.780
31837000000256QAM-5.8003135.780
32843000000256QAM-6.0003235.595
OFDM Downstream Overview
ReceiverFFT typeSubcarr 0 Frequency(MHz)PLC lockedNCP lockedMDC1 lockedPLC power(dBmv)
0NANANONONONA
14K275600000YESYESYES2.000000
Upstream Overview
Port IDFrequency (MHz)ModulationSignal strength (dBmV)Channel IDBandwidth
123700000ATDMA - 64QAM30.00026400000
238595707ATDMA - 64QAM35.00033200000
330596000ATDMA - 64QAM31.25016400000
OFDM/OFDMA Overview
Channel IndexStatelin Digital AttDigital AttBW (sc's*fft)Report PowerReport Power1_6FFT Size
0DISABLED0.50000.00000.0000-inf-1.00004K
1DISABLED0.50000.00000.0000-inf-1.00004K

 

Thanks.

 

PS, is there any updates to the main page as it looks like the last update was over a month ago.

Re: CODA-4582 - Open Issues for Investigation

DEERA
I've been here awhile
Sent u the mac address. Let me know if u know of any fix seems to be related to latest firmware update

Re: CODA-4582 - Open Issues for Investigation


@lethalsniper wrote:
Okay fair enough but @RogersDave what's causing the high ping and jitter as you see in that image

Congestion on the uplink will cause high ping and jitter.

 

Re: CODA-4582 - Open Issues for Investigation

Double_K
I'm a reliable contributor

@RogersDave wrote:

I have a question for everybody with very unstable connection (I know this is a vague definition) but looking at really slow downlink speeds (below 50 Mbps) or serious UDP problems.

 

Can you tell me how many devices (both wired and wifi) are connected on your network?

 

When I try to reproduce some of the UDP issues, I only have a single device on my test modem and I'm wondering if that has an impact in my inability to reproduce the issues you are facing.

 

Dave


@RogersDave  I'm having UDP problems & I can help you test - particularly serious since .24 on downstream RTP (VoIP) traffic.  My MOS scores are constantly dropping to 2's now on .24

 

http://communityforums.rogers.com/t5/forums/forumtopicpage/board-id/Getting_connected/message-id/434...

 

http://communityforums.rogers.com/t5/forums/forumtopicpage/board-id/Getting_connected/message-id/409...

 

 

25 devices wired & wireless - split across multiple VLANs on business-grade hardware.

Re: CODA-4582 - Open Issues for Investigation

MegnaGaming
I plan to stick around

I seem to be having more and more issues with streaming now. Major latency and some packet loss continues. 

 

https://i.gyazo.com/5deb407b52ff00542adb2bd83f9eca1a.png

 

I reset the modem after the spikes there at the end which seemed to fix it but the latency was still terrible (up to 150ms) - and that started at hop 2 (the modem).

Re: CODA-4582 - Open Issues for Investigation

JohnBeaudin
I'm a senior contributor

@MegnaGaming

 

I think your logs from Twitch could help @RogersDave to reproduce the UDP issue so he could work a firmware fix.

Re: CODA-4582 - Open Issues for Investigation

Jeffj
I plan to stick around

Modem lost sync last night according to logs, woke up to alerts on my cell telling methat my remote monitoring software lost connection to my servers i monitor.  investigated and my IP v4 changed. so fixed that up on my backends.

 

Internet was still acting foolish so i did a reboot of the modem and im not on DOCSIS 3.1

 

Weird, it mush be havign a hard time locking it as I assume thats what the reboot overnight was for, and it didnt grab it first time. 

 

 

Will test today.

Re: CODA-4582 - Open Issues for Investigation

Triple_Helix
I plan to stick around

Awful Upload speed and the Download is not much better when I was getting 940Mbps most of the time.

 

Image and video hosting by TinyPic

Re: CODA-4582 - Open Issues for Investigation

Jeffj
I plan to stick around

My latency has never been consistently this good, even on speed tests on dsl reports, I also notice speed tests dont cause my ping to go higher then 500ms and no longer drops packets while speed testing in my plot.

 

Heres to fingers crossed that i dont get the traditional boot from party chat 900 times a night  while on ARK tonight.

Re: CODA-4582 - Open Issues for Investigation

JohnBeaudin
I'm a senior contributor

For some reason ARK is the game where I get the lowest ping and by far out of any games I play.. I can get as low as 29 ping.

 

Dota2: 65 ms

CSGO: 70-75 MS

Overwatch: 45-50 ms

ARK: 29-31 ms

 

all on US-East servers..

Re: CODA-4582 - Open Issues for Investigation

@tonytoronto so i picked up the  CGNM-3552 modem and me and brother both played online using the xbox one, and so far so good game feels more responsive and alot less laggy now dont know why but could be the UDP like you said Thanks @tonytoronto was having bad experience and very frustrated when on the coda modem.

hopefully @rogersdave can rollout a udp fix for the coda modem because its  useless for gamers and there are a lot of us out there.

Re: CODA-4582 - Open Issues for Investigation

JohnBeaudin
I'm a senior contributor

@lethalsniper

 

if the CGNM-3552 fixed ur latency issue while playing online games, it means that it was not caused by the congestion in the uplink. You should ask @RogersDave to check your stats now VS the one he had while you were on CODA, this might lead us to find a fix for the CODA.

Re: CODA-4582 - Open Issues for Investigation

i think its caused by both   but so far so good when they fix the congestion issue in my area then i can really tell whats causing poor online but  like i said so far so good

Re: CODA-4582 - Open Issues for Investigation

MegnaGaming
I plan to stick around

@JohnBeaudin wrote:

@MegnaGaming

 

I think your logs from Twitch could help @RogersDave to reproduce the UDP issue so he could work a firmware fix.


Absolutely - @RogersDave just let me know any and all information you need and I can send it to you in a DM! I can run tests, etc. Would love to get to the bottom of this ASAP so willing to put in some grunt-work.