01-05-2017 11:03 AM - edited 05-02-2017 07:09 AM
*** This post was last edited May 2, 2017 ***
Good morning Community,
As I mentioned in a post two days ago, we have received the next firmware 2.0.10.20 from Hitron. We are currently running initial testing on this version and will push it out to participants in the firmware trial program as soon as it passes initial testing.
However, while running these tests, we discovered abnormal behavior with ICMP and are awaiting feedback from Hitron today to asses how this will be addressed. As soon as I this is confirmed, I’ll update the change log with the correct version information and start pushing it out.
In parallel, we are still working on the following high priority items. In some cases below, I requested affected customers to reach out to me via private message. If you do so, please include your modem MAC address in the subject line (even if we exchange messages daily) as there are a lot of you reaching out to me daily 🙂
UDP Packet Loss
The investigation for what has been reported as UDP packet loss is still ongoing. We have deployed a probe at one fellow forum member on both a CODA-4582 and a CGNM-3552 to collect additional data. We are actively working with Hitron and Intel on the results observed.
Based on what we know so far, in most instances UDP packet loss is coupled with higher uplink usage in the area. Although the impact is noticeable in specific logs (League of Legends), the root cause for the perceivable impact (while playing) is likely related to bufferbloat (see next issue).
Bufferbloat
When comparing the performance of a CODA-4582 to a CGNM-3552 in the same network conditions, the CODA-4582 consistently reports higher bufferbloat when tested on DSLReports.
Update April 12: The solution for this problem will come in two folds. It will require a change in software which will possibly be included in 2.0.10.27 but more likely in 2.0.10.28 and a change in network configuration.
The network configuration change is not compatible with the current firmware so this change will only come after a vast majority of the modems are running the new code. We are however looking at a way to make the change only for specific modems to support testing in the community.
Update April 22: This problem seems resolved in firmware 2.0.10.27
5 GHz WiFi Low range for channels 36 to 48
Lower WiFi channels on the modem have a much smaller range. This is due in part to the limit imposed by Industry Canada to maximum transmit power.
Furthermore, the current automatic channel selection (auto mode) tends to select the lower channels when in similar load conditions.
Workaround: manually select higher channels (149-153-157-161)
Update April 22: The channel selection algorithm has been improved in firmware 2.0.10.27
Loss of OFDM Channel Lock
Under some RF conditions, the modem fails to lock properly on the OFDM channel. This typically result in variable performance.
Update April 12: This problem is resolved in 2.0.10.26T2
List of connected device does not get fully populated
This is a known issue that has been tracked since firmware 2.0.10.13. We are making improvements at every firmware but it is not a perfect system.
The situation is worst after a reboot or firmware upgrade as the list gets reset and must be repopulated as devices renew their DHCP lease.
NAT Loopback not working for wired clients
When setting up port forwarding to an internal server, it is possible for a client on WiFi to reach the server using the external IP/port. If the client is on a wired interface, it doesn't work.
Update April 12: This problem is resolved in 2.0.10.26T2 (not confirmed)
LAN Counters not working
Some customers reported that LAN counters (especially in bridge mode) are reporting inaccurate values.
This problem has been reported to Hitron for investigation.
Unexpected modem reboot
Some customers reported their modem reboots unexpectedly. We have also seen this behavior in our lab.
Update April 12: This problem is resolved in 2.0.10.26T2
Missing SC-QAM Channels
After a reboot, some modems are missing SC-QAM channels. A fix has been implemented in 2.0.10.26T2 to address this behavior but it has not corrected all scenarios.
Investigation continues with Hitron.
WiFi Survey
The WiFi Survey functionality in firmware 2.0.10.26T2 (and possibly before) reports incorrect SSID names.
Guest Network
When connecting to the Guest Network, an error message is displayed "only allow DHCP client to use this wireless". This has been reported in firmware 2.0.10.26T2.
Update April 22: This issue has been resolved in firmware 2.0.10.27
Update May 2: It seems this issue is not fully resolved and still experienced by some users
Future Planned Improvements
The following are items that we are working on in parallel of the above.
Dave
*Edited Labels*
03-14-2017 08:12 PM
@lethalsniper wrote:@RogersDave look at these amazing speeds on the coda modem firmware .24 with 2 black dots and when i call rogersthey tell me everything looks good realy ? test done hardwired with cat 6 cable
lethalsniper,
If I'm not mistaken, you are on a 250/20 Mbps plan. Your downlink speed is therefore within an acceptable range but your uplink speed is too low. However, as I have previously stated to you, the upstream utilization in your area tends to be on the hot side and will require node rework.
This will unfortunately not happen before the Spring for sure as it usually involves getting various construction permits and a lot of digging.
Dave
03-14-2017 08:14 PM
@Triple_Helix wrote:@RogersDave Hold on there is a newer CODA with 2 Black Dots? Are they any better and should we change our single Black Dot Modems?
There are indeed CODAs with 2 black dots but they are not better than CODAs with a single black dot. It is simply a logistic marker for us for a specific shipment during the transition from "no dot" to "single dot".
We rechecked a batch of modem to ensure they were ok and added a second dot.
03-14-2017 08:40 PM
03-14-2017 08:45 PM
Ping and jitter is caused by the low upload you're seeing. So basically the node congestion on the upload side is causing this high jitter and ping.
03-14-2017 08:50 PM - edited 03-14-2017 08:52 PM
@RogersDave wrote:
@Triple_Helix wrote:@RogersDave Hold on there is a newer CODA with 2 Black Dots? Are they any better and should we change our single Black Dot Modems?
There are indeed CODAs with 2 black dots but they are not better than CODAs with a single black dot. It is simply a logistic marker for us for a specific shipment during the transition from "no dot" to "single dot".
We rechecked a batch of modem to ensure they were ok and added a second dot.
@RogersDave Sorry I couldn't wait as the store closes in about 15 Minutes so I went an got a 2 Black Dot Modem as I never did take back my first Black Dot that never went back for QA so I sent you a PM to update my new Modem info!
TIA,
Daniel
03-14-2017 08:52 PM
03-14-2017 09:17 PM
@lethalsniper As he mentioned, it will start during spring b/c it will require permits and a lot of digging in order to split the node. You can't really do much other than wait for it to be fixed.
03-14-2017 09:17 PM - edited 03-14-2017 09:19 PM
Has there been a fix to the issue where I keep losing the OFDM Downstream channel rendering my modem as being offline from the Rogers network? I have this happening 2 to 3x a day and the only fix is to unplug, wait a few minutes and replug the modem to reboot it. This is really annoying and has started from last week.
I called support and they eluded to the fact that I may have a signal problem and I have a Sr. Tech coming to check things out tomorrow morning.
Here is my current signal levels and I power cycled the modem aroung 7 pm.
Downstream Overview
Port ID | Frequency (MHz) | Modulation | Signal strength (dBmV) | Channel ID | Signal noise ratio (dB) |
1 | 615000000 | 256QAM | -2.900 | 11 | 36.610 |
2 | 561000000 | 256QAM | -3.500 | 2 | 35.780 |
3 | 567000000 | 256QAM | -3.900 | 3 | 35.780 |
4 | 573000000 | 256QAM | -2.700 | 4 | 35.595 |
5 | 579000000 | 256QAM | -1.700 | 5 | 35.780 |
6 | 585000000 | 256QAM | -1.100 | 6 | 36.610 |
7 | 591000000 | 256QAM | 0.400 | 7 | 37.356 |
8 | 597000000 | 256QAM | 0.700 | 8 | 37.636 |
9 | 603000000 | 256QAM | 0.300 | 9 | 37.636 |
10 | 609000000 | 256QAM | -1.100 | 10 | 37.356 |
11 | 555000000 | 256QAM | -2.700 | 1 | 36.387 |
12 | 621000000 | 256QAM | -4.000 | 12 | 35.780 |
13 | 633000000 | 256QAM | -3.200 | 13 | 36.387 |
14 | 639000000 | 256QAM | -2.500 | 14 | 36.610 |
15 | 645000000 | 256QAM | -1.800 | 15 | 36.610 |
16 | 651000000 | 256QAM | -3.000 | 16 | 36.610 |
17 | 657000000 | 256QAM | -3.500 | 17 | 36.610 |
18 | 663000000 | 256QAM | -2.800 | 18 | 36.387 |
19 | 669000000 | 256QAM | -2.500 | 19 | 36.387 |
20 | 675000000 | 256QAM | -2.600 | 20 | 36.610 |
21 | 681000000 | 256QAM | -2.100 | 21 | 36.387 |
22 | 687000000 | 256QAM | -2.100 | 22 | 36.610 |
23 | 693000000 | 256QAM | -2.900 | 23 | 36.610 |
24 | 699000000 | 256QAM | -2.900 | 24 | 36.387 |
25 | 705000000 | 256QAM | -4.000 | 25 | 36.610 |
26 | 711000000 | 256QAM | -5.300 | 26 | 35.780 |
27 | 717000000 | 256QAM | -6.200 | 27 | 35.084 |
28 | 723000000 | 256QAM | -7.400 | 28 | 34.484 |
29 | 825000000 | 256QAM | -5.100 | 29 | 35.780 |
30 | 831000000 | 256QAM | -5.400 | 30 | 35.780 |
31 | 837000000 | 256QAM | -5.800 | 31 | 35.780 |
32 | 843000000 | 256QAM | -6.000 | 32 | 35.595 |
Receiver | FFT type | Subcarr 0 Frequency(MHz) | PLC locked | NCP locked | MDC1 locked | PLC power(dBmv) |
0 | NA | NA | NO | NO | NO | NA |
1 | 4K | 275600000 | YES | YES | YES | 2.000000 |
Port ID | Frequency (MHz) | Modulation | Signal strength (dBmV) | Channel ID | Bandwidth |
1 | 23700000 | ATDMA - 64QAM | 30.000 | 2 | 6400000 |
2 | 38595707 | ATDMA - 64QAM | 35.000 | 3 | 3200000 |
3 | 30596000 | ATDMA - 64QAM | 31.250 | 1 | 6400000 |
Channel Index | State | lin Digital Att | Digital Att | BW (sc's*fft) | Report Power | Report Power1_6 | FFT Size |
0 | DISABLED | 0.5000 | 0.0000 | 0.0000 | -inf | -1.0000 | 4K |
1 | DISABLED | 0.5000 | 0.0000 | 0.0000 | -inf | -1.0000 | 4K |
Thanks.
PS, is there any updates to the main page as it looks like the last update was over a month ago.
03-14-2017 11:17 PM
03-15-2017 07:23 AM
@lethalsniper wrote:
Okay fair enough but @RogersDave what's causing the high ping and jitter as you see in that image
Congestion on the uplink will cause high ping and jitter.
03-15-2017 08:52 AM
@RogersDave wrote:I have a question for everybody with very unstable connection (I know this is a vague definition) but looking at really slow downlink speeds (below 50 Mbps) or serious UDP problems.
Can you tell me how many devices (both wired and wifi) are connected on your network?
When I try to reproduce some of the UDP issues, I only have a single device on my test modem and I'm wondering if that has an impact in my inability to reproduce the issues you are facing.
Dave
@RogersDave I'm having UDP problems & I can help you test - particularly serious since .24 on downstream RTP (VoIP) traffic. My MOS scores are constantly dropping to 2's now on .24
25 devices wired & wireless - split across multiple VLANs on business-grade hardware.
03-15-2017 09:02 AM
I seem to be having more and more issues with streaming now. Major latency and some packet loss continues.
https://i.gyazo.com/5deb407b52ff00542adb2bd83f9eca1a.png
I reset the modem after the spikes there at the end which seemed to fix it but the latency was still terrible (up to 150ms) - and that started at hop 2 (the modem).
03-15-2017 09:05 AM
I think your logs from Twitch could help @RogersDave to reproduce the UDP issue so he could work a firmware fix.
03-15-2017 10:07 AM
Modem lost sync last night according to logs, woke up to alerts on my cell telling methat my remote monitoring software lost connection to my servers i monitor. investigated and my IP v4 changed. so fixed that up on my backends.
Internet was still acting foolish so i did a reboot of the modem and im not on DOCSIS 3.1
Weird, it mush be havign a hard time locking it as I assume thats what the reboot overnight was for, and it didnt grab it first time.
Will test today.
03-15-2017 10:23 AM
03-15-2017 01:55 PM
My latency has never been consistently this good, even on speed tests on dsl reports, I also notice speed tests dont cause my ping to go higher then 500ms and no longer drops packets while speed testing in my plot.
Heres to fingers crossed that i dont get the traditional boot from party chat 900 times a night while on ARK tonight.
03-15-2017 01:58 PM
For some reason ARK is the game where I get the lowest ping and by far out of any games I play.. I can get as low as 29 ping.
Dota2: 65 ms
CSGO: 70-75 MS
Overwatch: 45-50 ms
ARK: 29-31 ms
all on US-East servers..
03-15-2017 02:04 PM - edited 03-15-2017 02:10 PM
@tonytoronto so i picked up the CGNM-3552 modem and me and brother both played online using the xbox one, and so far so good game feels more responsive and alot less laggy now dont know why but could be the UDP like you said Thanks @tonytoronto was having bad experience and very frustrated when on the coda modem.
hopefully @rogersdave can rollout a udp fix for the coda modem because its useless for gamers and there are a lot of us out there.
03-15-2017 02:09 PM
if the CGNM-3552 fixed ur latency issue while playing online games, it means that it was not caused by the congestion in the uplink. You should ask @RogersDave to check your stats now VS the one he had while you were on CODA, this might lead us to find a fix for the CODA.
03-15-2017 02:16 PM
i think its caused by both but so far so good when they fix the congestion issue in my area then i can really tell whats causing poor online but like i said so far so good
03-15-2017 02:20 PM
@JohnBeaudin wrote:
I think your logs from Twitch could help @RogersDave to reproduce the UDP issue so he could work a firmware fix.
Absolutely - @RogersDave just let me know any and all information you need and I can send it to you in a DM! I can run tests, etc. Would love to get to the bottom of this ASAP so willing to put in some grunt-work.