cancel
Showing results for 
Search instead for 
Did you mean: 

off and on route issues to US work VPN

mattlavergne
I'm Here A Lot

Hi Guys, 

 

three or four times a day my VPN to the amercian branch of my company will drop for 2 or 3 minutes. It's been happening pretty consistantly since I switched back to Rogers about a year ago. 

 

I have started gathering data and noticed that every time it drops I get the following route

 

Tracing route to epvpn.highjump.com [206.173.103.4]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms router.matttl.local [192.168.65.1]
2 11 ms 16 ms 8 ms 99.250.176.1
3 11 ms 13 ms 9 ms 69.63.254.157
4 22 ms 13 ms 13 ms 64.71.241.97
5 19 ms 13 ms 13 ms 209.148.230.230
6 * * * Request timed out.
7 * * * Request timed out.
8 * * * Request timed out.
9 * * * Request timed out.
10 * * * Request timed out.
11 * * * Request timed out.
12 * * * Request timed out.

 

 

But as soon as the conenction comes back my route changes to miss that 209.148.230.230 hop and looks like this

 

Tracing route to epvpn.highjump.com [206.173.103.4]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms router.matttl.local [192.168.65.1]
2 11 ms 20 ms 9 ms 99.250.176.1
3 9 ms 11 ms 13 ms 69.63.254.157
4 11 ms 13 ms 17 ms 24.156.157.86
5 26 ms 15 ms 13 ms 24.156.157.81
6 24 ms 13 ms 13 ms 24.156.144.129
7 19 ms 15 ms 12 ms 209.148.229.222
8 39 ms 37 ms 36 ms ce-0-2-0-1.r06.chcgil09.us.bb.gin.ntt.net [128.2
41.3.189]
9 40 ms 42 ms 42 ms 206.111.2.64.ptr.us.xo.net [206.111.2.64]
10 88 ms 61 ms 45 ms 207.88.13.134.ptr.us.xo.net [207.88.13.134]
11 46 ms 47 ms 49 ms te-4-2-0.rar3.sanjose-ca.us.xo.net [207.88.12.18
5]
12 103 ms 47 ms 47 ms 216.156.16.205.ptr.us.xo.net [216.156.16.205]
13 50 ms 51 ms 47 ms 207.238.29.106
14 47 ms 48 ms 54 ms 206.173.103.4.ptr.us.xo.net [206.173.103.4]

 

 

 

 

Can anyone direct me to a network team with the power to actually look into a BGP route?

 

*** Added Labels ***

1 ACCEPTED SOLUTION

Accepted Solutions

Re: off and on route issues to US work VPN

Based on the test I just ran, we now have a direct route to NFO Servers

 

mtr --report -c 10 --aslookup 74.91.122.174
Start: Wed May 24 12:49:18 2017
HOST: cmprobe2                    Loss%   Snt   Last   Avg  Best  Wrst StDev
  1. AS???   hitronhub.home       90.0%    10    1.2   1.2   1.2   1.2   0.0
  2. AS812   99.228.248.1          0.0%    10   98.2  26.3   9.6  98.2  29.5
  3. AS812   69.63.242.213         0.0%    10    9.0  14.8   9.0  20.8   4.1
  4. AS812   69.63.249.177         0.0%    10   52.9  35.0  10.3 189.8  55.9
  5. AS812   69.63.249.185         0.0%    10   25.4  43.5  11.4 164.6  57.5
  6. AS812   24.156.144.122        0.0%    10   18.5  25.2  12.7  57.9  13.3
  7. AS812   209.148.230.134       0.0%    10   39.0  39.1  33.3  48.4   4.6
  8. AS14586 equinix.b0.router1.c  0.0%    10   39.1  37.5  34.4  41.7   2.4
  9. AS14586 c-74-91-122-174.prem  0.0%    10   32.8  35.1  31.7  41.5   3.0

View solution in original post

16 REPLIES 16

Re: off and on route issues to US work VPN

mattlavergne
I'm Here A Lot
Just happened again and I got this tracert

Tracing route to epvpn.highjump.com [206.173.103.4]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms router.matttl.local [192.168.65.1]
2 12 ms 23 ms 7 ms 99.250.176.1
3 12 ms 13 ms 9 ms 69.63.254.157
4 15 ms 15 ms 14 ms 64.71.241.97
5 19 ms 12 ms 21 ms 209.148.230.230
6 * * * Request timed out.
7 * * * Request timed out.
8 * * * Request timed out.
9 * * * Request timed out.
10 * * * Request timed out.
11 * * * Request timed out.
12 * * * Request timed out.
13 * * * Request timed out.
14 * * 11 ms 209.148.229.214
15 * * 30 ms 209.148.229.213
16 13 ms * * 209.148.229.214
17 * * * Request timed out.
18 * 11 ms 13 ms 209.148.229.214

Re: off and on route issues to US work VPN

I should add, because I see the labels that were added to the thread. 

 

this is not an overall connection issue, i do NOT lose connection to the internet or any other sites that I am aware of, only the route to my specific VPN end point (or possibly all traffic between Rogers and XO communitcations stops. 

 

 

My speeds and connection quality are perfect other wise. This is strictly a route issue or potentially a misconfiguration on 209.148.230.230 that cuases a routing loop. 

Re: off and on route issues to US work VPN

Hi, We have also been experiencing thess problems at our school....

 

In our logs I can trace it back to at least yesterday....

Feb 13 - 7:32am - 7:36am

Feb 13 - 4:21pm - 4:22pm

Feb 14 - 4:10am - 4:12am

Feb 14 - 7:34am - 7:39am

Feb 14 - 8:12am - 8:17am

Feb 14 - 8:58am - 9:01am

 

And just happened right now.....10:20ish

 

Certain websites are effected for a few minutes then come back...I was pinging the sites the last time this happened and I get this in the ping windows:  "Reply from 209.148.229.214: TTL expired in transit.  Firewall shows requests as incomplete.

 

 

I'm not sure what is causing this...hopefully someone at Rogers has an idea!

 

Thanks,

Re: off and on route issues to US work VPN

I will add to SACNOC's  comment. If I run a ping to my VPN endpoint and happen to have it going when the connection fails, I also see the TTL expired, which would make sense as the jumping hops happen between 209.148.229.214 and .213 as my trace showed. 

Re: off and on route issues to US work VPN

Hello @mattlavergne @SACNOC,

 

Thanks for reaching out and welcome to the Community :).

 

I apologize for the late response. We're you able to get this issue addressed or are you both still experiencing issues with your VPN connection timing out? 

 

I'll invite a few of our Resident Experts to provide further insight and assistance.

 

@Datalink@gp-se@Gdkitty any thoughts?

 

Regards,

RogersCilio

Re: off and on route issues to US work VPN

My guess, is that specific node is having issues and droping.

Now, this may only happen with specific things.. your VPNs, etc.. may go through THAT route to the endpoint.. hitting that bad node on the way.

Going elsewhere in the net.. may go a completely different route.



Re: off and on route issues to US work VPN

Correct it was only traffic to a specific endpoint. 

 

 

that said, and I can't speak for the other customer in this thread, Since the day after I made this thread the issues seems to have cleared up. 

 

 

Re: off and on route issues to US work VPN

XDR
I Plan to Stick Around

Can you guys stop routing me through NYC to reach Chicago?

 

I frequently access a server in Chicago and past few months noticed high latency - turns out I'm now getting routed through Cogentco in NYC. Why? I don't know. All I know is that my ping is three times higher than normal. I've contacted the server owner (NFOServers) and they've actually informed me that they are aware of the issues and have unsuccesfully attempted to reach out to Rogers multiple times to get a config going for direct peering through the Equinix exchange. 

 

I tried my luck on the phone but none of the level 2 techs I've spoken to were even able to comprehend the problem that I am having - and one even stated that "Rogers doesn't control where their traffic goes on the world wide web".

 

This is what I'm talking about: 

 

 

 

Re: off and on route issues to US work VPN

RyzenFX
I'm a Reliable Contributor

@RogersDavesounds like something you'd be interested in! 😄

 

From what I can see the first hop outside of your modem is appearing in the 100's of ms which is abnormal. Could there be something on your end that is causing this? I also have pinged the IP to test and I am not being routed to NYC. 

 

Instead am being routed through this exchange point: be812.ccr41.ord03.atlas.cogentco.com

Re: off and on route issues to US work VPN

I was replying to this in the original thread when a moderator moved the message 🙂

 

I will send this over to our peering engineering team immediately. We have a point of presence at Equinix Chicago so establishing public peering should not be too much of an issue.

 

Dave

Re: off and on route issues to US work VPN

XDR
I Plan to Stick Around

Is there any ETA on this? Thanks.

Re: off and on route issues to US work VPN

Hello @XDR

 

High PING issues can definitely be a major nuisance, especially when you are trying to get some work done. At the moment I have not been advised with a specific ETA on this matter.

 

@RogersDave are you able to confirm if there is an approximate ETA for investigation/resolution on this matter? Any insight you can provide will be greatly appreciated.

 

Regards,
RogersTony

Re: off and on route issues to US work VPN

RogersDave
Retired Support
Retired Support

@XDR wrote:

Is there any ETA on this? Thanks.


It's a little to early to say. From a technical standpoint, we can turn up a new public peering in a day.

 

The reality however is that there are 2 companies involved that must share information (IP addresses, passwords, parameters, support contacts, escalation path) before the peering session can be established.

 

We have a template that we have this all this information that we send out to the peer. Sometime, they are happy with everything, provide their info and we schedule the network change in a couple of days. However, in some cases, the peer wants to have a more formal contract and that takes a little more time.

 

So ETA for a peering session is typically from 2-3 weeks in the best case to 2-3 months in the worst case. There are however some exceptions where technical difficulties can slow down this process.

 

Sorry that I can't be more precise at this point but we are on it.

 

Dave

Re: off and on route issues to US work VPN

RogersDave
Retired Support
Retired Support

@XDR,

 

Our peering engineering team has completed the preparatory work with Nuclearfallout Enterprise for this peering session.

 

If everything goes as planned, the new session and direct peering in Chicago should be live before noon today.

 

Let us know how it works and make sure to visit the Rogers Online Gaming Thread where @RogersKevin will be happy to hear about your gaming experience.

 

Dave

Re: off and on route issues to US work VPN

Based on the test I just ran, we now have a direct route to NFO Servers

 

mtr --report -c 10 --aslookup 74.91.122.174
Start: Wed May 24 12:49:18 2017
HOST: cmprobe2                    Loss%   Snt   Last   Avg  Best  Wrst StDev
  1. AS???   hitronhub.home       90.0%    10    1.2   1.2   1.2   1.2   0.0
  2. AS812   99.228.248.1          0.0%    10   98.2  26.3   9.6  98.2  29.5
  3. AS812   69.63.242.213         0.0%    10    9.0  14.8   9.0  20.8   4.1
  4. AS812   69.63.249.177         0.0%    10   52.9  35.0  10.3 189.8  55.9
  5. AS812   69.63.249.185         0.0%    10   25.4  43.5  11.4 164.6  57.5
  6. AS812   24.156.144.122        0.0%    10   18.5  25.2  12.7  57.9  13.3
  7. AS812   209.148.230.134       0.0%    10   39.0  39.1  33.3  48.4   4.6
  8. AS14586 equinix.b0.router1.c  0.0%    10   39.1  37.5  34.4  41.7   2.4
  9. AS14586 c-74-91-122-174.prem  0.0%    10   32.8  35.1  31.7  41.5   3.0

View solution in original post

Re: off and on route issues to US work VPN

XDR
I Plan to Stick Around

I'm seeing a huge improvement now. Next week, when I relocate, these numbers may be improving as I have pretty bad signal levels at the moment (-1.2 to -11.9) that I've given up on trying to fix.

 

Thank you for addressing this issue.

 

 

Target Name: c-74-91-122-174.premium-chicago.nfoservers.com
IP: 74.91.122.174
Date/Time: 5/24/2017 2:19:28 PM to 5/24/2017 2:29:34 PM

Hop  Sent  Err  PL%   Min Max  Avg  Host Name / [IP]
 1   598   0    0.0   0   24   0    [192.168.0.1]
 2   598   2    0.3   3   152  12   [173.35.136.1]
 3   598   1    0.2   3   179  11   [66.185.90.141]
 4   598   0    0.0   9   136  16   pos-1-0.gw01.nmkt.phub.net.cable.rogers.com [66.185.81.185]
 5   598   2    0.3  28   534  37   [209.148.230.138]
 6   598   2    0.3  17   470  23   equinix.b0.router1.chicago.nfoservers.com [66.85.80.254]
 7   598   2    0.3  17   265  22   c-74-91-122-174.premium-chicago.nfoservers.com [74.91.122.174]