View Full Version : possible brief network outage 6/30/2005
We`ll be performing quick maintenance tonight around midnight that may result in brief network interuptions
#1 Changes will be made to internal network topology
#2 Additional hardware will be added/changed on our core routers
the expected downtime will be around 10 minutes
Furthermore we will re-route all traffic through Cogent starting tonight due to Abovenet issues. This may cause slow down in transfer speeds untill tuesday/wednesday when we are scheduled to light up additional transit from Cogent
I do appologize about the recent network hiccups. Unfortunately Abovenet uplink has acumulated over 6 hours of downtime during month of June which is not acceptable.
We`ll keep the Abovenet uplink alive to have a failover in case something happens to Cogent. We`ll monitor the uptime/performance of the Abovenet feed during month of July and if the network problems get fixed we may resume using it in August
Everything seems fine, and it's 12:10pm.
-tzulo
what? this means that everyone will use cogent? Dont do this, everyone will slow down.. This cant be , please :)
and: Its not even enough cogent for the web-only customers how can this be enough for all FDC customers? this cant work...
jalmenaram
07-01-2005, 08:39
Hey bummer why not back to level3 :) its a suggestion :)
Regards
Jose Almenara Amico
as stated above we`re getting enough of additional Cogent transit to cover everything. If there is any slow down it will last only till tuesday as we turned up additional conectivity last week and more is being added next tuesday/wednesday.
you will be getting? "and more is being added next tuesday/wednesday."
it makes a big difference, because its not yet added, and everyone uses cogent now...
Are you sure your cogent connectivity is enough for everyone at FDC?? how much is it right now?
" it will last only till tuesday "
very funnny, haha.. We want to actually use what we pay for? what will be the compensation for this bad connectivity i am 100% sure we will experience over the next days?!?
Also : notify ALL customers with newsletter/email !! some wont read the forum and will be very unhappy soon...
Hey bummer why not back to level3 :) its a suggestion :)
Regards
Jose Almenara Amico
So far we`ve had best uptime and connectivity from Cogent. Also most of our customers prefer quantity over quality and for every 1gige of L3 you can get 2Gigs of Cogent.
I am not saying quality is not important but we feel Cogent`s service/price/uptime/reliability has been top notch in last 12 months
If you look here http://www.fixedorbit.com/stats.htm you`ll see that Cogent ranks better when it comes to peering than abovenet.
jalmenaram
07-01-2005, 08:47
Epaaa nice bummer fdc have good job to the customer i am happy with fdc :)
Regards
Jose Almenara Amico
I think you dont listen to what im saying : how much bandwidth is it right now?
2gigabit? this cant be enough for whole FDC, face it....(even for 4-5days)
I think you dont listen to what im saying : how much bandwidth is it right now?
2gigabit? this cant be enough for whole FDC, face it....(even for 4-5days)
I don`t know how you came up with that number. There is plenty of bandwidth even with Abovenet turned off
Ok.. so how much is it?? cant even answer this question? theres something wrong ?
AND: if it really is enough, you should do something about the network real quick, this would mean that your bandwidth gets lost somewhere, there are still problems with both cogent and Abovenet at FDC.... (freakin slow speeds on USA peak times)
Ok.. so how much is it?? cant even answer this question? theres something wrong ?
AND: if it really is enough, you should do something about the network real quick, this would mean that your bandwidth gets lost somewhere, there are still problems with both cogent and Abovenet at FDC.... (freakin slow speeds on USA peak times)
the announced change will result in shortfall of 1x1Gbit for next 5 days. Considering there`s holiday weekend + monday holiday in US the slow down will be barely noticable
jalmenaram
07-01-2005, 09:00
Good work bummer :) i see now :)
Regards
Jose Almenara Amico
haha.. and joking at me for saying 2gigabit , this is crazy!!
This means: all FDC customers will use 1gbit only for almost a week!!
And you think this doesnt cause any problems? We are doomed...
One support guy told me the switch i was on, was having like 400mbit traffic ...
how can 1 gbit be enough when there are 1000people using it?!?
haha.. and joking at me for saying 2gigabit , this is crazy!!
This means: all FDC customers will use 1gbit only for almost a week!!
And you think this doesnt cause any problems? We are doomed...
One support guy told me the switch i was on, was having like 400mbit traffic ...
how can 1 gbit be enough when there are 1000people using it?!?
if you bothered to read my post above you`d see there will be ONE gigabit less for next 5 days.
We are not going to run the datacenter on 1Gig connection
okay, thanks for info! and now the third time : HOW MUCH BW DO YOU STILL HAVE??
I wasnt asking how much is removed...
I dont want to pay for gigabit server when there isnt even a gigabit at fdc.... :)
Please understand that your customers are human too, you cant just go on with your FU all attitude... THanks!
okay, thanks for info! and now the third time : HOW MUCH BW DO YOU STILL HAVE??
I wasnt asking how much is removed...
I dont want to pay for gigabit server when there isnt even a gigabit at fdc.... :)
Please understand that your customers are human too, you cant just go on with your FU all attitude... THanks!
we don`t disclose information on our total transit capacity, we never have.
We have different customers (shared BW, dedicated BW, Gigabit Unmetered, local customers in our building) all are alloted different amount from our total capacity
you cant just go on with your FU all attitude... THanks!
not sure what you are refering to . This thread was started to inform the customers about the upcomming network changes
SCREW IT.. i wont say anything more just please fix the network problems... :(
Agreed, fix it ASAP please :S
When the new DC is finished, will that run on a seperate network, or will it share the same gige lines as the current one? Are customers going to be able to ask which DDC they are in?
Just a few questions
Villan
You cats are very demanding for what you pay. If you are really not happy. Go elsewhere ;)! It will save me time reading pointless posts. We know there are network issues. They told you when they are going to be fixed. Complaining about it will not fix it any faster. So STOP! Bummer / FDC will not tell you their total bandwidth capacity nor do they really need to... im sure we will live not knowing.. but yes it would be nice to have an idea.
why somebody would like to know? only coz he and we are nerds and we like to see. it dosent really make any diference to us as long as it works.
ChronoCross
07-01-2005, 19:22
I can't believe I just read all that. Jaz you need to just stop posting already. Bummer gave you some really good answers and it is obvious that they are working on things. plus you didn;t even read his responses or believe a word he said. Everything will work out fine guys. you'll have plenty of bandwidth for your servers and the abovenet will probably be added back on tuesday/wednesday after the problems that it's facing are repaired.
CapnCrunch
07-01-2005, 21:03
:( Could this be why I can't get more then 10KB/second and am getting many complaints from customers? :nuts:
:( Could this be why I can't get more then 10KB/second and am getting many complaints from customers? :nuts:
feel free to PM me with your server IP and I`ll look into it
CapnCrunch
07-01-2005, 21:32
feel free to PM me with your server IP and I`ll look into it
Thanks, I just heard back from support and there was a DDOS attack on the network. Everything seems fine now.
I'd like to see FDCservers.net to bring in some big 'dawgs' like UUnet, AT&T, Sprint, Qwest or at least 4 different ISP POPs to ensure solid & stable connectivity.
I'm afraid of everything being on cogent, cause what if someone cripples your only good leg, how are you going to stand up then?
Level3 & Above.net has too many bandwidth issues and downtimes.
From my experience hosting something like an ircd(or any other service that requires 100% 24/7/365 connectivity) server @ FDCservers.net's datacenter is not a good choice(/me cries)
As long as there are no extended periods of downtimes I'm happy but I'd like to see a stable connection that doesn't lose connectivity every few days for 1-5min or less. As I pay for a server that I'm allowed to use IRC related programs on. I would attempt to sell shell accounts, game servers, or ircd servers but its just not feasible when there are connectivity issues. :\
Every joe blow sales web hosting( I have a few customers of my own that don't notice the slight downtimes[not large sites though, less than 50gb monthly output] )
Anyone know what it would take to get a carrier hotel at the FDC data center?
I know of two carrier hotels the largest being in NYC and the 2nd largest in Atlanta, GA (www.telx.com)
FDC is pretty rock solid except for the ISP POP bandwidth issues which are not too severe(not too posisitve either). Would be nice for FDC and/or the ISPs to provide a solid solution for the denial of service attacks and other reasons for loss of connectivity.
I guess then the prices would go up twice as much *shrug*.
Overall I like the quality of service I receive from FDC, just the ISP issues is a bit irritating at times. Cannot find a better deal any where else for what you get...
I'd like to see someone go on the offensive, collect logs of the dos attacks, penitration attempts, etc.. and involve the FBI & Secret Service. Setup honey pots, and anything else to collect information on these individuals attacking FDC and/or the ISPs who supply FDC. There are two forms of justice, legal action and vigilante action. One or a combonation of both will most likely fix whomever insists on being an irritating prick. Fight em tooth and nail, down and dirty.
EOF
sorry but i got angry with your post.
[09:23:31] —› WSBR64 has been idle for 3wks 19hrs 3mins 32secs
[09:23:31] —› WSBR64 signed on 3wks 19hrs 3mins 30secs ago
Nah.. its not stable.. imagine..
From my experience hosting something like an ircd(or any other service that requires 100% 24/7/365 connectivity) server @ FDCservers.net's datacenter is not a good choice(/me cries)
imo, dont like? go away :nuts: :nuts:
sorry but i got angry with your post.
[09:23:31] —› WSBR64 has been idle for 3wks 19hrs 3mins 32secs
[09:23:31] —› WSBR64 signed on 3wks 19hrs 3mins 30secs ago
Nah.. its not stable.. imagine..
imo, dont like? go away :nuts: :nuts:
go piss up a rope and read the whole ranting post
"Overall I like the quality of service I receive from FDC, just the ISP issues is a bit irritating at times. Cannot find a better deal any where else for what you get..."
mikron15
07-02-2005, 18:58
b4sh, read the post 3 times before you reply next time ;)
I don't have to go in details but i think you got the hint.
Also, i very much support what rdx said abt the ircd, my solution was to move all my ircd outta FDC to somewhere else. I only have webhosting on FDC box
ChronoCross
07-02-2005, 19:47
The only thing I really agree with is that they need more than 1-2 bandwidth providers. even if it's a small bit from 4-5 of them it would provide better overall service and still fit a budget, I do however like cogent as it has indeed gotten better over the years.
I wanted to comment on ddos. It's relatively expensive and difficult to properly deal with all ddos to prevent downtime. It is no easy task especially with all the new broadband users popping up every day and with pretty much 90% of all customers having 0 knowledge on proper system security new drones will pop up all the time.
The only thing I really agree with is that they need more than 1-2 bandwidth providers. even if it's a small bit from 4-5 of them it would provide better overall service and still fit a budget, I do however like cogent as it has indeed gotten better over the years.
Having 4-5 different providers will not have any real benefit for average FDC customer untill the other providers can match Cogent`s pricing.
I guess the question is would you rather have 100 meg of L3, ATT, Qwest, Abovenet, UUNET, XO = 600meg total or 2Gigs of Cogent.
If your answer is 600megs than FDC might not be the right datacenter for you since we focus on providing quantity bandwidth. Also what is the real advantage ?
Lower latency , less hops ? Cogent is now Top 6 network when it comes to number of peers and they keep growing their network very fast thanks to their pricing.
ChronoCross
07-02-2005, 22:17
Having 4-5 different providers will not have any real benefit for average FDC customer untill the other providers can match Cogent`s pricing.
I guess the question is would you rather have 100 meg of L3, ATT, Qwest, Abovenet, UUNET, XO = 600meg total or 2Gigs of Cogent.
If your answer is 600megs than FDC might not be the right datacenter for you since we focus on providing quantity bandwidth. Also what is the real advantage ?
Lower latency , less hops ? Cogent is now Top 6 network when it comes to number of peers and they keep growing their network very fast thanks to their pricing.
Well the only thing that I was going for is network redundency. as rdx pointed out that if cogent goes down FDC is pretty much crippled but if you were to have 4-5 other bandwidth providers in your example 6 carriers at 100mbit each compared to 2 gig of cogent you may only get 1/4 the bandwidth but you'll be able to survive outages from each of the now 7 companies that your working with. I was simply looking at providing better stability to appease the customers complaining stability wise. then you can slowly add bandwidth to each carrier spreading the load out evenly.
stability has more than one way to increase and that was only my take on it. Speed on the other hand only has 1 solution: buy more.
@bummer
I hope I didn't offend you in any way in either of these two posts as this is not critism of FDC in any way as I have always been satisfied with the service.
I am not offended at all. One of the reasons we don`t censor these forums is that we do welcome feedback from our customers.
As far as stability goes the uptime monitor we run pretty much speaks for itself. Cogent had the best stability for the past 10 months. We do still have Abovenet , we just decided not to use it due to recent issues. But should Cogent have some unforseen problem we can always fail over traffic to Abovenet because that uplink is live and we have a contract for it untill May 2006
Bottom line is that if we spred the amount of bandwidth we currently have among 4 providers we`d either have to
# increase our pricing
or
# lower the amount of available bandwidth for the shared segment
ChronoCross
07-02-2005, 23:18
I am not offended at all. One of the reasons we don`t censor these forums is that we do welcome feedback from our customers.
As far as stability goes the uptime monitor we run pretty much speaks for itself. Cogent had the best stability for the past 10 months. We do still have Abovenet , we just decided not to use it due to recent issues. But should Cogent have some unforseen problem we can always fail over traffic to Abovenet because that uplink is live and we have a contract for it untill May 2006
Bottom line is that if we spred the amount of bandwidth we currently have among 4 providers we`d either have to
# increase our pricing
or
# lower the amount of available bandwidth for the shared segment
Well considering your prices are still the LOWEST. I think a increase in price would still be fine. I'm sure as a company you guys have priced all the providers. do you have an estimate of what it would cost(increase in customers price) to provide more carriers?
btw petr are you guys planning on putting abovenet back in the mix in the next few months once all the problems with them are worked out?
psyxakias
07-02-2005, 23:26
Everybody start raping ChronoCross, he's giving ideas to bummer to increase FDC's prices, hehehe. :hitting: :hitting: :box: :box:
If the Abovenet issue gets fixed we will add it back to the shared segment. We`ll be monitoring that link during July.
If we increased prices by $50 per server we could bring in other 3-5 ISPs. But it`s very unlikely that all or majority or customers would agree with such price hike.
Another option would be create separate network segment with 3-7 ISPs where the bandwidth would be metered.
psyxakias
07-02-2005, 23:34
Another option would be create separate network segment with 3-7 ISPs where the bandwidth would be metered.Sounds pretty good idea, satisfying both quantity/quality bandwidth customers.
Quantity bandwidth => Cogent
High-Quality bandwidth => that new segment with 3-7 ISPs
and because i know someone is going to say 'when is that new segment going to be in operation'
haha its just an idea / option ;)
ChronoCross
07-03-2005, 00:05
Another option would be create separate network segment with 3-7 ISPs where the bandwidth would be metered.
that would be sweet. especially for IRC users BNC ircds they don't really need the huge volume of traffic but rather better routing and near perfect stability. I happen to like metered services because it usually like you said would be priced to offer higher speeds on limited volume than the unmetered shared segment.
@psyxakias
now now no beat downs. It was just a thought. besides an awesome idea from bummer came of it. see this is what the message boards should be. thought provoking discussion =D
psyxakias
07-03-2005, 00:10
especially for IRC users BNC ircds they don't really need the huge volume of traffic but rather better routing and near perfect stability.Yes and No. You're possibly forgetting that IRC attracts DDoS so having limited incoming bandwidth/transfer is a pretty bad idea, as you're gonna have some real high monthly bills ;)
[Edit]Unless of course, FDC convinces all the 3-7 ISPs to charge them for outgoing bandwidth only, which might be a little hard to convince all these ISPs...
kodeking
07-03-2005, 02:01
Why couldn't you just increase the new server prices? The new customers wouldn't even know the difference ;)
Why couldn't you just increase the new server prices? The new customers wouldn't even know the difference ;)
They already have slightly, so why not again...?
Everybody start raping ChronoCross, he's giving ideas to bummer to increase FDC's prices, hehehe. :hitting: :hitting: :box: :box:
LOL Me rapes ChronoCross :jumpgrin: :jumpgrin:
I think we all should just hang tight and see how abovenet is going to work out this month.. I have been a abovenet customer for over 3 years now, out of New York and they are very stable! Lets just give them a chance before we jump the gun
I would pay more if i knew 100% that everything would be better afterwards, but so far FDC is going good and after 1-2 months its bad again just like now.. On peak times its still very slow , wether its cogent or abovenet, i think FDCs router/switches are not configured right...
Deltaanime
07-04-2005, 05:45
Like many others, our best uptime has been with cogent, and i have no complaints about using cogent. To be honest, i'd take it over level3 these days, all the other hosts i have that use L3 have been having nothing but problems.
I say bring on hte cogent, no more abovenet or l3 or anything! ;)
~Francisco
/me crosses fingers.. please no price hike... i hardly even use that much bandwidth to begin with.
if a price hike was made.. i think i would have to do lots of road shows to earn additional cash to pay for the servers.
/me crosses all fingers.. toes and anything else that can be crossed.
its doubtful that they would increase prices for existing customers as many would not be up for the hike in price and go elsewhere... price changes would more than likely be on new servers... but then again i could be wrong... but thats just what i have seen happen in the past and ive been with fdc for a year or so now
mikron15
07-05-2005, 04:52
I doubt...coz another price hike would result in same prices available else where for non-burstable unmetered 10 Mbps
johan_hammy
07-06-2005, 17:56
If you look here http://www.fixedorbit.com/stats.htm you`ll see that Cogent ranks better when it comes to peering than abovenet.
It's also a case of the quantity of peer links, where they are, how full they are, if there is even a route to X network when Y shuts off its peer with Cogent. Cogent is a fine example of a lot of peers not necessarily meaning a quality network.
johan_hammy
07-06-2005, 18:00
You cats are very demanding for what you pay. If you are really not happy. Go elsewhere ;)! It will save me time reading pointless posts. We know there are network issues. They told you when they are going to be fixed. Complaining about it will not fix it any faster. So STOP! Bummer / FDC will not tell you their total bandwidth capacity nor do they really need to... im sure we will live not knowing.. but yes it would be nice to have an idea.
FDC is a good deal, but it is not the best deal, nor are similar deals too far behind. However, I go with them due to ease of access. There are several things they can do that would have a minimal impact on their bottom line.
johan_hammy
07-06-2005, 18:08
Having 4-5 different providers will not have any real benefit for average FDC customer untill the other providers can match Cogent`s pricing.
I guess the question is would you rather have 100 meg of L3, ATT, Qwest, Abovenet, UUNET, XO = 600meg total or 2Gigs of Cogent.
If your answer is 600megs than FDC might not be the right datacenter for you since we focus on providing quantity bandwidth. Also what is the real advantage ?
Lower latency , less hops ? Cogent is now Top 6 network when it comes to number of peers and they keep growing their network very fast thanks to their pricing.
Maybe not another carrier of the mentioned quality levels, but there are several carriers that I've seen that are roughly 2x Cogent at 100 meg commits. You also don't need a lot of bandwidth from them, I'd venture to say if you kept 10% of your bandwidth through another carrier things would help tremendously. Prepend the non-Cogent AS a few times to give preference to Cogent, but X carrier will be a dynamic backup circuit in case of Cogent peering issues. As long as you kept any Cogent related outages to less than 36 hours, you wouldn't have any additional charges from providers X, Y, and Z. You then have the cost savings of Cogent, but the backup of having other carriers on board.
VideoJunky
07-06-2005, 20:08
is there another ddos attack happening right about now?
ibgetting like 1mbit or lower- it might just be my server being attack, it said 250 users a few minutes before http stopped responding
bummer,
speed is lacking.......and i get disconnected when i try download something from the server.
67.159.5.141
bummer,
speed is lacking.......and i get disconnected when i try download something from the server.
67.159.5.141
NERO
looking at your MRTGs your server was bursting to 40Mbits and your average usage in last 24 hours was 11Mbit. I wouldn`t call that slow
There was a similar post made by CapnCrunch couple days ago. I asked him to PM me his server IP. He emailed me IPs of the 6 servers , each of them was pushing 22Mbits on average
Also as noted earlier we`re adding more transit from Cogent this week
No offense to anyone (well not too much at least) but you don't really much of a right to complain about speeds if your pushing 10mbit+ 24/7 your getting your 3000GB as stated in the TOS.
mikron15
07-07-2005, 06:48
That my friend is called greed... When they got adjusted to the burst speed and now see it being reduced ( they claim to be so) , they are all getting frustrated. Its a vicious circle, always wanting more speed :)
thats true.. but im not even pushing 2mbit constantly and its still lagging/ slow speeds....
No , its not related to the server or any settings. FDC support checked the server like 10times ( but all they did was log in, download a file from tzulo.com which is fdc internal network.. haha, and then telling me everything is fast like always.. NICE JOKE!)
Inbound speeds are ok, but outbound sucks except on non-peak hours, like RIGHT NOW...(its fast now, in a few hours slow again...)
Wheres the purpose in denying every info Bummer?? There a tons of people at FDC who are very disappointed...
ChronoCross
07-07-2005, 06:57
Wheres the purpose in denying every info Bummer?? There a tons of people at FDC who are very disappointed...
apparently not as many as you seem to think. considering maybe 10 people post on the forums about "slow" speeds. FDC has a couple thousand customers. It's not really an issue if everyone isn't experiencing the same thing. FDC doesn't lie to you when they say "speeds are fine", that just means it's something witht he location of people downloading or your server isn't configured right.
Regards,
ChronoCross
yes it was mentioned before.. European users have many speed/routing issues while us users are fine. To be fair, network is better then it was some month ago :)
also i did say in some other posts. im not talking about a single server, 2 servers all exactly the same...
ChronoCross
07-07-2005, 13:13
yes it was mentioned before.. European users have many speed/routing issues while us users are fine. To be fair, network is better then it was some month ago :)
also i did say in some other posts. im not talking about a single server, 2 servers all exactly the same...
2 servers configed by the same user ;). perhaps you should rethink your config.
johan_hammy
07-07-2005, 15:10
apparently not as many as you seem to think. considering maybe 10 people post on the forums about "slow" speeds. FDC has a couple thousand customers. It's not really an issue if everyone isn't experiencing the same thing. FDC doesn't lie to you when they say "speeds are fine", that just means it's something witht he location of people downloading or your server isn't configured right.
Regards,
ChronoCross
However, there are quite a few FDC "fan boys" on this forum as well that will defend them to the grave.
very funny chronocross, please shut up! You dont have a single usefull comment, everything you say is pro-fdc even if it makes no sense...
and.. I have access to a third server at FDC which has also the same problems, right now every server is slow to europe, it was 300kb/s like 8hours ago.. Now it is 50kb/s (tested with different european ISP´s /cable/dsl)
Dont tell me there is nothing wrong.. Please do it for yourself and just shut up!
well it seems this thread is getting too much off topic
vBulletin® v3.7.3, Copyright ©2000-2009, Jelsoft Enterprises Ltd.