Jump to content
  • Sign Up

Inside ArenaNet: Live Game Outage Analysis


Recommended Posts

  • Replies 113
  • Created
  • Last Reply

Top Posters In This Topic

Top Posters In This Topic

Popular Posts

Go behind the scenes with Platform Team Lead Robert Neckorcuk.  

Hi All,   Many thanks for the feedback about this post and communication in general! I really enjoyed preparing this content - I hope my passion for this game and community showed through! T

I saw the post and thought "this is new?!". Read the entire post and loved it, thanks for the insight Robert!   Is it just me or is something.. happening/different at ANET the past few month

Posted Images

I saw the post and thought "this is new?!". Read the entire post and loved it, thanks for the insight Robert!

 

Is it just me or is something.. happening/different at ANET the past few months? Informative and fun peaks behind the scenes, a ramp up of communication via social media, content patch posts that are precise and to the point giving locations to travel to...even commitments to a long term strategy for GW2. I know EoD is coming up and I was on my 5 year 'sabbatical' during HoT and PoF launches but I am currently REALLY liking the communication right now. 

 

Add in some decent advertising and I think GW2 has a good future... which is the opposite of what I thought post-IBS.

 

Oh, and just have to laugh that it was a driver issue! Even huge games companies struggle like us commoners 😄

  • Like 17
Link to post
Share on other sites

Thanks for the explanation, it was actually very interesting, and its great to read these behind the scenes content.
I still think the way Arena Net "compensated" players for the down time was a bit disrespectful of those that were mindful of your work and didn't want to add extra pressure on the servers by attempting to log in. But hopefully the team behind that decision might have learned something then.

I've got to say i'm greatly enjoying this new Arena Net, keep up the good work you've been doing these last few months.

  • Like 9
Link to post
Share on other sites

Very interesting piece! I love getting to know the technical side of things, especially on AWS. My team  went through that Auric Basin picnic situation with the DB space filling up suddenly, investigate, patch, and release.
You guys actually make me want to check these driver matter with our DBs 😄

 

Anyway, keep these kind of behind-the-scene stories coming

  • Like 6
Link to post
Share on other sites

Extremely appreciated. I'm supper happy with Anet and all its team.

 

From the day it happened I wish I could see a retrospective like this, but I could also understand that you'd keep this as internal. You've made my wish come true, and I love it.

 

Thanks a lot for communicating this and being transparent.

  • Like 4
Link to post
Share on other sites

This is phenomenal, and I feel like it signals a desperately-wanted openness from the people who make the game.  I feel like this was an excellent first iteration of what I hope becomes a regular series -- "Inside ArenaNet".

 

This reminds me strongly of the blog posts from the creators of one of my other favorite games, Factorio.  The developers have a long-running blog called Factorio Friday Facts (FFF) with hundreds of posts.  They speak openly about the bugs and issues they've worked on in the game, and communicate clearly what they did to address it.  And the FFF posts are *BELOVED* by the Factorio community.  I would really, really love to see some sort of regular "Inside ArenaNet" post showing up, and I know others would be equally excited to have such an opportunity to learn more about what makes the game tick.

 

Thank you so much for posting this!

  • Like 6
  • Thanks 4
Link to post
Share on other sites

Hey, don't be too good with this swapping servers! Last time that we had a server down for half a day, we got a selectable mount skin :D

Joking, you always do a very good job. Other videogame companies should take example from Arenanet, to learn how a game can be mantained without weekly disconnections.

  • Like 3
Link to post
Share on other sites

Personally I consider such threads very interesting - it shows that there are also people on the another side who really do care about the game and the community. And trust me - also the community cares about the game and YOU.
Additionally, as an apprentice to the "dark arts of IT" I can still learn something new - fantastic.

 

I have you say, with your recent offensive regarding the posts, ideas and  art of work you are getting me back to the franchise I love since...15 years - exact half of my life. After Champions flop I lost my hope, now you are giving it back to me that there is still place for me and many other people.

Keep the good work up! We want to know more about all of you! Take care!

Edited by Araun.1638
  • Like 6
Link to post
Share on other sites
20 hours ago, Fire Attunement.9835 said:

 Wow I mean wow! The first thing I said is this is amazing, the amount of info you shared with us was wow.  I really appreciate this background look. I immediately consulted friends that worked in similar fields and passed this along.  Why? Because what you learned in this episode will probably help them similarly.  Thankyou for putting such time and passion into this! What a refreshing change and great amount of Knowledge.  I laughed so hard when the root cause was *drivers* ahhahahahahha.

  • Like 3
Link to post
Share on other sites

"We’d love to read your thoughts and feedback about this type of post, so we’ve set up a discussion thread on our official forums!"

 

I absolutely love this type of content. 

 

The company I work for has a very open blameless culture, we have weekly "blameless portmortems" in which basically talk about our incidents in detail. I learn soooo much from these meetings. In this case, you guys obviously need to be a bit more vague about everything but I still enjoyed this openness that you usually only see from opensource communities. 

 

To the story itself: I feel you guys. Being involved in database incidents is never fun 😄 But you also learn a lot from it! For example seeing 2,147,483,647 in a database table as an sequence id is usually not good, especially if legacy software is involved 😛 

  • Like 4
Link to post
Share on other sites

I love this kind of posts! They're a very good insight on what happens behind online games and to remember how great is the always-online model of GW2 servers!
Please, do more of these: I'll surely read them.

  • Like 3
Link to post
Share on other sites

Great post! As a member of the "IT crowd" myself, I can very much relate to this story. Fun fact: during the outage, I recall discussing the potential cause of the database error with another IT specialist guildmate, using only the few clues provided by the error messages or blog posts that we had at hand. Reading this post-mortem made me very pleased to realize that the actual issue was no trivial matter, as we had feared at that time. It shows how good your team and your infrastructure are. Anyway, I would love to read more posts like this one!

  • Like 2
Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...